2023-12-11T16:51:40.001 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-11T16:51:40.001 DEBUG:teuthology.run:Teuthology command: teuthology --name rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi --verbose --archive /home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487107 --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} --owner scheduled_rishabh@teuthology -- /home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487107/orig.config.yaml 2023-12-11T16:51:40.046 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-11T16:51:40.153 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487107 branch: rishabh-2023dec11 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev} email: null first_in_suite: false job_id: '7487107' kernel: client: branch: testing flavor: default kdb: true sha1: cd68252d7b4d7802f3cae7f5945b38e9b20dad4c ktype: upstream last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: rishabh-2023dec11 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: a62fda73efba5520d409bb5a21bd8373289dda5d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: a62fda73efba5520d409bb5a21bd8373289dda5d kclient: syntax: v1 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: rishabh-2023dec11 sha1: a62fda73efba5520d409bb5a21bd8373289dda5d owner: scheduled_rishabh@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 5791 sha1: a62fda73efba5520d409bb5a21bd8373289dda5d sleep_before_teardown: 0 subset: 209/512 suite: fs suite_branch: rishabh-2023dec11 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: a62fda73efba5520d409bb5a21bd8373289dda5d syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA/7D7ZkzOq7K2Vy4XbAMIGUGzRIhWNLg3CTN3r754GJROYw66Cun6ytSp1oNxOcdJKQhv3MD+R6xfhLZx4m67E= smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKXH1EIyyKqjHalV6CF5u0WgtqYNX0KeGjN3Xaua0ZmGNO2ICbZtS+gESf56TGdyKytnFbIBVPWFQ9/1JKr4N/8= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.tests_from_xfstests_dev teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-11_15:37:57 tube: smithi user: rishabh verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.232157 2023-12-11T16:51:40.153 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa; will attempt to use it 2023-12-11T16:51:40.154 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa/tasks 2023-12-11T16:51:40.154 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-11T16:51:40.155 INFO:teuthology.task.internal:Checking packages... 2023-12-11T16:51:40.179 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'a62fda73efba5520d409bb5a21bd8373289dda5d' 2023-12-11T16:51:40.179 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-11T16:51:40.179 INFO:teuthology.packaging:ref: None 2023-12-11T16:51:40.179 INFO:teuthology.packaging:tag: None 2023-12-11T16:51:40.179 INFO:teuthology.packaging:branch: rishabh-2023dec11 2023-12-11T16:51:40.179 INFO:teuthology.packaging:sha1: a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-11T16:51:40.180 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=rishabh-2023dec11 2023-12-11T16:51:40.320 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-119.ga62fda73 2023-12-11T16:51:40.322 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-11T16:51:40.327 INFO:teuthology.task.internal:no buildpackages task found 2023-12-11T16:51:40.328 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-11T16:51:40.363 INFO:teuthology.task.internal:Saving configuration 2023-12-11T16:51:40.380 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-11T16:51:40.385 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-11T16:51:40.409 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487107', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-11 16:46:23.459903', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA/7D7ZkzOq7K2Vy4XbAMIGUGzRIhWNLg3CTN3r754GJROYw66Cun6ytSp1oNxOcdJKQhv3MD+R6xfhLZx4m67E='} 2023-12-11T16:51:40.432 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487107', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-11 16:46:23.461442', 'locked_by': 'scheduled_rishabh@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKXH1EIyyKqjHalV6CF5u0WgtqYNX0KeGjN3Xaua0ZmGNO2ICbZtS+gESf56TGdyKytnFbIBVPWFQ9/1JKr4N/8='} 2023-12-11T16:51:40.432 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-11T16:51:40.438 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-12-11T16:51:40.438 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-12-11T16:51:40.438 INFO:teuthology.run_tasks:Running task console_log... 2023-12-11T16:51:40.521 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fd827817dc0>, signals=[15]) 2023-12-11T16:51:40.522 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-11T16:51:40.528 INFO:teuthology.task.internal:Opening connections... 2023-12-11T16:51:40.528 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2023-12-11T16:51:40.530 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T16:51:40.627 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2023-12-11T16:51:40.628 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T16:51:40.713 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-11T16:51:40.720 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2023-12-11T16:51:40.738 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2023-12-11T16:51:40.738 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2023-12-11T16:51:40.795 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2023-12-11T16:51:40.795 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2023-12-11T16:51:40.795 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2023-12-11T16:51:40.795 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2023-12-11T16:51:40.795 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2023-12-11T16:51:40.796 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2023-12-11T16:51:40.796 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-11T16:51:40.796 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2023-12-11T16:51:40.796 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2023-12-11T16:51:40.796 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-11T16:51:40.796 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2023-12-11T16:51:40.796 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T16:51:40.796 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-11T16:51:40.796 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-11T16:51:40.797 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2023-12-11T16:51:40.816 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2023-12-11T16:51:40.834 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2023-12-11T16:51:40.834 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2023-12-11T16:51:40.891 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2023-12-11T16:51:40.891 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9" 2023-12-11T16:51:40.891 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2023-12-11T16:51:40.891 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2023-12-11T16:51:40.891 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9" 2023-12-11T16:51:40.891 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9" 2023-12-11T16:51:40.891 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-11T16:51:40.891 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2023-12-11T16:51:40.891 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon" 2023-12-11T16:51:40.891 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-11T16:51:40.892 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2023-12-11T16:51:40.892 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-11T16:51:40.892 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-11T16:51:40.892 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-11T16:51:40.892 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2023-12-11T16:51:40.915 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-11T16:51:40.925 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-11T16:51:40.938 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-11T16:51:40.939 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2023-12-11T16:51:40.941 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2023-12-11T16:51:40.957 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-11T16:51:40.963 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-11T16:51:40.963 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2023-12-11T16:51:40.999 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2023-12-11T16:51:41.088 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-11T16:51:41.140 INFO:teuthology.run_tasks:Running task kernel... 2023-12-11T16:51:41.154 INFO:teuthology.task.kernel:normalize config orig: {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'} 2023-12-11T16:51:41.154 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'branch': 'testing'}, 'client.2': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}, 'client.3': {'branch': 'testing'}} 2023-12-11T16:51:41.154 INFO:teuthology.task.kernel:config {'client.0': {'branch': 'testing'}, 'client.1': {'branch': 'testing'}}, timeout 300 2023-12-11T16:51:41.155 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-11T16:51:41.155 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-11T16:51:41.172 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-11T16:51:41.172 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-11T16:51:41.173 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-12-11T16:51:41.174 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&ref=testing 2023-12-11T16:51:41.387 DEBUG:teuthology.task.kernel:sha1 for client.0 is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-11T16:51:41.387 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-11T16:51:41.387 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2023-12-11T16:51:41.405 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-361.el9.x86_64 2023-12-11T16:51:41.405 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-11T16:51:41.405 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-11T16:51:41.406 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum upgrade -y linux-firmware 2023-12-11T16:51:41.461 DEBUG:teuthology.task.kernel:sha1 for client.1 is cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-11T16:51:41.461 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "cd68252d7b4d7802f3cae7f5945b38e9b20dad4c"... 2023-12-11T16:51:41.461 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2023-12-11T16:51:41.478 INFO:teuthology.orchestra.run.smithi151.stdout:5.14.0-361.el9.x86_64 2023-12-11T16:51:41.479 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-361.el9.x86_64 vs cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-11T16:51:41.479 DEBUG:teuthology.task.kernel:failed to parse current kernel version 2023-12-11T16:51:41.479 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum upgrade -y linux-firmware 2023-12-11T16:51:43.718 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - AppStream 14 MB/s | 6.4 MB 00:00 2023-12-11T16:51:43.743 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-9 - AppStream 10 MB/s | 6.4 MB 00:00 2023-12-11T16:51:45.226 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-9 - BaseOS 5.1 MB/s | 2.0 MB 00:00 2023-12-11T16:51:45.367 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - BaseOS 3.3 MB/s | 2.0 MB 00:00 2023-12-11T16:51:46.033 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 7.9 MB 00:00 2023-12-11T16:51:49.323 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 7.9 MB 00:03 2023-12-11T16:51:53.134 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 3.0 MB/s | 18 MB 00:05 2023-12-11T16:51:55.241 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - AppStream 3.7 MB/s | 18 MB 00:04 2023-12-11T16:52:00.058 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - CRB 4.0 MB/s | 5.8 MB 00:01 2023-12-11T16:52:03.133 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - Extras packages 7.6 kB/s | 15 kB 00:01 2023-12-11T16:52:04.301 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 19 MB/s | 20 MB 00:01 2023-12-11T16:52:09.026 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2023-12-11T16:52:11.406 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-12-11T16:52:11.413 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-12-11T16:52:11.413 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-12-11T16:52:11.413 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-12-11T16:52:11.413 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2023-12-11T16:52:11.413 INFO:teuthology.orchestra.run.smithi151.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-11T16:52:11.413 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T16:52:11.413 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-12-11T16:52:11.414 INFO:teuthology.orchestra.run.smithi151.stdout:================================================================================ 2023-12-11T16:52:11.414 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 1 Package 2023-12-11T16:52:11.414 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T16:52:11.414 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 328 M 2023-12-11T16:52:11.414 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-12-11T16:52:15.494 INFO:teuthology.orchestra.run.smithi151.stdout:linux-firmware-20231030-141.el9.noarch.rpm 80 MB/s | 328 MB 00:04 2023-12-11T16:52:15.495 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-12-11T16:52:15.495 INFO:teuthology.orchestra.run.smithi151.stdout:Total 80 MB/s | 328 MB 00:04 2023-12-11T16:52:15.496 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-12-11T16:52:15.584 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-12-11T16:52:15.584 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-12-11T16:52:17.707 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-12-11T16:52:17.707 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-12-11T16:52:23.769 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-12-11T16:52:24.094 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-11T16:52:24.183 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-11T16:52:25.232 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-11T16:52:25.232 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-11T16:52:25.597 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-11T16:52:25.597 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T16:52:25.597 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2023-12-11T16:52:25.597 INFO:teuthology.orchestra.run.smithi151.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-11T16:52:25.597 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T16:52:25.597 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-12-11T16:52:25.876 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.1... 2023-12-11T16:52:25.876 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-11T16:52:26.026 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ 2023-12-11T16:52:26.026 DEBUG:teuthology.orchestra.run.smithi151:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-11T16:52:26.028 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi151.front.sepia.ceph.com to complete... 2023-12-11T16:52:38.011 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11 16:52:38 URL:https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [321162729/321162729] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-11T16:52:38.011 INFO:teuthology.orchestra.run.smithi151.stderr:FINISHED --2023-12-11 16:52:38-- 2023-12-11T16:52:38.011 INFO:teuthology.orchestra.run.smithi151.stderr:Total wall clock time: 12s 2023-12-11T16:52:38.011 INFO:teuthology.orchestra.run.smithi151.stderr:Downloaded: 1 files, 306M in 12s (26.4 MB/s) 2023-12-11T16:52:38.014 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.1... 2023-12-11T16:52:38.014 DEBUG:teuthology.orchestra.run.smithi151:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-11T16:52:39.868 INFO:teuthology.orchestra.run.smithi151.stdout:Verifying... ######################################## 2023-12-11T16:52:40.199 INFO:teuthology.orchestra.run.smithi151.stdout:Preparing... ######################################## 2023-12-11T16:52:40.279 INFO:teuthology.orchestra.run.smithi151.stdout:Updating / installing... 2023-12-11T16:52:47.386 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-11T16:53:03.364 INFO:teuthology.orchestra.run.smithi151.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-11T16:53:19.801 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 72 kB/s | 5.8 MB 01:23 2023-12-11T16:53:21.619 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 22 kB/s | 15 kB 00:00 2023-12-11T16:53:22.828 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 18 MB/s | 20 MB 00:01 2023-12-11T16:53:24.554 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi151.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-11T16:53:24.555 DEBUG:teuthology.orchestra.run.smithi151:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-11T16:53:24.622 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-11T16:53:24.622 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-11T16:53:24.623 INFO:teuthology.orchestra.run.smithi151.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-11T16:53:24.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-11T16:53:24.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-11T16:53:24.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-11T16:53:24.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-11T16:53:24.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-11T16:53:24.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-11T16:53:24.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-11T16:53:24.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-11T16:53:24.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-11T16:53:24.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-11T16:53:24.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-11T16:53:24.623 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-11T16:53:24.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-11T16:53:24.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-11T16:53:24.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-11T16:53:24.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-11T16:53:24.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-11T16:53:24.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-11T16:53:24.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-11T16:53:24.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-11T16:53:24.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-11T16:53:24.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-11T16:53:24.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-11T16:53:24.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-11T16:53:24.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-11T16:53:24.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-11T16:53:24.624 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-11T16:53:24.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-11T16:53:24.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-11T16:53:24.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-11T16:53:24.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-11T16:53:24.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-11T16:53:24.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-11T16:53:24.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-11T16:53:24.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-11T16:53:24.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-11T16:53:24.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-11T16:53:24.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-11T16:53:24.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-11T16:53:24.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-11T16:53:24.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-11T16:53:24.625 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-11T16:53:24.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-11T16:53:24.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-11T16:53:24.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-11T16:53:24.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-11T16:53:24.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-11T16:53:24.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-11T16:53:24.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-11T16:53:24.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-11T16:53:24.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-11T16:53:24.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-11T16:53:24.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-11T16:53:24.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-11T16:53:24.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-11T16:53:24.626 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-11T16:53:24.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-11T16:53:24.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-11T16:53:24.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-11T16:53:24.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-11T16:53:24.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-11T16:53:24.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-11T16:53:24.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-11T16:53:24.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-11T16:53:24.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-11T16:53:24.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-11T16:53:24.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-11T16:53:24.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-11T16:53:24.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-11T16:53:24.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-11T16:53:24.627 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-11T16:53:24.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-11T16:53:24.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-11T16:53:24.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-11T16:53:24.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-11T16:53:24.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-11T16:53:24.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-11T16:53:24.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-11T16:53:24.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-11T16:53:24.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-11T16:53:24.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-11T16:53:24.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-11T16:53:24.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-11T16:53:24.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-11T16:53:24.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-11T16:53:24.628 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-11T16:53:24.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-11T16:53:24.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-11T16:53:24.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-11T16:53:24.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-11T16:53:24.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-11T16:53:24.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-11T16:53:24.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-11T16:53:24.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-11T16:53:24.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-11T16:53:24.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-11T16:53:24.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-11T16:53:24.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-11T16:53:24.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-11T16:53:24.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-11T16:53:24.629 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-11T16:53:24.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-11T16:53:24.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-11T16:53:24.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-11T16:53:24.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-11T16:53:24.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-11T16:53:24.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-11T16:53:24.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-11T16:53:24.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-11T16:53:24.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-11T16:53:24.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-11T16:53:24.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-11T16:53:24.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-11T16:53:24.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-11T16:53:24.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-11T16:53:24.630 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-11T16:53:24.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-11T16:53:24.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-11T16:53:24.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-11T16:53:24.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-11T16:53:24.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-11T16:53:24.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-11T16:53:24.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-11T16:53:24.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-11T16:53:24.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-11T16:53:24.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-11T16:53:24.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-11T16:53:24.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-11T16:53:24.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-11T16:53:24.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-11T16:53:24.631 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-11T16:53:24.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-11T16:53:24.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-11T16:53:24.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-11T16:53:24.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-11T16:53:24.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-11T16:53:24.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-11T16:53:24.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-11T16:53:24.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-11T16:53:24.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-11T16:53:24.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-11T16:53:24.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-11T16:53:24.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-11T16:53:24.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-11T16:53:24.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-11T16:53:24.632 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-11T16:53:24.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-11T16:53:24.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-11T16:53:24.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-11T16:53:24.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-11T16:53:24.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-11T16:53:24.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-11T16:53:24.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-11T16:53:24.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-11T16:53:24.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-11T16:53:24.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-11T16:53:24.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-11T16:53:24.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-11T16:53:24.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-11T16:53:24.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-11T16:53:24.633 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-11T16:53:24.634 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-11T16:53:24.634 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-11T16:53:24.634 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-11T16:53:24.634 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-11T16:53:24.634 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-11T16:53:24.634 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-11T16:53:24.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-11T16:53:24.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-11T16:53:24.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-11T16:53:24.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-11T16:53:24.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-11T16:53:24.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-11T16:53:24.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-11T16:53:24.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-11T16:53:24.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-11T16:53:24.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-11T16:53:24.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-11T16:53:24.635 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-11T16:53:24.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-11T16:53:24.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-11T16:53:24.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-11T16:53:24.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-11T16:53:24.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-11T16:53:24.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-11T16:53:24.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-11T16:53:24.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-11T16:53:24.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-11T16:53:24.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-11T16:53:24.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-11T16:53:24.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-11T16:53:24.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-11T16:53:24.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-11T16:53:24.636 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-11T16:53:24.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-11T16:53:24.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-11T16:53:24.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-11T16:53:24.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-11T16:53:24.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-11T16:53:24.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-11T16:53:24.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-11T16:53:24.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-11T16:53:24.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-11T16:53:24.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-11T16:53:24.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-11T16:53:24.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-11T16:53:24.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-11T16:53:24.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-11T16:53:24.637 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-11T16:53:24.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-11T16:53:24.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-11T16:53:24.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-11T16:53:24.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-11T16:53:24.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-11T16:53:24.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-11T16:53:24.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-11T16:53:24.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-11T16:53:24.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-11T16:53:24.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-11T16:53:24.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-11T16:53:24.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-11T16:53:24.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-11T16:53:24.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-11T16:53:24.638 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-11T16:53:24.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-11T16:53:24.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-11T16:53:24.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-11T16:53:24.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-11T16:53:24.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-11T16:53:24.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-11T16:53:24.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-11T16:53:24.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-11T16:53:24.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-11T16:53:24.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-11T16:53:24.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-11T16:53:24.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-11T16:53:24.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-11T16:53:24.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-11T16:53:24.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-11T16:53:24.639 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-11T16:53:24.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-11T16:53:24.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-11T16:53:24.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-11T16:53:24.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-11T16:53:24.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-11T16:53:24.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-11T16:53:24.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-11T16:53:24.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-11T16:53:24.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-11T16:53:24.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-11T16:53:24.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-11T16:53:24.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-11T16:53:24.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-11T16:53:24.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-11T16:53:24.640 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-11T16:53:24.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-11T16:53:24.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-11T16:53:24.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-11T16:53:24.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-11T16:53:24.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-11T16:53:24.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-11T16:53:24.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-11T16:53:24.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-11T16:53:24.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-11T16:53:24.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-11T16:53:24.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-11T16:53:24.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-11T16:53:24.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-11T16:53:24.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-11T16:53:24.641 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-11T16:53:24.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-11T16:53:24.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-11T16:53:24.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-11T16:53:24.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-11T16:53:24.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-11T16:53:24.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-11T16:53:24.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-11T16:53:24.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-11T16:53:24.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-11T16:53:24.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-11T16:53:24.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-11T16:53:24.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-11T16:53:24.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-11T16:53:24.642 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-11T16:53:24.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-11T16:53:24.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-11T16:53:24.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-11T16:53:24.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-11T16:53:24.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-11T16:53:24.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-11T16:53:24.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-11T16:53:24.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-11T16:53:24.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-11T16:53:24.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-11T16:53:24.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-11T16:53:24.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-11T16:53:24.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-11T16:53:24.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-11T16:53:24.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-11T16:53:24.643 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-11T16:53:24.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-11T16:53:24.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-11T16:53:24.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-11T16:53:24.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-11T16:53:24.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-11T16:53:24.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-11T16:53:24.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-11T16:53:24.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-11T16:53:24.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-11T16:53:24.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-11T16:53:24.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-11T16:53:24.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-11T16:53:24.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-11T16:53:24.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-11T16:53:24.644 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-11T16:53:24.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-11T16:53:24.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-11T16:53:24.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-11T16:53:24.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-11T16:53:24.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-11T16:53:24.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-11T16:53:24.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-11T16:53:24.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-11T16:53:24.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-11T16:53:24.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-11T16:53:24.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-11T16:53:24.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-11T16:53:24.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-11T16:53:24.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-11T16:53:24.645 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-11T16:53:24.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-11T16:53:24.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-11T16:53:24.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-11T16:53:24.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-11T16:53:24.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-11T16:53:24.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-11T16:53:24.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-11T16:53:24.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-11T16:53:24.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-11T16:53:24.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-11T16:53:24.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-11T16:53:24.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-11T16:53:24.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-11T16:53:24.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-11T16:53:24.646 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-11T16:53:24.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-11T16:53:24.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-11T16:53:24.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-11T16:53:24.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-11T16:53:24.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-11T16:53:24.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-11T16:53:24.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-11T16:53:24.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-11T16:53:24.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-11T16:53:24.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-11T16:53:24.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-11T16:53:24.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-11T16:53:24.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-11T16:53:24.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-11T16:53:24.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-11T16:53:24.647 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-11T16:53:24.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-11T16:53:24.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-11T16:53:24.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-11T16:53:24.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-11T16:53:24.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-11T16:53:24.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-11T16:53:24.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-11T16:53:24.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-11T16:53:24.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-11T16:53:24.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-11T16:53:24.648 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-11T16:53:24.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-11T16:53:24.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-11T16:53:24.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-11T16:53:24.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-11T16:53:24.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-11T16:53:24.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-11T16:53:24.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-11T16:53:24.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-11T16:53:24.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-11T16:53:24.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-11T16:53:24.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-11T16:53:24.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-11T16:53:24.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-11T16:53:24.649 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-11T16:53:24.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-11T16:53:24.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-11T16:53:24.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-11T16:53:24.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-11T16:53:24.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-11T16:53:24.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-11T16:53:24.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-11T16:53:24.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-11T16:53:24.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-11T16:53:24.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-11T16:53:24.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-11T16:53:24.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-11T16:53:24.650 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-11T16:53:24.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-11T16:53:24.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-11T16:53:24.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-11T16:53:24.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-11T16:53:24.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-11T16:53:24.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-11T16:53:24.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-11T16:53:24.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-11T16:53:24.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-11T16:53:24.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-11T16:53:24.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-11T16:53:24.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-11T16:53:24.651 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-11T16:53:24.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-11T16:53:24.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-11T16:53:24.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-11T16:53:24.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-11T16:53:24.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-11T16:53:24.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-11T16:53:24.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-11T16:53:24.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-11T16:53:24.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-11T16:53:24.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-11T16:53:24.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-11T16:53:24.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-11T16:53:24.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-11T16:53:24.652 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-11T16:53:24.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-11T16:53:24.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-11T16:53:24.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-11T16:53:24.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-11T16:53:24.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-11T16:53:24.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-11T16:53:24.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-11T16:53:24.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-11T16:53:24.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-11T16:53:24.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-11T16:53:24.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-11T16:53:24.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-11T16:53:24.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-11T16:53:24.653 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-11T16:53:24.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-11T16:53:24.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-11T16:53:24.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-11T16:53:24.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-11T16:53:24.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-11T16:53:24.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-11T16:53:24.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-11T16:53:24.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-11T16:53:24.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-11T16:53:24.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-11T16:53:24.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-11T16:53:24.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-11T16:53:24.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-11T16:53:24.654 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-11T16:53:24.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-11T16:53:24.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-11T16:53:24.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-11T16:53:24.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-11T16:53:24.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-11T16:53:24.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-11T16:53:24.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-11T16:53:24.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-11T16:53:24.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-11T16:53:24.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-11T16:53:24.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-11T16:53:24.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-11T16:53:24.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-11T16:53:24.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-11T16:53:24.655 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-11T16:53:24.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-11T16:53:24.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-11T16:53:24.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-11T16:53:24.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-11T16:53:24.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-11T16:53:24.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-11T16:53:24.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-11T16:53:24.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-11T16:53:24.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-11T16:53:24.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-11T16:53:24.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-11T16:53:24.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-11T16:53:24.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-11T16:53:24.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-11T16:53:24.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-11T16:53:24.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-11T16:53:24.656 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-11T16:53:24.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-11T16:53:24.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-11T16:53:24.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-11T16:53:24.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-11T16:53:24.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-11T16:53:24.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-11T16:53:24.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-11T16:53:24.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-11T16:53:24.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-11T16:53:24.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-11T16:53:24.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-11T16:53:24.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-11T16:53:24.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-11T16:53:24.657 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-11T16:53:24.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-11T16:53:24.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-11T16:53:24.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-11T16:53:24.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-11T16:53:24.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-11T16:53:24.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-11T16:53:24.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-11T16:53:24.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-11T16:53:24.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-11T16:53:24.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-11T16:53:24.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-11T16:53:24.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-11T16:53:24.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-11T16:53:24.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-11T16:53:24.658 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-11T16:53:24.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-11T16:53:24.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-11T16:53:24.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-11T16:53:24.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-11T16:53:24.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-11T16:53:24.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-11T16:53:24.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-11T16:53:24.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-11T16:53:24.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-11T16:53:24.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-11T16:53:24.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-11T16:53:24.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-11T16:53:24.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-11T16:53:24.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-11T16:53:24.659 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-11T16:53:24.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-11T16:53:24.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-11T16:53:24.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-11T16:53:24.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-11T16:53:24.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-11T16:53:24.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-11T16:53:24.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-11T16:53:24.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-11T16:53:24.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-11T16:53:24.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-11T16:53:24.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-11T16:53:24.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-11T16:53:24.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-11T16:53:24.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-11T16:53:24.660 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-11T16:53:24.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-11T16:53:24.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-11T16:53:24.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-11T16:53:24.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-11T16:53:24.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-11T16:53:24.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-11T16:53:24.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-11T16:53:24.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-11T16:53:24.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-11T16:53:24.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-11T16:53:24.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-11T16:53:24.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-11T16:53:24.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-11T16:53:24.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-11T16:53:24.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-11T16:53:24.661 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-11T16:53:24.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-11T16:53:24.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-11T16:53:24.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-11T16:53:24.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-11T16:53:24.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-11T16:53:24.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-11T16:53:24.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-11T16:53:24.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-11T16:53:24.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-11T16:53:24.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-11T16:53:24.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-11T16:53:24.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-11T16:53:24.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-11T16:53:24.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-11T16:53:24.662 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-11T16:53:24.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-11T16:53:24.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-11T16:53:24.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-11T16:53:24.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-11T16:53:24.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-11T16:53:24.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-11T16:53:24.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-11T16:53:24.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-11T16:53:24.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-11T16:53:24.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-11T16:53:24.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-11T16:53:24.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-11T16:53:24.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-11T16:53:24.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-11T16:53:24.663 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-11T16:53:24.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-11T16:53:24.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-11T16:53:24.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-11T16:53:24.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-11T16:53:24.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-11T16:53:24.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-11T16:53:24.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-11T16:53:24.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-11T16:53:24.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-11T16:53:24.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-11T16:53:24.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-11T16:53:24.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-11T16:53:24.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-11T16:53:24.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-11T16:53:24.664 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-11T16:53:24.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-11T16:53:24.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-11T16:53:24.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-11T16:53:24.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-11T16:53:24.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-11T16:53:24.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-11T16:53:24.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-11T16:53:24.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-11T16:53:24.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-11T16:53:24.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-11T16:53:24.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-11T16:53:24.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-11T16:53:24.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-11T16:53:24.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-11T16:53:24.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-11T16:53:24.665 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-11T16:53:24.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-11T16:53:24.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-11T16:53:24.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-11T16:53:24.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-11T16:53:24.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-11T16:53:24.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-11T16:53:24.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-11T16:53:24.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-11T16:53:24.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-11T16:53:24.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-11T16:53:24.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-11T16:53:24.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-11T16:53:24.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-11T16:53:24.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-11T16:53:24.666 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-11T16:53:24.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-11T16:53:24.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-11T16:53:24.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-11T16:53:24.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-11T16:53:24.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-11T16:53:24.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-11T16:53:24.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-11T16:53:24.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-11T16:53:24.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-11T16:53:24.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-11T16:53:24.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-11T16:53:24.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-11T16:53:24.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-11T16:53:24.667 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-11T16:53:24.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-11T16:53:24.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-11T16:53:24.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-11T16:53:24.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-11T16:53:24.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-11T16:53:24.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-11T16:53:24.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-11T16:53:24.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-11T16:53:24.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-11T16:53:24.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-11T16:53:24.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-11T16:53:24.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-11T16:53:24.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-11T16:53:24.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-11T16:53:24.668 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-11T16:53:24.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-11T16:53:24.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-11T16:53:24.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-11T16:53:24.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-11T16:53:24.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-11T16:53:24.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-11T16:53:24.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-11T16:53:24.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-11T16:53:24.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-11T16:53:24.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-11T16:53:24.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-11T16:53:24.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-11T16:53:24.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-11T16:53:24.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-11T16:53:24.669 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-11T16:53:24.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-11T16:53:24.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-11T16:53:24.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-11T16:53:24.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-11T16:53:24.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-11T16:53:24.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-11T16:53:24.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-11T16:53:24.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-11T16:53:24.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-11T16:53:24.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-11T16:53:24.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-11T16:53:24.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-11T16:53:24.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-11T16:53:24.670 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-11T16:53:24.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-11T16:53:24.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-11T16:53:24.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-11T16:53:24.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-11T16:53:24.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-11T16:53:24.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-11T16:53:24.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-11T16:53:24.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-11T16:53:24.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-11T16:53:24.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-11T16:53:24.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-11T16:53:24.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-11T16:53:24.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-11T16:53:24.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-11T16:53:24.671 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-11T16:53:24.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-11T16:53:24.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-11T16:53:24.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-11T16:53:24.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-11T16:53:24.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-11T16:53:24.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-11T16:53:24.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-11T16:53:24.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-11T16:53:24.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-11T16:53:24.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-11T16:53:24.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-11T16:53:24.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-11T16:53:24.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-11T16:53:24.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-11T16:53:24.672 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-11T16:53:24.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-11T16:53:24.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-11T16:53:24.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-11T16:53:24.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-11T16:53:24.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-11T16:53:24.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-11T16:53:24.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-11T16:53:24.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-11T16:53:24.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-11T16:53:24.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-11T16:53:24.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-11T16:53:24.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-11T16:53:24.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-11T16:53:24.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-11T16:53:24.673 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-11T16:53:24.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-11T16:53:24.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-11T16:53:24.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-11T16:53:24.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-11T16:53:24.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-11T16:53:24.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-11T16:53:24.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-11T16:53:24.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-11T16:53:24.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-11T16:53:24.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-11T16:53:24.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-11T16:53:24.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-11T16:53:24.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-11T16:53:24.674 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-11T16:53:24.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-11T16:53:24.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-11T16:53:24.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-11T16:53:24.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-11T16:53:24.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-11T16:53:24.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-11T16:53:24.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-11T16:53:24.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-11T16:53:24.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-11T16:53:24.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-11T16:53:24.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-11T16:53:24.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-11T16:53:24.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-11T16:53:24.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-11T16:53:24.675 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-11T16:53:24.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-11T16:53:24.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-11T16:53:24.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-11T16:53:24.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-11T16:53:24.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-11T16:53:24.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-11T16:53:24.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-11T16:53:24.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-11T16:53:24.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-11T16:53:24.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-11T16:53:24.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-11T16:53:24.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-11T16:53:24.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-11T16:53:24.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-11T16:53:24.676 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-11T16:53:24.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-11T16:53:24.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-11T16:53:24.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-11T16:53:24.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-11T16:53:24.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-11T16:53:24.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-11T16:53:24.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-11T16:53:24.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-11T16:53:24.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-11T16:53:24.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-11T16:53:24.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-11T16:53:24.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-11T16:53:24.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-11T16:53:24.677 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-11T16:53:24.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-11T16:53:24.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-11T16:53:24.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-11T16:53:24.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-11T16:53:24.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-11T16:53:24.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-11T16:53:24.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-11T16:53:24.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-11T16:53:24.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-11T16:53:24.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-11T16:53:24.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-11T16:53:24.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-11T16:53:24.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-11T16:53:24.678 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-11T16:53:24.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-11T16:53:24.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-11T16:53:24.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-11T16:53:24.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-11T16:53:24.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-11T16:53:24.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-11T16:53:24.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-11T16:53:24.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-11T16:53:24.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-11T16:53:24.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-11T16:53:24.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-11T16:53:24.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-11T16:53:24.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-11T16:53:24.679 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-11T16:53:24.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-11T16:53:24.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-11T16:53:24.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-11T16:53:24.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-11T16:53:24.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-11T16:53:24.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-11T16:53:24.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-11T16:53:24.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-11T16:53:24.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-11T16:53:24.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-11T16:53:24.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-11T16:53:24.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-11T16:53:24.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-11T16:53:24.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-11T16:53:24.680 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-11T16:53:24.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-11T16:53:24.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-11T16:53:24.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-11T16:53:24.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-11T16:53:24.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-11T16:53:24.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-11T16:53:24.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-11T16:53:24.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-11T16:53:24.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-11T16:53:24.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-11T16:53:24.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-11T16:53:24.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-11T16:53:24.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-11T16:53:24.681 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-11T16:53:24.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-11T16:53:24.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-11T16:53:24.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-11T16:53:24.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-11T16:53:24.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-11T16:53:24.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-11T16:53:24.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-11T16:53:24.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-11T16:53:24.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-11T16:53:24.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-11T16:53:24.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-11T16:53:24.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-11T16:53:24.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-11T16:53:24.682 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-11T16:53:24.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-11T16:53:24.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-11T16:53:24.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-11T16:53:24.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-11T16:53:24.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-11T16:53:24.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-11T16:53:24.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-11T16:53:24.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-11T16:53:24.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-11T16:53:24.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-11T16:53:24.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-11T16:53:24.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-11T16:53:24.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-11T16:53:24.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-11T16:53:24.683 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-11T16:53:24.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-11T16:53:24.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-11T16:53:24.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-11T16:53:24.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-11T16:53:24.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-11T16:53:24.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-11T16:53:24.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-11T16:53:24.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-11T16:53:24.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-11T16:53:24.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-11T16:53:24.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-11T16:53:24.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-11T16:53:24.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-11T16:53:24.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-11T16:53:24.684 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-11T16:53:24.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-11T16:53:24.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-11T16:53:24.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-11T16:53:24.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-11T16:53:24.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-11T16:53:24.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-11T16:53:24.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-11T16:53:24.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-11T16:53:24.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-11T16:53:24.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-11T16:53:24.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-11T16:53:24.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-11T16:53:24.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-11T16:53:24.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-11T16:53:24.685 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-11T16:53:24.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-11T16:53:24.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-11T16:53:24.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-11T16:53:24.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-11T16:53:24.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-11T16:53:24.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-11T16:53:24.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-11T16:53:24.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-11T16:53:24.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-11T16:53:24.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-11T16:53:24.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-11T16:53:24.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-11T16:53:24.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-11T16:53:24.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-11T16:53:24.686 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-11T16:53:24.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-11T16:53:24.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-11T16:53:24.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-11T16:53:24.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-11T16:53:24.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-11T16:53:24.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-11T16:53:24.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-11T16:53:24.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-11T16:53:24.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-11T16:53:24.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-11T16:53:24.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-11T16:53:24.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-11T16:53:24.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-11T16:53:24.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-11T16:53:24.687 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-11T16:53:24.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-11T16:53:24.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-11T16:53:24.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-11T16:53:24.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-11T16:53:24.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-11T16:53:24.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-11T16:53:24.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-11T16:53:24.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-11T16:53:24.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-11T16:53:24.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-11T16:53:24.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-11T16:53:24.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-11T16:53:24.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-11T16:53:24.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-11T16:53:24.688 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-11T16:53:24.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-11T16:53:24.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-11T16:53:24.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-11T16:53:24.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-11T16:53:24.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-11T16:53:24.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-11T16:53:24.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-11T16:53:24.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-11T16:53:24.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-11T16:53:24.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-11T16:53:24.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-11T16:53:24.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-11T16:53:24.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-11T16:53:24.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-11T16:53:24.689 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-11T16:53:24.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-11T16:53:24.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-11T16:53:24.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-11T16:53:24.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-11T16:53:24.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-11T16:53:24.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-11T16:53:24.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-11T16:53:24.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-11T16:53:24.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-11T16:53:24.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-11T16:53:24.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-11T16:53:24.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-11T16:53:24.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-11T16:53:24.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-11T16:53:24.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-11T16:53:24.690 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-11T16:53:24.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-11T16:53:24.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-11T16:53:24.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-11T16:53:24.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-11T16:53:24.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-11T16:53:24.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-11T16:53:24.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-11T16:53:24.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-11T16:53:24.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-11T16:53:24.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-11T16:53:24.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-11T16:53:24.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-11T16:53:24.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-11T16:53:24.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-11T16:53:24.691 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-11T16:53:24.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-11T16:53:24.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-11T16:53:24.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-11T16:53:24.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-11T16:53:24.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-11T16:53:24.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-11T16:53:24.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-11T16:53:24.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-11T16:53:24.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-11T16:53:24.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-11T16:53:24.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-11T16:53:24.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-11T16:53:24.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-11T16:53:24.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-11T16:53:24.692 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-11T16:53:24.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-11T16:53:24.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-11T16:53:24.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-11T16:53:24.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-11T16:53:24.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-11T16:53:24.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-11T16:53:24.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-11T16:53:24.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-11T16:53:24.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-11T16:53:24.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-11T16:53:24.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-11T16:53:24.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-11T16:53:24.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-11T16:53:24.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-11T16:53:24.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-11T16:53:24.693 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-11T16:53:24.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-11T16:53:24.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-11T16:53:24.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-11T16:53:24.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-11T16:53:24.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-11T16:53:24.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-11T16:53:24.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-11T16:53:24.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-11T16:53:24.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-11T16:53:24.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-11T16:53:24.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-11T16:53:24.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-11T16:53:24.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-11T16:53:24.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-11T16:53:24.694 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-11T16:53:24.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-11T16:53:24.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-11T16:53:24.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-11T16:53:24.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-11T16:53:24.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-11T16:53:24.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-11T16:53:24.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-11T16:53:24.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-11T16:53:24.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-11T16:53:24.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-11T16:53:24.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-11T16:53:24.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-11T16:53:24.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-11T16:53:24.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-11T16:53:24.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-11T16:53:24.695 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-11T16:53:24.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-11T16:53:24.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-11T16:53:24.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-11T16:53:24.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-11T16:53:24.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-11T16:53:24.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-11T16:53:24.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-11T16:53:24.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-11T16:53:24.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-11T16:53:24.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-11T16:53:24.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-11T16:53:24.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-11T16:53:24.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-11T16:53:24.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-11T16:53:24.696 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-11T16:53:24.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-11T16:53:24.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-11T16:53:24.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-11T16:53:24.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-11T16:53:24.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-11T16:53:24.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-11T16:53:24.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-11T16:53:24.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-11T16:53:24.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-11T16:53:24.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-11T16:53:24.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-11T16:53:24.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-11T16:53:24.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-11T16:53:24.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-11T16:53:24.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-11T16:53:24.697 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-11T16:53:24.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-11T16:53:24.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-11T16:53:24.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-11T16:53:24.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-11T16:53:24.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-11T16:53:24.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-11T16:53:24.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-11T16:53:24.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-11T16:53:24.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-11T16:53:24.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-11T16:53:24.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-11T16:53:24.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-11T16:53:24.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-11T16:53:24.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-11T16:53:24.698 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-11T16:53:24.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-11T16:53:24.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-11T16:53:24.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-11T16:53:24.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-11T16:53:24.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-11T16:53:24.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-11T16:53:24.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-11T16:53:24.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-11T16:53:24.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-11T16:53:24.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-11T16:53:24.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-11T16:53:24.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-11T16:53:24.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-11T16:53:24.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-11T16:53:24.699 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-11T16:53:24.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-11T16:53:24.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-11T16:53:24.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-11T16:53:24.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-11T16:53:24.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-11T16:53:24.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-11T16:53:24.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-11T16:53:24.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-11T16:53:24.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-11T16:53:24.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-11T16:53:24.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-11T16:53:24.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-11T16:53:24.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-11T16:53:24.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-11T16:53:24.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-11T16:53:24.700 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-11T16:53:24.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-11T16:53:24.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-11T16:53:24.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-11T16:53:24.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-11T16:53:24.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-11T16:53:24.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-11T16:53:24.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-11T16:53:24.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-11T16:53:24.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-11T16:53:24.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-11T16:53:24.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-11T16:53:24.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-11T16:53:24.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-11T16:53:24.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-11T16:53:24.701 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-11T16:53:24.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-11T16:53:24.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-11T16:53:24.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-11T16:53:24.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-11T16:53:24.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-11T16:53:24.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-11T16:53:24.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-11T16:53:24.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-11T16:53:24.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-11T16:53:24.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-11T16:53:24.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-11T16:53:24.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-11T16:53:24.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-11T16:53:24.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-11T16:53:24.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-11T16:53:24.702 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-11T16:53:24.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-11T16:53:24.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-11T16:53:24.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-11T16:53:24.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-11T16:53:24.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-11T16:53:24.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-11T16:53:24.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-11T16:53:24.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-11T16:53:24.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-11T16:53:24.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-11T16:53:24.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-11T16:53:24.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-11T16:53:24.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-11T16:53:24.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-11T16:53:24.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-11T16:53:24.703 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-11T16:53:24.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-11T16:53:24.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-11T16:53:24.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-11T16:53:24.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-11T16:53:24.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-11T16:53:24.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-11T16:53:24.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-11T16:53:24.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-11T16:53:24.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-11T16:53:24.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-11T16:53:24.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-11T16:53:24.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-11T16:53:24.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-11T16:53:24.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-11T16:53:24.704 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-11T16:53:24.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-11T16:53:24.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-11T16:53:24.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-11T16:53:24.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-11T16:53:24.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-11T16:53:24.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-11T16:53:24.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-11T16:53:24.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-11T16:53:24.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-11T16:53:24.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-11T16:53:24.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-11T16:53:24.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-11T16:53:24.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-11T16:53:24.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-11T16:53:24.705 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-11T16:53:24.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-11T16:53:24.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-11T16:53:24.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-11T16:53:24.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-11T16:53:24.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-11T16:53:24.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-11T16:53:24.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-11T16:53:24.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-11T16:53:24.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-11T16:53:24.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-11T16:53:24.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-11T16:53:24.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-11T16:53:24.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-11T16:53:24.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-11T16:53:24.706 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-11T16:53:24.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-11T16:53:24.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-11T16:53:24.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-11T16:53:24.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-11T16:53:24.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-11T16:53:24.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-11T16:53:24.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-11T16:53:24.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-11T16:53:24.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-11T16:53:24.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-11T16:53:24.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-11T16:53:24.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-11T16:53:24.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-11T16:53:24.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-11T16:53:24.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-11T16:53:24.707 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-11T16:53:24.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-11T16:53:24.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-11T16:53:24.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-11T16:53:24.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-11T16:53:24.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-11T16:53:24.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-11T16:53:24.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-11T16:53:24.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-11T16:53:24.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-11T16:53:24.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-11T16:53:24.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-11T16:53:24.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-11T16:53:24.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-11T16:53:24.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-11T16:53:24.708 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-11T16:53:24.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-11T16:53:24.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-11T16:53:24.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-11T16:53:24.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-11T16:53:24.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-11T16:53:24.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-11T16:53:24.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-11T16:53:24.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-11T16:53:24.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-11T16:53:24.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-11T16:53:24.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-11T16:53:24.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-11T16:53:24.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-11T16:53:24.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-11T16:53:24.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-11T16:53:24.709 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-11T16:53:24.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-11T16:53:24.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-11T16:53:24.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-11T16:53:24.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-11T16:53:24.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-11T16:53:24.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-11T16:53:24.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-11T16:53:24.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-11T16:53:24.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-11T16:53:24.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-11T16:53:24.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-11T16:53:24.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-11T16:53:24.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-11T16:53:24.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-11T16:53:24.710 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-11T16:53:24.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-11T16:53:24.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-11T16:53:24.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-11T16:53:24.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-11T16:53:24.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-11T16:53:24.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-11T16:53:24.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-11T16:53:24.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-11T16:53:24.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-11T16:53:24.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-11T16:53:24.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-11T16:53:24.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-11T16:53:24.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-11T16:53:24.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-11T16:53:24.711 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-11T16:53:24.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-11T16:53:24.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-11T16:53:24.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-11T16:53:24.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-11T16:53:24.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-11T16:53:24.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-11T16:53:24.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-11T16:53:24.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-11T16:53:24.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-11T16:53:24.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-11T16:53:24.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-11T16:53:24.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-11T16:53:24.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-11T16:53:24.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-11T16:53:24.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-11T16:53:24.712 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-11T16:53:24.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-11T16:53:24.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-11T16:53:24.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-11T16:53:24.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-11T16:53:24.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-11T16:53:24.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-11T16:53:24.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-11T16:53:24.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-11T16:53:24.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-11T16:53:24.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-11T16:53:24.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-11T16:53:24.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-11T16:53:24.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-11T16:53:24.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-11T16:53:24.713 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-11T16:53:24.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-11T16:53:24.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-11T16:53:24.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-11T16:53:24.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-11T16:53:24.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-11T16:53:24.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-11T16:53:24.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-11T16:53:24.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-11T16:53:24.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-11T16:53:24.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-11T16:53:24.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-11T16:53:24.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-11T16:53:24.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-11T16:53:24.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-11T16:53:24.714 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-11T16:53:24.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-11T16:53:24.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-11T16:53:24.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-11T16:53:24.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-11T16:53:24.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-11T16:53:24.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-11T16:53:24.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-11T16:53:24.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-11T16:53:24.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-11T16:53:24.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-11T16:53:24.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-11T16:53:24.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-11T16:53:24.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-11T16:53:24.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-11T16:53:24.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-11T16:53:24.715 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-11T16:53:24.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-11T16:53:24.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-11T16:53:24.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-11T16:53:24.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-11T16:53:24.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-11T16:53:24.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-11T16:53:24.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-11T16:53:24.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-11T16:53:24.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-11T16:53:24.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-11T16:53:24.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-11T16:53:24.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-11T16:53:24.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-11T16:53:24.716 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-11T16:53:24.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-11T16:53:24.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-11T16:53:24.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-11T16:53:24.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-11T16:53:24.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-11T16:53:24.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-11T16:53:24.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-11T16:53:24.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-11T16:53:24.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-11T16:53:24.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-11T16:53:24.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-11T16:53:24.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-11T16:53:24.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-11T16:53:24.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-11T16:53:24.717 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-11T16:53:24.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-11T16:53:24.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-11T16:53:24.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-11T16:53:24.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-11T16:53:24.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-11T16:53:24.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-11T16:53:24.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-11T16:53:24.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-11T16:53:24.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-11T16:53:24.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-11T16:53:24.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-11T16:53:24.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-11T16:53:24.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-11T16:53:24.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-11T16:53:24.718 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-11T16:53:24.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-11T16:53:24.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-11T16:53:24.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-11T16:53:24.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-11T16:53:24.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-11T16:53:24.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-11T16:53:24.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-11T16:53:24.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-11T16:53:24.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-11T16:53:24.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-11T16:53:24.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-11T16:53:24.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-11T16:53:24.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-11T16:53:24.719 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-11T16:53:24.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-11T16:53:24.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-11T16:53:24.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-11T16:53:24.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-11T16:53:24.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-11T16:53:24.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-11T16:53:24.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-11T16:53:24.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-11T16:53:24.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-11T16:53:24.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-11T16:53:24.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-11T16:53:24.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-11T16:53:24.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-11T16:53:24.720 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-11T16:53:24.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-11T16:53:24.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-11T16:53:24.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-11T16:53:24.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-11T16:53:24.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-11T16:53:24.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-11T16:53:24.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-11T16:53:24.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-11T16:53:24.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-11T16:53:24.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-11T16:53:24.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-11T16:53:24.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-11T16:53:24.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-11T16:53:24.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-11T16:53:24.721 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-11T16:53:24.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-11T16:53:24.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-11T16:53:24.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-11T16:53:24.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-11T16:53:24.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-11T16:53:24.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-11T16:53:24.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-11T16:53:24.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-11T16:53:24.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-11T16:53:24.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-11T16:53:24.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-11T16:53:24.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-11T16:53:24.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-11T16:53:24.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-11T16:53:24.722 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-11T16:53:24.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-11T16:53:24.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-11T16:53:24.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-11T16:53:24.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-11T16:53:24.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-11T16:53:24.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-11T16:53:24.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-11T16:53:24.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-11T16:53:24.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-11T16:53:24.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-11T16:53:24.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-11T16:53:24.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-11T16:53:24.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-11T16:53:24.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-11T16:53:24.723 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-11T16:53:24.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-11T16:53:24.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-11T16:53:24.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-11T16:53:24.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-11T16:53:24.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-11T16:53:24.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-11T16:53:24.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-11T16:53:24.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-11T16:53:24.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-11T16:53:24.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-11T16:53:24.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-11T16:53:24.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-11T16:53:24.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-11T16:53:24.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-11T16:53:24.724 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-11T16:53:24.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-11T16:53:24.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-11T16:53:24.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-11T16:53:24.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-11T16:53:24.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-11T16:53:24.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-11T16:53:24.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-11T16:53:24.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-11T16:53:24.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-11T16:53:24.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-11T16:53:24.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-11T16:53:24.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-11T16:53:24.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-11T16:53:24.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-11T16:53:24.725 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-11T16:53:24.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-11T16:53:24.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-11T16:53:24.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-11T16:53:24.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-11T16:53:24.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-11T16:53:24.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-11T16:53:24.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-11T16:53:24.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-11T16:53:24.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-11T16:53:24.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-11T16:53:24.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-11T16:53:24.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-11T16:53:24.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-11T16:53:24.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-11T16:53:24.726 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-11T16:53:24.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-11T16:53:24.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-11T16:53:24.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-11T16:53:24.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-11T16:53:24.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-11T16:53:24.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-11T16:53:24.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-11T16:53:24.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-11T16:53:24.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-11T16:53:24.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-11T16:53:24.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-11T16:53:24.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-11T16:53:24.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-11T16:53:24.727 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-11T16:53:24.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-11T16:53:24.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-11T16:53:24.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-11T16:53:24.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-11T16:53:24.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-11T16:53:24.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-11T16:53:24.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-11T16:53:24.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-11T16:53:24.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-11T16:53:24.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-11T16:53:24.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-11T16:53:24.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-11T16:53:24.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-11T16:53:24.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-11T16:53:24.728 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-11T16:53:24.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-11T16:53:24.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-11T16:53:24.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-11T16:53:24.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-11T16:53:24.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-11T16:53:24.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-11T16:53:24.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-11T16:53:24.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-11T16:53:24.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-11T16:53:24.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-11T16:53:24.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-11T16:53:24.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-11T16:53:24.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-11T16:53:24.729 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-11T16:53:24.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-11T16:53:24.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-11T16:53:24.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-11T16:53:24.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-11T16:53:24.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-11T16:53:24.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-11T16:53:24.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-11T16:53:24.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-11T16:53:24.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-11T16:53:24.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-11T16:53:24.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-11T16:53:24.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-11T16:53:24.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-11T16:53:24.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-11T16:53:24.730 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-11T16:53:24.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-11T16:53:24.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-11T16:53:24.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-11T16:53:24.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-11T16:53:24.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-11T16:53:24.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-11T16:53:24.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-11T16:53:24.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-11T16:53:24.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-11T16:53:24.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-11T16:53:24.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-11T16:53:24.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-11T16:53:24.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-11T16:53:24.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-11T16:53:24.731 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-11T16:53:24.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-11T16:53:24.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-11T16:53:24.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-11T16:53:24.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-11T16:53:24.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-11T16:53:24.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-11T16:53:24.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-11T16:53:24.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-11T16:53:24.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-11T16:53:24.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-11T16:53:24.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-11T16:53:24.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-11T16:53:24.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-11T16:53:24.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-11T16:53:24.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-11T16:53:24.732 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-11T16:53:24.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-11T16:53:24.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-11T16:53:24.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-11T16:53:24.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-11T16:53:24.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-11T16:53:24.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-11T16:53:24.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-11T16:53:24.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-11T16:53:24.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-11T16:53:24.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-11T16:53:24.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-11T16:53:24.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-11T16:53:24.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-11T16:53:24.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-11T16:53:24.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-11T16:53:24.733 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-11T16:53:24.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-11T16:53:24.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-11T16:53:24.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-11T16:53:24.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-11T16:53:24.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-11T16:53:24.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-11T16:53:24.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-11T16:53:24.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-11T16:53:24.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-11T16:53:24.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-11T16:53:24.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-11T16:53:24.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-11T16:53:24.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-11T16:53:24.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-11T16:53:24.734 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-11T16:53:24.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-11T16:53:24.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-11T16:53:24.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-11T16:53:24.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-11T16:53:24.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-11T16:53:24.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-11T16:53:24.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-11T16:53:24.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-11T16:53:24.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-11T16:53:24.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-11T16:53:24.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-11T16:53:24.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-11T16:53:24.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-11T16:53:24.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-11T16:53:24.735 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-11T16:53:24.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-11T16:53:24.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-11T16:53:24.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-11T16:53:24.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-11T16:53:24.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-11T16:53:24.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-11T16:53:24.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-11T16:53:24.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-11T16:53:24.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-11T16:53:24.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-11T16:53:24.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-11T16:53:24.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-11T16:53:24.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-11T16:53:24.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-11T16:53:24.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-11T16:53:24.736 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-11T16:53:24.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-11T16:53:24.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-11T16:53:24.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-11T16:53:24.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-11T16:53:24.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-11T16:53:24.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-11T16:53:24.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-11T16:53:24.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-11T16:53:24.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-11T16:53:24.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-11T16:53:24.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-11T16:53:24.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-11T16:53:24.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-11T16:53:24.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-11T16:53:24.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-11T16:53:24.737 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-11T16:53:24.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-11T16:53:24.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-11T16:53:24.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-11T16:53:24.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-11T16:53:24.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-11T16:53:24.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-11T16:53:24.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-11T16:53:24.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-11T16:53:24.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-11T16:53:24.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-11T16:53:24.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-11T16:53:24.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-11T16:53:24.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-11T16:53:24.738 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-11T16:53:24.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-11T16:53:24.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-11T16:53:24.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-11T16:53:24.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-11T16:53:24.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-11T16:53:24.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-11T16:53:24.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-11T16:53:24.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-11T16:53:24.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-11T16:53:24.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-11T16:53:24.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-11T16:53:24.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-11T16:53:24.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-11T16:53:24.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-11T16:53:24.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-11T16:53:24.739 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-11T16:53:24.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-11T16:53:24.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-11T16:53:24.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-11T16:53:24.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-11T16:53:24.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-11T16:53:24.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-11T16:53:24.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-11T16:53:24.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-11T16:53:24.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-11T16:53:24.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-11T16:53:24.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-11T16:53:24.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-11T16:53:24.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-11T16:53:24.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-11T16:53:24.740 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-11T16:53:24.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-11T16:53:24.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-11T16:53:24.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-11T16:53:24.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-11T16:53:24.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-11T16:53:24.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-11T16:53:24.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-11T16:53:24.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-11T16:53:24.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-11T16:53:24.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-11T16:53:24.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-11T16:53:24.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-11T16:53:24.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-11T16:53:24.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-11T16:53:24.741 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-11T16:53:24.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-11T16:53:24.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-11T16:53:24.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-11T16:53:24.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-11T16:53:24.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-11T16:53:24.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-11T16:53:24.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-11T16:53:24.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-11T16:53:24.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-11T16:53:24.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-11T16:53:24.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-11T16:53:24.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-11T16:53:24.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-11T16:53:24.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-11T16:53:24.742 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-11T16:53:24.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-11T16:53:24.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-11T16:53:24.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-11T16:53:24.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-11T16:53:24.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-11T16:53:24.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-11T16:53:24.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-11T16:53:24.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-11T16:53:24.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-11T16:53:24.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-11T16:53:24.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-11T16:53:24.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-11T16:53:24.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-11T16:53:24.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-11T16:53:24.743 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-11T16:53:24.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-11T16:53:24.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-11T16:53:24.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-11T16:53:24.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-11T16:53:24.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-11T16:53:24.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-11T16:53:24.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-11T16:53:24.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-11T16:53:24.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-11T16:53:24.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-11T16:53:24.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-11T16:53:24.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-11T16:53:24.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-11T16:53:24.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-11T16:53:24.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-11T16:53:24.744 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-11T16:53:24.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-11T16:53:24.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-11T16:53:24.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-11T16:53:24.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-11T16:53:24.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-11T16:53:24.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-11T16:53:24.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-11T16:53:24.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-11T16:53:24.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-11T16:53:24.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-11T16:53:24.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-11T16:53:24.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-11T16:53:24.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-11T16:53:24.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-11T16:53:24.745 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-11T16:53:24.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-11T16:53:24.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-11T16:53:24.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-11T16:53:24.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-11T16:53:24.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-11T16:53:24.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-11T16:53:24.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-11T16:53:24.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-11T16:53:24.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-11T16:53:24.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-11T16:53:24.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-11T16:53:24.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-11T16:53:24.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-11T16:53:24.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-11T16:53:24.746 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-11T16:53:24.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-11T16:53:24.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-11T16:53:24.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-11T16:53:24.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-11T16:53:24.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-11T16:53:24.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-11T16:53:24.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-11T16:53:24.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-11T16:53:24.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-11T16:53:24.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-11T16:53:24.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-11T16:53:24.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-11T16:53:24.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-11T16:53:24.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-11T16:53:24.747 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-11T16:53:24.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-11T16:53:24.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-11T16:53:24.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-11T16:53:24.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-11T16:53:24.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-11T16:53:24.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-11T16:53:24.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-11T16:53:24.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-11T16:53:24.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-11T16:53:24.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-11T16:53:24.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-11T16:53:24.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-11T16:53:24.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-11T16:53:24.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-11T16:53:24.748 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-11T16:53:24.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-11T16:53:24.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-11T16:53:24.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-11T16:53:24.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-11T16:53:24.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-11T16:53:24.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-11T16:53:24.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-11T16:53:24.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-11T16:53:24.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-11T16:53:24.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-11T16:53:24.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-11T16:53:24.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-11T16:53:24.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-11T16:53:24.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-11T16:53:24.749 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-11T16:53:24.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-11T16:53:24.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-11T16:53:24.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-11T16:53:24.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-11T16:53:24.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-11T16:53:24.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-11T16:53:24.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-11T16:53:24.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-11T16:53:24.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-11T16:53:24.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-11T16:53:24.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-11T16:53:24.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-11T16:53:24.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-11T16:53:24.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-11T16:53:24.750 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-11T16:53:24.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-11T16:53:24.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-11T16:53:24.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-11T16:53:24.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-11T16:53:24.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-11T16:53:24.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-11T16:53:24.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-11T16:53:24.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-11T16:53:24.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-11T16:53:24.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-11T16:53:24.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-11T16:53:24.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-11T16:53:24.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-11T16:53:24.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-11T16:53:24.751 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-11T16:53:24.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-11T16:53:24.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-11T16:53:24.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-11T16:53:24.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-11T16:53:24.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-11T16:53:24.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-11T16:53:24.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-11T16:53:24.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-11T16:53:24.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-11T16:53:24.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-11T16:53:24.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-11T16:53:24.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-11T16:53:24.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-11T16:53:24.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-11T16:53:24.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-11T16:53:24.752 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-11T16:53:24.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-11T16:53:24.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-11T16:53:24.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-11T16:53:24.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-11T16:53:24.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-11T16:53:24.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-11T16:53:24.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-11T16:53:24.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-11T16:53:24.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-11T16:53:24.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-11T16:53:24.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-11T16:53:24.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-11T16:53:24.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-11T16:53:24.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-11T16:53:24.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-11T16:53:24.753 INFO:teuthology.orchestra.run.smithi151.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-11T16:53:24.754 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-11T16:53:24.754 DEBUG:teuthology.orchestra.run.smithi151:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-11T16:53:24.777 INFO:teuthology.orchestra.run.smithi151.stdout:postinstall scriptlet (using /bin/sh): 2023-12-11T16:53:24.777 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-11T16:53:24.777 INFO:teuthology.orchestra.run.smithi151.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-11T16:53:24.778 INFO:teuthology.orchestra.run.smithi151.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-11T16:53:24.778 INFO:teuthology.orchestra.run.smithi151.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-11T16:53:24.778 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-11T16:53:24.778 INFO:teuthology.orchestra.run.smithi151.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-11T16:53:24.778 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2023-12-11T16:53:24.778 INFO:teuthology.orchestra.run.smithi151.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-11T16:53:24.778 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-11T16:53:24.778 INFO:teuthology.orchestra.run.smithi151.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-11T16:53:24.778 INFO:teuthology.orchestra.run.smithi151.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-11T16:53:24.778 INFO:teuthology.orchestra.run.smithi151.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-11T16:53:24.778 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2023-12-11T16:53:24.778 INFO:teuthology.orchestra.run.smithi151.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-11T16:53:24.778 INFO:teuthology.orchestra.run.smithi151.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-11T16:53:24.778 INFO:teuthology.orchestra.run.smithi151.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-11T16:53:24.779 INFO:teuthology.orchestra.run.smithi151.stdout:fi 2023-12-11T16:53:24.779 DEBUG:teuthology.orchestra.run.smithi151:> sudo rpm -qi grub2-tools 2023-12-11T16:53:24.861 INFO:teuthology.orchestra.run.smithi151.stdout:Name : grub2-tools 2023-12-11T16:53:24.861 INFO:teuthology.orchestra.run.smithi151.stdout:Epoch : 1 2023-12-11T16:53:24.861 INFO:teuthology.orchestra.run.smithi151.stdout:Version : 2.06 2023-12-11T16:53:24.861 INFO:teuthology.orchestra.run.smithi151.stdout:Release : 68.el9 2023-12-11T16:53:24.861 INFO:teuthology.orchestra.run.smithi151.stdout:Architecture: x86_64 2023-12-11T16:53:24.861 INFO:teuthology.orchestra.run.smithi151.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-11T16:53:24.861 INFO:teuthology.orchestra.run.smithi151.stdout:Group : Unspecified 2023-12-11T16:53:24.862 INFO:teuthology.orchestra.run.smithi151.stdout:Size : 8264254 2023-12-11T16:53:24.862 INFO:teuthology.orchestra.run.smithi151.stdout:License : GPLv3+ 2023-12-11T16:53:24.862 INFO:teuthology.orchestra.run.smithi151.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-11T16:53:24.862 INFO:teuthology.orchestra.run.smithi151.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-11T16:53:24.862 INFO:teuthology.orchestra.run.smithi151.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-11T16:53:24.862 INFO:teuthology.orchestra.run.smithi151.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-11T16:53:24.862 INFO:teuthology.orchestra.run.smithi151.stdout:Packager : builder@centos.org 2023-12-11T16:53:24.862 INFO:teuthology.orchestra.run.smithi151.stdout:Vendor : CentOS 2023-12-11T16:53:24.862 INFO:teuthology.orchestra.run.smithi151.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-11T16:53:24.862 INFO:teuthology.orchestra.run.smithi151.stdout:Summary : Support tools for GRUB. 2023-12-11T16:53:24.862 INFO:teuthology.orchestra.run.smithi151.stdout:Description : 2023-12-11T16:53:24.862 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T16:53:24.862 INFO:teuthology.orchestra.run.smithi151.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-11T16:53:24.862 INFO:teuthology.orchestra.run.smithi151.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-11T16:53:24.862 INFO:teuthology.orchestra.run.smithi151.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-11T16:53:24.863 INFO:teuthology.orchestra.run.smithi151.stdout:hardware devices. 2023-12-11T16:53:24.863 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T16:53:24.863 INFO:teuthology.orchestra.run.smithi151.stdout:This subpackage provides tools for support of all platforms. 2023-12-11T16:53:24.863 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-11T16:53:24.864 INFO:teuthology.task.kernel:Updating grub on smithi151 to boot 6.6.0-gcd68252d7b4d 2023-12-11T16:53:24.864 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-11T16:53:25.455 INFO:teuthology.orchestra.run.smithi151.stderr:Generating grub configuration file ... 2023-12-11T16:53:26.749 INFO:teuthology.orchestra.run.smithi151.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-11T16:53:26.773 INFO:teuthology.orchestra.run.smithi151.stderr:done 2023-12-11T16:53:26.775 DEBUG:teuthology.orchestra.run.smithi151:> mktemp 2023-12-11T16:53:26.789 INFO:teuthology.orchestra.run.smithi151.stdout:/tmp/tmp.KRkMjWYeOJ 2023-12-11T16:53:26.789 DEBUG:teuthology.orchestra.run.smithi151:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.KRkMjWYeOJ 2023-12-11T16:53:26.868 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0666 /tmp/tmp.KRkMjWYeOJ 2023-12-11T16:53:27.013 DEBUG:teuthology.orchestra.remote:smithi151:/tmp/tmp.KRkMjWYeOJ is 6KB 2023-12-11T16:53:27.033 DEBUG:teuthology.orchestra.run.smithi151:> rm -fr /tmp/tmp.KRkMjWYeOJ 2023-12-11T16:53:27.047 DEBUG:teuthology.orchestra.run.smithi151:> sudo /bin/ls /boot/loader/entries || true 2023-12-11T16:53:27.112 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-11T16:53:27.112 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-11T16:53:27.112 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-11T16:53:27.112 INFO:teuthology.orchestra.run.smithi151.stdout:15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d.conf 2023-12-11T16:53:27.113 DEBUG:teuthology.orchestra.run.smithi151:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d 2023-12-11T16:53:27.265 DEBUG:teuthology.orchestra.run.smithi151:> sudo shutdown -r now 2023-12-11T16:53:27.612 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2023-12-11T16:53:30.010 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-12-11T16:53:30.025 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-12-11T16:53:30.025 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2023-12-11T16:53:30.025 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-12-11T16:53:30.025 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2023-12-11T16:53:30.025 INFO:teuthology.orchestra.run.smithi037.stdout: linux-firmware noarch 20231030-141.el9 CentOS-BaseOS 328 M 2023-12-11T16:53:30.025 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T16:53:30.025 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-12-11T16:53:30.025 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-12-11T16:53:30.026 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 1 Package 2023-12-11T16:53:30.026 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T16:53:30.026 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 328 M 2023-12-11T16:53:30.026 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-12-11T16:53:33.705 INFO:teuthology.orchestra.run.smithi037.stdout:linux-firmware-20231030-141.el9.noarch.rpm 89 MB/s | 328 MB 00:03 2023-12-11T16:53:33.705 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-12-11T16:53:33.706 INFO:teuthology.orchestra.run.smithi037.stdout:Total 89 MB/s | 328 MB 00:03 2023-12-11T16:53:33.706 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-12-11T16:53:33.802 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-12-11T16:53:33.803 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-12-11T16:53:36.034 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-12-11T16:53:36.035 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-12-11T16:53:41.840 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-12-11T16:53:42.160 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-11T16:53:42.254 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-11T16:53:43.103 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: linux-firmware-20230814-139.el9.noarch 2/2 2023-12-11T16:53:43.103 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : linux-firmware-20231030-141.el9.noarch 1/2 2023-12-11T16:53:43.488 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : linux-firmware-20230814-139.el9.noarch 2/2 2023-12-11T16:53:43.489 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T16:53:43.489 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2023-12-11T16:53:43.489 INFO:teuthology.orchestra.run.smithi037.stdout: linux-firmware-20231030-141.el9.noarch 2023-12-11T16:53:43.489 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T16:53:43.489 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-12-11T16:53:43.813 INFO:teuthology.task.kernel:Downloading kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.0... 2023-12-11T16:53:43.814 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=kernel&flavor=default&distros=centos%2F9%2Fx86_64&sha1=cd68252d7b4d7802f3cae7f5945b38e9b20dad4c 2023-12-11T16:53:44.034 INFO:teuthology.task.kernel:fetching, builder baseurl is https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ 2023-12-11T16:53:44.034 DEBUG:teuthology.orchestra.run.smithi037:> rm -f /tmp/kernel.x86_64.rpm && echo kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm | wget -nv -O /tmp/kernel.x86_64.rpm --base=https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/ --input-file=- 2023-12-11T16:53:44.036 DEBUG:teuthology.task.kernel:Waiting for download/copy to ubuntu@smithi037.front.sepia.ceph.com to complete... 2023-12-11T16:53:54.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11 16:53:54 URL:https://4.chacra.ceph.com/r/kernel/testing/cd68252d7b4d7802f3cae7f5945b38e9b20dad4c/centos/9/flavors/default/x86_64/kernel-6.6.0_gcd68252d7b4d-1.x86_64.rpm [321162729/321162729] -> "/tmp/kernel.x86_64.rpm" [1] 2023-12-11T16:53:54.982 INFO:teuthology.orchestra.run.smithi037.stderr:FINISHED --2023-12-11 16:53:54-- 2023-12-11T16:53:54.982 INFO:teuthology.orchestra.run.smithi037.stderr:Total wall clock time: 11s 2023-12-11T16:53:54.982 INFO:teuthology.orchestra.run.smithi037.stderr:Downloaded: 1 files, 306M in 11s (28.8 MB/s) 2023-12-11T16:53:54.985 INFO:teuthology.task.kernel:Installing kernel cd68252d7b4d7802f3cae7f5945b38e9b20dad4c on client.0... 2023-12-11T16:53:54.985 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -ivh --oldpackage --replacefiles --replacepkgs /tmp/kernel.x86_64.rpm 2023-12-11T16:53:56.931 INFO:teuthology.orchestra.run.smithi037.stdout:Verifying... ######################################## 2023-12-11T16:53:56.991 INFO:teuthology.orchestra.run.smithi037.stdout:Preparing... ######################################## 2023-12-11T16:53:57.076 INFO:teuthology.orchestra.run.smithi037.stdout:Updating / installing... 2023-12-11T16:53:57.268 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-12-11T16:53:57.268 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-12-11T16:53:57.269 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T16:54:04.490 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-6.6.0_gcd68252d7b4d-1 ######################################## 2023-12-11T16:54:15.650 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-12-11T16:54:19.808 INFO:teuthology.orchestra.run.smithi037.stderr:dracut: Disabling early microcode, because kernel does not support it. CONFIG_MICROCODE_[AMD|INTEL]!=y 2023-12-11T16:54:24.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-12-11T16:54:24.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T16:54:27.714 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-12-11T16:54:39.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-12-11T16:54:39.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T16:54:41.737 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi037.front.sepia.ceph.com, path=/tmp/kernel.x86_64.rpm, version=None) 2023-12-11T16:54:41.737 DEBUG:teuthology.orchestra.run.smithi037:> rpm -qlp /tmp/kernel.x86_64.rpm 2023-12-11T16:54:41.808 INFO:teuthology.orchestra.run.smithi037.stdout:/boot/System.map-6.6.0-gcd68252d7b4d 2023-12-11T16:54:41.808 INFO:teuthology.orchestra.run.smithi037.stdout:/boot/config-6.6.0-gcd68252d7b4d 2023-12-11T16:54:41.808 INFO:teuthology.orchestra.run.smithi037.stdout:/boot/vmlinuz-6.6.0-gcd68252d7b4d 2023-12-11T16:54:41.809 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d 2023-12-11T16:54:41.809 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel 2023-12-11T16:54:41.809 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch 2023-12-11T16:54:41.809 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86 2023-12-11T16:54:41.809 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto 2023-12-11T16:54:41.809 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/blowfish-x86_64.ko 2023-12-11T16:54:41.809 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx-x86_64.ko 2023-12-11T16:54:41.809 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-aesni-avx2.ko 2023-12-11T16:54:41.809 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/camellia-x86_64.ko 2023-12-11T16:54:41.809 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast5-avx-x86_64.ko 2023-12-11T16:54:41.809 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/cast6-avx-x86_64.ko 2023-12-11T16:54:41.809 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32-pclmul.ko 2023-12-11T16:54:41.809 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crc32c-intel.ko 2023-12-11T16:54:41.809 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/crct10dif-pclmul.ko 2023-12-11T16:54:41.810 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/des3_ede-x86_64.ko 2023-12-11T16:54:41.810 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/ghash-clmulni-intel.ko 2023-12-11T16:54:41.810 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx-x86_64.ko 2023-12-11T16:54:41.810 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-avx2.ko 2023-12-11T16:54:41.810 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/serpent-sse2-x86_64.ko 2023-12-11T16:54:41.810 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha1-ssse3.ko 2023-12-11T16:54:41.810 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha256-ssse3.ko 2023-12-11T16:54:41.810 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/sha512-ssse3.ko 2023-12-11T16:54:41.810 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-avx-x86_64.ko 2023-12-11T16:54:41.810 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64-3way.ko 2023-12-11T16:54:41.810 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/crypto/twofish-x86_64.ko 2023-12-11T16:54:41.810 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel 2023-12-11T16:54:41.810 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu 2023-12-11T16:54:41.810 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce 2023-12-11T16:54:41.811 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kernel/cpu/mce/mce-inject.ko 2023-12-11T16:54:41.811 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm 2023-12-11T16:54:41.811 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-amd.ko 2023-12-11T16:54:41.811 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm-intel.ko 2023-12-11T16:54:41.811 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/arch/x86/kvm/kvm.ko 2023-12-11T16:54:41.811 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto 2023-12-11T16:54:41.811 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ansi_cprng.ko 2023-12-11T16:54:41.811 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/anubis.ko 2023-12-11T16:54:41.811 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/arc4.ko 2023-12-11T16:54:41.811 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx 2023-12-11T16:54:41.811 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_memcpy.ko 2023-12-11T16:54:41.811 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_pq.ko 2023-12-11T16:54:41.811 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_raid6_recov.ko 2023-12-11T16:54:41.811 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_tx.ko 2023-12-11T16:54:41.812 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/async_xor.ko 2023-12-11T16:54:41.812 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/async_tx/raid6test.ko 2023-12-11T16:54:41.812 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authenc.ko 2023-12-11T16:54:41.812 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/authencesn.ko 2023-12-11T16:54:41.812 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blake2b_generic.ko 2023-12-11T16:54:41.812 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_common.ko 2023-12-11T16:54:41.812 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/blowfish_generic.ko 2023-12-11T16:54:41.812 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/camellia_generic.ko 2023-12-11T16:54:41.812 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast5_generic.ko 2023-12-11T16:54:41.812 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast6_generic.ko 2023-12-11T16:54:41.812 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cast_common.ko 2023-12-11T16:54:41.812 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/ccm.ko 2023-12-11T16:54:41.812 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cmac.ko 2023-12-11T16:54:41.812 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crc32_generic.ko 2023-12-11T16:54:41.812 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_engine.ko 2023-12-11T16:54:41.813 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/crypto_user.ko 2023-12-11T16:54:41.813 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/cts.ko 2023-12-11T16:54:41.813 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/des_generic.ko 2023-12-11T16:54:41.813 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/dh_generic.ko 2023-12-11T16:54:41.813 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/echainiv.ko 2023-12-11T16:54:41.813 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/essiv.ko 2023-12-11T16:54:41.813 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/fcrypt.ko 2023-12-11T16:54:41.813 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/khazad.ko 2023-12-11T16:54:41.813 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4.ko 2023-12-11T16:54:41.813 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/lz4hc.ko 2023-12-11T16:54:41.813 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/md4.ko 2023-12-11T16:54:41.813 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/michael_mic.ko 2023-12-11T16:54:41.813 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcbc.ko 2023-12-11T16:54:41.814 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/pcrypt.ko 2023-12-11T16:54:41.814 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/rmd160.ko 2023-12-11T16:54:41.814 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/seed.ko 2023-12-11T16:54:41.814 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/serpent_generic.ko 2023-12-11T16:54:41.814 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tcrypt.ko 2023-12-11T16:54:41.814 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/tea.ko 2023-12-11T16:54:41.814 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_common.ko 2023-12-11T16:54:41.814 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/twofish_generic.ko 2023-12-11T16:54:41.814 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/vmac.ko 2023-12-11T16:54:41.814 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/wp512.ko 2023-12-11T16:54:41.814 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xcbc.ko 2023-12-11T16:54:41.814 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xor.ko 2023-12-11T16:54:41.815 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/crypto/xxhash_generic.ko 2023-12-11T16:54:41.815 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers 2023-12-11T16:54:41.815 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi 2023-12-11T16:54:41.815 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_ipmi.ko 2023-12-11T16:54:41.815 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/acpi_pad.ko 2023-12-11T16:54:41.815 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/custom_method.ko 2023-12-11T16:54:41.815 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/ec_sys.ko 2023-12-11T16:54:41.815 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/platform_profile.ko 2023-12-11T16:54:41.815 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbs.ko 2023-12-11T16:54:41.815 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/sbshc.ko 2023-12-11T16:54:41.815 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/acpi/video.ko 2023-12-11T16:54:41.815 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata 2023-12-11T16:54:41.815 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/acard-ahci.ko 2023-12-11T16:54:41.815 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ahci_platform.ko 2023-12-11T16:54:41.816 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/ata_generic.ko 2023-12-11T16:54:41.816 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/libahci_platform.ko 2023-12-11T16:54:41.816 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_acpi.ko 2023-12-11T16:54:41.816 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ali.ko 2023-12-11T16:54:41.816 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_amd.ko 2023-12-11T16:54:41.816 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_artop.ko 2023-12-11T16:54:41.816 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atiixp.ko 2023-12-11T16:54:41.816 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_atp867x.ko 2023-12-11T16:54:41.816 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd640.ko 2023-12-11T16:54:41.816 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cmd64x.ko 2023-12-11T16:54:41.816 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_cypress.ko 2023-12-11T16:54:41.816 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_efar.ko 2023-12-11T16:54:41.816 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt366.ko 2023-12-11T16:54:41.816 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt37x.ko 2023-12-11T16:54:41.816 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x2n.ko 2023-12-11T16:54:41.817 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_hpt3x3.ko 2023-12-11T16:54:41.817 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it8213.ko 2023-12-11T16:54:41.817 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_it821x.ko 2023-12-11T16:54:41.817 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_jmicron.ko 2023-12-11T16:54:41.817 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_marvell.ko 2023-12-11T16:54:41.817 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_mpiix.ko 2023-12-11T16:54:41.817 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_netcell.ko 2023-12-11T16:54:41.817 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ninja32.ko 2023-12-11T16:54:41.817 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87410.ko 2023-12-11T16:54:41.817 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_ns87415.ko 2023-12-11T16:54:41.817 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_oldpiix.ko 2023-12-11T16:54:41.817 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_opti.ko 2023-12-11T16:54:41.817 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_optidma.ko 2023-12-11T16:54:41.817 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pcmcia.ko 2023-12-11T16:54:41.817 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc2027x.ko 2023-12-11T16:54:41.818 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_pdc202xx_old.ko 2023-12-11T16:54:41.818 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_piccolo.ko 2023-12-11T16:54:41.818 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_rdc.ko 2023-12-11T16:54:41.818 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sch.ko 2023-12-11T16:54:41.818 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_serverworks.ko 2023-12-11T16:54:41.818 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sil680.ko 2023-12-11T16:54:41.818 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sis.ko 2023-12-11T16:54:41.818 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_sl82c105.ko 2023-12-11T16:54:41.818 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_triflex.ko 2023-12-11T16:54:41.818 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pata_via.ko 2023-12-11T16:54:41.818 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/pdc_adma.ko 2023-12-11T16:54:41.819 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_inic162x.ko 2023-12-11T16:54:41.819 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_mv.ko 2023-12-11T16:54:41.819 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_nv.ko 2023-12-11T16:54:41.819 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_promise.ko 2023-12-11T16:54:41.819 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_qstor.ko 2023-12-11T16:54:41.819 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil.ko 2023-12-11T16:54:41.819 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sil24.ko 2023-12-11T16:54:41.819 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sis.ko 2023-12-11T16:54:41.819 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_svw.ko 2023-12-11T16:54:41.819 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_sx4.ko 2023-12-11T16:54:41.819 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_uli.ko 2023-12-11T16:54:41.819 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_via.ko 2023-12-11T16:54:41.819 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ata/sata_vsc.ko 2023-12-11T16:54:41.819 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay 2023-12-11T16:54:41.819 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/auxdisplay/ks0108.ko 2023-12-11T16:54:41.820 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base 2023-12-11T16:54:41.820 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap 2023-12-11T16:54:41.820 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-i2c.ko 2023-12-11T16:54:41.820 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/base/regmap/regmap-mmio.ko 2023-12-11T16:54:41.820 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma 2023-12-11T16:54:41.820 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/bcma/bcma.ko 2023-12-11T16:54:41.820 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block 2023-12-11T16:54:41.820 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe 2023-12-11T16:54:41.820 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/aoe/aoe.ko 2023-12-11T16:54:41.820 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/brd.ko 2023-12-11T16:54:41.820 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd 2023-12-11T16:54:41.820 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/drbd/drbd.ko 2023-12-11T16:54:41.820 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/floppy.ko 2023-12-11T16:54:41.820 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/loop.ko 2023-12-11T16:54:41.820 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx 2023-12-11T16:54:41.821 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/mtip32xx/mtip32xx.ko 2023-12-11T16:54:41.821 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/nbd.ko 2023-12-11T16:54:41.821 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk 2023-12-11T16:54:41.821 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/null_blk/null_blk.ko 2023-12-11T16:54:41.821 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/pktcdvd.ko 2023-12-11T16:54:41.821 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/rbd.ko 2023-12-11T16:54:41.821 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/virtio_blk.ko 2023-12-11T16:54:41.821 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback 2023-12-11T16:54:41.821 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkback/xen-blkback.ko 2023-12-11T16:54:41.821 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/xen-blkfront.ko 2023-12-11T16:54:41.821 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram 2023-12-11T16:54:41.821 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/block/zram/zram.ko 2023-12-11T16:54:41.821 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char 2023-12-11T16:54:41.821 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hangcheck-timer.ko 2023-12-11T16:54:41.822 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random 2023-12-11T16:54:41.822 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/amd-rng.ko 2023-12-11T16:54:41.822 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/intel-rng.ko 2023-12-11T16:54:41.822 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/timeriomem-rng.ko 2023-12-11T16:54:41.822 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/via-rng.ko 2023-12-11T16:54:41.822 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/hw_random/virtio-rng.ko 2023-12-11T16:54:41.822 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi 2023-12-11T16:54:41.822 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_devintf.ko 2023-12-11T16:54:41.822 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_msghandler.ko 2023-12-11T16:54:41.822 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_poweroff.ko 2023-12-11T16:54:41.822 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_si.ko 2023-12-11T16:54:41.822 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_ssif.ko 2023-12-11T16:54:41.822 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ipmi/ipmi_watchdog.ko 2023-12-11T16:54:41.823 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/lp.ko 2023-12-11T16:54:41.823 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave 2023-12-11T16:54:41.823 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/mwave/mwave.ko 2023-12-11T16:54:41.823 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/ppdev.ko 2023-12-11T16:54:41.823 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tlclk.ko 2023-12-11T16:54:41.823 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm 2023-12-11T16:54:41.823 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm.ko 2023-12-11T16:54:41.823 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_atmel.ko 2023-12-11T16:54:41.823 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_infineon.ko 2023-12-11T16:54:41.823 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_nsc.ko 2023-12-11T16:54:41.823 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis.ko 2023-12-11T16:54:41.823 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/tpm/tpm_tis_core.ko 2023-12-11T16:54:41.823 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/uv_mmtimer.ko 2023-12-11T16:54:41.823 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/char/virtio_console.ko 2023-12-11T16:54:41.823 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq 2023-12-11T16:54:41.824 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/acpi-cpufreq.ko 2023-12-11T16:54:41.824 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/amd_freq_sensitivity.ko 2023-12-11T16:54:41.824 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/p4-clockmod.ko 2023-12-11T16:54:41.824 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/pcc-cpufreq.ko 2023-12-11T16:54:41.824 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/powernow-k8.ko 2023-12-11T16:54:41.824 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/cpufreq/speedstep-lib.ko 2023-12-11T16:54:41.824 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto 2023-12-11T16:54:41.824 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp 2023-12-11T16:54:41.824 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp-crypto.ko 2023-12-11T16:54:41.824 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/ccp/ccp.ko 2023-12-11T16:54:41.824 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel 2023-12-11T16:54:41.824 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat 2023-12-11T16:54:41.824 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common 2023-12-11T16:54:41.824 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_common/intel_qat.ko 2023-12-11T16:54:41.824 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc 2023-12-11T16:54:41.825 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/intel/qat/qat_dh895xcc/qat_dh895xcc.ko 2023-12-11T16:54:41.825 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-aes.ko 2023-12-11T16:54:41.825 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/padlock-sha.ko 2023-12-11T16:54:41.825 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio 2023-12-11T16:54:41.825 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/crypto/virtio/virtio_crypto.ko 2023-12-11T16:54:41.825 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca 2023-12-11T16:54:41.825 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dca/dca.ko 2023-12-11T16:54:41.825 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq 2023-12-11T16:54:41.825 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/devfreq/governor_simpleondemand.ko 2023-12-11T16:54:41.825 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma 2023-12-11T16:54:41.825 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw 2023-12-11T16:54:41.825 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/dw/dw_dmac.ko 2023-12-11T16:54:41.825 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat 2023-12-11T16:54:41.825 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/dma/ioat/ioatdma.ko 2023-12-11T16:54:41.825 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac 2023-12-11T16:54:41.825 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/amd64_edac.ko 2023-12-11T16:54:41.826 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/e752x_edac.ko 2023-12-11T16:54:41.826 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/edac_mce_amd.ko 2023-12-11T16:54:41.826 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3000_edac.ko 2023-12-11T16:54:41.826 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i3200_edac.ko 2023-12-11T16:54:41.826 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5100_edac.ko 2023-12-11T16:54:41.826 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i5400_edac.ko 2023-12-11T16:54:41.826 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7300_edac.ko 2023-12-11T16:54:41.826 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i7core_edac.ko 2023-12-11T16:54:41.826 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/i82975x_edac.ko 2023-12-11T16:54:41.826 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/ie31200_edac.ko 2023-12-11T16:54:41.826 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/sb_edac.ko 2023-12-11T16:54:41.826 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/edac/x38_edac.ko 2023-12-11T16:54:41.826 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware 2023-12-11T16:54:41.827 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/edd.ko 2023-12-11T16:54:41.827 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/firmware/iscsi_ibft.ko 2023-12-11T16:54:41.827 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio 2023-12-11T16:54:41.827 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-ich.ko 2023-12-11T16:54:41.827 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/gpio/gpio-viperboard.ko 2023-12-11T16:54:41.827 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid 2023-12-11T16:54:41.827 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-appleir.ko 2023-12-11T16:54:41.827 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-aureal.ko 2023-12-11T16:54:41.827 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-axff.ko 2023-12-11T16:54:41.827 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-dr.ko 2023-12-11T16:54:41.827 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elecom.ko 2023-12-11T16:54:41.827 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-elo.ko 2023-12-11T16:54:41.827 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-emsff.ko 2023-12-11T16:54:41.827 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gaff.ko 2023-12-11T16:54:41.827 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gt683r.ko 2023-12-11T16:54:41.828 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-gyration.ko 2023-12-11T16:54:41.828 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-kbd.ko 2023-12-11T16:54:41.828 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtek-mouse.ko 2023-12-11T16:54:41.828 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-holtekff.ko 2023-12-11T16:54:41.828 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-hyperv.ko 2023-12-11T16:54:41.828 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-icade.ko 2023-12-11T16:54:41.828 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-keytouch.ko 2023-12-11T16:54:41.828 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-kye.ko 2023-12-11T16:54:41.828 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lcpower.ko 2023-12-11T16:54:41.828 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-led.ko 2023-12-11T16:54:41.828 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-lenovo.ko 2023-12-11T16:54:41.828 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-dj.ko 2023-12-11T16:54:41.828 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-logitech-hidpp.ko 2023-12-11T16:54:41.828 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-multitouch.ko 2023-12-11T16:54:41.828 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-ortek.ko 2023-12-11T16:54:41.829 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-penmount.ko 2023-12-11T16:54:41.829 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-petalynx.ko 2023-12-11T16:54:41.829 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-picolcd.ko 2023-12-11T16:54:41.829 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-pl.ko 2023-12-11T16:54:41.829 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-plantronics.ko 2023-12-11T16:54:41.829 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-primax.ko 2023-12-11T16:54:41.829 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-rmi.ko 2023-12-11T16:54:41.829 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-arvo.ko 2023-12-11T16:54:41.829 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-common.ko 2023-12-11T16:54:41.829 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-isku.ko 2023-12-11T16:54:41.829 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kone.ko 2023-12-11T16:54:41.829 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-koneplus.ko 2023-12-11T16:54:41.829 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-konepure.ko 2023-12-11T16:54:41.829 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-kovaplus.ko 2023-12-11T16:54:41.830 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-lua.ko 2023-12-11T16:54:41.830 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-pyra.ko 2023-12-11T16:54:41.830 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-ryos.ko 2023-12-11T16:54:41.830 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat-savu.ko 2023-12-11T16:54:41.830 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-roccat.ko 2023-12-11T16:54:41.830 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-saitek.ko 2023-12-11T16:54:41.830 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-samsung.ko 2023-12-11T16:54:41.830 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sensor-hub.ko 2023-12-11T16:54:41.830 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sjoy.ko 2023-12-11T16:54:41.830 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sony.ko 2023-12-11T16:54:41.830 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-speedlink.ko 2023-12-11T16:54:41.830 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-steelseries.ko 2023-12-11T16:54:41.830 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-sunplus.ko 2023-12-11T16:54:41.830 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-thrustmaster.ko 2023-12-11T16:54:41.831 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tivo.ko 2023-12-11T16:54:41.831 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-tmff.ko 2023-12-11T16:54:41.831 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-topseed.ko 2023-12-11T16:54:41.831 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-twinhan.ko 2023-12-11T16:54:41.831 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-uclogic.ko 2023-12-11T16:54:41.831 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-waltop.ko 2023-12-11T16:54:41.831 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-wiimote.ko 2023-12-11T16:54:41.831 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-xinmo.ko 2023-12-11T16:54:41.831 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zpff.ko 2023-12-11T16:54:41.831 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/hid-zydacron.ko 2023-12-11T16:54:41.831 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/uhid.ko 2023-12-11T16:54:41.831 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hid/wacom.ko 2023-12-11T16:54:41.831 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv 2023-12-11T16:54:41.831 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_balloon.ko 2023-12-11T16:54:41.831 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_utils.ko 2023-12-11T16:54:41.832 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hv/hv_vmbus.ko 2023-12-11T16:54:41.832 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon 2023-12-11T16:54:41.832 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru.ko 2023-12-11T16:54:41.832 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/abituguru3.ko 2023-12-11T16:54:41.832 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/acpi_power_meter.ko 2023-12-11T16:54:41.832 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7414.ko 2023-12-11T16:54:41.832 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ad7418.ko 2023-12-11T16:54:41.832 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adc128d818.ko 2023-12-11T16:54:41.832 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1025.ko 2023-12-11T16:54:41.832 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1026.ko 2023-12-11T16:54:41.832 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1029.ko 2023-12-11T16:54:41.832 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm1031.ko 2023-12-11T16:54:41.832 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adm9240.ko 2023-12-11T16:54:41.832 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ads7828.ko 2023-12-11T16:54:41.832 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7410.ko 2023-12-11T16:54:41.833 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7411.ko 2023-12-11T16:54:41.833 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7462.ko 2023-12-11T16:54:41.833 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7470.ko 2023-12-11T16:54:41.833 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7475.ko 2023-12-11T16:54:41.833 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/adt7x10.ko 2023-12-11T16:54:41.833 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/amc6821.ko 2023-12-11T16:54:41.833 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/applesmc.ko 2023-12-11T16:54:41.833 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asb100.ko 2023-12-11T16:54:41.833 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asc7621.ko 2023-12-11T16:54:41.833 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/asus_atk0110.ko 2023-12-11T16:54:41.833 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/atxp1.ko 2023-12-11T16:54:41.833 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/coretemp.ko 2023-12-11T16:54:41.833 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dell-smm-hwmon.ko 2023-12-11T16:54:41.833 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/dme1737.ko 2023-12-11T16:54:41.834 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds1621.ko 2023-12-11T16:54:41.834 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ds620.ko 2023-12-11T16:54:41.834 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc1403.ko 2023-12-11T16:54:41.834 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/emc6w201.ko 2023-12-11T16:54:41.834 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71805f.ko 2023-12-11T16:54:41.834 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f71882fg.ko 2023-12-11T16:54:41.834 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/f75375s.ko 2023-12-11T16:54:41.834 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fam15h_power.ko 2023-12-11T16:54:41.834 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/fschmd.ko 2023-12-11T16:54:41.834 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g760a.ko 2023-12-11T16:54:41.834 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/g762.ko 2023-12-11T16:54:41.834 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl518sm.ko 2023-12-11T16:54:41.834 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/gl520sm.ko 2023-12-11T16:54:41.834 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/hwmon-vid.ko 2023-12-11T16:54:41.835 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5500_temp.ko 2023-12-11T16:54:41.835 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/i5k_amb.ko 2023-12-11T16:54:41.835 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmaem.ko 2023-12-11T16:54:41.835 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ibmpex.ko 2023-12-11T16:54:41.835 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina209.ko 2023-12-11T16:54:41.835 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ina2xx.ko 2023-12-11T16:54:41.835 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/it87.ko 2023-12-11T16:54:41.835 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k10temp.ko 2023-12-11T16:54:41.835 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/k8temp.ko 2023-12-11T16:54:41.835 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lineage-pem.ko 2023-12-11T16:54:41.835 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm63.ko 2023-12-11T16:54:41.835 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm73.ko 2023-12-11T16:54:41.835 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm75.ko 2023-12-11T16:54:41.835 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm77.ko 2023-12-11T16:54:41.835 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm78.ko 2023-12-11T16:54:41.836 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm80.ko 2023-12-11T16:54:41.836 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm83.ko 2023-12-11T16:54:41.836 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm85.ko 2023-12-11T16:54:41.836 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm87.ko 2023-12-11T16:54:41.836 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm90.ko 2023-12-11T16:54:41.836 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm92.ko 2023-12-11T16:54:41.836 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm93.ko 2023-12-11T16:54:41.836 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95234.ko 2023-12-11T16:54:41.836 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95241.ko 2023-12-11T16:54:41.836 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/lm95245.ko 2023-12-11T16:54:41.836 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc2945.ko 2023-12-11T16:54:41.836 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4151.ko 2023-12-11T16:54:41.836 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4215.ko 2023-12-11T16:54:41.836 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4222.ko 2023-12-11T16:54:41.836 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4245.ko 2023-12-11T16:54:41.837 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4260.ko 2023-12-11T16:54:41.837 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/ltc4261.ko 2023-12-11T16:54:41.837 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max16065.ko 2023-12-11T16:54:41.837 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1619.ko 2023-12-11T16:54:41.837 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max1668.ko 2023-12-11T16:54:41.837 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max197.ko 2023-12-11T16:54:41.837 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6639.ko 2023-12-11T16:54:41.837 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6650.ko 2023-12-11T16:54:41.837 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/max6697.ko 2023-12-11T16:54:41.837 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/mcp3021.ko 2023-12-11T16:54:41.837 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6683.ko 2023-12-11T16:54:41.837 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775-core.ko 2023-12-11T16:54:41.837 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct6775.ko 2023-12-11T16:54:41.838 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/nct7802.ko 2023-12-11T16:54:41.838 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87360.ko 2023-12-11T16:54:41.838 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pc87427.ko 2023-12-11T16:54:41.838 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pcf8591.ko 2023-12-11T16:54:41.838 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus 2023-12-11T16:54:41.838 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/adm1275.ko 2023-12-11T16:54:41.838 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/lm25066.ko 2023-12-11T16:54:41.838 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ltc2978.ko 2023-12-11T16:54:41.838 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max16064.ko 2023-12-11T16:54:41.838 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max34440.ko 2023-12-11T16:54:41.838 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/max8688.ko 2023-12-11T16:54:41.838 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus.ko 2023-12-11T16:54:41.838 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/pmbus_core.ko 2023-12-11T16:54:41.838 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/tps40422.ko 2023-12-11T16:54:41.839 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9000.ko 2023-12-11T16:54:41.839 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/ucd9200.ko 2023-12-11T16:54:41.839 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/pmbus/zl6100.ko 2023-12-11T16:54:41.839 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/powr1220.ko 2023-12-11T16:54:41.839 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5627.ko 2023-12-11T16:54:41.839 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch5636.ko 2023-12-11T16:54:41.839 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sch56xx-common.ko 2023-12-11T16:54:41.839 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht15.ko 2023-12-11T16:54:41.839 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sht21.ko 2023-12-11T16:54:41.839 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/shtc1.ko 2023-12-11T16:54:41.839 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/sis5595.ko 2023-12-11T16:54:41.839 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47b397.ko 2023-12-11T16:54:41.839 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m1.ko 2023-12-11T16:54:41.839 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/smsc47m192.ko 2023-12-11T16:54:41.839 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/thmc50.ko 2023-12-11T16:54:41.839 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp102.ko 2023-12-11T16:54:41.840 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp103.ko 2023-12-11T16:54:41.840 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp401.ko 2023-12-11T16:54:41.840 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/tmp421.ko 2023-12-11T16:54:41.840 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via-cputemp.ko 2023-12-11T16:54:41.840 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/via686a.ko 2023-12-11T16:54:41.840 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt1211.ko 2023-12-11T16:54:41.840 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/vt8231.ko 2023-12-11T16:54:41.840 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627ehf.ko 2023-12-11T16:54:41.840 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83627hf.ko 2023-12-11T16:54:41.840 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83781d.ko 2023-12-11T16:54:41.840 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83791d.ko 2023-12-11T16:54:41.840 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83792d.ko 2023-12-11T16:54:41.840 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83793.ko 2023-12-11T16:54:41.840 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83795.ko 2023-12-11T16:54:41.841 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l785ts.ko 2023-12-11T16:54:41.841 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/hwmon/w83l786ng.ko 2023-12-11T16:54:41.841 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c 2023-12-11T16:54:41.841 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos 2023-12-11T16:54:41.841 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-bit.ko 2023-12-11T16:54:41.841 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/algos/i2c-algo-pca.ko 2023-12-11T16:54:41.841 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses 2023-12-11T16:54:41.841 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756-s4882.ko 2023-12-11T16:54:41.841 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd756.ko 2023-12-11T16:54:41.841 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-amd8111.ko 2023-12-11T16:54:41.841 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ccgx-ucsi.ko 2023-12-11T16:54:41.841 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-core.ko 2023-12-11T16:54:41.841 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-pci.ko 2023-12-11T16:54:41.841 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-designware-platform.ko 2023-12-11T16:54:41.841 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-diolan-u2c.ko 2023-12-11T16:54:41.842 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-i801.ko 2023-12-11T16:54:41.842 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-isch.ko 2023-12-11T16:54:41.842 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-ismt.ko 2023-12-11T16:54:41.842 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2-s4985.ko 2023-12-11T16:54:41.842 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-nforce2.ko 2023-12-11T16:54:41.842 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-parport.ko 2023-12-11T16:54:41.842 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-pca-platform.ko 2023-12-11T16:54:41.842 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-piix4.ko 2023-12-11T16:54:41.842 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-scmi.ko 2023-12-11T16:54:41.842 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-simtec.ko 2023-12-11T16:54:41.842 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-sis96x.ko 2023-12-11T16:54:41.842 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-tiny-usb.ko 2023-12-11T16:54:41.842 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-via.ko 2023-12-11T16:54:41.842 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viapro.ko 2023-12-11T16:54:41.843 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/busses/i2c-viperboard.ko 2023-12-11T16:54:41.843 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-dev.ko 2023-12-11T16:54:41.843 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-mux.ko 2023-12-11T16:54:41.843 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-slave-eeprom.ko 2023-12-11T16:54:41.843 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-smbus.ko 2023-12-11T16:54:41.843 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/i2c/i2c-stub.ko 2023-12-11T16:54:41.843 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband 2023-12-11T16:54:41.843 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core 2023-12-11T16:54:41.843 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_cm.ko 2023-12-11T16:54:41.843 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_core.ko 2023-12-11T16:54:41.843 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_umad.ko 2023-12-11T16:54:41.843 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/ib_uverbs.ko 2023-12-11T16:54:41.843 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/iw_cm.ko 2023-12-11T16:54:41.843 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_cm.ko 2023-12-11T16:54:41.844 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/core/rdma_ucm.ko 2023-12-11T16:54:41.844 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw 2023-12-11T16:54:41.844 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4 2023-12-11T16:54:41.844 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/cxgb4/iw_cxgb4.ko 2023-12-11T16:54:41.844 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4 2023-12-11T16:54:41.844 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx4/mlx4_ib.ko 2023-12-11T16:54:41.844 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5 2023-12-11T16:54:41.844 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mlx5/mlx5_ib.ko 2023-12-11T16:54:41.844 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca 2023-12-11T16:54:41.844 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/hw/mthca/ib_mthca.ko 2023-12-11T16:54:41.844 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp 2023-12-11T16:54:41.844 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib 2023-12-11T16:54:41.844 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/ipoib/ib_ipoib.ko 2023-12-11T16:54:41.844 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser 2023-12-11T16:54:41.844 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/iser/ib_iser.ko 2023-12-11T16:54:41.845 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert 2023-12-11T16:54:41.845 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/isert/ib_isert.ko 2023-12-11T16:54:41.845 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp 2023-12-11T16:54:41.845 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srp/ib_srp.ko 2023-12-11T16:54:41.845 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt 2023-12-11T16:54:41.845 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/infiniband/ulp/srpt/ib_srpt.ko 2023-12-11T16:54:41.845 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input 2023-12-11T16:54:41.845 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport 2023-12-11T16:54:41.845 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/emu10k1-gp.ko 2023-12-11T16:54:41.845 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/fm801-gp.ko 2023-12-11T16:54:41.845 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/gameport/gameport.ko 2023-12-11T16:54:41.845 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/joydev.ko 2023-12-11T16:54:41.845 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard 2023-12-11T16:54:41.845 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/keyboard/gpio_keys.ko 2023-12-11T16:54:41.846 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse 2023-12-11T16:54:41.846 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/appletouch.ko 2023-12-11T16:54:41.846 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/bcm5974.ko 2023-12-11T16:54:41.846 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/cyapatp.ko 2023-12-11T16:54:41.846 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/elan_i2c.ko 2023-12-11T16:54:41.846 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/sermouse.ko 2023-12-11T16:54:41.846 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_i2c.ko 2023-12-11T16:54:41.846 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/synaptics_usb.ko 2023-12-11T16:54:41.846 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/mouse/vsxxxaa.ko 2023-12-11T16:54:41.846 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4 2023-12-11T16:54:41.846 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/rmi4/rmi_core.ko 2023-12-11T16:54:41.846 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio 2023-12-11T16:54:41.846 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/altera_ps2.ko 2023-12-11T16:54:41.846 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/arc_ps2.ko 2023-12-11T16:54:41.847 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/hyperv-keyboard.ko 2023-12-11T16:54:41.847 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/serio/serio_raw.ko 2023-12-11T16:54:41.847 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/input/sparse-keymap.ko 2023-12-11T16:54:41.847 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu 2023-12-11T16:54:41.847 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd 2023-12-11T16:54:41.847 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/iommu/amd/iommu_v2.ko 2023-12-11T16:54:41.847 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds 2023-12-11T16:54:41.847 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-blinkm.ko 2023-12-11T16:54:41.847 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lm3530.ko 2023-12-11T16:54:41.847 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-lp3944.ko 2023-12-11T16:54:41.847 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/leds-ss4200.ko 2023-12-11T16:54:41.847 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger 2023-12-11T16:54:41.847 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-audio.ko 2023-12-11T16:54:41.847 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-backlight.ko 2023-12-11T16:54:41.848 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-camera.ko 2023-12-11T16:54:41.848 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-default-on.ko 2023-12-11T16:54:41.848 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-heartbeat.ko 2023-12-11T16:54:41.848 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-oneshot.ko 2023-12-11T16:54:41.848 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-timer.ko 2023-12-11T16:54:41.848 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/leds/trigger/ledtrig-transient.ko 2023-12-11T16:54:41.848 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md 2023-12-11T16:54:41.848 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache 2023-12-11T16:54:41.848 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/bcache/bcache.ko 2023-12-11T16:54:41.848 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-bio-prison.ko 2023-12-11T16:54:41.848 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache-smq.ko 2023-12-11T16:54:41.848 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-cache.ko 2023-12-11T16:54:41.848 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-crypt.ko 2023-12-11T16:54:41.848 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-delay.ko 2023-12-11T16:54:41.849 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-flakey.ko 2023-12-11T16:54:41.849 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-log-userspace.ko 2023-12-11T16:54:41.849 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-multipath.ko 2023-12-11T16:54:41.849 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-queue-length.ko 2023-12-11T16:54:41.849 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-raid.ko 2023-12-11T16:54:41.849 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-round-robin.ko 2023-12-11T16:54:41.849 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-service-time.ko 2023-12-11T16:54:41.849 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-switch.ko 2023-12-11T16:54:41.849 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-thin-pool.ko 2023-12-11T16:54:41.849 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/dm-verity.ko 2023-12-11T16:54:41.849 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/faulty.ko 2023-12-11T16:54:41.849 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/linear.ko 2023-12-11T16:54:41.849 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/multipath.ko 2023-12-11T16:54:41.849 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data 2023-12-11T16:54:41.849 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/persistent-data/dm-persistent-data.ko 2023-12-11T16:54:41.850 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid0.ko 2023-12-11T16:54:41.850 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid1.ko 2023-12-11T16:54:41.850 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid10.ko 2023-12-11T16:54:41.850 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/md/raid456.ko 2023-12-11T16:54:41.850 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message 2023-12-11T16:54:41.850 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion 2023-12-11T16:54:41.850 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptbase.ko 2023-12-11T16:54:41.850 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptctl.ko 2023-12-11T16:54:41.850 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptfc.ko 2023-12-11T16:54:41.850 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptlan.ko 2023-12-11T16:54:41.850 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptsas.ko 2023-12-11T16:54:41.850 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptscsih.ko 2023-12-11T16:54:41.850 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/message/fusion/mptspi.ko 2023-12-11T16:54:41.850 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd 2023-12-11T16:54:41.850 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_ich.ko 2023-12-11T16:54:41.851 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/lpc_sch.ko 2023-12-11T16:54:41.851 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/mfd-core.ko 2023-12-11T16:54:41.851 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/sm501.ko 2023-12-11T16:54:41.851 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/viperboard.ko 2023-12-11T16:54:41.851 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/vx855.ko 2023-12-11T16:54:41.851 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/mfd/wl1273-core.ko 2023-12-11T16:54:41.851 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc 2023-12-11T16:54:41.851 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl 2023-12-11T16:54:41.851 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/altera-stapl/altera-stapl.ko 2023-12-11T16:54:41.851 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds9802als.ko 2023-12-11T16:54:41.851 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/apds990x.ko 2023-12-11T16:54:41.851 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/bh1770glc.ko 2023-12-11T16:54:41.851 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710 2023-12-11T16:54:41.851 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/cb710/cb710.ko 2023-12-11T16:54:41.852 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom 2023-12-11T16:54:41.852 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/at24.ko 2023-12-11T16:54:41.852 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom.ko 2023-12-11T16:54:41.852 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/eeprom_93cx6.ko 2023-12-11T16:54:41.852 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/eeprom/max6875.ko 2023-12-11T16:54:41.852 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/enclosure.ko 2023-12-11T16:54:41.852 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/hpilo.ko 2023-12-11T16:54:41.852 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29003.ko 2023-12-11T16:54:41.852 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/isl29020.ko 2023-12-11T16:54:41.852 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d 2023-12-11T16:54:41.852 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d.ko 2023-12-11T16:54:41.852 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/lis3lv02d/lis3lv02d_i2c.ko 2023-12-11T16:54:41.852 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei 2023-12-11T16:54:41.852 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-me.ko 2023-12-11T16:54:41.852 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei-txe.ko 2023-12-11T16:54:41.853 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/mei/mei.ko 2023-12-11T16:54:41.853 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru 2023-12-11T16:54:41.853 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-gru/gru.ko 2023-12-11T16:54:41.853 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp 2023-12-11T16:54:41.853 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xp.ko 2023-12-11T16:54:41.853 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpc.ko 2023-12-11T16:54:41.853 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/sgi-xp/xpnet.ko 2023-12-11T16:54:41.853 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_7xx1.ko 2023-12-11T16:54:41.853 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tifm_core.ko 2023-12-11T16:54:41.853 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/tsl2550.ko 2023-12-11T16:54:41.853 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_balloon.ko 2023-12-11T16:54:41.853 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci 2023-12-11T16:54:41.853 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/misc/vmw_vmci/vmw_vmci.ko 2023-12-11T16:54:41.853 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net 2023-12-11T16:54:41.853 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding 2023-12-11T16:54:41.854 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/bonding/bonding.ko 2023-12-11T16:54:41.854 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa 2023-12-11T16:54:41.854 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53 2023-12-11T16:54:41.854 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/b53/b53_common.ko 2023-12-11T16:54:41.854 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/bcm-sf2.ko 2023-12-11T16:54:41.854 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6060.ko 2023-12-11T16:54:41.854 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx 2023-12-11T16:54:41.854 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dsa/mv88e6xxx/mv88e6xxx.ko 2023-12-11T16:54:41.854 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/dummy.ko 2023-12-11T16:54:41.854 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/eql.ko 2023-12-11T16:54:41.854 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet 2023-12-11T16:54:41.854 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com 2023-12-11T16:54:41.854 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c574_cs.ko 2023-12-11T16:54:41.854 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c589_cs.ko 2023-12-11T16:54:41.855 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/3c59x.ko 2023-12-11T16:54:41.855 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/3com/typhoon.ko 2023-12-11T16:54:41.855 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390 2023-12-11T16:54:41.855 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/8390.ko 2023-12-11T16:54:41.855 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/axnet_cs.ko 2023-12-11T16:54:41.855 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/ne2k-pci.ko 2023-12-11T16:54:41.855 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/8390/pcnet_cs.ko 2023-12-11T16:54:41.855 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec 2023-12-11T16:54:41.855 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/adaptec/starfire.ko 2023-12-11T16:54:41.855 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere 2023-12-11T16:54:41.855 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/agere/et131x.ko 2023-12-11T16:54:41.855 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon 2023-12-11T16:54:41.855 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/alteon/acenic.ko 2023-12-11T16:54:41.855 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera 2023-12-11T16:54:41.856 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/altera/altera_tse.ko 2023-12-11T16:54:41.856 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd 2023-12-11T16:54:41.856 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/amd8111e.ko 2023-12-11T16:54:41.856 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/nmclan_cs.ko 2023-12-11T16:54:41.856 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/amd/pcnet32.ko 2023-12-11T16:54:41.856 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros 2023-12-11T16:54:41.856 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx 2023-12-11T16:54:41.856 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/alx/alx.ko 2023-12-11T16:54:41.856 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c 2023-12-11T16:54:41.856 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1c/atl1c.ko 2023-12-11T16:54:41.856 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e 2023-12-11T16:54:41.856 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atl1e/atl1e.ko 2023-12-11T16:54:41.856 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx 2023-12-11T16:54:41.856 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl1.ko 2023-12-11T16:54:41.856 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/atheros/atlx/atl2.ko 2023-12-11T16:54:41.857 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom 2023-12-11T16:54:41.857 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/b44.ko 2023-12-11T16:54:41.857 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2.ko 2023-12-11T16:54:41.857 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x 2023-12-11T16:54:41.857 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/bnx2x/bnx2x.ko 2023-12-11T16:54:41.857 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/cnic.ko 2023-12-11T16:54:41.857 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet 2023-12-11T16:54:41.857 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/genet/genet.ko 2023-12-11T16:54:41.857 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/broadcom/tg3.ko 2023-12-11T16:54:41.857 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade 2023-12-11T16:54:41.857 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna 2023-12-11T16:54:41.857 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/brocade/bna/bna.ko 2023-12-11T16:54:41.857 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio 2023-12-11T16:54:41.857 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb 2023-12-11T16:54:41.857 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb/cxgb.ko 2023-12-11T16:54:41.858 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3 2023-12-11T16:54:41.858 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb3/cxgb3.ko 2023-12-11T16:54:41.858 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4 2023-12-11T16:54:41.858 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4/cxgb4.ko 2023-12-11T16:54:41.858 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf 2023-12-11T16:54:41.858 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/cxgb4vf/cxgb4vf.ko 2023-12-11T16:54:41.858 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb 2023-12-11T16:54:41.858 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/chelsio/libcxgb/libcxgb.ko 2023-12-11T16:54:41.858 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco 2023-12-11T16:54:41.858 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic 2023-12-11T16:54:41.858 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/cisco/enic/enic.ko 2023-12-11T16:54:41.858 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec 2023-12-11T16:54:41.858 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip 2023-12-11T16:54:41.858 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/de2104x.ko 2023-12-11T16:54:41.859 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/dmfe.ko 2023-12-11T16:54:41.859 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/tulip.ko 2023-12-11T16:54:41.859 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/uli526x.ko 2023-12-11T16:54:41.859 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/winbond-840.ko 2023-12-11T16:54:41.859 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dec/tulip/xircom_cb.ko 2023-12-11T16:54:41.859 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink 2023-12-11T16:54:41.859 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/dl2k.ko 2023-12-11T16:54:41.859 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dlink/sundance.ko 2023-12-11T16:54:41.859 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/dnet.ko 2023-12-11T16:54:41.859 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex 2023-12-11T16:54:41.859 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet 2023-12-11T16:54:41.859 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/emulex/benet/be2net.ko 2023-12-11T16:54:41.859 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ethoc.ko 2023-12-11T16:54:41.859 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/fealnx.ko 2023-12-11T16:54:41.859 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel 2023-12-11T16:54:41.860 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e100.ko 2023-12-11T16:54:41.860 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000 2023-12-11T16:54:41.860 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000/e1000.ko 2023-12-11T16:54:41.860 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e 2023-12-11T16:54:41.860 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/e1000e/e1000e.ko 2023-12-11T16:54:41.860 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k 2023-12-11T16:54:41.860 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/fm10k/fm10k.ko 2023-12-11T16:54:41.860 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e 2023-12-11T16:54:41.860 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/i40e/i40e.ko 2023-12-11T16:54:41.860 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf 2023-12-11T16:54:41.860 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/iavf/iavf.ko 2023-12-11T16:54:41.860 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb 2023-12-11T16:54:41.860 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igb/igb.ko 2023-12-11T16:54:41.860 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf 2023-12-11T16:54:41.861 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/igbvf/igbvf.ko 2023-12-11T16:54:41.861 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe 2023-12-11T16:54:41.861 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbe/ixgbe.ko 2023-12-11T16:54:41.861 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf 2023-12-11T16:54:41.861 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/intel/ixgbevf/ixgbevf.ko 2023-12-11T16:54:41.861 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/jme.ko 2023-12-11T16:54:41.861 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell 2023-12-11T16:54:41.861 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/mvmdio.ko 2023-12-11T16:54:41.861 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/skge.ko 2023-12-11T16:54:41.861 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/marvell/sky2.ko 2023-12-11T16:54:41.861 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox 2023-12-11T16:54:41.861 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4 2023-12-11T16:54:41.861 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_core.ko 2023-12-11T16:54:41.861 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx4/mlx4_en.ko 2023-12-11T16:54:41.861 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5 2023-12-11T16:54:41.862 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core 2023-12-11T16:54:41.862 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/mellanox/mlx5/core/mlx5_core.ko 2023-12-11T16:54:41.862 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel 2023-12-11T16:54:41.862 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/micrel/ksz884x.ko 2023-12-11T16:54:41.862 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom 2023-12-11T16:54:41.862 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge 2023-12-11T16:54:41.862 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/myricom/myri10ge/myri10ge.ko 2023-12-11T16:54:41.862 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi 2023-12-11T16:54:41.862 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/natsemi.ko 2023-12-11T16:54:41.862 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/natsemi/ns83820.ko 2023-12-11T16:54:41.862 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion 2023-12-11T16:54:41.862 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/neterion/s2io.ko 2023-12-11T16:54:41.862 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia 2023-12-11T16:54:41.862 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/nvidia/forcedeth.ko 2023-12-11T16:54:41.862 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines 2023-12-11T16:54:41.863 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/hamachi.ko 2023-12-11T16:54:41.863 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/packetengines/yellowfin.ko 2023-12-11T16:54:41.863 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic 2023-12-11T16:54:41.863 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen 2023-12-11T16:54:41.863 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/netxen/netxen_nic.ko 2023-12-11T16:54:41.863 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qla3xxx.ko 2023-12-11T16:54:41.863 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic 2023-12-11T16:54:41.863 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/qlogic/qlcnic/qlcnic.ko 2023-12-11T16:54:41.863 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc 2023-12-11T16:54:41.863 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rdc/r6040.ko 2023-12-11T16:54:41.864 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek 2023-12-11T16:54:41.864 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139cp.ko 2023-12-11T16:54:41.864 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/8139too.ko 2023-12-11T16:54:41.864 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/atp.ko 2023-12-11T16:54:41.864 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/realtek/r8169.ko 2023-12-11T16:54:41.864 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker 2023-12-11T16:54:41.864 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/rocker/rocker.ko 2023-12-11T16:54:41.864 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc 2023-12-11T16:54:41.865 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sfc/sfc.ko 2023-12-11T16:54:41.865 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan 2023-12-11T16:54:41.865 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/silan/sc92031.ko 2023-12-11T16:54:41.865 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis 2023-12-11T16:54:41.865 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis190.ko 2023-12-11T16:54:41.865 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sis/sis900.ko 2023-12-11T16:54:41.865 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc 2023-12-11T16:54:41.865 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/epic100.ko 2023-12-11T16:54:41.865 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smc91c92_cs.ko 2023-12-11T16:54:41.866 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc911x.ko 2023-12-11T16:54:41.866 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/smsc/smsc9420.ko 2023-12-11T16:54:41.866 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro 2023-12-11T16:54:41.866 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac 2023-12-11T16:54:41.866 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/dwmac-intel.ko 2023-12-11T16:54:41.866 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/stmicro/stmmac/stmmac.ko 2023-12-11T16:54:41.866 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun 2023-12-11T16:54:41.866 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/cassini.ko 2023-12-11T16:54:41.866 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/niu.ko 2023-12-11T16:54:41.866 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sungem.ko 2023-12-11T16:54:41.866 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/sun/sunhme.ko 2023-12-11T16:54:41.866 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti 2023-12-11T16:54:41.866 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/tehuti/tehuti.ko 2023-12-11T16:54:41.867 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti 2023-12-11T16:54:41.867 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/ti/tlan.ko 2023-12-11T16:54:41.867 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via 2023-12-11T16:54:41.867 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-rhine.ko 2023-12-11T16:54:41.867 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/via/via-velocity.ko 2023-12-11T16:54:41.867 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet 2023-12-11T16:54:41.867 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5100.ko 2023-12-11T16:54:41.867 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/wiznet/w5300.ko 2023-12-11T16:54:41.867 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom 2023-12-11T16:54:41.867 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ethernet/xircom/xirc2ps_cs.ko 2023-12-11T16:54:41.867 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/geneve.ko 2023-12-11T16:54:41.867 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv 2023-12-11T16:54:41.867 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/hyperv/hv_netvsc.ko 2023-12-11T16:54:41.868 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154 2023-12-11T16:54:41.868 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ieee802154/fakelb.ko 2023-12-11T16:54:41.868 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ifb.ko 2023-12-11T16:54:41.868 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan 2023-12-11T16:54:41.868 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ipvlan/ipvlan.ko 2023-12-11T16:54:41.868 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvlan.ko 2023-12-11T16:54:41.868 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/macvtap.ko 2023-12-11T16:54:41.868 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio 2023-12-11T16:54:41.868 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio.ko 2023-12-11T16:54:41.868 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bcm-unimac.ko 2023-12-11T16:54:41.869 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-bitbang.ko 2023-12-11T16:54:41.869 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mdio/mdio-regmap.ko 2023-12-11T16:54:41.869 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/mii.ko 2023-12-11T16:54:41.869 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/net_failover.ko 2023-12-11T16:54:41.869 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/netconsole.ko 2023-12-11T16:54:41.869 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/nlmon.ko 2023-12-11T16:54:41.869 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs 2023-12-11T16:54:41.869 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs-lynx.ko 2023-12-11T16:54:41.870 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/pcs/pcs_xpcs.ko 2023-12-11T16:54:41.870 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy 2023-12-11T16:54:41.870 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/amd.ko 2023-12-11T16:54:41.870 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-lib.ko 2023-12-11T16:54:41.870 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm-phy-ptp.ko 2023-12-11T16:54:41.870 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm7xxx.ko 2023-12-11T16:54:41.870 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/bcm87xx.ko 2023-12-11T16:54:41.870 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/broadcom.ko 2023-12-11T16:54:41.871 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/cicada.ko 2023-12-11T16:54:41.871 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/davicom.ko 2023-12-11T16:54:41.871 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/dp83640.ko 2023-12-11T16:54:41.871 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/et1011c.ko 2023-12-11T16:54:41.871 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/icplus.ko 2023-12-11T16:54:41.871 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/lxt.ko 2023-12-11T16:54:41.871 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/marvell.ko 2023-12-11T16:54:41.871 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/micrel.ko 2023-12-11T16:54:41.872 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/national.ko 2023-12-11T16:54:41.872 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/phylink.ko 2023-12-11T16:54:41.872 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/qsemi.ko 2023-12-11T16:54:41.872 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/realtek.ko 2023-12-11T16:54:41.872 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/smsc.ko 2023-12-11T16:54:41.872 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/ste10Xp.ko 2023-12-11T16:54:41.872 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/phy/vitesse.ko 2023-12-11T16:54:41.872 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp 2023-12-11T16:54:41.872 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/bsd_comp.ko 2023-12-11T16:54:41.873 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_async.ko 2023-12-11T16:54:41.873 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_deflate.ko 2023-12-11T16:54:41.873 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_generic.ko 2023-12-11T16:54:41.873 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_mppe.ko 2023-12-11T16:54:41.873 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/ppp_synctty.ko 2023-12-11T16:54:41.873 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppoe.ko 2023-12-11T16:54:41.873 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pppox.ko 2023-12-11T16:54:41.873 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/ppp/pptp.ko 2023-12-11T16:54:41.873 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip 2023-12-11T16:54:41.874 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slhc.ko 2023-12-11T16:54:41.874 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/slip/slip.ko 2023-12-11T16:54:41.874 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/sungem_phy.ko 2023-12-11T16:54:41.874 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tap.ko 2023-12-11T16:54:41.874 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team 2023-12-11T16:54:41.874 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team.ko 2023-12-11T16:54:41.874 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_activebackup.ko 2023-12-11T16:54:41.874 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_broadcast.ko 2023-12-11T16:54:41.875 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_loadbalance.ko 2023-12-11T16:54:41.875 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_random.ko 2023-12-11T16:54:41.875 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/team/team_mode_roundrobin.ko 2023-12-11T16:54:41.875 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/tun.ko 2023-12-11T16:54:41.875 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/veth.ko 2023-12-11T16:54:41.875 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/virtio_net.ko 2023-12-11T16:54:41.875 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3 2023-12-11T16:54:41.875 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vmxnet3/vmxnet3.ko 2023-12-11T16:54:41.876 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan 2023-12-11T16:54:41.876 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/vxlan/vxlan.ko 2023-12-11T16:54:41.876 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback 2023-12-11T16:54:41.876 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netback/xen-netback.ko 2023-12-11T16:54:41.876 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/net/xen-netfront.ko 2023-12-11T16:54:41.876 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb 2023-12-11T16:54:41.876 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ntb/ntb.ko 2023-12-11T16:54:41.876 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme 2023-12-11T16:54:41.877 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host 2023-12-11T16:54:41.877 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme-core.ko 2023-12-11T16:54:41.877 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/nvme/host/nvme.ko 2023-12-11T16:54:41.877 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport 2023-12-11T16:54:41.877 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport.ko 2023-12-11T16:54:41.877 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_cs.ko 2023-12-11T16:54:41.877 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_pc.ko 2023-12-11T16:54:41.877 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/parport/parport_serial.ko 2023-12-11T16:54:41.878 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci 2023-12-11T16:54:41.878 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug 2023-12-11T16:54:41.878 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/hotplug/acpiphp_ibm.ko 2023-12-11T16:54:41.878 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie 2023-12-11T16:54:41.878 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/pcie/aer_inject.ko 2023-12-11T16:54:41.878 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pci/xen-pcifront.ko 2023-12-11T16:54:41.878 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia 2023-12-11T16:54:41.879 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/i82092.ko 2023-12-11T16:54:41.879 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/pd6729.ko 2023-12-11T16:54:41.879 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pcmcia/yenta_socket.ko 2023-12-11T16:54:41.879 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl 2023-12-11T16:54:41.879 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel 2023-12-11T16:54:41.879 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pinctrl/intel/pinctrl-cherryview.ko 2023-12-11T16:54:41.880 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform 2023-12-11T16:54:41.880 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86 2023-12-11T16:54:41.880 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acer-wmi.ko 2023-12-11T16:54:41.880 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/acerhdf.ko 2023-12-11T16:54:41.880 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/apple-gmux.ko 2023-12-11T16:54:41.880 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-laptop.ko 2023-12-11T16:54:41.880 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-nb-wmi.ko 2023-12-11T16:54:41.881 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/asus-wmi.ko 2023-12-11T16:54:41.881 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/classmate-laptop.ko 2023-12-11T16:54:41.881 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-laptop.ko 2023-12-11T16:54:41.881 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/eeepc-wmi.ko 2023-12-11T16:54:41.881 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-laptop.ko 2023-12-11T16:54:41.881 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/fujitsu-tablet.ko 2023-12-11T16:54:41.881 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/hdaps.ko 2023-12-11T16:54:41.881 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel 2023-12-11T16:54:41.882 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel/intel-rst.ko 2023-12-11T16:54:41.882 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/intel_ips.ko 2023-12-11T16:54:41.882 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/msi-wmi.ko 2023-12-11T16:54:41.882 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/mxm-wmi.ko 2023-12-11T16:54:41.882 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/panasonic-laptop.ko 2023-12-11T16:54:41.882 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-laptop.ko 2023-12-11T16:54:41.882 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/samsung-q10.ko 2023-12-11T16:54:41.882 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/topstar-laptop.ko 2023-12-11T16:54:41.882 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_bluetooth.ko 2023-12-11T16:54:41.883 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/toshiba_haps.ko 2023-12-11T16:54:41.883 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi-bmof.ko 2023-12-11T16:54:41.883 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/platform/x86/wmi.ko 2023-12-11T16:54:41.883 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap 2023-12-11T16:54:41.883 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_common.ko 2023-12-11T16:54:41.883 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/powercap/intel_rapl_msr.ko 2023-12-11T16:54:41.883 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps 2023-12-11T16:54:41.884 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients 2023-12-11T16:54:41.884 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-gpio.ko 2023-12-11T16:54:41.884 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps-ldisc.ko 2023-12-11T16:54:41.884 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/clients/pps_parport.ko 2023-12-11T16:54:41.884 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/pps/pps_core.ko 2023-12-11T16:54:41.884 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp 2023-12-11T16:54:41.885 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp.ko 2023-12-11T16:54:41.885 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ptp/ptp_kvm.ko 2023-12-11T16:54:41.885 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc 2023-12-11T16:54:41.885 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-bq32k.ko 2023-12-11T16:54:41.885 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1286.ko 2023-12-11T16:54:41.885 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1307.ko 2023-12-11T16:54:41.885 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1374.ko 2023-12-11T16:54:41.886 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1511.ko 2023-12-11T16:54:41.886 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1553.ko 2023-12-11T16:54:41.886 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1672.ko 2023-12-11T16:54:41.886 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds1742.ko 2023-12-11T16:54:41.886 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds2404.ko 2023-12-11T16:54:41.886 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-ds3232.ko 2023-12-11T16:54:41.886 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-em3027.ko 2023-12-11T16:54:41.886 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-fm3130.ko 2023-12-11T16:54:41.887 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl12022.ko 2023-12-11T16:54:41.887 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-isl1208.ko 2023-12-11T16:54:41.887 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m41t80.ko 2023-12-11T16:54:41.887 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t35.ko 2023-12-11T16:54:41.887 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-m48t59.ko 2023-12-11T16:54:41.887 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-max6900.ko 2023-12-11T16:54:41.888 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-msm6242.ko 2023-12-11T16:54:41.888 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf2127.ko 2023-12-11T16:54:41.888 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf85063.ko 2023-12-11T16:54:41.888 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8523.ko 2023-12-11T16:54:41.888 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8563.ko 2023-12-11T16:54:41.888 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-pcf8583.ko 2023-12-11T16:54:41.889 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rp5c01.ko 2023-12-11T16:54:41.889 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rs5c372.ko 2023-12-11T16:54:41.889 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rv3029c2.ko 2023-12-11T16:54:41.889 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8025.ko 2023-12-11T16:54:41.889 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-rx8581.ko 2023-12-11T16:54:41.889 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-stk17ta8.ko 2023-12-11T16:54:41.890 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/rtc/rtc-x1205.ko 2023-12-11T16:54:41.890 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi 2023-12-11T16:54:41.890 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-9xxx.ko 2023-12-11T16:54:41.890 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-sas.ko 2023-12-11T16:54:41.890 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/3w-xxxx.ko 2023-12-11T16:54:41.890 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/BusLogic.ko 2023-12-11T16:54:41.890 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/a100u2w.ko 2023-12-11T16:54:41.891 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid 2023-12-11T16:54:41.891 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aacraid/aacraid.ko 2023-12-11T16:54:41.891 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/advansys.ko 2023-12-11T16:54:41.891 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx 2023-12-11T16:54:41.891 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic79xx.ko 2023-12-11T16:54:41.891 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/aic7xxx/aic7xxx.ko 2023-12-11T16:54:41.892 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/am53c974.ko 2023-12-11T16:54:41.892 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr 2023-12-11T16:54:41.892 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/arcmsr/arcmsr.ko 2023-12-11T16:54:41.892 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/atp870u.ko 2023-12-11T16:54:41.892 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi 2023-12-11T16:54:41.892 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/be2iscsi/be2iscsi.ko 2023-12-11T16:54:41.893 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa 2023-12-11T16:54:41.893 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bfa/bfa.ko 2023-12-11T16:54:41.893 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc 2023-12-11T16:54:41.893 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2fc/bnx2fc.ko 2023-12-11T16:54:41.893 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i 2023-12-11T16:54:41.893 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/bnx2i/bnx2i.ko 2023-12-11T16:54:41.894 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ch.ko 2023-12-11T16:54:41.894 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor 2023-12-11T16:54:41.894 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/csiostor/csiostor.ko 2023-12-11T16:54:41.894 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi 2023-12-11T16:54:41.894 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i 2023-12-11T16:54:41.895 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb3i/cxgb3i.ko 2023-12-11T16:54:41.895 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i 2023-12-11T16:54:41.895 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/cxgb4i/cxgb4i.ko 2023-12-11T16:54:41.895 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/cxgbi/libcxgbi.ko 2023-12-11T16:54:41.895 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dc395x.ko 2023-12-11T16:54:41.895 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler 2023-12-11T16:54:41.895 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_alua.ko 2023-12-11T16:54:41.896 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_emc.ko 2023-12-11T16:54:41.896 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_hp_sw.ko 2023-12-11T16:54:41.896 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/device_handler/scsi_dh_rdac.ko 2023-12-11T16:54:41.896 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/dmx3191d.ko 2023-12-11T16:54:41.896 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r 2023-12-11T16:54:41.896 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esas2r/esas2r.ko 2023-12-11T16:54:41.896 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/esp_scsi.ko 2023-12-11T16:54:41.896 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe 2023-12-11T16:54:41.896 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/fcoe.ko 2023-12-11T16:54:41.897 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fcoe/libfcoe.ko 2023-12-11T16:54:41.897 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic 2023-12-11T16:54:41.897 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/fnic/fnic.ko 2023-12-11T16:54:41.897 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hpsa.ko 2023-12-11T16:54:41.897 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hptiop.ko 2023-12-11T16:54:41.897 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/hv_storvsc.ko 2023-12-11T16:54:41.897 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/initio.ko 2023-12-11T16:54:41.897 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ipr.ko 2023-12-11T16:54:41.898 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ips.ko 2023-12-11T16:54:41.898 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci 2023-12-11T16:54:41.898 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/isci/isci.ko 2023-12-11T16:54:41.898 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_boot_sysfs.ko 2023-12-11T16:54:41.898 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/iscsi_tcp.ko 2023-12-11T16:54:41.898 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc 2023-12-11T16:54:41.898 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libfc/libfc.ko 2023-12-11T16:54:41.898 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi.ko 2023-12-11T16:54:41.898 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libiscsi_tcp.ko 2023-12-11T16:54:41.899 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas 2023-12-11T16:54:41.899 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/libsas/libsas.ko 2023-12-11T16:54:41.899 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc 2023-12-11T16:54:41.899 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/lpfc/lpfc.ko 2023-12-11T16:54:41.899 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid 2023-12-11T16:54:41.899 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid.ko 2023-12-11T16:54:41.899 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mbox.ko 2023-12-11T16:54:41.899 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_mm.ko 2023-12-11T16:54:41.900 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/megaraid/megaraid_sas.ko 2023-12-11T16:54:41.900 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas 2023-12-11T16:54:41.900 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mpt3sas/mpt3sas.ko 2023-12-11T16:54:41.900 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas 2023-12-11T16:54:41.900 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvsas/mvsas.ko 2023-12-11T16:54:41.900 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/mvumi.ko 2023-12-11T16:54:41.900 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001 2023-12-11T16:54:41.900 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pm8001/pm80xx.ko 2023-12-11T16:54:41.900 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/pmcraid.ko 2023-12-11T16:54:41.900 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla1280.ko 2023-12-11T16:54:41.900 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx 2023-12-11T16:54:41.901 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/qla2xxx.ko 2023-12-11T16:54:41.901 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla2xxx/tcm_qla2xxx.ko 2023-12-11T16:54:41.901 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx 2023-12-11T16:54:41.901 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/qla4xxx/qla4xxx.ko 2023-12-11T16:54:41.901 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/raid_class.ko 2023-12-11T16:54:41.901 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_debug.ko 2023-12-11T16:54:41.901 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_fc.ko 2023-12-11T16:54:41.901 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_iscsi.ko 2023-12-11T16:54:41.901 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_sas.ko 2023-12-11T16:54:41.901 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_spi.ko 2023-12-11T16:54:41.901 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/scsi_transport_srp.ko 2023-12-11T16:54:41.901 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/ses.ko 2023-12-11T16:54:41.901 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/st.ko 2023-12-11T16:54:41.901 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/stex.ko 2023-12-11T16:54:41.902 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2 2023-12-11T16:54:41.902 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/sym53c8xx_2/sym53c8xx.ko 2023-12-11T16:54:41.902 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/virtio_scsi.ko 2023-12-11T16:54:41.902 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/vmw_pvscsi.ko 2023-12-11T16:54:41.902 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/scsi/wd719x.ko 2023-12-11T16:54:41.902 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb 2023-12-11T16:54:41.902 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ssb/ssb.ko 2023-12-11T16:54:41.902 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target 2023-12-11T16:54:41.902 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi 2023-12-11T16:54:41.902 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/iscsi/iscsi_target_mod.ko 2023-12-11T16:54:41.902 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback 2023-12-11T16:54:41.902 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/loopback/tcm_loop.ko 2023-12-11T16:54:41.902 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_file.ko 2023-12-11T16:54:41.902 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_iblock.ko 2023-12-11T16:54:41.902 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_mod.ko 2023-12-11T16:54:41.903 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_pscsi.ko 2023-12-11T16:54:41.903 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/target_core_user.ko 2023-12-11T16:54:41.903 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc 2023-12-11T16:54:41.903 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/target/tcm_fc/tcm_fc.ko 2023-12-11T16:54:41.903 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal 2023-12-11T16:54:41.903 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel 2023-12-11T16:54:41.903 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal 2023-12-11T16:54:41.903 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/acpi_thermal_rel.ko 2023-12-11T16:54:41.903 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3400_thermal.ko 2023-12-11T16:54:41.903 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3401_thermal.ko 2023-12-11T16:54:41.903 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3402_thermal.ko 2023-12-11T16:54:41.903 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int3403_thermal.ko 2023-12-11T16:54:41.903 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/int340x_thermal_zone.ko 2023-12-11T16:54:41.903 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device.ko 2023-12-11T16:54:41.904 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci.ko 2023-12-11T16:54:41.904 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_device_pci_legacy.ko 2023-12-11T16:54:41.904 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_mbox.ko 2023-12-11T16:54:41.904 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rapl.ko 2023-12-11T16:54:41.904 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/int340x_thermal/processor_thermal_rfim.ko 2023-12-11T16:54:41.904 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_iosf.ko 2023-12-11T16:54:41.904 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/intel_soc_dts_thermal.ko 2023-12-11T16:54:41.904 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/thermal/intel/x86_pkg_temp_thermal.ko 2023-12-11T16:54:41.904 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty 2023-12-11T16:54:41.904 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless 2023-12-11T16:54:41.904 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/ipwireless/ipwireless.ko 2023-12-11T16:54:41.904 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_gsm.ko 2023-12-11T16:54:41.904 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/n_hdlc.ko 2023-12-11T16:54:41.904 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/nozomi.ko 2023-12-11T16:54:41.904 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial 2023-12-11T16:54:41.905 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250 2023-12-11T16:54:41.905 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/8250/serial_cs.ko 2023-12-11T16:54:41.905 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/arc_uart.ko 2023-12-11T16:54:41.905 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm 2023-12-11T16:54:41.905 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/tty/serial/jsm/jsm.ko 2023-12-11T16:54:41.905 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs 2023-12-11T16:54:41.905 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core 2023-12-11T16:54:41.905 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/core/ufshcd-core.ko 2023-12-11T16:54:41.905 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host 2023-12-11T16:54:41.905 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/ufs/host/ufshcd-pci.ko 2023-12-11T16:54:41.905 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio 2023-12-11T16:54:41.905 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio.ko 2023-12-11T16:54:41.905 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_aec.ko 2023-12-11T16:54:41.905 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_cif.ko 2023-12-11T16:54:41.905 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_pci_generic.ko 2023-12-11T16:54:41.906 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/uio/uio_sercos3.ko 2023-12-11T16:54:41.906 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb 2023-12-11T16:54:41.906 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class 2023-12-11T16:54:41.906 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-acm.ko 2023-12-11T16:54:41.906 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/cdc-wdm.ko 2023-12-11T16:54:41.906 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usblp.ko 2023-12-11T16:54:41.906 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/class/usbtmc.ko 2023-12-11T16:54:41.906 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host 2023-12-11T16:54:41.906 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/host/sl811-hcd.ko 2023-12-11T16:54:41.906 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image 2023-12-11T16:54:41.906 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/mdc800.ko 2023-12-11T16:54:41.906 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/image/microtek.ko 2023-12-11T16:54:41.906 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc 2023-12-11T16:54:41.907 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/adutux.ko 2023-12-11T16:54:41.907 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/appledisplay.ko 2023-12-11T16:54:41.907 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi26.ko 2023-12-11T16:54:41.907 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/emi62.ko 2023-12-11T16:54:41.907 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ezusb.ko 2023-12-11T16:54:41.907 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/idmouse.ko 2023-12-11T16:54:41.907 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/iowarrior.ko 2023-12-11T16:54:41.907 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/isight_firmware.ko 2023-12-11T16:54:41.907 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/ldusb.ko 2023-12-11T16:54:41.907 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/legousbtower.ko 2023-12-11T16:54:41.907 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga 2023-12-11T16:54:41.907 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/sisusbvga/sisusbvga.ko 2023-12-11T16:54:41.907 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/trancevibrator.ko 2023-12-11T16:54:41.907 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usb3503.ko 2023-12-11T16:54:41.907 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usblcd.ko 2023-12-11T16:54:41.908 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/usbsevseg.ko 2023-12-11T16:54:41.908 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/uss720.ko 2023-12-11T16:54:41.908 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/misc/yurex.ko 2023-12-11T16:54:41.908 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy 2023-12-11T16:54:41.908 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/phy/phy-generic.ko 2023-12-11T16:54:41.908 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial 2023-12-11T16:54:41.908 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/aircable.ko 2023-12-11T16:54:41.908 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ark3116.ko 2023-12-11T16:54:41.908 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/belkin_sa.ko 2023-12-11T16:54:41.908 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ch341.ko 2023-12-11T16:54:41.908 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cp210x.ko 2023-12-11T16:54:41.908 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cyberjack.ko 2023-12-11T16:54:41.908 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/cypress_m8.ko 2023-12-11T16:54:41.908 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/digi_acceleport.ko 2023-12-11T16:54:41.908 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/empeg.ko 2023-12-11T16:54:41.908 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ftdi_sio.ko 2023-12-11T16:54:41.909 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/garmin_gps.ko 2023-12-11T16:54:41.909 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_edgeport.ko 2023-12-11T16:54:41.909 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/io_ti.ko 2023-12-11T16:54:41.909 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipaq.ko 2023-12-11T16:54:41.909 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ipw.ko 2023-12-11T16:54:41.909 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ir-usb.ko 2023-12-11T16:54:41.909 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/iuu_phoenix.ko 2023-12-11T16:54:41.909 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan.ko 2023-12-11T16:54:41.909 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/keyspan_pda.ko 2023-12-11T16:54:41.909 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kl5kusb105.ko 2023-12-11T16:54:41.909 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/kobil_sct.ko 2023-12-11T16:54:41.909 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mct_u232.ko 2023-12-11T16:54:41.909 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7720.ko 2023-12-11T16:54:41.910 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/mos7840.ko 2023-12-11T16:54:41.910 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/navman.ko 2023-12-11T16:54:41.910 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/omninet.ko 2023-12-11T16:54:41.910 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/opticon.ko 2023-12-11T16:54:41.910 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/option.ko 2023-12-11T16:54:41.910 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/oti6858.ko 2023-12-11T16:54:41.910 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/pl2303.ko 2023-12-11T16:54:41.910 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcaux.ko 2023-12-11T16:54:41.910 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/qcserial.ko 2023-12-11T16:54:41.910 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/quatech2.ko 2023-12-11T16:54:41.910 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/safe_serial.ko 2023-12-11T16:54:41.910 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/sierra.ko 2023-12-11T16:54:41.910 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/spcp8x5.ko 2023-12-11T16:54:41.910 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ssu100.ko 2023-12-11T16:54:41.911 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/symbolserial.ko 2023-12-11T16:54:41.911 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/ti_usb_3410_5052.ko 2023-12-11T16:54:41.911 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb-serial-simple.ko 2023-12-11T16:54:41.911 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_debug.ko 2023-12-11T16:54:41.911 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/usb_wwan.ko 2023-12-11T16:54:41.911 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/visor.ko 2023-12-11T16:54:41.911 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/whiteheat.ko 2023-12-11T16:54:41.911 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/serial/xsens_mt.ko 2023-12-11T16:54:41.911 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage 2023-12-11T16:54:41.911 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/uas.ko 2023-12-11T16:54:41.911 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-alauda.ko 2023-12-11T16:54:41.911 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-cypress.ko 2023-12-11T16:54:41.911 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-datafab.ko 2023-12-11T16:54:41.911 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-eneub6250.ko 2023-12-11T16:54:41.911 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-freecom.ko 2023-12-11T16:54:41.912 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-isd200.ko 2023-12-11T16:54:41.912 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-jumpshot.ko 2023-12-11T16:54:41.912 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-karma.ko 2023-12-11T16:54:41.912 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-onetouch.ko 2023-12-11T16:54:41.912 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-realtek.ko 2023-12-11T16:54:41.912 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr09.ko 2023-12-11T16:54:41.912 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-sddr55.ko 2023-12-11T16:54:41.912 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/ums-usbat.ko 2023-12-11T16:54:41.912 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/storage/usb-storage.ko 2023-12-11T16:54:41.912 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip 2023-12-11T16:54:41.912 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-core.ko 2023-12-11T16:54:41.912 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/usbip-host.ko 2023-12-11T16:54:41.912 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/usb/usbip/vhci-hcd.ko 2023-12-11T16:54:41.912 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio 2023-12-11T16:54:41.913 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci 2023-12-11T16:54:41.913 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci-core.ko 2023-12-11T16:54:41.913 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/pci/vfio-pci.ko 2023-12-11T16:54:41.913 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio.ko 2023-12-11T16:54:41.913 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vfio/vfio_iommu_type1.ko 2023-12-11T16:54:41.913 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost 2023-12-11T16:54:41.913 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost.ko 2023-12-11T16:54:41.913 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_iotlb.ko 2023-12-11T16:54:41.913 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_net.ko 2023-12-11T16:54:41.913 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/vhost/vhost_scsi.ko 2023-12-11T16:54:41.913 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video 2023-12-11T16:54:41.913 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight 2023-12-11T16:54:41.913 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/apple_bl.ko 2023-12-11T16:54:41.913 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/lcd.ko 2023-12-11T16:54:41.913 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/video/backlight/platform_lcd.ko 2023-12-11T16:54:41.914 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio 2023-12-11T16:54:41.914 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio.ko 2023-12-11T16:54:41.914 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_balloon.ko 2023-12-11T16:54:41.914 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_mmio.ko 2023-12-11T16:54:41.914 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci.ko 2023-12-11T16:54:41.914 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_legacy_dev.ko 2023-12-11T16:54:41.914 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_pci_modern_dev.ko 2023-12-11T16:54:41.914 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/virtio/virtio_ring.ko 2023-12-11T16:54:41.914 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1 2023-12-11T16:54:41.914 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters 2023-12-11T16:54:41.915 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2482.ko 2023-12-11T16:54:41.915 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/masters/ds2490.ko 2023-12-11T16:54:41.915 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves 2023-12-11T16:54:41.915 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2406.ko 2023-12-11T16:54:41.915 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2408.ko 2023-12-11T16:54:41.915 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2413.ko 2023-12-11T16:54:41.915 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2423.ko 2023-12-11T16:54:41.915 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2431.ko 2023-12-11T16:54:41.915 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2433.ko 2023-12-11T16:54:41.915 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2780.ko 2023-12-11T16:54:41.915 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds2781.ko 2023-12-11T16:54:41.915 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_ds28e04.ko 2023-12-11T16:54:41.915 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_smem.ko 2023-12-11T16:54:41.915 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/slaves/w1_therm.ko 2023-12-11T16:54:41.915 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/w1/wire.ko 2023-12-11T16:54:41.916 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog 2023-12-11T16:54:41.916 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim1535_wdt.ko 2023-12-11T16:54:41.916 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/alim7101_wdt.ko 2023-12-11T16:54:41.916 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/f71808e_wdt.ko 2023-12-11T16:54:41.916 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/hpwdt.ko 2023-12-11T16:54:41.916 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/i6300esb.ko 2023-12-11T16:54:41.916 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_vendor_support.ko 2023-12-11T16:54:41.916 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/iTCO_wdt.ko 2023-12-11T16:54:41.916 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ib700wdt.ko 2023-12-11T16:54:41.916 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ibmasr.ko 2023-12-11T16:54:41.916 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/ie6xx_wdt.ko 2023-12-11T16:54:41.916 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it8712f_wdt.ko 2023-12-11T16:54:41.916 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/it87_wdt.ko 2023-12-11T16:54:41.916 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/machzwd.ko 2023-12-11T16:54:41.916 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/nv_tco.ko 2023-12-11T16:54:41.917 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_pci.ko 2023-12-11T16:54:41.917 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/pcwd_usb.ko 2023-12-11T16:54:41.917 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sbc_fitpc2_wdt.ko 2023-12-11T16:54:41.917 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sch311x_wdt.ko 2023-12-11T16:54:41.917 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/softdog.ko 2023-12-11T16:54:41.917 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/sp5100_tco.ko 2023-12-11T16:54:41.917 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/via_wdt.ko 2023-12-11T16:54:41.917 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83627hf_wdt.ko 2023-12-11T16:54:41.917 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83877f_wdt.ko 2023-12-11T16:54:41.917 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/w83977f_wdt.ko 2023-12-11T16:54:41.917 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/wdt_pci.ko 2023-12-11T16:54:41.917 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/watchdog/xen_wdt.ko 2023-12-11T16:54:41.917 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen 2023-12-11T16:54:41.917 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-acpi-processor.ko 2023-12-11T16:54:41.918 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-evtchn.ko 2023-12-11T16:54:41.918 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntalloc.ko 2023-12-11T16:54:41.918 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-gntdev.ko 2023-12-11T16:54:41.918 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback 2023-12-11T16:54:41.918 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-pciback/xen-pciback.ko 2023-12-11T16:54:41.918 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xen-privcmd.ko 2023-12-11T16:54:41.918 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs 2023-12-11T16:54:41.918 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/drivers/xen/xenfs/xenfs.ko 2023-12-11T16:54:41.918 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs 2023-12-11T16:54:41.918 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p 2023-12-11T16:54:41.918 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/9p/9p.ko 2023-12-11T16:54:41.918 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs 2023-12-11T16:54:41.918 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/affs/affs.ko 2023-12-11T16:54:41.918 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs 2023-12-11T16:54:41.918 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/befs/befs.ko 2023-12-11T16:54:41.919 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/binfmt_misc.ko 2023-12-11T16:54:41.919 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs 2023-12-11T16:54:41.919 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/btrfs/btrfs.ko 2023-12-11T16:54:41.919 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles 2023-12-11T16:54:41.919 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cachefiles/cachefiles.ko 2023-12-11T16:54:41.919 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph 2023-12-11T16:54:41.919 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ceph/ceph.ko 2023-12-11T16:54:41.919 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda 2023-12-11T16:54:41.919 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/coda/coda.ko 2023-12-11T16:54:41.919 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs 2023-12-11T16:54:41.919 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/cramfs/cramfs.ko 2023-12-11T16:54:41.919 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm 2023-12-11T16:54:41.919 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/dlm/dlm.ko 2023-12-11T16:54:41.919 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs 2023-12-11T16:54:41.919 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ecryptfs/ecryptfs.ko 2023-12-11T16:54:41.920 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs 2023-12-11T16:54:41.920 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/f2fs/f2fs.ko 2023-12-11T16:54:41.920 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat 2023-12-11T16:54:41.920 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/fat.ko 2023-12-11T16:54:41.920 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/msdos.ko 2023-12-11T16:54:41.920 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fat/vfat.ko 2023-12-11T16:54:41.920 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache 2023-12-11T16:54:41.920 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fscache/fscache.ko 2023-12-11T16:54:41.920 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse 2023-12-11T16:54:41.920 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/cuse.ko 2023-12-11T16:54:41.920 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/fuse/fuse.ko 2023-12-11T16:54:41.920 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2 2023-12-11T16:54:41.920 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/gfs2/gfs2.ko 2023-12-11T16:54:41.920 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs 2023-12-11T16:54:41.921 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfs/hfs.ko 2023-12-11T16:54:41.921 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus 2023-12-11T16:54:41.921 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/hfsplus/hfsplus.ko 2023-12-11T16:54:41.921 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs 2023-12-11T16:54:41.921 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/isofs/isofs.ko 2023-12-11T16:54:41.921 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs 2023-12-11T16:54:41.921 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/jfs/jfs.ko 2023-12-11T16:54:41.921 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd 2023-12-11T16:54:41.921 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/lockd/lockd.ko 2023-12-11T16:54:41.921 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix 2023-12-11T16:54:41.921 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/minix/minix.ko 2023-12-11T16:54:41.921 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs 2023-12-11T16:54:41.921 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/netfs/netfs.ko 2023-12-11T16:54:41.921 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs 2023-12-11T16:54:41.921 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout 2023-12-11T16:54:41.922 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/blocklayout/blocklayoutdriver.ko 2023-12-11T16:54:41.922 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout 2023-12-11T16:54:41.922 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/filelayout/nfs_layout_nfsv41_files.ko 2023-12-11T16:54:41.922 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout 2023-12-11T16:54:41.922 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/flexfilelayout/nfs_layout_flexfiles.ko 2023-12-11T16:54:41.922 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfs.ko 2023-12-11T16:54:41.922 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv3.ko 2023-12-11T16:54:41.922 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs/nfsv4.ko 2023-12-11T16:54:41.922 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common 2023-12-11T16:54:41.922 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/grace.ko 2023-12-11T16:54:41.922 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfs_common/nfs_acl.ko 2023-12-11T16:54:41.922 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd 2023-12-11T16:54:41.922 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nfsd/nfsd.ko 2023-12-11T16:54:41.922 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2 2023-12-11T16:54:41.923 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nilfs2/nilfs2.ko 2023-12-11T16:54:41.923 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls 2023-12-11T16:54:41.923 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-celtic.ko 2023-12-11T16:54:41.923 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-centeuro.ko 2023-12-11T16:54:41.923 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-croatian.ko 2023-12-11T16:54:41.923 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-cyrillic.ko 2023-12-11T16:54:41.923 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-gaelic.ko 2023-12-11T16:54:41.923 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-greek.ko 2023-12-11T16:54:41.923 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-iceland.ko 2023-12-11T16:54:41.923 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-inuit.ko 2023-12-11T16:54:41.923 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-roman.ko 2023-12-11T16:54:41.923 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-romanian.ko 2023-12-11T16:54:41.923 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/mac-turkish.ko 2023-12-11T16:54:41.923 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1250.ko 2023-12-11T16:54:41.923 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1251.ko 2023-12-11T16:54:41.924 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp1255.ko 2023-12-11T16:54:41.924 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp737.ko 2023-12-11T16:54:41.924 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp775.ko 2023-12-11T16:54:41.924 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp850.ko 2023-12-11T16:54:41.924 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp852.ko 2023-12-11T16:54:41.924 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp855.ko 2023-12-11T16:54:41.924 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp857.ko 2023-12-11T16:54:41.924 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp860.ko 2023-12-11T16:54:41.924 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp861.ko 2023-12-11T16:54:41.924 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp862.ko 2023-12-11T16:54:41.924 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp863.ko 2023-12-11T16:54:41.924 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp864.ko 2023-12-11T16:54:41.924 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp865.ko 2023-12-11T16:54:41.924 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp866.ko 2023-12-11T16:54:41.925 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp869.ko 2023-12-11T16:54:41.925 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp874.ko 2023-12-11T16:54:41.925 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp932.ko 2023-12-11T16:54:41.925 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp936.ko 2023-12-11T16:54:41.925 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp949.ko 2023-12-11T16:54:41.925 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_cp950.ko 2023-12-11T16:54:41.925 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_euc-jp.ko 2023-12-11T16:54:41.925 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-1.ko 2023-12-11T16:54:41.925 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-13.ko 2023-12-11T16:54:41.925 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-14.ko 2023-12-11T16:54:41.925 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-15.ko 2023-12-11T16:54:41.925 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-2.ko 2023-12-11T16:54:41.925 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-3.ko 2023-12-11T16:54:41.925 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-4.ko 2023-12-11T16:54:41.925 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-5.ko 2023-12-11T16:54:41.926 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-6.ko 2023-12-11T16:54:41.926 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-7.ko 2023-12-11T16:54:41.926 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_iso8859-9.ko 2023-12-11T16:54:41.926 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-r.ko 2023-12-11T16:54:41.926 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-ru.ko 2023-12-11T16:54:41.926 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_koi8-u.ko 2023-12-11T16:54:41.926 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_ucs2_utils.ko 2023-12-11T16:54:41.926 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/nls/nls_utf8.ko 2023-12-11T16:54:41.926 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2 2023-12-11T16:54:41.926 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster 2023-12-11T16:54:41.929 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/cluster/ocfs2_nodemanager.ko 2023-12-11T16:54:41.929 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm 2023-12-11T16:54:41.929 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlm/ocfs2_dlm.ko 2023-12-11T16:54:41.929 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs 2023-12-11T16:54:41.929 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/dlmfs/ocfs2_dlmfs.ko 2023-12-11T16:54:41.929 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2.ko 2023-12-11T16:54:41.929 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_o2cb.ko 2023-12-11T16:54:41.929 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stack_user.ko 2023-12-11T16:54:41.929 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ocfs2/ocfs2_stackglue.ko 2023-12-11T16:54:41.929 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs 2023-12-11T16:54:41.929 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/overlayfs/overlay.ko 2023-12-11T16:54:41.929 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore 2023-12-11T16:54:41.929 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/pstore/ramoops.ko 2023-12-11T16:54:41.929 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs 2023-12-11T16:54:41.930 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/reiserfs/reiserfs.ko 2023-12-11T16:54:41.930 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs 2023-12-11T16:54:41.930 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/romfs/romfs.ko 2023-12-11T16:54:41.930 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb 2023-12-11T16:54:41.930 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client 2023-12-11T16:54:41.930 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/client/cifs.ko 2023-12-11T16:54:41.930 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common 2023-12-11T16:54:41.930 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_arc4.ko 2023-12-11T16:54:41.930 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/smb/common/cifs_md4.ko 2023-12-11T16:54:41.930 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs 2023-12-11T16:54:41.930 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/squashfs/squashfs.ko 2023-12-11T16:54:41.930 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv 2023-12-11T16:54:41.930 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/sysv/sysv.ko 2023-12-11T16:54:41.930 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf 2023-12-11T16:54:41.930 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/udf/udf.ko 2023-12-11T16:54:41.931 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs 2023-12-11T16:54:41.931 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/ufs/ufs.ko 2023-12-11T16:54:41.931 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs 2023-12-11T16:54:41.931 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/fs/xfs/xfs.ko 2023-12-11T16:54:41.931 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel 2023-12-11T16:54:41.931 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu 2023-12-11T16:54:41.931 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/rcu/rcutorture.ko 2023-12-11T16:54:41.931 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/torture.ko 2023-12-11T16:54:41.931 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace 2023-12-11T16:54:41.931 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/kernel/trace/ring_buffer_benchmark.ko 2023-12-11T16:54:41.931 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib 2023-12-11T16:54:41.931 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/asn1_encoder.ko 2023-12-11T16:54:41.931 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc-itu-t.ko 2023-12-11T16:54:41.931 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crc8.ko 2023-12-11T16:54:41.931 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto 2023-12-11T16:54:41.932 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libarc4.ko 2023-12-11T16:54:41.932 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/crypto/libdes.ko 2023-12-11T16:54:41.932 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/libcrc32c.ko 2023-12-11T16:54:41.932 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lru_cache.ko 2023-12-11T16:54:41.932 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4 2023-12-11T16:54:41.932 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4_compress.ko 2023-12-11T16:54:41.932 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/lz4/lz4hc_compress.ko 2023-12-11T16:54:41.932 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math 2023-12-11T16:54:41.932 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/math/cordic.ko 2023-12-11T16:54:41.932 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6 2023-12-11T16:54:41.932 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/raid6/raid6_pq.ko 2023-12-11T16:54:41.932 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon 2023-12-11T16:54:41.932 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/reed_solomon/reed_solomon.ko 2023-12-11T16:54:41.932 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_bm.ko 2023-12-11T16:54:41.932 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_fsm.ko 2023-12-11T16:54:41.933 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/ts_kmp.ko 2023-12-11T16:54:41.933 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd 2023-12-11T16:54:41.933 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/lib/zstd/zstd_compress.ko 2023-12-11T16:54:41.933 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm 2023-12-11T16:54:41.933 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/mm/hwpoison-inject.ko 2023-12-11T16:54:41.933 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net 2023-12-11T16:54:41.933 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan 2023-12-11T16:54:41.933 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/6lowpan.ko 2023-12-11T16:54:41.933 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_dest.ko 2023-12-11T16:54:41.933 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_fragment.ko 2023-12-11T16:54:41.933 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_hop.ko 2023-12-11T16:54:41.933 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_ipv6.ko 2023-12-11T16:54:41.933 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_mobility.ko 2023-12-11T16:54:41.933 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_routing.ko 2023-12-11T16:54:41.934 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/6lowpan/nhc_udp.ko 2023-12-11T16:54:41.934 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802 2023-12-11T16:54:41.934 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/garp.ko 2023-12-11T16:54:41.934 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/mrp.ko 2023-12-11T16:54:41.934 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/p8022.ko 2023-12-11T16:54:41.934 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/psnap.ko 2023-12-11T16:54:41.934 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/802/stp.ko 2023-12-11T16:54:41.934 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q 2023-12-11T16:54:41.934 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/8021q/8021q.ko 2023-12-11T16:54:41.934 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p 2023-12-11T16:54:41.934 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet.ko 2023-12-11T16:54:41.934 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_fd.ko 2023-12-11T16:54:41.934 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_rdma.ko 2023-12-11T16:54:41.935 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/9p/9pnet_virtio.ko 2023-12-11T16:54:41.935 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv 2023-12-11T16:54:41.935 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/batman-adv/batman-adv.ko 2023-12-11T16:54:41.935 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge 2023-12-11T16:54:41.935 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/br_netfilter.ko 2023-12-11T16:54:41.935 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/bridge.ko 2023-12-11T16:54:41.935 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter 2023-12-11T16:54:41.935 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_802_3.ko 2023-12-11T16:54:41.935 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_among.ko 2023-12-11T16:54:41.935 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arp.ko 2023-12-11T16:54:41.935 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_arpreply.ko 2023-12-11T16:54:41.935 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_dnat.ko 2023-12-11T16:54:41.935 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip.ko 2023-12-11T16:54:41.936 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_ip6.ko 2023-12-11T16:54:41.936 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_limit.ko 2023-12-11T16:54:41.936 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_log.ko 2023-12-11T16:54:41.936 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark.ko 2023-12-11T16:54:41.936 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_mark_m.ko 2023-12-11T16:54:41.936 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_nflog.ko 2023-12-11T16:54:41.936 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_pkttype.ko 2023-12-11T16:54:41.936 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_redirect.ko 2023-12-11T16:54:41.936 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_snat.ko 2023-12-11T16:54:41.937 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_stp.ko 2023-12-11T16:54:41.937 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebt_vlan.ko 2023-12-11T16:54:41.937 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_broute.ko 2023-12-11T16:54:41.937 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_filter.ko 2023-12-11T16:54:41.937 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtable_nat.ko 2023-12-11T16:54:41.937 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/ebtables.ko 2023-12-11T16:54:41.937 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nf_conntrack_bridge.ko 2023-12-11T16:54:41.937 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_meta_bridge.ko 2023-12-11T16:54:41.937 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/bridge/netfilter/nft_reject_bridge.ko 2023-12-11T16:54:41.937 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph 2023-12-11T16:54:41.937 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ceph/libceph.ko 2023-12-11T16:54:41.937 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core 2023-12-11T16:54:41.937 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/failover.ko 2023-12-11T16:54:41.937 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/core/pktgen.ko 2023-12-11T16:54:41.937 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp 2023-12-11T16:54:41.938 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp.ko 2023-12-11T16:54:41.938 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_diag.ko 2023-12-11T16:54:41.938 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv4.ko 2023-12-11T16:54:41.938 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dccp/dccp_ipv6.ko 2023-12-11T16:54:41.938 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver 2023-12-11T16:54:41.938 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dns_resolver/dns_resolver.ko 2023-12-11T16:54:41.938 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa 2023-12-11T16:54:41.938 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/dsa_core.ko 2023-12-11T16:54:41.938 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_brcm.ko 2023-12-11T16:54:41.938 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_dsa.ko 2023-12-11T16:54:41.938 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_none.ko 2023-12-11T16:54:41.938 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/dsa/tag_trailer.ko 2023-12-11T16:54:41.938 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154 2023-12-11T16:54:41.939 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan 2023-12-11T16:54:41.939 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/6lowpan/ieee802154_6lowpan.ko 2023-12-11T16:54:41.939 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154.ko 2023-12-11T16:54:41.939 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ieee802154/ieee802154_socket.ko 2023-12-11T16:54:41.939 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4 2023-12-11T16:54:41.939 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ah4.ko 2023-12-11T16:54:41.939 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/esp4.ko 2023-12-11T16:54:41.939 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/fou.ko 2023-12-11T16:54:41.939 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/gre.ko 2023-12-11T16:54:41.939 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/inet_diag.ko 2023-12-11T16:54:41.939 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_gre.ko 2023-12-11T16:54:41.939 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_tunnel.ko 2023-12-11T16:54:41.939 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ip_vti.ko 2023-12-11T16:54:41.939 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipcomp.ko 2023-12-11T16:54:41.939 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/ipip.ko 2023-12-11T16:54:41.940 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter 2023-12-11T16:54:41.940 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arp_tables.ko 2023-12-11T16:54:41.940 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arpt_mangle.ko 2023-12-11T16:54:41.940 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/arptable_filter.ko 2023-12-11T16:54:41.940 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ECN.ko 2023-12-11T16:54:41.940 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_SYNPROXY.ko 2023-12-11T16:54:41.940 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_ah.ko 2023-12-11T16:54:41.940 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/ipt_rpfilter.ko 2023-12-11T16:54:41.940 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_mangle.ko 2023-12-11T16:54:41.940 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_nat.ko 2023-12-11T16:54:41.940 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_raw.ko 2023-12-11T16:54:41.940 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/iptable_security.ko 2023-12-11T16:54:41.940 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_defrag_ipv4.ko 2023-12-11T16:54:41.940 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_dup_ipv4.ko 2023-12-11T16:54:41.940 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_h323.ko 2023-12-11T16:54:41.941 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_pptp.ko 2023-12-11T16:54:41.941 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_nat_snmp_basic.ko 2023-12-11T16:54:41.941 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_socket_ipv4.ko 2023-12-11T16:54:41.941 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nf_tproxy_ipv4.ko 2023-12-11T16:54:41.941 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_dup_ipv4.ko 2023-12-11T16:54:41.941 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_fib_ipv4.ko 2023-12-11T16:54:41.941 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/netfilter/nft_reject_ipv4.ko 2023-12-11T16:54:41.941 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_bic.ko 2023-12-11T16:54:41.941 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_dctcp.ko 2023-12-11T16:54:41.941 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_diag.ko 2023-12-11T16:54:41.941 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_highspeed.ko 2023-12-11T16:54:41.941 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_htcp.ko 2023-12-11T16:54:41.941 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_hybla.ko 2023-12-11T16:54:41.942 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_illinois.ko 2023-12-11T16:54:41.942 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_lp.ko 2023-12-11T16:54:41.942 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_scalable.ko 2023-12-11T16:54:41.942 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_vegas.ko 2023-12-11T16:54:41.942 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_veno.ko 2023-12-11T16:54:41.942 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_westwood.ko 2023-12-11T16:54:41.942 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tcp_yeah.ko 2023-12-11T16:54:41.942 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/tunnel4.ko 2023-12-11T16:54:41.942 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_diag.ko 2023-12-11T16:54:41.942 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/udp_tunnel.ko 2023-12-11T16:54:41.942 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv4/xfrm4_tunnel.ko 2023-12-11T16:54:41.942 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6 2023-12-11T16:54:41.942 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ah6.ko 2023-12-11T16:54:41.943 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/esp6.ko 2023-12-11T16:54:41.943 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/fou6.ko 2023-12-11T16:54:41.943 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_tunnel.ko 2023-12-11T16:54:41.943 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_udp_tunnel.ko 2023-12-11T16:54:41.943 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ip6_vti.ko 2023-12-11T16:54:41.943 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/ipcomp6.ko 2023-12-11T16:54:41.943 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter 2023-12-11T16:54:41.943 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6_tables.ko 2023-12-11T16:54:41.943 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_REJECT.ko 2023-12-11T16:54:41.943 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_SYNPROXY.ko 2023-12-11T16:54:41.943 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ah.ko 2023-12-11T16:54:41.943 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_eui64.ko 2023-12-11T16:54:41.943 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_frag.ko 2023-12-11T16:54:41.944 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_hbh.ko 2023-12-11T16:54:41.944 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_ipv6header.ko 2023-12-11T16:54:41.944 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_mh.ko 2023-12-11T16:54:41.944 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rpfilter.ko 2023-12-11T16:54:41.944 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6t_rt.ko 2023-12-11T16:54:41.944 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_filter.ko 2023-12-11T16:54:41.944 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_mangle.ko 2023-12-11T16:54:41.944 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_nat.ko 2023-12-11T16:54:41.944 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_raw.ko 2023-12-11T16:54:41.944 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/ip6table_security.ko 2023-12-11T16:54:41.944 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_defrag_ipv6.ko 2023-12-11T16:54:41.944 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_dup_ipv6.ko 2023-12-11T16:54:41.945 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_reject_ipv6.ko 2023-12-11T16:54:41.945 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_socket_ipv6.ko 2023-12-11T16:54:41.945 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nf_tproxy_ipv6.ko 2023-12-11T16:54:41.945 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_dup_ipv6.ko 2023-12-11T16:54:41.945 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_fib_ipv6.ko 2023-12-11T16:54:41.945 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/netfilter/nft_reject_ipv6.ko 2023-12-11T16:54:41.945 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/sit.ko 2023-12-11T16:54:41.945 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/tunnel6.ko 2023-12-11T16:54:41.946 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/ipv6/xfrm6_tunnel.ko 2023-12-11T16:54:41.946 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key 2023-12-11T16:54:41.946 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/key/af_key.ko 2023-12-11T16:54:41.946 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp 2023-12-11T16:54:41.946 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_core.ko 2023-12-11T16:54:41.946 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_debugfs.ko 2023-12-11T16:54:41.946 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_eth.ko 2023-12-11T16:54:41.947 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip.ko 2023-12-11T16:54:41.947 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ip6.ko 2023-12-11T16:54:41.947 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_netlink.ko 2023-12-11T16:54:41.947 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/l2tp/l2tp_ppp.ko 2023-12-11T16:54:41.947 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc 2023-12-11T16:54:41.947 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/llc/llc.ko 2023-12-11T16:54:41.947 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154 2023-12-11T16:54:41.948 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mac802154/mac802154.ko 2023-12-11T16:54:41.948 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls 2023-12-11T16:54:41.948 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/mpls/mpls_gso.ko 2023-12-11T16:54:41.948 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter 2023-12-11T16:54:41.948 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset 2023-12-11T16:54:41.948 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set.ko 2023-12-11T16:54:41.948 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ip.ko 2023-12-11T16:54:41.949 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_ipmac.ko 2023-12-11T16:54:41.949 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_bitmap_port.ko 2023-12-11T16:54:41.949 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ip.ko 2023-12-11T16:54:41.949 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipmark.ko 2023-12-11T16:54:41.949 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipport.ko 2023-12-11T16:54:41.949 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportip.ko 2023-12-11T16:54:41.949 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_ipportnet.ko 2023-12-11T16:54:41.950 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_mac.ko 2023-12-11T16:54:41.950 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_net.ko 2023-12-11T16:54:41.950 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netiface.ko 2023-12-11T16:54:41.950 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netnet.ko 2023-12-11T16:54:41.950 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netport.ko 2023-12-11T16:54:41.950 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_hash_netportnet.ko 2023-12-11T16:54:41.950 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipset/ip_set_list_set.ko 2023-12-11T16:54:41.951 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs 2023-12-11T16:54:41.951 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs.ko 2023-12-11T16:54:41.951 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_dh.ko 2023-12-11T16:54:41.951 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_fo.ko 2023-12-11T16:54:41.951 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_ftp.ko 2023-12-11T16:54:41.951 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblc.ko 2023-12-11T16:54:41.951 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lblcr.ko 2023-12-11T16:54:41.951 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_lc.ko 2023-12-11T16:54:41.951 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_nq.ko 2023-12-11T16:54:41.952 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_pe_sip.ko 2023-12-11T16:54:41.952 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_rr.ko 2023-12-11T16:54:41.952 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sed.ko 2023-12-11T16:54:41.952 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_sh.ko 2023-12-11T16:54:41.952 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wlc.ko 2023-12-11T16:54:41.952 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/ipvs/ip_vs_wrr.ko 2023-12-11T16:54:41.952 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conncount.ko 2023-12-11T16:54:41.953 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack.ko 2023-12-11T16:54:41.953 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_amanda.ko 2023-12-11T16:54:41.953 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_broadcast.ko 2023-12-11T16:54:41.953 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_ftp.ko 2023-12-11T16:54:41.953 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_h323.ko 2023-12-11T16:54:41.953 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_irc.ko 2023-12-11T16:54:41.954 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netbios_ns.ko 2023-12-11T16:54:41.954 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_netlink.ko 2023-12-11T16:54:41.954 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_pptp.ko 2023-12-11T16:54:41.954 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sane.ko 2023-12-11T16:54:41.954 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_sip.ko 2023-12-11T16:54:41.954 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_snmp.ko 2023-12-11T16:54:41.954 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_conntrack_tftp.ko 2023-12-11T16:54:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_dup_netdev.ko 2023-12-11T16:54:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table.ko 2023-12-11T16:54:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_flow_table_inet.ko 2023-12-11T16:54:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_log_syslog.ko 2023-12-11T16:54:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat.ko 2023-12-11T16:54:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_amanda.ko 2023-12-11T16:54:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_ftp.ko 2023-12-11T16:54:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_irc.ko 2023-12-11T16:54:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_sip.ko 2023-12-11T16:54:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_nat_tftp.ko 2023-12-11T16:54:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_synproxy_core.ko 2023-12-11T16:54:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nf_tables.ko 2023-12-11T16:54:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink.ko 2023-12-11T16:54:41.956 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_acct.ko 2023-12-11T16:54:41.956 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_log.ko 2023-12-11T16:54:41.956 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_osf.ko 2023-12-11T16:54:41.956 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nfnetlink_queue.ko 2023-12-11T16:54:41.956 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_chain_nat.ko 2023-12-11T16:54:41.956 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_compat.ko 2023-12-11T16:54:41.956 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_ct.ko 2023-12-11T16:54:41.956 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_dup_netdev.ko 2023-12-11T16:54:41.956 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fib.ko 2023-12-11T16:54:41.956 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_fwd_netdev.ko 2023-12-11T16:54:41.956 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_hash.ko 2023-12-11T16:54:41.956 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_limit.ko 2023-12-11T16:54:41.956 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_log.ko 2023-12-11T16:54:41.956 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_masq.ko 2023-12-11T16:54:41.957 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_nat.ko 2023-12-11T16:54:41.957 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_numgen.ko 2023-12-11T16:54:41.957 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_queue.ko 2023-12-11T16:54:41.957 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_quota.ko 2023-12-11T16:54:41.957 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_redir.ko 2023-12-11T16:54:41.957 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject.ko 2023-12-11T16:54:41.957 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_reject_inet.ko 2023-12-11T16:54:41.957 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_socket.ko 2023-12-11T16:54:41.957 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/nft_tunnel.ko 2023-12-11T16:54:41.957 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_AUDIT.ko 2023-12-11T16:54:41.957 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CHECKSUM.ko 2023-12-11T16:54:41.957 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CLASSIFY.ko 2023-12-11T16:54:41.957 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CONNSECMARK.ko 2023-12-11T16:54:41.957 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_CT.ko 2023-12-11T16:54:41.957 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_DSCP.ko 2023-12-11T16:54:41.958 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HL.ko 2023-12-11T16:54:41.958 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_HMARK.ko 2023-12-11T16:54:41.958 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_IDLETIMER.ko 2023-12-11T16:54:41.958 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LED.ko 2023-12-11T16:54:41.958 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_LOG.ko 2023-12-11T16:54:41.958 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_MASQUERADE.ko 2023-12-11T16:54:41.958 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NETMAP.ko 2023-12-11T16:54:41.958 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFLOG.ko 2023-12-11T16:54:41.958 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_NFQUEUE.ko 2023-12-11T16:54:41.958 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_RATEEST.ko 2023-12-11T16:54:41.958 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_REDIRECT.ko 2023-12-11T16:54:41.958 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_SECMARK.ko 2023-12-11T16:54:41.958 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPMSS.ko 2023-12-11T16:54:41.958 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TCPOPTSTRIP.ko 2023-12-11T16:54:41.959 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TEE.ko 2023-12-11T16:54:41.959 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TPROXY.ko 2023-12-11T16:54:41.959 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_TRACE.ko 2023-12-11T16:54:41.959 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_addrtype.ko 2023-12-11T16:54:41.959 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_bpf.ko 2023-12-11T16:54:41.959 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cgroup.ko 2023-12-11T16:54:41.959 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cluster.ko 2023-12-11T16:54:41.959 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_comment.ko 2023-12-11T16:54:41.959 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connbytes.ko 2023-12-11T16:54:41.959 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlabel.ko 2023-12-11T16:54:41.959 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connlimit.ko 2023-12-11T16:54:41.959 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_connmark.ko 2023-12-11T16:54:41.959 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_conntrack.ko 2023-12-11T16:54:41.959 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_cpu.ko 2023-12-11T16:54:41.959 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dccp.ko 2023-12-11T16:54:41.959 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_devgroup.ko 2023-12-11T16:54:41.960 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_dscp.ko 2023-12-11T16:54:41.960 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ecn.ko 2023-12-11T16:54:41.960 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_esp.ko 2023-12-11T16:54:41.960 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hashlimit.ko 2023-12-11T16:54:41.960 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_helper.ko 2023-12-11T16:54:41.960 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_hl.ko 2023-12-11T16:54:41.960 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipcomp.ko 2023-12-11T16:54:41.960 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_iprange.ko 2023-12-11T16:54:41.960 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_ipvs.ko 2023-12-11T16:54:41.960 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_l2tp.ko 2023-12-11T16:54:41.960 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_length.ko 2023-12-11T16:54:41.960 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_limit.ko 2023-12-11T16:54:41.960 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mac.ko 2023-12-11T16:54:41.960 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_mark.ko 2023-12-11T16:54:41.960 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_multiport.ko 2023-12-11T16:54:41.961 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nat.ko 2023-12-11T16:54:41.961 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_nfacct.ko 2023-12-11T16:54:41.961 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_osf.ko 2023-12-11T16:54:41.961 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_owner.ko 2023-12-11T16:54:41.961 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_physdev.ko 2023-12-11T16:54:41.961 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_pkttype.ko 2023-12-11T16:54:41.961 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_policy.ko 2023-12-11T16:54:41.961 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_quota.ko 2023-12-11T16:54:41.961 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_rateest.ko 2023-12-11T16:54:41.961 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_realm.ko 2023-12-11T16:54:41.961 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_recent.ko 2023-12-11T16:54:41.961 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_sctp.ko 2023-12-11T16:54:41.961 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_set.ko 2023-12-11T16:54:41.961 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_socket.ko 2023-12-11T16:54:41.961 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_state.ko 2023-12-11T16:54:41.962 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_statistic.ko 2023-12-11T16:54:41.962 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_string.ko 2023-12-11T16:54:41.962 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_tcpmss.ko 2023-12-11T16:54:41.962 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_time.ko 2023-12-11T16:54:41.962 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netfilter/xt_u32.ko 2023-12-11T16:54:41.962 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink 2023-12-11T16:54:41.962 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/netlink/netlink_diag.ko 2023-12-11T16:54:41.962 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh 2023-12-11T16:54:41.962 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/nsh/nsh.ko 2023-12-11T16:54:41.962 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch 2023-12-11T16:54:41.962 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/openvswitch.ko 2023-12-11T16:54:41.962 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-geneve.ko 2023-12-11T16:54:41.962 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-gre.ko 2023-12-11T16:54:41.963 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/openvswitch/vport-vxlan.ko 2023-12-11T16:54:41.963 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet 2023-12-11T16:54:41.963 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/packet/af_packet_diag.ko 2023-12-11T16:54:41.963 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds 2023-12-11T16:54:41.963 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds.ko 2023-12-11T16:54:41.963 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_rdma.ko 2023-12-11T16:54:41.963 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/rds/rds_tcp.ko 2023-12-11T16:54:41.963 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched 2023-12-11T16:54:41.963 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_csum.ko 2023-12-11T16:54:41.963 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_gact.ko 2023-12-11T16:54:41.963 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_ipt.ko 2023-12-11T16:54:41.963 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_mirred.ko 2023-12-11T16:54:41.963 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_nat.ko 2023-12-11T16:54:41.963 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_pedit.ko 2023-12-11T16:54:41.963 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_police.ko 2023-12-11T16:54:41.964 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_simple.ko 2023-12-11T16:54:41.964 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_skbedit.ko 2023-12-11T16:54:41.964 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/act_vlan.ko 2023-12-11T16:54:41.964 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_basic.ko 2023-12-11T16:54:41.964 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_bpf.ko 2023-12-11T16:54:41.964 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_flow.ko 2023-12-11T16:54:41.964 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_fw.ko 2023-12-11T16:54:41.964 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_route.ko 2023-12-11T16:54:41.964 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/cls_u32.ko 2023-12-11T16:54:41.964 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_cmp.ko 2023-12-11T16:54:41.965 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_ipset.ko 2023-12-11T16:54:41.965 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_meta.ko 2023-12-11T16:54:41.965 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_nbyte.ko 2023-12-11T16:54:41.965 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_text.ko 2023-12-11T16:54:41.965 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/em_u32.ko 2023-12-11T16:54:41.965 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_choke.ko 2023-12-11T16:54:41.965 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_codel.ko 2023-12-11T16:54:41.965 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_drr.ko 2023-12-11T16:54:41.965 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_fq.ko 2023-12-11T16:54:41.965 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_gred.ko 2023-12-11T16:54:41.965 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hfsc.ko 2023-12-11T16:54:41.965 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_hhf.ko 2023-12-11T16:54:41.965 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_htb.ko 2023-12-11T16:54:41.965 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_ingress.ko 2023-12-11T16:54:41.966 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio.ko 2023-12-11T16:54:41.966 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_mqprio_lib.ko 2023-12-11T16:54:41.966 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_multiq.ko 2023-12-11T16:54:41.966 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_netem.ko 2023-12-11T16:54:41.966 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_pie.ko 2023-12-11T16:54:41.966 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_plug.ko 2023-12-11T16:54:41.966 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_prio.ko 2023-12-11T16:54:41.966 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_qfq.ko 2023-12-11T16:54:41.966 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_red.ko 2023-12-11T16:54:41.966 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfb.ko 2023-12-11T16:54:41.966 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_sfq.ko 2023-12-11T16:54:41.966 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_tbf.ko 2023-12-11T16:54:41.966 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sched/sch_teql.ko 2023-12-11T16:54:41.966 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp 2023-12-11T16:54:41.967 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp.ko 2023-12-11T16:54:41.967 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sctp/sctp_diag.ko 2023-12-11T16:54:41.967 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc 2023-12-11T16:54:41.967 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss 2023-12-11T16:54:41.967 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/auth_rpcgss.ko 2023-12-11T16:54:41.967 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/auth_gss/rpcsec_gss_krb5.ko 2023-12-11T16:54:41.967 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/sunrpc.ko 2023-12-11T16:54:41.967 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma 2023-12-11T16:54:41.967 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/sunrpc/xprtrdma/rpcrdma.ko 2023-12-11T16:54:41.967 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc 2023-12-11T16:54:41.967 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/diag.ko 2023-12-11T16:54:41.967 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/tipc/tipc.ko 2023-12-11T16:54:41.967 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix 2023-12-11T16:54:41.967 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/unix/unix_diag.ko 2023-12-11T16:54:41.968 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock 2023-12-11T16:54:41.968 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_virtio_transport_common.ko 2023-12-11T16:54:41.968 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vmw_vsock_vmci_transport.ko 2023-12-11T16:54:41.968 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock.ko 2023-12-11T16:54:41.968 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_diag.ko 2023-12-11T16:54:41.968 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/vmw_vsock/vsock_loopback.ko 2023-12-11T16:54:41.968 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm 2023-12-11T16:54:41.968 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/net/xfrm/xfrm_ipcomp.ko 2023-12-11T16:54:41.968 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security 2023-12-11T16:54:41.968 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys 2023-12-11T16:54:41.968 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys 2023-12-11T16:54:41.968 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/encrypted-keys/encrypted-keys.ko 2023-12-11T16:54:41.968 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys 2023-12-11T16:54:41.969 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/security/keys/trusted-keys/trusted.ko 2023-12-11T16:54:41.969 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt 2023-12-11T16:54:41.969 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib 2023-12-11T16:54:41.969 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/kernel/virt/lib/irqbypass.ko 2023-12-11T16:54:41.969 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias 2023-12-11T16:54:41.969 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.alias.bin 2023-12-11T16:54:41.969 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin 2023-12-11T16:54:41.969 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.alias.bin 2023-12-11T16:54:41.969 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.bin 2023-12-11T16:54:41.969 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.builtin.modinfo 2023-12-11T16:54:41.969 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep 2023-12-11T16:54:41.970 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.dep.bin 2023-12-11T16:54:41.970 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.devname 2023-12-11T16:54:41.970 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.order 2023-12-11T16:54:41.970 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.softdep 2023-12-11T16:54:41.970 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols 2023-12-11T16:54:41.970 INFO:teuthology.orchestra.run.smithi037.stdout:/lib/modules/6.6.0-gcd68252d7b4d/modules.symbols.bin 2023-12-11T16:54:41.971 DEBUG:teuthology.task.kernel:get_image_version: 6.6.0-gcd68252d7b4d 2023-12-11T16:54:41.971 DEBUG:teuthology.orchestra.run.smithi037:> rpm --scripts -qp /tmp/kernel.x86_64.rpm 2023-12-11T16:54:41.995 INFO:teuthology.orchestra.run.smithi037.stdout:postinstall scriptlet (using /bin/sh): 2023-12-11T16:54:41.995 INFO:teuthology.orchestra.run.smithi037.stdout:if [ -x /sbin/installkernel -a -r /boot/vmlinuz-6.6.0-gcd68252d7b4d -a -r /boot/System.map-6.6.0-gcd68252d7b4d ]; then 2023-12-11T16:54:41.995 INFO:teuthology.orchestra.run.smithi037.stdout:cp /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm 2023-12-11T16:54:41.995 INFO:teuthology.orchestra.run.smithi037.stdout:cp /boot/System.map-6.6.0-gcd68252d7b4d /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-11T16:54:41.995 INFO:teuthology.orchestra.run.smithi037.stdout:rm -f /boot/vmlinuz-6.6.0-gcd68252d7b4d /boot/System.map-6.6.0-gcd68252d7b4d 2023-12-11T16:54:41.995 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/installkernel 6.6.0-gcd68252d7b4d /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-11T16:54:41.995 INFO:teuthology.orchestra.run.smithi037.stdout:rm -f /boot/.vmlinuz-6.6.0-gcd68252d7b4d-rpm /boot/.System.map-6.6.0-gcd68252d7b4d-rpm 2023-12-11T16:54:41.996 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2023-12-11T16:54:41.996 INFO:teuthology.orchestra.run.smithi037.stdout:preuninstall scriptlet (using /bin/sh): 2023-12-11T16:54:41.996 INFO:teuthology.orchestra.run.smithi037.stdout:if [ -x /sbin/new-kernel-pkg ]; then 2023-12-11T16:54:41.996 INFO:teuthology.orchestra.run.smithi037.stdout:new-kernel-pkg --remove 6.6.0-gcd68252d7b4d --rminitrd --initrdfile=/boot/initramfs-6.6.0-gcd68252d7b4d.img 2023-12-11T16:54:41.996 INFO:teuthology.orchestra.run.smithi037.stdout:elif [ -x /usr/bin/kernel-install ]; then 2023-12-11T16:54:41.996 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-install remove 6.6.0-gcd68252d7b4d 2023-12-11T16:54:41.996 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2023-12-11T16:54:41.996 INFO:teuthology.orchestra.run.smithi037.stdout:postuninstall scriptlet (using /bin/sh): 2023-12-11T16:54:41.996 INFO:teuthology.orchestra.run.smithi037.stdout:if [ -x /sbin/update-bootloader ]; then 2023-12-11T16:54:41.996 INFO:teuthology.orchestra.run.smithi037.stdout:/sbin/update-bootloader --remove 6.6.0-gcd68252d7b4d 2023-12-11T16:54:41.996 INFO:teuthology.orchestra.run.smithi037.stdout:fi 2023-12-11T16:54:41.997 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -qi grub2-tools 2023-12-11T16:54:42.077 INFO:teuthology.orchestra.run.smithi037.stdout:Name : grub2-tools 2023-12-11T16:54:42.077 INFO:teuthology.orchestra.run.smithi037.stdout:Epoch : 1 2023-12-11T16:54:42.077 INFO:teuthology.orchestra.run.smithi037.stdout:Version : 2.06 2023-12-11T16:54:42.077 INFO:teuthology.orchestra.run.smithi037.stdout:Release : 68.el9 2023-12-11T16:54:42.077 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: x86_64 2023-12-11T16:54:42.078 INFO:teuthology.orchestra.run.smithi037.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-11T16:54:42.078 INFO:teuthology.orchestra.run.smithi037.stdout:Group : Unspecified 2023-12-11T16:54:42.078 INFO:teuthology.orchestra.run.smithi037.stdout:Size : 8264254 2023-12-11T16:54:42.078 INFO:teuthology.orchestra.run.smithi037.stdout:License : GPLv3+ 2023-12-11T16:54:42.078 INFO:teuthology.orchestra.run.smithi037.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-11T16:54:42.078 INFO:teuthology.orchestra.run.smithi037.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-11T16:54:42.078 INFO:teuthology.orchestra.run.smithi037.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-11T16:54:42.078 INFO:teuthology.orchestra.run.smithi037.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-11T16:54:42.078 INFO:teuthology.orchestra.run.smithi037.stdout:Packager : builder@centos.org 2023-12-11T16:54:42.078 INFO:teuthology.orchestra.run.smithi037.stdout:Vendor : CentOS 2023-12-11T16:54:42.078 INFO:teuthology.orchestra.run.smithi037.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-11T16:54:42.079 INFO:teuthology.orchestra.run.smithi037.stdout:Summary : Support tools for GRUB. 2023-12-11T16:54:42.079 INFO:teuthology.orchestra.run.smithi037.stdout:Description : 2023-12-11T16:54:42.079 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T16:54:42.079 INFO:teuthology.orchestra.run.smithi037.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-11T16:54:42.079 INFO:teuthology.orchestra.run.smithi037.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-11T16:54:42.079 INFO:teuthology.orchestra.run.smithi037.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-11T16:54:42.079 INFO:teuthology.orchestra.run.smithi037.stdout:hardware devices. 2023-12-11T16:54:42.079 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T16:54:42.079 INFO:teuthology.orchestra.run.smithi037.stdout:This subpackage provides tools for support of all platforms. 2023-12-11T16:54:42.080 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-11T16:54:42.080 INFO:teuthology.task.kernel:Updating grub on smithi037 to boot 6.6.0-gcd68252d7b4d 2023-12-11T16:54:42.080 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-11T16:54:42.638 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2023-12-11T16:54:44.132 INFO:teuthology.orchestra.run.smithi037.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-11T16:54:44.166 INFO:teuthology.orchestra.run.smithi037.stderr:done 2023-12-11T16:54:44.168 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2023-12-11T16:54:44.183 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.3RU5hdLQPF 2023-12-11T16:54:44.183 DEBUG:teuthology.orchestra.run.smithi037:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.3RU5hdLQPF 2023-12-11T16:54:44.256 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.3RU5hdLQPF 2023-12-11T16:54:44.409 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.3RU5hdLQPF is 6KB 2023-12-11T16:54:44.461 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.3RU5hdLQPF 2023-12-11T16:54:44.476 DEBUG:teuthology.orchestra.run.smithi037:> sudo /bin/ls /boot/loader/entries || true 2023-12-11T16:54:44.550 INFO:teuthology.orchestra.run.smithi037.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-11T16:54:44.551 INFO:teuthology.orchestra.run.smithi037.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-11T16:54:44.551 INFO:teuthology.orchestra.run.smithi037.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-11T16:54:44.551 INFO:teuthology.orchestra.run.smithi037.stdout:15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d.conf 2023-12-11T16:54:44.552 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-6.6.0-gcd68252d7b4d 2023-12-11T16:54:44.729 DEBUG:teuthology.orchestra.run.smithi037:> sudo shutdown -r now 2023-12-11T16:54:58.146 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-12-11T16:55:13.158 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-12-11T16:55:13.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T16:55:14.733 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-12-11T16:55:14.734 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-12-11T16:55:14.734 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T16:55:16.230 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.151 2023-12-11T16:55:33.218 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-11T16:55:34.232 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-12-11T16:55:34.233 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T16:55:34.716 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-12-11T16:55:35.298 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-12-11T16:55:35.298 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "6.6.0-gcd68252d7b4d"... 2023-12-11T16:55:35.298 DEBUG:teuthology.orchestra.run.smithi151:> uname -r 2023-12-11T16:55:35.342 INFO:teuthology.orchestra.run.smithi151.stdout:6.6.0-gcd68252d7b4d 2023-12-11T16:55:35.342 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-11T16:55:35.342 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-11T16:55:35.342 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-11T16:55:36.343 DEBUG:teuthology.parallel:result is None 2023-12-11T16:55:42.220 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-12-11T16:55:42.220 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T16:56:00.610 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2023-12-11T16:56:12.611 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-12-11T16:56:12.612 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T16:56:14.507 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-12-11T16:56:15.469 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-12-11T16:56:15.469 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "6.6.0-gcd68252d7b4d"... 2023-12-11T16:56:15.469 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2023-12-11T16:56:15.514 INFO:teuthology.orchestra.run.smithi037.stdout:6.6.0-gcd68252d7b4d 2023-12-11T16:56:15.514 DEBUG:teuthology.task.kernel:current kernel version is 6.6.0-gcd68252d7b4d vs 6.6.0-gcd68252d7b4d 2023-12-11T16:56:15.514 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-11T16:56:15.514 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-11T16:56:16.515 DEBUG:teuthology.parallel:result is None 2023-12-11T16:56:16.515 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-11T16:56:16.526 INFO:teuthology.task.internal:Creating test directory... 2023-12-11T16:56:16.527 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-11T16:56:16.540 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-11T16:56:16.599 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-11T16:56:16.606 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-11T16:56:16.638 INFO:teuthology.task.internal:Creating archive directory... 2023-12-11T16:56:16.638 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-11T16:56:16.643 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-11T16:56:16.725 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-11T16:56:16.732 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-11T16:56:16.733 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-11T16:56:16.738 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-11T16:56:16.882 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-11T16:56:16.897 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-11T16:56:16.945 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-11T16:56:16.969 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-11T16:56:16.974 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-11T16:56:16.982 INFO:teuthology.task.internal:Configuring sudo... 2023-12-11T16:56:16.982 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-11T16:56:16.990 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-11T16:56:17.094 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-11T16:56:17.104 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-11T16:56:17.104 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-11T16:56:17.112 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-11T16:56:17.167 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-11T16:56:17.234 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-11T16:56:17.334 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-11T16:56:17.400 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-11T16:56:17.496 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T16:56:17.496 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-11T16:56:17.589 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-11T16:56:17.676 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-11T16:56:17.786 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-11T16:56:17.873 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-11T16:56:17.972 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T16:56:17.972 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-11T16:56:18.070 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2023-12-11T16:56:18.080 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2023-12-11T16:56:18.193 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-11T16:56:18.249 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-11T16:56:18.416 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-11T16:56:18.424 INFO:teuthology.task.internal:Starting timer... 2023-12-11T16:56:18.425 INFO:teuthology.run_tasks:Running task pcp... 2023-12-11T16:56:18.475 INFO:teuthology.run_tasks:Running task selinux... 2023-12-11T16:56:18.515 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2023-12-11T16:56:18.615 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2023-12-11T16:56:18.619 DEBUG:teuthology.orchestra.run.smithi151:> sudo service auditd rotate 2023-12-11T16:56:18.766 INFO:teuthology.orchestra.run.smithi151.stdout:Rotating logs: 2023-12-11T16:56:18.771 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-11T16:56:18.771 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2023-12-11T16:56:18.822 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2023-12-11T16:56:18.823 DEBUG:teuthology.orchestra.run.smithi151:> /usr/sbin/getenforce 2023-12-11T16:56:18.893 INFO:teuthology.orchestra.run.smithi151.stdout:Permissive 2023-12-11T16:56:18.893 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi151.front.sepia.ceph.com': 'permissive'} 2023-12-11T16:56:18.894 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-11T16:56:18.980 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-11T16:56:18.981 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-11T16:56:19.076 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-11T16:56:19.076 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-11T16:56:19.077 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2023-12-11T16:56:19.169 DEBUG:teuthology.orchestra.run.smithi151:> sudo /usr/sbin/setenforce permissive 2023-12-11T16:56:19.287 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-11T16:56:19.297 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2023-12-11T16:56:19.303 INFO:teuthology.repo_utils:Fetching main from origin 2023-12-11T16:56:19.452 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-11T16:56:19.467 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-11T16:56:19.469 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi151.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-11T17:06:42.111 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi151.front.sepia.ceph.com')] 2023-12-11T17:06:42.134 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-12-11T17:06:42.135 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T17:06:42.279 DEBUG:teuthology.orchestra.run.smithi037:> true 2023-12-11T17:06:42.448 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2023-12-11T17:06:42.448 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-12-11T17:06:42.449 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-11T17:06:42.580 DEBUG:teuthology.orchestra.run.smithi151:> true 2023-12-11T17:06:42.742 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2023-12-11T17:06:42.743 INFO:teuthology.run_tasks:Running task clock... 2023-12-11T17:06:42.754 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-11T17:06:42.754 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-11T17:06:42.755 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-11T17:06:42.764 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-11T17:06:42.764 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-11T17:06:42.872 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-11T17:06:42.872 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-11T17:06:42.923 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-11T17:06:42.931 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-11T17:06:43.022 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: ntpd: command not found 2023-12-11T17:06:43.031 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2023-12-11T17:06:43.066 INFO:teuthology.orchestra.run.smithi151.stdout:506 Cannot talk to daemon 2023-12-11T17:06:43.077 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2023-12-11T17:06:43.117 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-11T17:06:43.133 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-11T17:06:43.168 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-11T17:06:43.191 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-11T17:06:43.294 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2023-12-11T17:06:43.303 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-11T17:06:43.303 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2023-12-11T17:06:43.303 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-11T17:06:43.303 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-11T17:06:43.303 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-11T17:06:43.304 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-11T17:06:43.324 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2023-12-11T17:06:43.334 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-11T17:06:43.334 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2023-12-11T17:06:43.334 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-11T17:06:43.334 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-11T17:06:43.335 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-11T17:06:43.335 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-11T17:06:43.336 INFO:teuthology.run_tasks:Running task install... 2023-12-11T17:06:43.345 DEBUG:teuthology.task.install:project ceph 2023-12-11T17:06:43.345 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d'}} 2023-12-11T17:06:43.345 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d'} 2023-12-11T17:06:43.346 INFO:teuthology.task.install:Using flavor: default 2023-12-11T17:06:43.352 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-11T17:06:43.352 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-12-11T17:06:43.352 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'tag': None, 'wait_for_package': False} 2023-12-11T17:06:43.353 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-11T17:06:43.355 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'tag': None, 'wait_for_package': False} 2023-12-11T17:06:43.355 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-11T17:06:43.504 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/9/flavors/default/ 2023-12-11T17:06:43.504 INFO:teuthology.task.install.rpm:Package version is 19.0.0-119.ga62fda73 2023-12-11T17:06:43.507 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/9/flavors/default/ 2023-12-11T17:06:43.507 INFO:teuthology.task.install.rpm:Package version is 19.0.0-119.ga62fda73 2023-12-11T17:06:43.674 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-11T17:06:43.674 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:06:43.674 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-11T17:06:43.685 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/rishabh-2023dec11/a62fda73efba5520d409bb5a21bd8373289dda5d/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-11T17:06:43.686 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:06:43.686 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-11T17:06:43.777 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-11T17:06:43.777 DEBUG:teuthology.orchestra.run.smithi151:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a62fda73efba5520d409bb5a21bd8373289dda5d/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-11T17:06:43.799 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-11T17:06:43.799 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/a62fda73efba5520d409bb5a21bd8373289dda5d/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-11T17:06:43.920 DEBUG:teuthology.orchestra.run.smithi151:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-11T17:06:43.951 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-11T17:06:44.053 DEBUG:teuthology.orchestra.run.smithi151:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-11T17:06:44.096 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-11T17:06:44.145 INFO:teuthology.orchestra.run.smithi151.stdout:check_obsoletes = 1 2023-12-11T17:06:44.149 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum clean all 2023-12-11T17:06:44.189 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2023-12-11T17:06:44.194 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2023-12-11T17:06:44.509 INFO:teuthology.orchestra.run.smithi151.stdout:73 files removed 2023-12-11T17:06:44.548 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-11T17:06:44.565 INFO:teuthology.orchestra.run.smithi037.stdout:73 files removed 2023-12-11T17:06:44.604 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-11T17:06:45.520 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 198 kB/s | 78 kB 00:00 2023-12-11T17:06:45.533 INFO:teuthology.orchestra.run.smithi151.stdout:ceph packages for x86_64 166 kB/s | 78 kB 00:00 2023-12-11T17:06:46.050 INFO:teuthology.orchestra.run.smithi151.stdout:ceph noarch packages 22 kB/s | 9.5 kB 00:00 2023-12-11T17:06:46.088 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 20 kB/s | 9.5 kB 00:00 2023-12-11T17:06:46.600 INFO:teuthology.orchestra.run.smithi151.stdout:ceph source packages 3.9 kB/s | 1.9 kB 00:00 2023-12-11T17:06:46.696 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 3.5 kB/s | 1.9 kB 00:00 2023-12-11T17:06:47.156 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - AppStream 13 MB/s | 6.4 MB 00:00 2023-12-11T17:06:47.334 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-9 - AppStream 11 MB/s | 6.4 MB 00:00 2023-12-11T17:06:48.732 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS-9 - BaseOS 6.3 MB/s | 2.0 MB 00:00 2023-12-11T17:06:49.150 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS-9 - BaseOS 4.1 MB/s | 2.0 MB 00:00 2023-12-11T17:06:50.190 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 7.9 MB 00:00 2023-12-11T17:06:51.803 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - BaseOS 2.9 MB/s | 7.9 MB 00:02 2023-12-11T17:06:52.449 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 19 MB/s | 18 MB 00:00 2023-12-11T17:06:53.743 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - AppStream 25 MB/s | 18 MB 00:00 2023-12-11T17:06:57.034 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 7.7 MB/s | 5.8 MB 00:00 2023-12-11T17:06:58.668 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 15 kB 00:00 2023-12-11T17:06:59.228 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 5.8 MB 00:01 2023-12-11T17:07:01.004 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - Extras packages 32 kB/s | 15 kB 00:00 2023-12-11T17:07:01.006 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 9.2 MB/s | 20 MB 00:02 2023-12-11T17:07:02.754 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2023-12-11T17:07:06.896 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 31 kB/s | 1.7 kB 00:00 2023-12-11T17:07:08.331 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2023-12-11T17:07:09.776 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-11T17:07:09.778 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-11T17:07:09.799 INFO:teuthology.orchestra.run.smithi037.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-11T17:07:09.800 INFO:teuthology.orchestra.run.smithi037.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-11T17:07:09.802 INFO:teuthology.orchestra.run.smithi037.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-11T17:07:09.803 INFO:teuthology.orchestra.run.smithi037.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-11T17:07:09.806 INFO:teuthology.orchestra.run.smithi037.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-11T17:07:09.810 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-11T17:07:09.811 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-11T17:07:09.899 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-12-11T17:07:09.916 INFO:teuthology.orchestra.run.smithi037.stdout:=========================================================================================== 2023-12-11T17:07:09.916 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2023-12-11T17:07:09.916 INFO:teuthology.orchestra.run.smithi037.stdout:=========================================================================================== 2023-12-11T17:07:09.916 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-12-11T17:07:09.916 INFO:teuthology.orchestra.run.smithi037.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-11T17:07:09.917 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:19.0.0-119.ga62fda73.el9 ceph 6.5 k 2023-12-11T17:07:09.917 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:19.0.0-119.ga62fda73.el9 ceph 5.2 M 2023-12-11T17:07:09.917 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:19.0.0-119.ga62fda73.el9 ceph 859 k 2023-12-11T17:07:09.917 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-119.ga62fda73.el9 ceph 141 k 2023-12-11T17:07:09.917 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:19.0.0-119.ga62fda73.el9 ceph 1.5 M 2023-12-11T17:07:09.917 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 133 k 2023-12-11T17:07:09.917 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 1.8 M 2023-12-11T17:07:09.917 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 7.4 M 2023-12-11T17:07:09.917 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 50 k 2023-12-11T17:07:09.917 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:19.0.0-119.ga62fda73.el9 ceph 8.6 M 2023-12-11T17:07:09.917 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:19.0.0-119.ga62fda73.el9 ceph 41 M 2023-12-11T17:07:09.917 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 262 k 2023-12-11T17:07:09.917 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 803 k 2023-12-11T17:07:09.917 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror x86_64 2:19.0.0-119.ga62fda73.el9 ceph 217 k 2023-12-11T17:07:09.918 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 18 k 2023-12-11T17:07:09.918 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-11T17:07:09.918 INFO:teuthology.orchestra.run.smithi037.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-11T17:07:09.918 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-11T17:07:09.918 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:19.0.0-119.ga62fda73.el9 ceph 31 k 2023-12-11T17:07:09.918 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:19.0.0-119.ga62fda73.el9 ceph 718 k 2023-12-11T17:07:09.918 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:19.0.0-119.ga62fda73.el9 ceph 127 k 2023-12-11T17:07:09.918 INFO:teuthology.orchestra.run.smithi037.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-11T17:07:09.918 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-11T17:07:09.918 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-11T17:07:09.918 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-11T17:07:09.918 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-11T17:07:09.918 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-11T17:07:09.919 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:19.0.0-119.ga62fda73.el9 ceph 161 k 2023-12-11T17:07:09.919 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:19.0.0-119.ga62fda73.el9 ceph 321 k 2023-12-11T17:07:09.919 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:19.0.0-119.ga62fda73.el9 ceph 298 k 2023-12-11T17:07:09.919 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:19.0.0-119.ga62fda73.el9 ceph 99 k 2023-12-11T17:07:09.919 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:19.0.0-119.ga62fda73.el9 ceph 85 k 2023-12-11T17:07:09.919 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:19.0.0-119.ga62fda73.el9 ceph 3.0 M 2023-12-11T17:07:09.919 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:19.0.0-119.ga62fda73.el9 ceph 170 k 2023-12-11T17:07:09.919 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-11T17:07:09.919 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2023-12-11T17:07:09.919 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-11T17:07:09.919 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-11T17:07:09.919 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-11T17:07:09.919 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-11T17:07:09.919 INFO:teuthology.orchestra.run.smithi037.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-11T17:07:09.919 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-11T17:07:09.920 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-11T17:07:09.920 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-11T17:07:09.920 INFO:teuthology.orchestra.run.smithi037.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-11T17:07:09.920 INFO:teuthology.orchestra.run.smithi037.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-11T17:07:09.920 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:19.0.0-119.ga62fda73.el9 ceph 3.3 M 2023-12-11T17:07:09.920 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:19.0.0-119.ga62fda73.el9 ceph 3.0 M 2023-12-11T17:07:09.920 INFO:teuthology.orchestra.run.smithi037.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-11T17:07:09.920 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-11T17:07:09.920 INFO:teuthology.orchestra.run.smithi037.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-11T17:07:09.920 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2023-12-11T17:07:09.920 INFO:teuthology.orchestra.run.smithi037.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-11T17:07:09.920 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-11T17:07:09.920 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:19.0.0-119.ga62fda73.el9 ceph 19 M 2023-12-11T17:07:09.921 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 28 k 2023-12-11T17:07:09.921 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:19.0.0-119.ga62fda73.el9 ceph 2.1 M 2023-12-11T17:07:09.921 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 243 k 2023-12-11T17:07:09.921 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:19.0.0-119.ga62fda73.el9 ceph 4.4 M 2023-12-11T17:07:09.921 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:19.0.0-119.ga62fda73.el9 ceph 18 M 2023-12-11T17:07:09.921 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 15 k 2023-12-11T17:07:09.921 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:19.0.0-119.ga62fda73.el9 ceph 24 k 2023-12-11T17:07:09.921 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-11T17:07:09.921 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-11T17:07:09.921 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-11T17:07:09.921 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-11T17:07:09.921 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-11T17:07:09.921 INFO:teuthology.orchestra.run.smithi037.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-11T17:07:09.921 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-11T17:07:09.921 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-11T17:07:09.922 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:19.0.0-119.ga62fda73.el9 ceph 163 k 2023-12-11T17:07:09.922 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-11T17:07:09.922 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-11T17:07:09.922 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-11T17:07:09.922 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-11T17:07:09.922 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-11T17:07:09.922 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:19.0.0-119.ga62fda73.el9 ceph 476 k 2023-12-11T17:07:09.922 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-11T17:07:09.922 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:19.0.0-119.ga62fda73.el9 ceph 4.8 M 2023-12-11T17:07:09.922 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-11T17:07:09.922 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-11T17:07:09.922 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-11T17:07:09.922 INFO:teuthology.orchestra.run.smithi037.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-11T17:07:09.922 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-11T17:07:09.923 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-11T17:07:09.923 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-11T17:07:09.923 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-11T17:07:09.923 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-11T17:07:09.923 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-11T17:07:09.923 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-11T17:07:09.923 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-11T17:07:09.923 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-11T17:07:09.923 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-11T17:07:09.923 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:19.0.0-119.ga62fda73.el9 ceph 45 k 2023-12-11T17:07:09.923 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:19.0.0-119.ga62fda73.el9 ceph 129 k 2023-12-11T17:07:09.923 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-11T17:07:09.923 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-11T17:07:09.924 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-11T17:07:09.924 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-11T17:07:09.924 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-11T17:07:09.924 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-11T17:07:09.924 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-11T17:07:09.924 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-11T17:07:09.924 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-11T17:07:09.924 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-11T17:07:09.924 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-11T17:07:09.924 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-11T17:07:09.924 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-11T17:07:09.924 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-11T17:07:09.924 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-11T17:07:09.924 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-11T17:07:09.924 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-11T17:07:09.925 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-11T17:07:09.925 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-11T17:07:09.925 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-11T17:07:09.925 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-11T17:07:09.925 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-11T17:07:09.925 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-11T17:07:09.925 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-11T17:07:09.925 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-11T17:07:09.925 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-11T17:07:09.925 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-11T17:07:09.925 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-11T17:07:09.925 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-11T17:07:09.925 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-11T17:07:09.925 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-11T17:07:09.926 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-11T17:07:09.926 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-11T17:07:09.926 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-11T17:07:09.926 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-11T17:07:09.926 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-11T17:07:09.926 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-11T17:07:09.926 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-11T17:07:09.926 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-11T17:07:09.926 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-11T17:07:09.926 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-11T17:07:09.926 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-11T17:07:09.926 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-11T17:07:09.926 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-11T17:07:09.926 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-11T17:07:09.927 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-11T17:07:09.927 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-11T17:07:09.927 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-11T17:07:09.927 INFO:teuthology.orchestra.run.smithi037.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-11T17:07:09.927 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-11T17:07:09.927 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-11T17:07:09.927 INFO:teuthology.orchestra.run.smithi037.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-11T17:07:09.927 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-11T17:07:09.927 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-11T17:07:09.927 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2023-12-11T17:07:09.927 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-11T17:07:09.927 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:07:09.927 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-12-11T17:07:09.927 INFO:teuthology.orchestra.run.smithi037.stdout:=========================================================================================== 2023-12-11T17:07:09.927 INFO:teuthology.orchestra.run.smithi037.stdout:Install 134 Packages 2023-12-11T17:07:09.927 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 15 Packages 2023-12-11T17:07:09.928 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:07:09.928 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 204 M 2023-12-11T17:07:09.928 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-12-11T17:07:10.665 INFO:teuthology.orchestra.run.smithi037.stdout:(1/149): ceph-19.0.0-119.ga62fda73.el9.x86_64.r 20 kB/s | 6.5 kB 00:00 2023-12-11T17:07:11.106 INFO:teuthology.orchestra.run.smithi151.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-11T17:07:11.108 INFO:teuthology.orchestra.run.smithi151.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-11T17:07:11.129 INFO:teuthology.orchestra.run.smithi151.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-11T17:07:11.130 INFO:teuthology.orchestra.run.smithi151.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-11T17:07:11.131 INFO:teuthology.orchestra.run.smithi151.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-11T17:07:11.133 INFO:teuthology.orchestra.run.smithi151.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-11T17:07:11.136 INFO:teuthology.orchestra.run.smithi151.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-11T17:07:11.139 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-11T17:07:11.141 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-11T17:07:11.219 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2023-12-11T17:07:11.244 INFO:teuthology.orchestra.run.smithi151.stdout:=========================================================================================== 2023-12-11T17:07:11.244 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2023-12-11T17:07:11.244 INFO:teuthology.orchestra.run.smithi151.stdout:=========================================================================================== 2023-12-11T17:07:11.244 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2023-12-11T17:07:11.244 INFO:teuthology.orchestra.run.smithi151.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-11T17:07:11.244 INFO:teuthology.orchestra.run.smithi151.stdout: ceph x86_64 2:19.0.0-119.ga62fda73.el9 ceph 6.5 k 2023-12-11T17:07:11.244 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base x86_64 2:19.0.0-119.ga62fda73.el9 ceph 5.2 M 2023-12-11T17:07:11.244 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse x86_64 2:19.0.0-119.ga62fda73.el9 ceph 859 k 2023-12-11T17:07:11.244 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache x86_64 2:19.0.0-119.ga62fda73.el9 ceph 141 k 2023-12-11T17:07:11.245 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr x86_64 2:19.0.0-119.ga62fda73.el9 ceph 1.5 M 2023-12-11T17:07:11.245 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 133 k 2023-12-11T17:07:11.245 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 1.8 M 2023-12-11T17:07:11.245 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 7.4 M 2023-12-11T17:07:11.245 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 50 k 2023-12-11T17:07:11.245 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw x86_64 2:19.0.0-119.ga62fda73.el9 ceph 8.6 M 2023-12-11T17:07:11.245 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test x86_64 2:19.0.0-119.ga62fda73.el9 ceph 41 M 2023-12-11T17:07:11.245 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 262 k 2023-12-11T17:07:11.245 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 803 k 2023-12-11T17:07:11.245 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror x86_64 2:19.0.0-119.ga62fda73.el9 ceph 217 k 2023-12-11T17:07:11.245 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 18 k 2023-12-11T17:07:11.245 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-11T17:07:11.245 INFO:teuthology.orchestra.run.smithi151.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-11T17:07:11.245 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-11T17:07:11.245 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel x86_64 2:19.0.0-119.ga62fda73.el9 ceph 31 k 2023-12-11T17:07:11.245 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2 x86_64 2:19.0.0-119.ga62fda73.el9 ceph 718 k 2023-12-11T17:07:11.246 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel x86_64 2:19.0.0-119.ga62fda73.el9 ceph 127 k 2023-12-11T17:07:11.246 INFO:teuthology.orchestra.run.smithi151.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-11T17:07:11.246 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-11T17:07:11.246 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-11T17:07:11.246 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-11T17:07:11.246 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-11T17:07:11.246 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-11T17:07:11.246 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs x86_64 2:19.0.0-119.ga62fda73.el9 ceph 161 k 2023-12-11T17:07:11.246 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados x86_64 2:19.0.0-119.ga62fda73.el9 ceph 321 k 2023-12-11T17:07:11.246 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd x86_64 2:19.0.0-119.ga62fda73.el9 ceph 298 k 2023-12-11T17:07:11.246 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw x86_64 2:19.0.0-119.ga62fda73.el9 ceph 99 k 2023-12-11T17:07:11.246 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse x86_64 2:19.0.0-119.ga62fda73.el9 ceph 85 k 2023-12-11T17:07:11.246 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror x86_64 2:19.0.0-119.ga62fda73.el9 ceph 3.0 M 2023-12-11T17:07:11.247 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd x86_64 2:19.0.0-119.ga62fda73.el9 ceph 170 k 2023-12-11T17:07:11.247 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-11T17:07:11.247 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2023-12-11T17:07:11.247 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-11T17:07:11.247 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-11T17:07:11.247 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-11T17:07:11.247 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-11T17:07:11.247 INFO:teuthology.orchestra.run.smithi151.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-11T17:07:11.247 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-11T17:07:11.247 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-11T17:07:11.247 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-11T17:07:11.247 INFO:teuthology.orchestra.run.smithi151.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-11T17:07:11.247 INFO:teuthology.orchestra.run.smithi151.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-11T17:07:11.247 INFO:teuthology.orchestra.run.smithi151.stdout: librados2 x86_64 2:19.0.0-119.ga62fda73.el9 ceph 3.3 M 2023-12-11T17:07:11.247 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1 x86_64 2:19.0.0-119.ga62fda73.el9 ceph 3.0 M 2023-12-11T17:07:11.248 INFO:teuthology.orchestra.run.smithi151.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-11T17:07:11.248 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-11T17:07:11.248 INFO:teuthology.orchestra.run.smithi151.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-11T17:07:11.248 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2023-12-11T17:07:11.248 INFO:teuthology.orchestra.run.smithi151.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-11T17:07:11.248 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-11T17:07:11.248 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common x86_64 2:19.0.0-119.ga62fda73.el9 ceph 19 M 2023-12-11T17:07:11.248 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 28 k 2023-12-11T17:07:11.248 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds x86_64 2:19.0.0-119.ga62fda73.el9 ceph 2.1 M 2023-12-11T17:07:11.248 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 243 k 2023-12-11T17:07:11.248 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon x86_64 2:19.0.0-119.ga62fda73.el9 ceph 4.4 M 2023-12-11T17:07:11.248 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd x86_64 2:19.0.0-119.ga62fda73.el9 ceph 18 M 2023-12-11T17:07:11.248 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts noarch 2:19.0.0-119.ga62fda73.el9 ceph-noarch 15 k 2023-12-11T17:07:11.248 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux x86_64 2:19.0.0-119.ga62fda73.el9 ceph 24 k 2023-12-11T17:07:11.249 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-11T17:07:11.249 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-11T17:07:11.249 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-11T17:07:11.249 INFO:teuthology.orchestra.run.smithi151.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-11T17:07:11.249 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-11T17:07:11.249 INFO:teuthology.orchestra.run.smithi151.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-11T17:07:11.249 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-11T17:07:11.249 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-11T17:07:11.249 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite x86_64 2:19.0.0-119.ga62fda73.el9 ceph 163 k 2023-12-11T17:07:11.249 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-11T17:07:11.249 INFO:teuthology.orchestra.run.smithi151.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-11T17:07:11.249 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-11T17:07:11.249 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-11T17:07:11.249 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-11T17:07:11.250 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1 x86_64 2:19.0.0-119.ga62fda73.el9 ceph 476 k 2023-12-11T17:07:11.250 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-11T17:07:11.250 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2 x86_64 2:19.0.0-119.ga62fda73.el9 ceph 4.8 M 2023-12-11T17:07:11.250 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-11T17:07:11.250 INFO:teuthology.orchestra.run.smithi151.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-11T17:07:11.250 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-11T17:07:11.250 INFO:teuthology.orchestra.run.smithi151.stdout: lua x86_64 5.4.4-4.el9 CentOS-AppStream 187 k 2023-12-11T17:07:11.250 INFO:teuthology.orchestra.run.smithi151.stdout: luarocks noarch 3.9.2-1.el9 epel 151 k 2023-12-11T17:07:11.250 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-11T17:07:11.250 INFO:teuthology.orchestra.run.smithi151.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-11T17:07:11.250 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-11T17:07:11.250 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-11T17:07:11.250 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-11T17:07:11.250 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-11T17:07:11.251 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-11T17:07:11.251 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-11T17:07:11.251 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-11T17:07:11.251 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse x86_64 2:19.0.0-119.ga62fda73.el9 ceph 45 k 2023-12-11T17:07:11.251 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common x86_64 2:19.0.0-119.ga62fda73.el9 ceph 129 k 2023-12-11T17:07:11.251 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-11T17:07:11.251 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-11T17:07:11.251 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-11T17:07:11.251 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-11T17:07:11.252 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-11T17:07:11.252 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-11T17:07:11.252 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-11T17:07:11.252 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-11T17:07:11.252 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-11T17:07:11.252 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-11T17:07:11.252 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-11T17:07:11.252 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-11T17:07:11.252 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-11T17:07:11.252 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-11T17:07:11.252 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-11T17:07:11.252 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-11T17:07:11.252 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-11T17:07:11.252 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-11T17:07:11.253 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-11T17:07:11.253 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-11T17:07:11.253 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-11T17:07:11.253 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-11T17:07:11.253 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-11T17:07:11.253 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-11T17:07:11.253 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-11T17:07:11.253 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-11T17:07:11.253 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-11T17:07:11.253 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-11T17:07:11.253 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-11T17:07:11.253 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-11T17:07:11.253 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-11T17:07:11.254 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-11T17:07:11.254 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-11T17:07:11.254 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-11T17:07:11.254 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-11T17:07:11.254 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-11T17:07:11.254 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-11T17:07:11.254 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-11T17:07:11.254 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-11T17:07:11.254 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-11T17:07:11.254 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-11T17:07:11.254 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-11T17:07:11.254 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-11T17:07:11.254 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-11T17:07:11.254 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-11T17:07:11.255 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-11T17:07:11.255 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-11T17:07:11.255 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-11T17:07:11.255 INFO:teuthology.orchestra.run.smithi151.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-11T17:07:11.255 INFO:teuthology.orchestra.run.smithi151.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-11T17:07:11.255 INFO:teuthology.orchestra.run.smithi151.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-11T17:07:11.255 INFO:teuthology.orchestra.run.smithi151.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-11T17:07:11.255 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-11T17:07:11.255 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-11T17:07:11.255 INFO:teuthology.orchestra.run.smithi151.stdout:Installing weak dependencies: 2023-12-11T17:07:11.255 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-11T17:07:11.255 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:07:11.255 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2023-12-11T17:07:11.255 INFO:teuthology.orchestra.run.smithi151.stdout:=========================================================================================== 2023-12-11T17:07:11.256 INFO:teuthology.orchestra.run.smithi151.stdout:Install 134 Packages 2023-12-11T17:07:11.256 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 15 Packages 2023-12-11T17:07:11.256 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:07:11.256 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 204 M 2023-12-11T17:07:11.256 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2023-12-11T17:07:11.298 INFO:teuthology.orchestra.run.smithi037.stdout:(2/149): ceph-fuse-19.0.0-119.ga62fda73.el9.x86 1.3 MB/s | 859 kB 00:00 2023-12-11T17:07:11.457 INFO:teuthology.orchestra.run.smithi037.stdout:(3/149): ceph-immutable-object-cache-19.0.0-119 900 kB/s | 141 kB 00:00 2023-12-11T17:07:12.001 INFO:teuthology.orchestra.run.smithi151.stdout:(1/149): ceph-19.0.0-119.ga62fda73.el9.x86_64.r 14 kB/s | 6.5 kB 00:00 2023-12-11T17:07:12.099 INFO:teuthology.orchestra.run.smithi037.stdout:(4/149): ceph-base-19.0.0-119.ga62fda73.el9.x86 2.9 MB/s | 5.2 MB 00:01 2023-12-11T17:07:12.507 INFO:teuthology.orchestra.run.smithi037.stdout:(5/149): ceph-mds-19.0.0-119.ga62fda73.el9.x86_ 2.0 MB/s | 2.1 MB 00:01 2023-12-11T17:07:12.851 INFO:teuthology.orchestra.run.smithi151.stdout:(2/149): ceph-fuse-19.0.0-119.ga62fda73.el9.x86 1.0 MB/s | 859 kB 00:00 2023-12-11T17:07:13.099 INFO:teuthology.orchestra.run.smithi037.stdout:(6/149): ceph-common-19.0.0-119.ga62fda73.el9.x 6.8 MB/s | 19 MB 00:02 2023-12-11T17:07:13.126 INFO:teuthology.orchestra.run.smithi151.stdout:(3/149): ceph-common-19.0.0-119.ga62fda73.el9.x 12 MB/s | 19 MB 00:01 2023-12-11T17:07:13.159 INFO:teuthology.orchestra.run.smithi151.stdout:(4/149): ceph-immutable-object-cache-19.0.0-119 460 kB/s | 141 kB 00:00 2023-12-11T17:07:13.293 INFO:teuthology.orchestra.run.smithi151.stdout:(5/149): ceph-mds-19.0.0-119.ga62fda73.el9.x86_ 13 MB/s | 2.1 MB 00:00 2023-12-11T17:07:13.794 INFO:teuthology.orchestra.run.smithi151.stdout:(6/149): ceph-mon-19.0.0-119.ga62fda73.el9.x86_ 8.8 MB/s | 4.4 MB 00:00 2023-12-11T17:07:13.883 INFO:teuthology.orchestra.run.smithi037.stdout:(7/149): ceph-mgr-19.0.0-119.ga62fda73.el9.x86_ 840 kB/s | 1.5 MB 00:01 2023-12-11T17:07:14.577 INFO:teuthology.orchestra.run.smithi151.stdout:(7/149): ceph-base-19.0.0-119.ga62fda73.el9.x86 1.7 MB/s | 5.2 MB 00:03 2023-12-11T17:07:14.633 INFO:teuthology.orchestra.run.smithi037.stdout:(8/149): ceph-mon-19.0.0-119.ga62fda73.el9.x86_ 2.1 MB/s | 4.4 MB 00:02 2023-12-11T17:07:14.636 INFO:teuthology.orchestra.run.smithi151.stdout:(8/149): ceph-mgr-19.0.0-119.ga62fda73.el9.x86_ 1.0 MB/s | 1.5 MB 00:01 2023-12-11T17:07:14.745 INFO:teuthology.orchestra.run.smithi151.stdout:(9/149): ceph-selinux-19.0.0-119.ga62fda73.el9. 224 kB/s | 24 kB 00:00 2023-12-11T17:07:14.749 INFO:teuthology.orchestra.run.smithi037.stdout:(9/149): ceph-selinux-19.0.0-119.ga62fda73.el9. 207 kB/s | 24 kB 00:00 2023-12-11T17:07:15.600 INFO:teuthology.orchestra.run.smithi037.stdout:(10/149): ceph-osd-19.0.0-119.ga62fda73.el9.x86 7.1 MB/s | 18 MB 00:02 2023-12-11T17:07:15.703 INFO:teuthology.orchestra.run.smithi151.stdout:(10/149): ceph-osd-19.0.0-119.ga62fda73.el9.x86 9.3 MB/s | 18 MB 00:01 2023-12-11T17:07:15.733 INFO:teuthology.orchestra.run.smithi037.stdout:(11/149): cephfs-mirror-19.0.0-119.ga62fda73.el 1.6 MB/s | 217 kB 00:00 2023-12-11T17:07:15.753 INFO:teuthology.orchestra.run.smithi151.stdout:(11/149): cephfs-mirror-19.0.0-119.ga62fda73.el 4.3 MB/s | 217 kB 00:00 2023-12-11T17:07:15.783 INFO:teuthology.orchestra.run.smithi037.stdout:(12/149): libcephfs-devel-19.0.0-119.ga62fda73. 637 kB/s | 31 kB 00:00 2023-12-11T17:07:15.829 INFO:teuthology.orchestra.run.smithi151.stdout:(12/149): libcephfs-devel-19.0.0-119.ga62fda73. 421 kB/s | 31 kB 00:00 2023-12-11T17:07:15.921 INFO:teuthology.orchestra.run.smithi151.stdout:(13/149): libcephfs2-19.0.0-119.ga62fda73.el9.x 7.7 MB/s | 718 kB 00:00 2023-12-11T17:07:15.967 INFO:teuthology.orchestra.run.smithi037.stdout:(13/149): ceph-radosgw-19.0.0-119.ga62fda73.el9 4.1 MB/s | 8.6 MB 00:02 2023-12-11T17:07:15.996 INFO:teuthology.orchestra.run.smithi151.stdout:(14/149): libcephsqlite-19.0.0-119.ga62fda73.el 2.2 MB/s | 163 kB 00:00 2023-12-11T17:07:16.026 INFO:teuthology.orchestra.run.smithi037.stdout:(14/149): libcephfs2-19.0.0-119.ga62fda73.el9.x 2.9 MB/s | 718 kB 00:00 2023-12-11T17:07:16.059 INFO:teuthology.orchestra.run.smithi037.stdout:(15/149): libcephsqlite-19.0.0-119.ga62fda73.el 1.8 MB/s | 163 kB 00:00 2023-12-11T17:07:16.063 INFO:teuthology.orchestra.run.smithi151.stdout:(15/149): librados-devel-19.0.0-119.ga62fda73.e 1.9 MB/s | 127 kB 00:00 2023-12-11T17:07:16.093 INFO:teuthology.orchestra.run.smithi037.stdout:(16/149): librados-devel-19.0.0-119.ga62fda73.e 1.9 MB/s | 127 kB 00:00 2023-12-11T17:07:16.147 INFO:teuthology.orchestra.run.smithi151.stdout:(16/149): libradosstriper1-19.0.0-119.ga62fda73 5.6 MB/s | 476 kB 00:00 2023-12-11T17:07:16.202 INFO:teuthology.orchestra.run.smithi037.stdout:(17/149): libradosstriper1-19.0.0-119.ga62fda73 3.3 MB/s | 476 kB 00:00 2023-12-11T17:07:16.310 INFO:teuthology.orchestra.run.smithi037.stdout:(18/149): python3-ceph-argparse-19.0.0-119.ga62 420 kB/s | 45 kB 00:00 2023-12-11T17:07:16.444 INFO:teuthology.orchestra.run.smithi037.stdout:(19/149): python3-ceph-common-19.0.0-119.ga62fd 971 kB/s | 129 kB 00:00 2023-12-11T17:07:16.627 INFO:teuthology.orchestra.run.smithi037.stdout:(20/149): python3-cephfs-19.0.0-119.ga62fda73.e 885 kB/s | 161 kB 00:00 2023-12-11T17:07:16.664 INFO:teuthology.orchestra.run.smithi151.stdout:(17/149): librgw2-19.0.0-119.ga62fda73.el9.x86_ 9.2 MB/s | 4.8 MB 00:00 2023-12-11T17:07:16.736 INFO:teuthology.orchestra.run.smithi037.stdout:(21/149): librgw2-19.0.0-119.ga62fda73.el9.x86_ 7.4 MB/s | 4.8 MB 00:00 2023-12-11T17:07:16.739 INFO:teuthology.orchestra.run.smithi151.stdout:(18/149): python3-ceph-argparse-19.0.0-119.ga62 606 kB/s | 45 kB 00:00 2023-12-11T17:07:16.778 INFO:teuthology.orchestra.run.smithi037.stdout:(22/149): python3-rados-19.0.0-119.ga62fda73.el 2.1 MB/s | 321 kB 00:00 2023-12-11T17:07:16.798 INFO:teuthology.orchestra.run.smithi151.stdout:(19/149): python3-ceph-common-19.0.0-119.ga62fd 2.2 MB/s | 129 kB 00:00 2023-12-11T17:07:16.849 INFO:teuthology.orchestra.run.smithi151.stdout:(20/149): python3-cephfs-19.0.0-119.ga62fda73.e 3.2 MB/s | 161 kB 00:00 2023-12-11T17:07:16.907 INFO:teuthology.orchestra.run.smithi151.stdout:(21/149): python3-rados-19.0.0-119.ga62fda73.el 5.5 MB/s | 321 kB 00:00 2023-12-11T17:07:17.224 INFO:teuthology.orchestra.run.smithi151.stdout:(22/149): python3-rbd-19.0.0-119.ga62fda73.el9. 943 kB/s | 298 kB 00:00 2023-12-11T17:07:17.228 INFO:teuthology.orchestra.run.smithi037.stdout:(23/149): python3-rbd-19.0.0-119.ga62fda73.el9. 606 kB/s | 298 kB 00:00 2023-12-11T17:07:17.262 INFO:teuthology.orchestra.run.smithi037.stdout:(24/149): python3-rgw-19.0.0-119.ga62fda73.el9. 206 kB/s | 99 kB 00:00 2023-12-11T17:07:17.275 INFO:teuthology.orchestra.run.smithi151.stdout:(23/149): python3-rgw-19.0.0-119.ga62fda73.el9. 2.0 MB/s | 99 kB 00:00 2023-12-11T17:07:17.296 INFO:teuthology.orchestra.run.smithi037.stdout:(25/149): rbd-fuse-19.0.0-119.ga62fda73.el9.x86 1.3 MB/s | 85 kB 00:00 2023-12-11T17:07:17.325 INFO:teuthology.orchestra.run.smithi151.stdout:(24/149): rbd-fuse-19.0.0-119.ga62fda73.el9.x86 1.7 MB/s | 85 kB 00:00 2023-12-11T17:07:17.626 INFO:teuthology.orchestra.run.smithi151.stdout:(25/149): rbd-mirror-19.0.0-119.ga62fda73.el9.x 10 MB/s | 3.0 MB 00:00 2023-12-11T17:07:17.696 INFO:teuthology.orchestra.run.smithi037.stdout:(26/149): rbd-nbd-19.0.0-119.ga62fda73.el9.x86_ 426 kB/s | 170 kB 00:00 2023-12-11T17:07:17.715 INFO:teuthology.orchestra.run.smithi151.stdout:(26/149): rbd-nbd-19.0.0-119.ga62fda73.el9.x86_ 1.9 MB/s | 170 kB 00:00 2023-12-11T17:07:17.813 INFO:teuthology.orchestra.run.smithi037.stdout:(27/149): rbd-mirror-19.0.0-119.ga62fda73.el9.x 5.5 MB/s | 3.0 MB 00:00 2023-12-11T17:07:17.838 INFO:teuthology.orchestra.run.smithi037.stdout:(28/149): ceph-grafana-dashboards-19.0.0-119.ga 200 kB/s | 28 kB 00:00 2023-12-11T17:07:17.876 INFO:teuthology.orchestra.run.smithi151.stdout:(27/149): ceph-radosgw-19.0.0-119.ga62fda73.el9 2.6 MB/s | 8.6 MB 00:03 2023-12-11T17:07:17.893 INFO:teuthology.orchestra.run.smithi151.stdout:(28/149): ceph-grafana-dashboards-19.0.0-119.ga 158 kB/s | 28 kB 00:00 2023-12-11T17:07:17.943 INFO:teuthology.orchestra.run.smithi151.stdout:(29/149): ceph-mgr-cephadm-19.0.0-119.ga62fda73 1.9 MB/s | 133 kB 00:00 2023-12-11T17:07:17.972 INFO:teuthology.orchestra.run.smithi037.stdout:(29/149): ceph-mgr-cephadm-19.0.0-119.ga62fda73 842 kB/s | 133 kB 00:00 2023-12-11T17:07:18.136 INFO:teuthology.orchestra.run.smithi151.stdout:(30/149): ceph-mgr-dashboard-19.0.0-119.ga62fda 7.3 MB/s | 1.8 MB 00:00 2023-12-11T17:07:18.180 INFO:teuthology.orchestra.run.smithi037.stdout:(30/149): ceph-mgr-dashboard-19.0.0-119.ga62fda 5.2 MB/s | 1.8 MB 00:00 2023-12-11T17:07:18.194 INFO:teuthology.orchestra.run.smithi151.stdout:(31/149): ceph-mgr-modules-core-19.0.0-119.ga62 4.1 MB/s | 243 kB 00:00 2023-12-11T17:07:18.248 INFO:teuthology.orchestra.run.smithi037.stdout:(31/149): ceph-mgr-modules-core-19.0.0-119.ga62 3.6 MB/s | 243 kB 00:00 2023-12-11T17:07:18.262 INFO:teuthology.orchestra.run.smithi151.stdout:(32/149): ceph-mgr-rook-19.0.0-119.ga62fda73.el 763 kB/s | 50 kB 00:00 2023-12-11T17:07:18.320 INFO:teuthology.orchestra.run.smithi151.stdout:(33/149): ceph-prometheus-alerts-19.0.0-119.ga6 263 kB/s | 15 kB 00:00 2023-12-11T17:07:18.331 INFO:teuthology.orchestra.run.smithi037.stdout:(32/149): ceph-mgr-rook-19.0.0-119.ga62fda73.el 609 kB/s | 50 kB 00:00 2023-12-11T17:07:18.398 INFO:teuthology.orchestra.run.smithi037.stdout:(33/149): ceph-prometheus-alerts-19.0.0-119.ga6 230 kB/s | 15 kB 00:00 2023-12-11T17:07:18.404 INFO:teuthology.orchestra.run.smithi151.stdout:(34/149): ceph-volume-19.0.0-119.ga62fda73.el9. 3.1 MB/s | 262 kB 00:00 2023-12-11T17:07:18.473 INFO:teuthology.orchestra.run.smithi037.stdout:(34/149): ceph-volume-19.0.0-119.ga62fda73.el9. 3.5 MB/s | 262 kB 00:00 2023-12-11T17:07:18.537 INFO:teuthology.orchestra.run.smithi151.stdout:(35/149): cephadm-19.0.0-119.ga62fda73.el9.noar 5.9 MB/s | 803 kB 00:00 2023-12-11T17:07:18.599 INFO:teuthology.orchestra.run.smithi037.stdout:(35/149): cephadm-19.0.0-119.ga62fda73.el9.noar 6.3 MB/s | 803 kB 00:00 2023-12-11T17:07:18.605 INFO:teuthology.orchestra.run.smithi151.stdout:(36/149): cephfs-top-19.0.0-119.ga62fda73.el9.n 277 kB/s | 18 kB 00:00 2023-12-11T17:07:18.682 INFO:teuthology.orchestra.run.smithi037.stdout:(36/149): cephfs-top-19.0.0-119.ga62fda73.el9.n 221 kB/s | 18 kB 00:00 2023-12-11T17:07:18.800 INFO:teuthology.orchestra.run.smithi151.stdout:(37/149): automake-1.16.2-8.el9.noarch.rpm 3.3 MB/s | 662 kB 00:00 2023-12-11T17:07:18.858 INFO:teuthology.orchestra.run.smithi037.stdout:(37/149): automake-1.16.2-8.el9.noarch.rpm 3.7 MB/s | 662 kB 00:00 2023-12-11T17:07:18.863 INFO:teuthology.orchestra.run.smithi151.stdout:(38/149): bison-3.7.4-5.el9.x86_64.rpm 14 MB/s | 920 kB 00:00 2023-12-11T17:07:18.897 INFO:teuthology.orchestra.run.smithi151.stdout:(39/149): boost-program-options-1.75.0-8.el9.x8 3.2 MB/s | 106 kB 00:00 2023-12-11T17:07:18.916 INFO:teuthology.orchestra.run.smithi037.stdout:(38/149): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 920 kB 00:00 2023-12-11T17:07:18.931 INFO:teuthology.orchestra.run.smithi151.stdout:(40/149): elfutils-libelf-devel-0.190-1.el9.x86 646 kB/s | 21 kB 00:00 2023-12-11T17:07:18.950 INFO:teuthology.orchestra.run.smithi037.stdout:(39/149): boost-program-options-1.75.0-8.el9.x8 3.2 MB/s | 106 kB 00:00 2023-12-11T17:07:18.982 INFO:teuthology.orchestra.run.smithi151.stdout:(41/149): flex-2.6.4-9.el9.x86_64.rpm 6.1 MB/s | 307 kB 00:00 2023-12-11T17:07:18.983 INFO:teuthology.orchestra.run.smithi037.stdout:(40/149): elfutils-libelf-devel-0.190-1.el9.x86 665 kB/s | 21 kB 00:00 2023-12-11T17:07:19.015 INFO:teuthology.orchestra.run.smithi151.stdout:(42/149): flexiblas-3.0.4-8.el9.x86_64.rpm 964 kB/s | 32 kB 00:00 2023-12-11T17:07:19.025 INFO:teuthology.orchestra.run.smithi037.stdout:(41/149): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 307 kB 00:00 2023-12-11T17:07:19.059 INFO:teuthology.orchestra.run.smithi037.stdout:(42/149): flexiblas-3.0.4-8.el9.x86_64.rpm 968 kB/s | 32 kB 00:00 2023-12-11T17:07:19.159 INFO:teuthology.orchestra.run.smithi037.stdout:(43/149): flexiblas-netlib-3.0.4-8.el9.x86_64.r 30 MB/s | 3.0 MB 00:00 2023-12-11T17:07:19.202 INFO:teuthology.orchestra.run.smithi037.stdout:(44/149): flexiblas-openblas-openmp-3.0.4-8.el9 422 kB/s | 17 kB 00:00 2023-12-11T17:07:19.213 INFO:teuthology.orchestra.run.smithi151.stdout:(43/149): flexiblas-netlib-3.0.4-8.el9.x86_64.r 15 MB/s | 3.0 MB 00:00 2023-12-11T17:07:19.243 INFO:teuthology.orchestra.run.smithi037.stdout:(45/149): jq-1.6-16.el9.x86_64.rpm 4.5 MB/s | 186 kB 00:00 2023-12-11T17:07:19.250 INFO:teuthology.orchestra.run.smithi151.stdout:(44/149): flexiblas-openblas-openmp-3.0.4-8.el9 484 kB/s | 17 kB 00:00 2023-12-11T17:07:19.292 INFO:teuthology.orchestra.run.smithi151.stdout:(45/149): jq-1.6-16.el9.x86_64.rpm 4.5 MB/s | 186 kB 00:00 2023-12-11T17:07:19.326 INFO:teuthology.orchestra.run.smithi151.stdout:(46/149): libaio-devel-0.3.111-13.el9.x86_64.rp 306 kB/s | 10 kB 00:00 2023-12-11T17:07:19.360 INFO:teuthology.orchestra.run.smithi151.stdout:(47/149): libpmemobj-1.12.1-1.el9.x86_64.rpm 4.8 MB/s | 159 kB 00:00 2023-12-11T17:07:19.377 INFO:teuthology.orchestra.run.smithi037.stdout:(46/149): ceph-mgr-diskprediction-local-19.0.0- 5.3 MB/s | 7.4 MB 00:01 2023-12-11T17:07:19.385 INFO:teuthology.orchestra.run.smithi151.stdout:(48/149): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.8 MB/s | 44 kB 00:00 2023-12-11T17:07:19.394 INFO:teuthology.orchestra.run.smithi037.stdout:(47/149): libaio-devel-0.3.111-13.el9.x86_64.rp 67 kB/s | 10 kB 00:00 2023-12-11T17:07:19.420 INFO:teuthology.orchestra.run.smithi037.stdout:(48/149): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.8 MB/s | 159 kB 00:00 2023-12-11T17:07:19.435 INFO:teuthology.orchestra.run.smithi151.stdout:(49/149): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-12-11T17:07:19.436 INFO:teuthology.orchestra.run.smithi037.stdout:(49/149): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 44 kB 00:00 2023-12-11T17:07:19.478 INFO:teuthology.orchestra.run.smithi037.stdout:(50/149): librdkafka-1.6.1-102.el9.x86_64.rpm 11 MB/s | 661 kB 00:00 2023-12-11T17:07:19.494 INFO:teuthology.orchestra.run.smithi151.stdout:(50/149): libtool-2.4.6-45.el9.x86_64.rpm 9.8 MB/s | 578 kB 00:00 2023-12-11T17:07:19.519 INFO:teuthology.orchestra.run.smithi151.stdout:(51/149): libuuid-devel-2.37.4-15.el9.x86_64.rp 1.0 MB/s | 24 kB 00:00 2023-12-11T17:07:19.528 INFO:teuthology.orchestra.run.smithi037.stdout:(51/149): libtool-2.4.6-45.el9.x86_64.rpm 6.6 MB/s | 578 kB 00:00 2023-12-11T17:07:19.545 INFO:teuthology.orchestra.run.smithi151.stdout:(52/149): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.9 MB/s | 46 kB 00:00 2023-12-11T17:07:19.554 INFO:teuthology.orchestra.run.smithi037.stdout:(52/149): libuuid-devel-2.37.4-15.el9.x86_64.rp 352 kB/s | 24 kB 00:00 2023-12-11T17:07:19.579 INFO:teuthology.orchestra.run.smithi037.stdout:(53/149): libzstd-devel-1.5.1-2.el9.x86_64.rpm 946 kB/s | 46 kB 00:00 2023-12-11T17:07:19.587 INFO:teuthology.orchestra.run.smithi151.stdout:(53/149): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.8 MB/s | 282 kB 00:00 2023-12-11T17:07:19.613 INFO:teuthology.orchestra.run.smithi037.stdout:(54/149): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.8 MB/s | 282 kB 00:00 2023-12-11T17:07:19.629 INFO:teuthology.orchestra.run.smithi151.stdout:(54/149): lua-5.4.4-4.el9.x86_64.rpm 4.5 MB/s | 187 kB 00:00 2023-12-11T17:07:19.646 INFO:teuthology.orchestra.run.smithi037.stdout:(55/149): lua-5.4.4-4.el9.x86_64.rpm 2.9 MB/s | 187 kB 00:00 2023-12-11T17:07:19.671 INFO:teuthology.orchestra.run.smithi151.stdout:(55/149): oniguruma-6.9.6-1.el9.5.x86_64.rpm 5.2 MB/s | 217 kB 00:00 2023-12-11T17:07:19.680 INFO:teuthology.orchestra.run.smithi037.stdout:(56/149): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.3 MB/s | 217 kB 00:00 2023-12-11T17:07:19.705 INFO:teuthology.orchestra.run.smithi151.stdout:(56/149): openblas-0.3.21-2.el9.x86_64.rpm 1.0 MB/s | 34 kB 00:00 2023-12-11T17:07:19.705 INFO:teuthology.orchestra.run.smithi037.stdout:(57/149): openblas-0.3.21-2.el9.x86_64.rpm 614 kB/s | 34 kB 00:00 2023-12-11T17:07:19.839 INFO:teuthology.orchestra.run.smithi037.stdout:(58/149): openblas-openmp-0.3.21-2.el9.x86_64.r 30 MB/s | 4.7 MB 00:00 2023-12-11T17:07:19.847 INFO:teuthology.orchestra.run.smithi151.stdout:(57/149): openblas-openmp-0.3.21-2.el9.x86_64.r 34 MB/s | 4.7 MB 00:00 2023-12-11T17:07:19.889 INFO:teuthology.orchestra.run.smithi037.stdout:(59/149): postgresql-13.11-1.el9.x86_64.rpm 9.0 MB/s | 1.5 MB 00:00 2023-12-11T17:07:19.922 INFO:teuthology.orchestra.run.smithi151.stdout:(58/149): postgresql-13.11-1.el9.x86_64.rpm 21 MB/s | 1.5 MB 00:00 2023-12-11T17:07:19.939 INFO:teuthology.orchestra.run.smithi037.stdout:(60/149): postgresql-contrib-13.11-1.el9.x86_64 8.0 MB/s | 811 kB 00:00 2023-12-11T17:07:19.965 INFO:teuthology.orchestra.run.smithi037.stdout:(61/149): postgresql-private-libs-13.11-1.el9.x 1.9 MB/s | 134 kB 00:00 2023-12-11T17:07:19.973 INFO:teuthology.orchestra.run.smithi151.stdout:(59/149): postgresql-contrib-13.11-1.el9.x86_64 16 MB/s | 811 kB 00:00 2023-12-11T17:07:20.015 INFO:teuthology.orchestra.run.smithi151.stdout:(60/149): postgresql-private-libs-13.11-1.el9.x 3.2 MB/s | 134 kB 00:00 2023-12-11T17:07:20.107 INFO:teuthology.orchestra.run.smithi037.stdout:(62/149): postgresql-server-13.11-1.el9.x86_64. 35 MB/s | 5.7 MB 00:00 2023-12-11T17:07:20.174 INFO:teuthology.orchestra.run.smithi151.stdout:(61/149): postgresql-server-13.11-1.el9.x86_64. 36 MB/s | 5.7 MB 00:00 2023-12-11T17:07:20.265 INFO:teuthology.orchestra.run.smithi037.stdout:(63/149): python3-babel-2.9.1-2.el9.noarch.rpm 20 MB/s | 5.8 MB 00:00 2023-12-11T17:07:20.291 INFO:teuthology.orchestra.run.smithi037.stdout:(64/149): python3-jinja2-2.11.3-4.el9.noarch.rp 1.3 MB/s | 228 kB 00:00 2023-12-11T17:07:20.307 INFO:teuthology.orchestra.run.smithi151.stdout:(62/149): ceph-mgr-diskprediction-local-19.0.0- 3.1 MB/s | 7.4 MB 00:02 2023-12-11T17:07:20.324 INFO:teuthology.orchestra.run.smithi037.stdout:(65/149): python3-jsonpointer-2.0-4.el9.noarch. 569 kB/s | 18 kB 00:00 2023-12-11T17:07:20.349 INFO:teuthology.orchestra.run.smithi037.stdout:(66/149): python3-jsonpatch-1.21-16.el9.noarch. 426 kB/s | 24 kB 00:00 2023-12-11T17:07:20.375 INFO:teuthology.orchestra.run.smithi037.stdout:(67/149): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 144 kB 00:00 2023-12-11T17:07:20.400 INFO:teuthology.orchestra.run.smithi037.stdout:(68/149): python3-markupsafe-1.1.1-12.el9.x86_6 658 kB/s | 32 kB 00:00 2023-12-11T17:07:20.450 INFO:teuthology.orchestra.run.smithi151.stdout:(63/149): python3-babel-2.9.1-2.el9.noarch.rpm 21 MB/s | 5.8 MB 00:00 2023-12-11T17:07:20.475 INFO:teuthology.orchestra.run.smithi151.stdout:(64/149): python3-jinja2-2.11.3-4.el9.noarch.rp 1.5 MB/s | 228 kB 00:00 2023-12-11T17:07:20.508 INFO:teuthology.orchestra.run.smithi151.stdout:(65/149): python3-jsonpatch-1.21-16.el9.noarch. 758 kB/s | 24 kB 00:00 2023-12-11T17:07:20.534 INFO:teuthology.orchestra.run.smithi037.stdout:(69/149): python3-numpy-1.20.1-5.el9.x86_64.rpm 30 MB/s | 4.8 MB 00:00 2023-12-11T17:07:20.534 INFO:teuthology.orchestra.run.smithi151.stdout:(66/149): python3-jsonpointer-2.0-4.el9.noarch. 316 kB/s | 18 kB 00:00 2023-12-11T17:07:20.559 INFO:teuthology.orchestra.run.smithi037.stdout:(70/149): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 217 kB 00:00 2023-12-11T17:07:20.567 INFO:teuthology.orchestra.run.smithi151.stdout:(67/149): python3-markupsafe-1.1.1-12.el9.x86_6 988 kB/s | 32 kB 00:00 2023-12-11T17:07:20.592 INFO:teuthology.orchestra.run.smithi037.stdout:(71/149): python3-prettytable-0.7.2-27.el9.noar 1.3 MB/s | 41 kB 00:00 2023-12-11T17:07:20.593 INFO:teuthology.orchestra.run.smithi151.stdout:(68/149): python3-mako-1.1.4-6.el9.noarch.rpm 2.4 MB/s | 144 kB 00:00 2023-12-11T17:07:20.626 INFO:teuthology.orchestra.run.smithi037.stdout:(72/149): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 174 kB 00:00 2023-12-11T17:07:20.651 INFO:teuthology.orchestra.run.smithi037.stdout:(73/149): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.3 MB/s | 132 kB 00:00 2023-12-11T17:07:20.685 INFO:teuthology.orchestra.run.smithi037.stdout:(74/149): python3-pyasn1-modules-0.4.8-6.el9.no 3.7 MB/s | 211 kB 00:00 2023-12-11T17:07:20.710 INFO:teuthology.orchestra.run.smithi037.stdout:(75/149): python3-pytz-2021.1-5.el9.noarch.rpm 849 kB/s | 47 kB 00:00 2023-12-11T17:07:20.727 INFO:teuthology.orchestra.run.smithi151.stdout:(69/149): python3-numpy-1.20.1-5.el9.x86_64.rpm 30 MB/s | 4.8 MB 00:00 2023-12-11T17:07:20.735 INFO:teuthology.orchestra.run.smithi037.stdout:(76/149): python3-requests-oauthlib-1.3.0-12.el 873 kB/s | 43 kB 00:00 2023-12-11T17:07:20.752 INFO:teuthology.orchestra.run.smithi151.stdout:(70/149): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.5 MB/s | 217 kB 00:00 2023-12-11T17:07:20.794 INFO:teuthology.orchestra.run.smithi151.stdout:(71/149): python3-oauthlib-3.1.1-5.el9.noarch.r 4.2 MB/s | 174 kB 00:00 2023-12-11T17:07:20.819 INFO:teuthology.orchestra.run.smithi151.stdout:(72/149): python3-prettytable-0.7.2-27.el9.noar 629 kB/s | 41 kB 00:00 2023-12-11T17:07:20.861 INFO:teuthology.orchestra.run.smithi151.stdout:(73/149): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.2 MB/s | 132 kB 00:00 2023-12-11T17:07:20.869 INFO:teuthology.orchestra.run.smithi037.stdout:(77/149): python3-toml-0.10.2-6.el9.noarch.rpm 328 kB/s | 39 kB 00:00 2023-12-11T17:07:20.895 INFO:teuthology.orchestra.run.smithi151.stdout:(74/149): python3-pyasn1-modules-0.4.8-6.el9.no 2.8 MB/s | 211 kB 00:00 2023-12-11T17:07:20.920 INFO:teuthology.orchestra.run.smithi151.stdout:(75/149): python3-pytz-2021.1-5.el9.noarch.rpm 1.9 MB/s | 47 kB 00:00 2023-12-11T17:07:20.937 INFO:teuthology.orchestra.run.smithi151.stdout:(76/149): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 43 kB 00:00 2023-12-11T17:07:20.987 INFO:teuthology.orchestra.run.smithi151.stdout:(77/149): python3-toml-0.10.2-6.el9.noarch.rpm 792 kB/s | 39 kB 00:00 2023-12-11T17:07:21.061 INFO:teuthology.orchestra.run.smithi037.stdout:(78/149): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2023-12-11T17:07:21.095 INFO:teuthology.orchestra.run.smithi037.stdout:(79/149): socat-1.7.4.1-5.el9.x86_64.rpm 1.3 MB/s | 300 kB 00:00 2023-12-11T17:07:21.120 INFO:teuthology.orchestra.run.smithi037.stdout:(80/149): uuid-1.6.2-55.el9.x86_64.rpm 1.0 MB/s | 56 kB 00:00 2023-12-11T17:07:21.145 INFO:teuthology.orchestra.run.smithi037.stdout:(81/149): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.7 MB/s | 85 kB 00:00 2023-12-11T17:07:21.170 INFO:teuthology.orchestra.run.smithi037.stdout:(82/149): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.3 MB/s | 63 kB 00:00 2023-12-11T17:07:21.196 INFO:teuthology.orchestra.run.smithi037.stdout:(83/149): zlib-devel-1.2.11-40.el9.x86_64.rpm 906 kB/s | 44 kB 00:00 2023-12-11T17:07:21.221 INFO:teuthology.orchestra.run.smithi037.stdout:(84/149): fuse-2.9.9-15.el9.x86_64.rpm 1.6 MB/s | 79 kB 00:00 2023-12-11T17:07:21.280 INFO:teuthology.orchestra.run.smithi037.stdout:(85/149): libgfortran-11.4.1-2.3.el9.x86_64.rpm 9.5 MB/s | 803 kB 00:00 2023-12-11T17:07:21.304 INFO:teuthology.orchestra.run.smithi151.stdout:(78/149): python3-scipy-1.6.2-8.el9.x86_64.rpm 43 MB/s | 16 MB 00:00 2023-12-11T17:07:21.313 INFO:teuthology.orchestra.run.smithi037.stdout:(86/149): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2023-12-11T17:07:21.338 INFO:teuthology.orchestra.run.smithi151.stdout:(79/149): socat-1.7.4.1-5.el9.x86_64.rpm 891 kB/s | 300 kB 00:00 2023-12-11T17:07:21.355 INFO:teuthology.orchestra.run.smithi037.stdout:(87/149): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.2 MB/s | 241 kB 00:00 2023-12-11T17:07:21.380 INFO:teuthology.orchestra.run.smithi151.stdout:(80/149): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 56 kB 00:00 2023-12-11T17:07:21.405 INFO:teuthology.orchestra.run.smithi151.stdout:(81/149): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.3 MB/s | 85 kB 00:00 2023-12-11T17:07:21.414 INFO:teuthology.orchestra.run.smithi037.stdout:(88/149): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.1 MB 00:00 2023-12-11T17:07:21.439 INFO:teuthology.orchestra.run.smithi151.stdout:(82/149): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.3 MB/s | 44 kB 00:00 2023-12-11T17:07:21.439 INFO:teuthology.orchestra.run.smithi037.stdout:(89/149): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2023-12-11T17:07:21.464 INFO:teuthology.orchestra.run.smithi037.stdout:(90/149): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2023-12-11T17:07:21.465 INFO:teuthology.orchestra.run.smithi151.stdout:(83/149): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 63 kB 00:00 2023-12-11T17:07:21.490 INFO:teuthology.orchestra.run.smithi037.stdout:(91/149): python3-requests-2.25.1-7.el9.noarch. 2.3 MB/s | 113 kB 00:00 2023-12-11T17:07:21.490 INFO:teuthology.orchestra.run.smithi151.stdout:(84/149): fuse-2.9.9-15.el9.x86_64.rpm 1.5 MB/s | 79 kB 00:00 2023-12-11T17:07:21.523 INFO:teuthology.orchestra.run.smithi037.stdout:(92/149): python3-urllib3-1.26.5-4.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2023-12-11T17:07:21.532 INFO:teuthology.orchestra.run.smithi151.stdout:(85/149): libgfortran-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2023-12-11T17:07:21.566 INFO:teuthology.orchestra.run.smithi151.stdout:(86/149): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.8 MB/s | 195 kB 00:00 2023-12-11T17:07:21.608 INFO:teuthology.orchestra.run.smithi151.stdout:(87/149): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.2 MB/s | 241 kB 00:00 2023-12-11T17:07:21.640 INFO:teuthology.orchestra.run.smithi037.stdout:(93/149): python3-devel-3.9.17-2.el9.x86_64.rpm 2.1 MB/s | 245 kB 00:00 2023-12-11T17:07:21.666 INFO:teuthology.orchestra.run.smithi151.stdout:(88/149): python3-cryptography-36.0.1-4.el9.x86 12 MB/s | 1.1 MB 00:00 2023-12-11T17:07:21.692 INFO:teuthology.orchestra.run.smithi151.stdout:(89/149): python3-ply-3.11-14.el9.noarch.rpm 1.4 MB/s | 103 kB 00:00 2023-12-11T17:07:21.717 INFO:teuthology.orchestra.run.smithi151.stdout:(90/149): python3-pycparser-2.20-6.el9.noarch.r 2.5 MB/s | 124 kB 00:00 2023-12-11T17:07:21.742 INFO:teuthology.orchestra.run.smithi151.stdout:(91/149): python3-requests-2.25.1-7.el9.noarch. 2.3 MB/s | 113 kB 00:00 2023-12-11T17:07:21.776 INFO:teuthology.orchestra.run.smithi151.stdout:(92/149): python3-urllib3-1.26.5-4.el9.noarch.r 3.2 MB/s | 187 kB 00:00 2023-12-11T17:07:21.832 INFO:teuthology.orchestra.run.smithi037.stdout:(94/149): openssl-devel-3.0.7-25.el9.x86_64.rpm 12 MB/s | 4.1 MB 00:00 2023-12-11T17:07:21.977 INFO:teuthology.orchestra.run.smithi151.stdout:(93/149): python3-devel-3.9.17-2.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2023-12-11T17:07:22.174 INFO:teuthology.orchestra.run.smithi037.stdout:(95/149): gperftools-libs-2.9.1-2.el9.x86_64.rp 580 kB/s | 309 kB 00:00 2023-12-11T17:07:22.391 INFO:teuthology.orchestra.run.smithi037.stdout:(96/149): libarrow-doc-9.0.0-10.el9.noarch.rpm 120 kB/s | 26 kB 00:00 2023-12-11T17:07:22.500 INFO:teuthology.orchestra.run.smithi037.stdout:(97/149): liboath-2.6.7-2.el9.x86_64.rpm 451 kB/s | 49 kB 00:00 2023-12-11T17:07:22.600 INFO:teuthology.orchestra.run.smithi037.stdout:(98/149): libunwind-1.6.2-1.el9.x86_64.rpm 680 kB/s | 67 kB 00:00 2023-12-11T17:07:22.726 INFO:teuthology.orchestra.run.smithi037.stdout:(99/149): luarocks-3.9.2-1.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2023-12-11T17:07:22.859 INFO:teuthology.orchestra.run.smithi037.stdout:(100/149): libarrow-9.0.0-10.el9.x86_64.rpm 4.3 MB/s | 4.4 MB 00:01 2023-12-11T17:07:22.994 INFO:teuthology.orchestra.run.smithi151.stdout:(94/149): openssl-devel-3.0.7-25.el9.x86_64.rpm 3.3 MB/s | 4.1 MB 00:01 2023-12-11T17:07:23.384 INFO:teuthology.orchestra.run.smithi037.stdout:(101/149): ceph-test-19.0.0-119.ga62fda73.el9.x 4.8 MB/s | 41 MB 00:08 2023-12-11T17:07:23.435 INFO:teuthology.orchestra.run.smithi037.stdout:(102/149): parquet-libs-9.0.0-10.el9.x86_64.rpm 1.2 MB/s | 838 kB 00:00 2023-12-11T17:07:23.468 INFO:teuthology.orchestra.run.smithi037.stdout:(103/149): python3-asyncssh-2.13.2-3.el9.noarch 901 kB/s | 548 kB 00:00 2023-12-11T17:07:23.535 INFO:teuthology.orchestra.run.smithi037.stdout:(104/149): python3-cachetools-4.2.4-1.el9.noarc 323 kB/s | 32 kB 00:00 2023-12-11T17:07:23.561 INFO:teuthology.orchestra.run.smithi037.stdout:(105/149): python3-certifi-2021.10.8-2.el9.noar 164 kB/s | 15 kB 00:00 2023-12-11T17:07:23.644 INFO:teuthology.orchestra.run.smithi037.stdout:(106/149): python3-cheroot-8.6.0-4.el9.noarch.r 1.5 MB/s | 172 kB 00:00 2023-12-11T17:07:23.669 INFO:teuthology.orchestra.run.smithi151.stdout:(95/149): gperftools-libs-2.9.1-2.el9.x86_64.rp 183 kB/s | 309 kB 00:01 2023-12-11T17:07:23.678 INFO:teuthology.orchestra.run.smithi037.stdout:(107/149): python3-cherrypy-18.6.1-2.el9.noarch 3.0 MB/s | 358 kB 00:00 2023-12-11T17:07:23.703 INFO:teuthology.orchestra.run.smithi037.stdout:(108/149): python3-bcrypt-3.2.2-1.el9.x86_64.rp 137 kB/s | 43 kB 00:00 2023-12-11T17:07:23.754 INFO:teuthology.orchestra.run.smithi037.stdout:(109/149): python3-google-auth-2.23.4-1.el9.noa 1.8 MB/s | 197 kB 00:00 2023-12-11T17:07:23.779 INFO:teuthology.orchestra.run.smithi037.stdout:(110/149): python3-jaraco-8.2.1-3.el9.noarch.rp 107 kB/s | 11 kB 00:00 2023-12-11T17:07:23.829 INFO:teuthology.orchestra.run.smithi037.stdout:(111/149): python3-jaraco-classes-3.2.1-5.el9.n 141 kB/s | 18 kB 00:00 2023-12-11T17:07:23.871 INFO:teuthology.orchestra.run.smithi037.stdout:(112/149): python3-jaraco-collections-3.0.0-8.e 198 kB/s | 23 kB 00:00 2023-12-11T17:07:23.913 INFO:teuthology.orchestra.run.smithi037.stdout:(113/149): python3-jaraco-functools-3.5.0-2.el9 146 kB/s | 19 kB 00:00 2023-12-11T17:07:23.955 INFO:teuthology.orchestra.run.smithi037.stdout:(114/149): python3-jaraco-text-3.2.0-6.el9.noar 157 kB/s | 20 kB 00:00 2023-12-11T17:07:23.997 INFO:teuthology.orchestra.run.smithi037.stdout:(115/149): python3-jwt+crypto-2.4.0-1.el9.noarc 72 kB/s | 9.0 kB 00:00 2023-12-11T17:07:24.039 INFO:teuthology.orchestra.run.smithi037.stdout:(116/149): python3-jwt-2.4.0-1.el9.noarch.rpm 328 kB/s | 41 kB 00:00 2023-12-11T17:07:24.139 INFO:teuthology.orchestra.run.smithi037.stdout:(117/149): python3-kubernetes-26.1.0-2.el9.noar 5.6 MB/s | 1.0 MB 00:00 2023-12-11T17:07:24.161 INFO:teuthology.orchestra.run.smithi151.stdout:(96/149): libarrow-doc-9.0.0-10.el9.noarch.rpm 53 kB/s | 26 kB 00:00 2023-12-11T17:07:24.181 INFO:teuthology.orchestra.run.smithi037.stdout:(118/149): python3-logutils-0.3.5-21.el9.noarch 253 kB/s | 46 kB 00:00 2023-12-11T17:07:24.206 INFO:teuthology.orchestra.run.smithi037.stdout:(119/149): python3-more-itertools-8.12.0-2.el9. 473 kB/s | 79 kB 00:00 2023-12-11T17:07:24.257 INFO:teuthology.orchestra.run.smithi037.stdout:(120/149): python3-natsort-7.1.1-5.el9.noarch.r 496 kB/s | 58 kB 00:00 2023-12-11T17:07:24.335 INFO:teuthology.orchestra.run.smithi037.stdout:(121/149): python3-portend-3.1.0-2.el9.noarch.r 129 kB/s | 16 kB 00:00 2023-12-11T17:07:24.365 INFO:teuthology.orchestra.run.smithi037.stdout:(122/149): python3-pyOpenSSL-21.0.0-1.el9.noarc 834 kB/s | 90 kB 00:00 2023-12-11T17:07:24.457 INFO:teuthology.orchestra.run.smithi037.stdout:(123/149): python3-repoze-lru-0.7-16.el9.noarch 253 kB/s | 31 kB 00:00 2023-12-11T17:07:24.491 INFO:teuthology.orchestra.run.smithi037.stdout:(124/149): python3-pecan-1.4.2-3.el9.noarch.rpm 881 kB/s | 272 kB 00:00 2023-12-11T17:07:24.495 INFO:teuthology.orchestra.run.smithi151.stdout:(97/149): liboath-2.6.7-2.el9.x86_64.rpm 147 kB/s | 49 kB 00:00 2023-12-11T17:07:24.516 INFO:teuthology.orchestra.run.smithi037.stdout:(125/149): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2023-12-11T17:07:24.575 INFO:teuthology.orchestra.run.smithi037.stdout:(126/149): python3-rsa-4.9-2.el9.noarch.rpm 508 kB/s | 59 kB 00:00 2023-12-11T17:07:24.595 INFO:teuthology.orchestra.run.smithi151.stdout:(98/149): libarrow-9.0.0-10.el9.x86_64.rpm 2.8 MB/s | 4.4 MB 00:01 2023-12-11T17:07:24.625 INFO:teuthology.orchestra.run.smithi037.stdout:(127/149): python3-tempora-5.0.0-2.el9.noarch.r 268 kB/s | 36 kB 00:00 2023-12-11T17:07:24.676 INFO:teuthology.orchestra.run.smithi037.stdout:(128/149): python3-typing-extensions-4.4.0-2.el 322 kB/s | 51 kB 00:00 2023-12-11T17:07:24.709 INFO:teuthology.orchestra.run.smithi037.stdout:(129/149): python3-webob-1.8.7-6.el9.noarch.rpm 1.7 MB/s | 230 kB 00:00 2023-12-11T17:07:24.729 INFO:teuthology.orchestra.run.smithi151.stdout:(99/149): libunwind-1.6.2-1.el9.x86_64.rpm 293 kB/s | 67 kB 00:00 2023-12-11T17:07:24.751 INFO:teuthology.orchestra.run.smithi037.stdout:(130/149): python3-websocket-client-1.2.3-2.el9 719 kB/s | 90 kB 00:00 2023-12-11T17:07:24.784 INFO:teuthology.orchestra.run.smithi037.stdout:(131/149): python3-werkzeug-2.0.3-3.el9.1.noarc 3.9 MB/s | 427 kB 00:00 2023-12-11T17:07:24.829 INFO:teuthology.orchestra.run.smithi151.stdout:(100/149): luarocks-3.9.2-1.el9.noarch.rpm 648 kB/s | 151 kB 00:00 2023-12-11T17:07:24.835 INFO:teuthology.orchestra.run.smithi037.stdout:(132/149): python3-zc-lockfile-2.0-10.el9.noarc 160 kB/s | 20 kB 00:00 2023-12-11T17:07:24.893 INFO:teuthology.orchestra.run.smithi037.stdout:(133/149): re2-20211101-3.el9.x86_64.rpm 1.3 MB/s | 192 kB 00:00 2023-12-11T17:07:24.969 INFO:teuthology.orchestra.run.smithi037.stdout:(134/149): thrift-0.15.0-2.el9.x86_64.rpm 8.6 MB/s | 1.6 MB 00:00 2023-12-11T17:07:24.996 INFO:teuthology.orchestra.run.smithi151.stdout:(101/149): parquet-libs-9.0.0-10.el9.x86_64.rpm 3.1 MB/s | 838 kB 00:00 2023-12-11T17:07:25.002 INFO:teuthology.orchestra.run.smithi037.stdout:(135/149): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-12-11T17:07:25.028 INFO:teuthology.orchestra.run.smithi037.stdout:(136/149): acl-2.3.1-4.el9.x86_64.rpm 2.7 MB/s | 69 kB 00:00 2023-12-11T17:07:25.078 INFO:teuthology.orchestra.run.smithi037.stdout:(137/149): elfutils-debuginfod-client-0.190-1.e 741 kB/s | 36 kB 00:00 2023-12-11T17:07:25.097 INFO:teuthology.orchestra.run.smithi151.stdout:(102/149): python3-asyncssh-2.13.2-3.el9.noarch 2.0 MB/s | 548 kB 00:00 2023-12-11T17:07:25.120 INFO:teuthology.orchestra.run.smithi037.stdout:(138/149): elfutils-libelf-0.190-1.el9.x86_64.r 4.6 MB/s | 192 kB 00:00 2023-12-11T17:07:25.162 INFO:teuthology.orchestra.run.smithi037.stdout:(139/149): elfutils-libs-0.190-1.el9.x86_64.rpm 6.1 MB/s | 255 kB 00:00 2023-12-11T17:07:25.212 INFO:teuthology.orchestra.run.smithi037.stdout:(140/149): libacl-2.3.1-4.el9.x86_64.rpm 446 kB/s | 22 kB 00:00 2023-12-11T17:07:25.230 INFO:teuthology.orchestra.run.smithi151.stdout:(103/149): python3-bcrypt-3.2.2-1.el9.x86_64.rp 186 kB/s | 43 kB 00:00 2023-12-11T17:07:25.254 INFO:teuthology.orchestra.run.smithi037.stdout:(141/149): xfsdump-3.1.12-4.el9.x86_64.rpm 7.8 MB/s | 321 kB 00:00 2023-12-11T17:07:25.348 INFO:teuthology.orchestra.run.smithi151.stdout:(104/149): python3-cachetools-4.2.4-1.el9.noarc 129 kB/s | 32 kB 00:00 2023-12-11T17:07:25.465 INFO:teuthology.orchestra.run.smithi151.stdout:(105/149): python3-certifi-2021.10.8-2.el9.noar 64 kB/s | 15 kB 00:00 2023-12-11T17:07:25.505 INFO:teuthology.orchestra.run.smithi037.stdout:(142/149): librados2-19.0.0-119.ga62fda73.el9.x 5.0 MB/s | 3.3 MB 00:00 2023-12-11T17:07:25.588 INFO:teuthology.orchestra.run.smithi037.stdout:(143/149): librbd1-19.0.0-119.ga62fda73.el9.x86 4.4 MB/s | 3.0 MB 00:00 2023-12-11T17:07:25.590 INFO:teuthology.orchestra.run.smithi151.stdout:(106/149): python3-cheroot-8.6.0-4.el9.noarch.r 711 kB/s | 172 kB 00:00 2023-12-11T17:07:25.716 INFO:teuthology.orchestra.run.smithi151.stdout:(107/149): python3-cherrypy-18.6.1-2.el9.noarch 1.4 MB/s | 358 kB 00:00 2023-12-11T17:07:25.780 INFO:teuthology.orchestra.run.smithi037.stdout:(144/149): NetworkManager-team-1.45.7-1.el9.x86 226 kB/s | 43 kB 00:00 2023-12-11T17:07:25.832 INFO:teuthology.orchestra.run.smithi151.stdout:(108/149): python3-google-auth-2.23.4-1.el9.noa 818 kB/s | 197 kB 00:00 2023-12-11T17:07:25.950 INFO:teuthology.orchestra.run.smithi151.stdout:(109/149): python3-jaraco-8.2.1-3.el9.noarch.rp 46 kB/s | 11 kB 00:00 2023-12-11T17:07:25.955 INFO:teuthology.orchestra.run.smithi037.stdout:(145/149): NetworkManager-tui-1.45.7-1.el9.x86_ 1.4 MB/s | 246 kB 00:00 2023-12-11T17:07:26.067 INFO:teuthology.orchestra.run.smithi151.stdout:(110/149): python3-jaraco-classes-3.2.1-5.el9.n 76 kB/s | 18 kB 00:00 2023-12-11T17:07:26.131 INFO:teuthology.orchestra.run.smithi037.stdout:(146/149): NetworkManager-1.45.7-1.el9.x86_64.r 2.6 MB/s | 2.3 MB 00:00 2023-12-11T17:07:26.184 INFO:teuthology.orchestra.run.smithi151.stdout:(111/149): python3-jaraco-collections-3.0.0-8.e 99 kB/s | 23 kB 00:00 2023-12-11T17:07:26.289 INFO:teuthology.orchestra.run.smithi037.stdout:(147/149): NetworkManager-libnm-1.45.7-1.el9.x8 2.3 MB/s | 1.8 MB 00:00 2023-12-11T17:07:26.301 INFO:teuthology.orchestra.run.smithi151.stdout:(112/149): python3-jaraco-functools-3.5.0-2.el9 83 kB/s | 19 kB 00:00 2023-12-11T17:07:26.389 INFO:teuthology.orchestra.run.smithi037.stdout:(148/149): openssl-3.0.7-25.el9.x86_64.rpm 2.8 MB/s | 1.2 MB 00:00 2023-12-11T17:07:26.443 INFO:teuthology.orchestra.run.smithi151.stdout:(113/149): python3-jaraco-text-3.2.0-6.el9.noar 76 kB/s | 20 kB 00:00 2023-12-11T17:07:26.535 INFO:teuthology.orchestra.run.smithi151.stdout:(114/149): python3-jwt+crypto-2.4.0-1.el9.noarc 39 kB/s | 9.0 kB 00:00 2023-12-11T17:07:26.677 INFO:teuthology.orchestra.run.smithi151.stdout:(115/149): python3-jwt-2.4.0-1.el9.noarch.rpm 175 kB/s | 41 kB 00:00 2023-12-11T17:07:26.819 INFO:teuthology.orchestra.run.smithi151.stdout:(116/149): python3-kubernetes-26.1.0-2.el9.noar 3.6 MB/s | 1.0 MB 00:00 2023-12-11T17:07:26.911 INFO:teuthology.orchestra.run.smithi151.stdout:(117/149): python3-logutils-0.3.5-21.el9.noarch 198 kB/s | 46 kB 00:00 2023-12-11T17:07:27.061 INFO:teuthology.orchestra.run.smithi151.stdout:(118/149): python3-more-itertools-8.12.0-2.el9. 327 kB/s | 79 kB 00:00 2023-12-11T17:07:27.537 INFO:teuthology.orchestra.run.smithi151.stdout:(119/149): ceph-test-19.0.0-119.ga62fda73.el9.x 3.2 MB/s | 41 MB 00:12 2023-12-11T17:07:27.570 INFO:teuthology.orchestra.run.smithi151.stdout:(120/149): python3-natsort-7.1.1-5.el9.noarch.r 88 kB/s | 58 kB 00:00 2023-12-11T17:07:27.596 INFO:teuthology.orchestra.run.smithi151.stdout:(121/149): python3-pecan-1.4.2-3.el9.noarch.rpm 510 kB/s | 272 kB 00:00 2023-12-11T17:07:27.656 INFO:teuthology.orchestra.run.smithi037.stdout:(149/149): openssl-libs-3.0.7-25.el9.x86_64.rpm 1.4 MB/s | 2.2 MB 00:01 2023-12-11T17:07:27.664 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-12-11T17:07:27.665 INFO:teuthology.orchestra.run.smithi037.stdout:Total 12 MB/s | 204 MB 00:17 2023-12-11T17:07:27.779 INFO:teuthology.orchestra.run.smithi151.stdout:(122/149): python3-portend-3.1.0-2.el9.noarch.r 69 kB/s | 16 kB 00:00 2023-12-11T17:07:27.830 INFO:teuthology.orchestra.run.smithi151.stdout:(123/149): python3-pyOpenSSL-21.0.0-1.el9.noarc 386 kB/s | 90 kB 00:00 2023-12-11T17:07:27.855 INFO:teuthology.orchestra.run.smithi151.stdout:(124/149): python3-repoze-lru-0.7-16.el9.noarch 119 kB/s | 31 kB 00:00 2023-12-11T17:07:28.031 INFO:teuthology.orchestra.run.smithi151.stdout:(125/149): python3-routes-2.5.1-5.el9.noarch.rp 753 kB/s | 188 kB 00:00 2023-12-11T17:07:28.056 INFO:teuthology.orchestra.run.smithi151.stdout:(126/149): python3-rsa-4.9-2.el9.noarch.rpm 262 kB/s | 59 kB 00:00 2023-12-11T17:07:28.081 INFO:teuthology.orchestra.run.smithi151.stdout:(127/149): python3-tempora-5.0.0-2.el9.noarch.r 159 kB/s | 36 kB 00:00 2023-12-11T17:07:28.098 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-12-11T17:07:28.265 INFO:teuthology.orchestra.run.smithi151.stdout:(128/149): python3-typing-extensions-4.4.0-2.el 218 kB/s | 51 kB 00:00 2023-12-11T17:07:28.307 INFO:teuthology.orchestra.run.smithi151.stdout:(129/149): python3-webob-1.8.7-6.el9.noarch.rpm 918 kB/s | 230 kB 00:00 2023-12-11T17:07:28.333 INFO:teuthology.orchestra.run.smithi151.stdout:(130/149): python3-websocket-client-1.2.3-2.el9 358 kB/s | 90 kB 00:00 2023-12-11T17:07:28.397 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-12-11T17:07:28.397 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-12-11T17:07:28.516 INFO:teuthology.orchestra.run.smithi151.stdout:(131/149): python3-werkzeug-2.0.3-3.el9.1.noarc 1.7 MB/s | 427 kB 00:00 2023-12-11T17:07:28.541 INFO:teuthology.orchestra.run.smithi151.stdout:(132/149): python3-zc-lockfile-2.0-10.el9.noarc 86 kB/s | 20 kB 00:00 2023-12-11T17:07:28.600 INFO:teuthology.orchestra.run.smithi151.stdout:(133/149): re2-20211101-3.el9.x86_64.rpm 717 kB/s | 192 kB 00:00 2023-12-11T17:07:28.834 INFO:teuthology.orchestra.run.smithi151.stdout:(134/149): thrift-0.15.0-2.el9.x86_64.rpm 5.0 MB/s | 1.6 MB 00:00 2023-12-11T17:07:28.867 INFO:teuthology.orchestra.run.smithi151.stdout:(135/149): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-12-11T17:07:28.910 INFO:teuthology.orchestra.run.smithi151.stdout:(136/149): acl-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 69 kB 00:00 2023-12-11T17:07:28.943 INFO:teuthology.orchestra.run.smithi151.stdout:(137/149): elfutils-debuginfod-client-0.190-1.e 1.1 MB/s | 36 kB 00:00 2023-12-11T17:07:28.985 INFO:teuthology.orchestra.run.smithi151.stdout:(138/149): elfutils-libelf-0.190-1.el9.x86_64.r 4.6 MB/s | 192 kB 00:00 2023-12-11T17:07:29.027 INFO:teuthology.orchestra.run.smithi151.stdout:(139/149): elfutils-libs-0.190-1.el9.x86_64.rpm 6.1 MB/s | 255 kB 00:00 2023-12-11T17:07:29.061 INFO:teuthology.orchestra.run.smithi151.stdout:(140/149): libacl-2.3.1-4.el9.x86_64.rpm 674 kB/s | 22 kB 00:00 2023-12-11T17:07:29.103 INFO:teuthology.orchestra.run.smithi151.stdout:(141/149): xfsdump-3.1.12-4.el9.x86_64.rpm 7.6 MB/s | 321 kB 00:00 2023-12-11T17:07:29.320 INFO:teuthology.orchestra.run.smithi151.stdout:(142/149): librados2-19.0.0-119.ga62fda73.el9.x 4.3 MB/s | 3.3 MB 00:00 2023-12-11T17:07:29.571 INFO:teuthology.orchestra.run.smithi151.stdout:(143/149): NetworkManager-libnm-1.45.7-1.el9.x8 7.1 MB/s | 1.8 MB 00:00 2023-12-11T17:07:29.699 INFO:teuthology.orchestra.run.smithi151.stdout:(144/149): NetworkManager-1.45.7-1.el9.x86_64.r 3.8 MB/s | 2.3 MB 00:00 2023-12-11T17:07:29.730 INFO:teuthology.orchestra.run.smithi151.stdout:(145/149): NetworkManager-team-1.45.7-1.el9.x86 274 kB/s | 43 kB 00:00 2023-12-11T17:07:29.805 INFO:teuthology.orchestra.run.smithi151.stdout:(146/149): librbd1-19.0.0-119.ga62fda73.el9.x86 2.5 MB/s | 3.0 MB 00:01 2023-12-11T17:07:29.839 INFO:teuthology.orchestra.run.smithi151.stdout:(147/149): NetworkManager-tui-1.45.7-1.el9.x86_ 1.7 MB/s | 246 kB 00:00 2023-12-11T17:07:29.898 INFO:teuthology.orchestra.run.smithi151.stdout:(148/149): openssl-3.0.7-25.el9.x86_64.rpm 7.3 MB/s | 1.2 MB 00:00 2023-12-11T17:07:30.131 INFO:teuthology.orchestra.run.smithi151.stdout:(149/149): openssl-libs-3.0.7-25.el9.x86_64.rpm 6.6 MB/s | 2.2 MB 00:00 2023-12-11T17:07:30.141 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2023-12-11T17:07:30.141 INFO:teuthology.orchestra.run.smithi151.stdout:Total 11 MB/s | 204 MB 00:18 2023-12-11T17:07:30.554 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2023-12-11T17:07:30.610 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-12-11T17:07:30.611 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-12-11T17:07:30.836 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2023-12-11T17:07:30.836 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2023-12-11T17:07:33.036 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2023-12-11T17:07:33.036 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2023-12-11T17:07:36.985 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-12-11T17:07:37.175 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/164 2023-12-11T17:07:37.206 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/164 2023-12-11T17:07:37.291 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/164 2023-12-11T17:07:37.352 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/164 2023-12-11T17:07:37.390 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2023-12-11T17:07:37.492 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2023-12-11T17:07:37.935 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2023-12-11T17:07:37.970 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:19.0.0-119.ga62fda73.el9.x86_64 8/164 2023-12-11T17:07:38.144 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:19.0.0-119.ga62fda73.el9.x86_64 8/164 2023-12-11T17:07:38.188 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:19.0.0-119.ga62fda73.el9.x86_64 9/164 2023-12-11T17:07:38.347 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:19.0.0-119.ga62fda73.el9.x86_64 9/164 2023-12-11T17:07:38.384 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:19.0.0-119.ga62fda73.el9.x86_64 10/164 2023-12-11T17:07:38.454 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/164 2023-12-11T17:07:38.749 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/164 2023-12-11T17:07:38.818 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/164 2023-12-11T17:07:38.843 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:19.0.0-119.ga62fda73.el9.x86_64 14/164 2023-12-11T17:07:39.048 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:19.0.0-119.ga62fda73.el9.x86_64 14/164 2023-12-11T17:07:39.077 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:19.0.0-119.ga62fda73.el9.x86_ 15/164 2023-12-11T17:07:39.479 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:19.0.0-119.ga62fda73.el9.x86_ 15/164 2023-12-11T17:07:39.481 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2023-12-11T17:07:39.655 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/164 2023-12-11T17:07:39.657 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/164 2023-12-11T17:07:39.690 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/164 2023-12-11T17:07:39.745 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/164 2023-12-11T17:07:39.779 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/164 2023-12-11T17:07:39.835 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/164 2023-12-11T17:07:39.866 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2023-12-11T17:07:39.947 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-11T17:07:39.955 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2023-12-11T17:07:39.993 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-11T17:07:40.366 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-11T17:07:40.367 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2023-12-11T17:07:40.406 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librados2-2:19.0.0-119.ga62fda73.el9.x86_64 8/164 2023-12-11T17:07:40.546 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/164 2023-12-11T17:07:40.577 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:19.0.0-119.ga62fda73.el9.x86_64 8/164 2023-12-11T17:07:40.599 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/164 2023-12-11T17:07:40.642 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs2-2:19.0.0-119.ga62fda73.el9.x86_64 9/164 2023-12-11T17:07:40.750 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/164 2023-12-11T17:07:40.776 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephfs2-2:19.0.0-119.ga62fda73.el9.x86_64 9/164 2023-12-11T17:07:40.813 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rados-2:19.0.0-119.ga62fda73.el9.x86_64 10/164 2023-12-11T17:07:40.826 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/164 2023-12-11T17:07:40.861 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/164 2023-12-11T17:07:40.873 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/164 2023-12-11T17:07:40.901 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/164 2023-12-11T17:07:40.945 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/164 2023-12-11T17:07:41.056 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/164 2023-12-11T17:07:41.103 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/164 2023-12-11T17:07:41.137 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/164 2023-12-11T17:07:41.156 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/164 2023-12-11T17:07:41.226 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/164 2023-12-11T17:07:41.254 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/164 2023-12-11T17:07:41.256 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephsqlite-2:19.0.0-119.ga62fda73.el9.x86_64 14/164 2023-12-11T17:07:41.292 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:19.0.0-119.ga62fda73.el9.x 29/164 2023-12-11T17:07:41.342 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:19.0.0-119.ga62fda73.el9 30/164 2023-12-11T17:07:41.416 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephsqlite-2:19.0.0-119.ga62fda73.el9.x86_64 14/164 2023-12-11T17:07:41.449 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libradosstriper1-2:19.0.0-119.ga62fda73.el9.x86_ 15/164 2023-12-11T17:07:41.454 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:19.0.0-119.ga62fda73.el9.x86_64 31/164 2023-12-11T17:07:41.634 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/164 2023-12-11T17:07:41.703 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/164 2023-12-11T17:07:41.820 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libradosstriper1-2:19.0.0-119.ga62fda73.el9.x86_ 15/164 2023-12-11T17:07:42.038 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/164 2023-12-11T17:07:42.144 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/164 2023-12-11T17:07:42.352 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-11T17:07:42.442 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-11T17:07:42.456 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/164 2023-12-11T17:07:42.554 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/164 2023-12-11T17:07:42.607 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/164 2023-12-11T17:07:42.649 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/164 2023-12-11T17:07:42.676 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:19.0.0-119.ga62fda73.el9.x86_64 38/164 2023-12-11T17:07:42.738 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/164 2023-12-11T17:07:42.759 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/164 2023-12-11T17:07:42.936 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/164 2023-12-11T17:07:42.954 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/164 2023-12-11T17:07:42.984 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/164 2023-12-11T17:07:42.990 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/164 2023-12-11T17:07:43.102 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/164 2023-12-11T17:07:43.132 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/164 2023-12-11T17:07:43.165 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/164 2023-12-11T17:07:43.170 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/164 2023-12-11T17:07:43.203 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/164 2023-12-11T17:07:43.233 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/164 2023-12-11T17:07:43.251 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/164 2023-12-11T17:07:43.296 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/164 2023-12-11T17:07:43.321 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/164 2023-12-11T17:07:43.363 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/164 2023-12-11T17:07:43.396 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/164 2023-12-11T17:07:43.402 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/164 2023-12-11T17:07:43.438 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/164 2023-12-11T17:07:43.468 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/164 2023-12-11T17:07:43.473 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/164 2023-12-11T17:07:43.529 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/164 2023-12-11T17:07:43.589 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/164 2023-12-11T17:07:43.598 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/164 2023-12-11T17:07:43.637 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-common-2:19.0.0-119.ga62fda73.el9.x 29/164 2023-12-11T17:07:43.697 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-argparse-2:19.0.0-119.ga62fda73.el9 30/164 2023-12-11T17:07:43.787 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/164 2023-12-11T17:07:43.805 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cephfs-2:19.0.0-119.ga62fda73.el9.x86_64 31/164 2023-12-11T17:07:43.837 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/164 2023-12-11T17:07:43.892 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/164 2023-12-11T17:07:43.982 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/164 2023-12-11T17:07:44.033 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/164 2023-12-11T17:07:44.050 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/164 2023-12-11T17:07:44.069 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/164 2023-12-11T17:07:44.119 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/164 2023-12-11T17:07:44.152 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/164 2023-12-11T17:07:44.311 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 58/164 2023-12-11T17:07:44.358 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/164 2023-12-11T17:07:44.426 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/164 2023-12-11T17:07:44.510 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/164 2023-12-11T17:07:44.739 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/164 2023-12-11T17:07:44.784 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/164 2023-12-11T17:07:44.844 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/164 2023-12-11T17:07:44.905 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/164 2023-12-11T17:07:44.952 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/164 2023-12-11T17:07:45.021 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/164 2023-12-11T17:07:45.034 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/164 2023-12-11T17:07:45.072 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/164 2023-12-11T17:07:45.082 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librados-devel-2:19.0.0-119.ga62fda73.el9.x86_64 38/164 2023-12-11T17:07:45.104 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/164 2023-12-11T17:07:45.143 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/164 2023-12-11T17:07:45.146 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/164 2023-12-11T17:07:45.187 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/164 2023-12-11T17:07:45.232 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/164 2023-12-11T17:07:45.275 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/164 2023-12-11T17:07:45.347 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/164 2023-12-11T17:07:45.358 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/164 2023-12-11T17:07:45.394 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/164 2023-12-11T17:07:45.426 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/164 2023-12-11T17:07:45.492 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2023-12-11T17:07:45.539 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/164 2023-12-11T17:07:45.581 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/164 2023-12-11T17:07:45.630 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2023-12-11T17:07:45.643 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/164 2023-12-11T17:07:45.677 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/164 2023-12-11T17:07:45.714 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/164 2023-12-11T17:07:45.732 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/164 2023-12-11T17:07:45.773 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/164 2023-12-11T17:07:45.779 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/164 2023-12-11T17:07:45.812 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/164 2023-12-11T17:07:45.841 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/164 2023-12-11T17:07:45.881 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/164 2023-12-11T17:07:45.938 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/164 2023-12-11T17:07:45.996 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/164 2023-12-11T17:07:45.997 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 50/164 2023-12-11T17:07:46.038 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/164 2023-12-11T17:07:46.188 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 51/164 2023-12-11T17:07:46.190 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2023-12-11T17:07:46.240 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 52/164 2023-12-11T17:07:46.253 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2023-12-11T17:07:46.286 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 53/164 2023-12-11T17:07:46.412 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 54/164 2023-12-11T17:07:46.449 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 55/164 2023-12-11T17:07:46.495 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 56/164 2023-12-11T17:07:46.531 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 57/164 2023-12-11T17:07:46.671 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 58/164 2023-12-11T17:07:46.728 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 59/164 2023-12-11T17:07:46.797 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ply-3.11-14.el9.noarch 60/164 2023-12-11T17:07:46.879 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 61/164 2023-12-11T17:07:47.152 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 62/164 2023-12-11T17:07:47.217 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 63/164 2023-12-11T17:07:47.267 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2023-12-11T17:07:47.318 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2023-12-11T17:07:47.370 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2023-12-11T17:07:47.389 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 64/164 2023-12-11T17:07:47.410 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2023-12-11T17:07:47.445 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 65/164 2023-12-11T17:07:47.470 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 66/164 2023-12-11T17:07:47.508 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 67/164 2023-12-11T17:07:47.552 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 68/164 2023-12-11T17:07:47.589 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fuse-2.9.9-15.el9.x86_64 69/164 2023-12-11T17:07:47.632 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 70/164 2023-12-11T17:07:47.670 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/164 2023-12-11T17:07:47.696 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/164 2023-12-11T17:07:47.697 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/164 2023-12-11T17:07:47.758 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/164 2023-12-11T17:07:47.801 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/164 2023-12-11T17:07:47.809 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2023-12-11T17:07:47.936 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2023-12-11T17:07:47.994 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 75/164 2023-12-11T17:07:48.030 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/164 2023-12-11T17:07:48.091 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/164 2023-12-11T17:07:48.141 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/164 2023-12-11T17:07:48.285 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/164 2023-12-11T17:07:48.332 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 80/164 2023-12-11T17:07:48.466 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2023-12-11T17:07:48.539 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2023-12-11T17:07:48.648 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/164 2023-12-11T17:07:48.779 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/164 2023-12-11T17:07:49.518 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2023-12-11T17:07:49.580 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2023-12-11T17:07:49.614 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2023-12-11T17:07:49.648 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2023-12-11T17:07:49.885 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-0.3.21-2.el9.x86_64 87/164 2023-12-11T17:07:49.919 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 88/164 2023-12-11T17:07:50.015 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 89/164 2023-12-11T17:07:50.420 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/164 2023-12-11T17:07:50.772 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/164 2023-12-11T17:07:50.816 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/164 2023-12-11T17:07:50.818 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 90/164 2023-12-11T17:07:50.882 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : jq-1.6-16.el9.x86_64 95/164 2023-12-11T17:07:50.951 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 91/164 2023-12-11T17:07:51.022 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-5.4.4-4.el9.x86_64 96/164 2023-12-11T17:07:51.063 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : luarocks-3.9.2-1.el9.noarch 97/164 2023-12-11T17:07:51.106 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2023-12-11T17:07:51.149 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 99/164 2023-12-11T17:07:51.545 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2023-12-11T17:07:51.577 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:19.0.0-119.ga62fda73.el9.x86_64 101/164 2023-12-11T17:07:51.700 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:19.0.0-119.ga62fda73.el9.x86_64 101/164 2023-12-11T17:07:51.733 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:19.0.0-119.ga62fda73.el9.x86_64 102/164 2023-12-11T17:07:51.788 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2023-12-11T17:07:52.307 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 104/164 2023-12-11T17:07:52.330 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:19.0.0-119.ga62fda73.el9.x86_64 105/164 2023-12-11T17:07:52.414 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:19.0.0-119.ga62fda73.el9.x86_64 105/164 2023-12-11T17:07:52.440 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:19.0.0-119.ga62fda73.el9.x86_64 106/164 2023-12-11T17:07:52.489 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 92/164 2023-12-11T17:07:52.631 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 93/164 2023-12-11T17:07:52.669 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 94/164 2023-12-11T17:07:52.722 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : jq-1.6-16.el9.x86_64 95/164 2023-12-11T17:07:52.842 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lua-5.4.4-4.el9.x86_64 96/164 2023-12-11T17:07:52.899 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : luarocks-3.9.2-1.el9.noarch 97/164 2023-12-11T17:07:53.345 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2023-12-11T17:07:53.393 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 99/164 2023-12-11T17:07:53.797 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2023-12-11T17:07:53.834 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librbd1-2:19.0.0-119.ga62fda73.el9.x86_64 101/164 2023-12-11T17:07:53.948 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:19.0.0-119.ga62fda73.el9.x86_64 101/164 2023-12-11T17:07:53.982 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rbd-2:19.0.0-119.ga62fda73.el9.x86_64 102/164 2023-12-11T17:07:54.036 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2023-12-11T17:07:54.542 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 104/164 2023-12-11T17:07:54.579 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librgw2-2:19.0.0-119.ga62fda73.el9.x86_64 105/164 2023-12-11T17:07:54.671 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librgw2-2:19.0.0-119.ga62fda73.el9.x86_64 105/164 2023-12-11T17:07:54.698 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rgw-2:19.0.0-119.ga62fda73.el9.x86_64 106/164 2023-12-11T17:07:55.197 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 107/164 2023-12-11T17:07:55.236 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 107/164 2023-12-11T17:07:55.897 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 107/164 2023-12-11T17:07:55.940 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:19.0.0-119.ga62fda73.el9.x86_64 108/164 2023-12-11T17:07:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:19.0.0-119.ga62fda73.el9.x86_64 108/164 2023-12-11T17:07:56.169 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-11T17:07:56.169 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-11T17:07:56.169 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:07:56.207 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:19.0.0-119.ga62fda73.el9.x86_64 109/164 2023-12-11T17:07:57.190 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 107/164 2023-12-11T17:07:57.230 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 107/164 2023-12-11T17:07:57.853 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 107/164 2023-12-11T17:07:57.901 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-base-2:19.0.0-119.ga62fda73.el9.x86_64 108/164 2023-12-11T17:07:58.085 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-base-2:19.0.0-119.ga62fda73.el9.x86_64 108/164 2023-12-11T17:07:58.085 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-11T17:07:58.085 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-11T17:07:58.085 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:07:58.136 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-selinux-2:19.0.0-119.ga62fda73.el9.x86_64 109/164 2023-12-11T17:08:09.031 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:19.0.0-119.ga62fda73.el9.x86_64 109/164 2023-12-11T17:08:09.031 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2023-12-11T17:08:09.031 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2023-12-11T17:08:09.031 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2023-12-11T17:08:09.031 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2023-12-11T17:08:09.031 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2023-12-11T17:08:09.031 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /root 2023-12-11T17:08:09.031 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2023-12-11T17:08:09.031 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:09.260 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:19.0.0-119.ga62fda73.el9.noarch 110/164 2023-12-11T17:08:09.312 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:19.0.0-119.ga62fda73.el9.noarch 110/164 2023-12-11T17:08:09.312 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-11T17:08:09.312 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-11T17:08:09.312 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:10.998 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-selinux-2:19.0.0-119.ga62fda73.el9.x86_64 109/164 2023-12-11T17:08:10.998 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /sys 2023-12-11T17:08:10.998 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /proc 2023-12-11T17:08:10.998 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /mnt 2023-12-11T17:08:10.998 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /var/tmp 2023-12-11T17:08:10.999 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /home 2023-12-11T17:08:10.999 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /root 2023-12-11T17:08:10.999 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /tmp 2023-12-11T17:08:10.999 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:11.073 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:19.0.0-119.ga62fda73.el9.x86_64 111/164 2023-12-11T17:08:11.176 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:19.0.0-119.ga62fda73.el9.x86_64 111/164 2023-12-11T17:08:11.177 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-11T17:08:11.177 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-11T17:08:11.177 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-11T17:08:11.177 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-11T17:08:11.177 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:11.233 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-volume-2:19.0.0-119.ga62fda73.el9.noarch 110/164 2023-12-11T17:08:11.280 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-volume-2:19.0.0-119.ga62fda73.el9.noarch 110/164 2023-12-11T17:08:11.280 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-11T17:08:11.280 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-11T17:08:11.280 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:11.423 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:19.0.0-119.ga62fda73.el9.x86_64 112/164 2023-12-11T17:08:11.505 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:19.0.0-119.ga62fda73.el9.x86_64 112/164 2023-12-11T17:08:11.505 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-11T17:08:11.505 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-11T17:08:11.505 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-11T17:08:11.505 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-11T17:08:11.505 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:12.032 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:19.0.0-119.ga62fda73.el9.x86_64 113/164 2023-12-11T17:08:12.111 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:19.0.0-119.ga62fda73.el9.x86_64 113/164 2023-12-11T17:08:12.112 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-11T17:08:12.112 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-11T17:08:12.112 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-11T17:08:12.112 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-11T17:08:12.112 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:12.251 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2023-12-11T17:08:12.959 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:19.0.0-119.ga62fda73.el9.noarch 115/164 2023-12-11T17:08:12.993 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:19.0.0-119.ga62fda73.el9.noarch 115/164 2023-12-11T17:08:13.005 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-osd-2:19.0.0-119.ga62fda73.el9.x86_64 111/164 2023-12-11T17:08:13.041 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el 116/164 2023-12-11T17:08:13.088 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-osd-2:19.0.0-119.ga62fda73.el9.x86_64 111/164 2023-12-11T17:08:13.088 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-11T17:08:13.088 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-11T17:08:13.088 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-11T17:08:13.088 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-11T17:08:13.088 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:13.149 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.e 117/164 2023-12-11T17:08:13.181 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el9.noar 118/164 2023-12-11T17:08:13.313 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mds-2:19.0.0-119.ga62fda73.el9.x86_64 112/164 2023-12-11T17:08:13.385 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mds-2:19.0.0-119.ga62fda73.el9.x86_64 112/164 2023-12-11T17:08:13.385 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-11T17:08:13.385 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-11T17:08:13.385 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-11T17:08:13.385 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-11T17:08:13.385 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:13.518 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el9.noar 118/164 2023-12-11T17:08:13.556 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el9.no 119/164 2023-12-11T17:08:13.873 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mon-2:19.0.0-119.ga62fda73.el9.x86_64 113/164 2023-12-11T17:08:13.945 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mon-2:19.0.0-119.ga62fda73.el9.x86_64 113/164 2023-12-11T17:08:13.945 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-11T17:08:13.945 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-11T17:08:13.945 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-11T17:08:13.945 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-11T17:08:13.945 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:14.058 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2023-12-11T17:08:14.637 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephadm-2:19.0.0-119.ga62fda73.el9.noarch 115/164 2023-12-11T17:08:14.668 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephadm-2:19.0.0-119.ga62fda73.el9.noarch 115/164 2023-12-11T17:08:14.713 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el 116/164 2023-12-11T17:08:14.747 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el9.no 119/164 2023-12-11T17:08:14.782 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 120/164 2023-12-11T17:08:14.836 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.e 117/164 2023-12-11T17:08:14.874 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el9.noar 118/164 2023-12-11T17:08:14.932 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 120/164 2023-12-11T17:08:15.106 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el9 121/164 2023-12-11T17:08:15.142 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:19.0.0-119.ga62fda73.el9.x86_64 122/164 2023-12-11T17:08:15.202 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el9.noar 118/164 2023-12-11T17:08:15.217 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:19.0.0-119.ga62fda73.el9.x86_64 122/164 2023-12-11T17:08:15.217 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-11T17:08:15.217 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-11T17:08:15.217 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-11T17:08:15.217 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-11T17:08:15.218 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:15.241 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el9.no 119/164 2023-12-11T17:08:15.276 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:19.0.0-119.ga62fda73.el9.noarch 123/164 2023-12-11T17:08:15.315 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-119.ga62fda73.el9.noarch 123/164 2023-12-11T17:08:15.377 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:19.0.0-119.ga62fda73.el9.x86_64 124/164 2023-12-11T17:08:16.286 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libtool-2.4.6-45.el9.x86_64 125/164 2023-12-11T17:08:16.320 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:19.0.0-119.ga62fda73.el9.x86_64 126/164 2023-12-11T17:08:16.396 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-119.ga62fda73.el9.x86_64 126/164 2023-12-11T17:08:16.396 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-11T17:08:16.396 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-11T17:08:16.396 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-11T17:08:16.396 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-11T17:08:16.396 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:16.396 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el9.no 119/164 2023-12-11T17:08:16.425 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 120/164 2023-12-11T17:08:16.445 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-119.ga62fda 127/164 2023-12-11T17:08:16.525 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-119.ga62fda 127/164 2023-12-11T17:08:16.525 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-11T17:08:16.526 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-11T17:08:16.526 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:16.569 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 120/164 2023-12-11T17:08:16.596 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 128/164 2023-12-11T17:08:16.679 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 128/164 2023-12-11T17:08:16.679 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-11T17:08:16.679 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-11T17:08:16.680 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-11T17:08:16.680 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-11T17:08:16.680 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:16.742 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el9 121/164 2023-12-11T17:08:16.770 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-2:19.0.0-119.ga62fda73.el9.x86_64 122/164 2023-12-11T17:08:16.842 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-2:19.0.0-119.ga62fda73.el9.x86_64 122/164 2023-12-11T17:08:16.842 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-11T17:08:16.843 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-11T17:08:16.843 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-11T17:08:16.843 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-11T17:08:16.843 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:16.919 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-rook-2:19.0.0-119.ga62fda73.el9.noarch 123/164 2023-12-11T17:08:16.958 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-rook-2:19.0.0-119.ga62fda73.el9.noarch 123/164 2023-12-11T17:08:17.057 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-2:19.0.0-119.ga62fda73.el9.x86_64 124/164 2023-12-11T17:08:17.088 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 129/164 2023-12-11T17:08:17.169 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 129/164 2023-12-11T17:08:17.170 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-11T17:08:17.170 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-11T17:08:17.170 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-11T17:08:17.170 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-11T17:08:17.170 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:17.963 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libtool-2.4.6-45.el9.x86_64 125/164 2023-12-11T17:08:18.023 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-radosgw-2:19.0.0-119.ga62fda73.el9.x86_64 126/164 2023-12-11T17:08:18.103 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-radosgw-2:19.0.0-119.ga62fda73.el9.x86_64 126/164 2023-12-11T17:08:18.103 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-11T17:08:18.103 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-11T17:08:18.104 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-11T17:08:18.104 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-11T17:08:18.104 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:18.157 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-immutable-object-cache-2:19.0.0-119.ga62fda 127/164 2023-12-11T17:08:18.229 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.0.0-119.ga62fda 127/164 2023-12-11T17:08:18.229 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-11T17:08:18.229 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-11T17:08:18.229 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:18.308 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 128/164 2023-12-11T17:08:18.391 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephfs-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 128/164 2023-12-11T17:08:18.391 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-11T17:08:18.391 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-11T17:08:18.391 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-11T17:08:18.391 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-11T17:08:18.391 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:18.759 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 129/164 2023-12-11T17:08:18.833 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 129/164 2023-12-11T17:08:18.833 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-11T17:08:18.834 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-11T17:08:18.834 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-11T17:08:18.834 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-11T17:08:18.834 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:21.560 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:19.0.0-119.ga62fda73.el9.x86_64 130/164 2023-12-11T17:08:21.622 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 131/164 2023-12-11T17:08:21.679 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:19.0.0-119.ga62fda73.el9.x86_64 132/164 2023-12-11T17:08:21.718 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 133/164 2023-12-11T17:08:22.007 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 134/164 2023-12-11T17:08:22.130 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 135/164 2023-12-11T17:08:22.163 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 136/164 2023-12-11T17:08:22.197 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:19.0.0-119.ga62fda73.el9.x86_6 137/164 2023-12-11T17:08:22.332 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 138/164 2023-12-11T17:08:22.401 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 139/164 2023-12-11T17:08:22.449 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 140/164 2023-12-11T17:08:22.504 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 141/164 2023-12-11T17:08:22.565 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 142/164 2023-12-11T17:08:23.010 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-test-2:19.0.0-119.ga62fda73.el9.x86_64 130/164 2023-12-11T17:08:23.066 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 131/164 2023-12-11T17:08:23.129 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-nbd-2:19.0.0-119.ga62fda73.el9.x86_64 132/164 2023-12-11T17:08:23.166 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 133/164 2023-12-11T17:08:23.444 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 134/164 2023-12-11T17:08:23.470 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-11T17:08:23.521 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-11T17:08:23.568 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 135/164 2023-12-11T17:08:23.581 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-11T17:08:23.604 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 136/164 2023-12-11T17:08:23.645 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs-devel-2:19.0.0-119.ga62fda73.el9.x86_6 137/164 2023-12-11T17:08:23.732 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 138/164 2023-12-11T17:08:23.797 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 139/164 2023-12-11T17:08:23.842 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 140/164 2023-12-11T17:08:23.894 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 141/164 2023-12-11T17:08:23.967 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 142/164 2023-12-11T17:08:24.965 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-11T17:08:25.007 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephfs-top-2:19.0.0-119.ga62fda73.el9.noarch 144/164 2023-12-11T17:08:25.008 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-11T17:08:25.065 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 143/164 2023-12-11T17:08:25.127 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 145/164 2023-12-11T17:08:25.210 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 146/164 2023-12-11T17:08:25.284 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 147/164 2023-12-11T17:08:25.438 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flex-2.6.4-9.el9.x86_64 148/164 2023-12-11T17:08:25.479 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : bison-3.7.4-5.el9.x86_64 149/164 2023-12-11T17:08:25.512 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 150/164 2023-12-11T17:08:25.546 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 151/164 2023-12-11T17:08:25.588 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 152/164 2023-12-11T17:08:25.588 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/164 2023-12-11T17:08:25.720 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/164 2023-12-11T17:08:25.772 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 154/164 2023-12-11T17:08:25.818 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 155/164 2023-12-11T17:08:25.849 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 156/164 2023-12-11T17:08:25.849 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 157/164 2023-12-11T17:08:25.971 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 157/164 2023-12-11T17:08:26.001 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 158/164 2023-12-11T17:08:26.041 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-11T17:08:26.042 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-11T17:08:26.383 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-11T17:08:26.383 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/164 2023-12-11T17:08:26.394 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-top-2:19.0.0-119.ga62fda73.el9.noarch 144/164 2023-12-11T17:08:26.529 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 145/164 2023-12-11T17:08:26.535 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/164 2023-12-11T17:08:26.570 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 161/164 2023-12-11T17:08:26.583 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 146/164 2023-12-11T17:08:26.604 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 162/164 2023-12-11T17:08:26.638 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 163/164 2023-12-11T17:08:26.652 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 147/164 2023-12-11T17:08:26.769 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 164/164 2023-12-11T17:08:26.827 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flex-2.6.4-9.el9.x86_64 148/164 2023-12-11T17:08:26.864 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : bison-3.7.4-5.el9.x86_64 149/164 2023-12-11T17:08:26.897 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 150/164 2023-12-11T17:08:26.931 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 151/164 2023-12-11T17:08:26.964 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 152/164 2023-12-11T17:08:26.964 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 153/164 2023-12-11T17:08:27.052 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 164/164 2023-12-11T17:08:27.052 INFO:teuthology.orchestra.run.smithi037.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-11T17:08:27.052 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:27.094 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 153/164 2023-12-11T17:08:27.131 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 154/164 2023-12-11T17:08:27.178 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 155/164 2023-12-11T17:08:27.211 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 156/164 2023-12-11T17:08:27.211 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 157/164 2023-12-11T17:08:27.340 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 157/164 2023-12-11T17:08:27.371 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 158/164 2023-12-11T17:08:27.409 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-11T17:08:27.409 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-11T17:08:27.754 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 159/164 2023-12-11T17:08:27.754 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/164 2023-12-11T17:08:27.896 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 160/164 2023-12-11T17:08:27.933 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 161/164 2023-12-11T17:08:27.966 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 162/164 2023-12-11T17:08:28.001 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 163/164 2023-12-11T17:08:28.127 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 164/164 2023-12-11T17:08:28.392 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 164/164 2023-12-11T17:08:28.392 INFO:teuthology.orchestra.run.smithi151.stdout:Couldn't write '0' to 'kernel/yama/ptrace_scope', ignoring: No such file or directory 2023-12-11T17:08:28.393 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:31.679 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:19.0.0-119.ga62fda73.el9.x86_64 1/164 2023-12-11T17:08:31.679 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:19.0.0-119.ga62fda73.el9.x86_64 2/164 2023-12-11T17:08:31.679 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 3/164 2023-12-11T17:08:31.679 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 4/164 2023-12-11T17:08:31.680 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-119.ga62fda 5/164 2023-12-11T17:08:31.680 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:19.0.0-119.ga62fda73.el9.x86_64 6/164 2023-12-11T17:08:31.680 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:19.0.0-119.ga62fda73.el9.x86_64 7/164 2023-12-11T17:08:31.680 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:19.0.0-119.ga62fda73.el9.x86_64 8/164 2023-12-11T17:08:31.680 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:19.0.0-119.ga62fda73.el9.x86_64 9/164 2023-12-11T17:08:31.680 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:19.0.0-119.ga62fda73.el9.x86_64 10/164 2023-12-11T17:08:31.680 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:19.0.0-119.ga62fda73.el9.x86_64 11/164 2023-12-11T17:08:31.680 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:19.0.0-119.ga62fda73.el9.x86_64 12/164 2023-12-11T17:08:31.680 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 13/164 2023-12-11T17:08:31.680 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:19.0.0-119.ga62fda73.el9.x86_6 14/164 2023-12-11T17:08:31.680 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:19.0.0-119.ga62fda73.el9.x86_64 15/164 2023-12-11T17:08:31.680 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:19.0.0-119.ga62fda73.el9.x86_64 16/164 2023-12-11T17:08:31.680 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:19.0.0-119.ga62fda73.el9.x86_64 17/164 2023-12-11T17:08:31.680 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:19.0.0-119.ga62fda73.el9.x86_ 18/164 2023-12-11T17:08:31.681 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:19.0.0-119.ga62fda73.el9.x86_64 19/164 2023-12-11T17:08:31.681 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:19.0.0-119.ga62fda73.el9 20/164 2023-12-11T17:08:31.681 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:19.0.0-119.ga62fda73.el9.x 21/164 2023-12-11T17:08:31.681 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:19.0.0-119.ga62fda73.el9.x86_64 22/164 2023-12-11T17:08:31.681 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:19.0.0-119.ga62fda73.el9.x86_64 23/164 2023-12-11T17:08:31.681 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:19.0.0-119.ga62fda73.el9.x86_64 24/164 2023-12-11T17:08:31.681 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:19.0.0-119.ga62fda73.el9.x86_64 25/164 2023-12-11T17:08:31.681 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 26/164 2023-12-11T17:08:31.681 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 27/164 2023-12-11T17:08:31.681 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:19.0.0-119.ga62fda73.el9.x86_64 28/164 2023-12-11T17:08:31.681 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.e 29/164 2023-12-11T17:08:31.693 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el9.noar 30/164 2023-12-11T17:08:31.693 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el9.no 31/164 2023-12-11T17:08:31.693 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 32/164 2023-12-11T17:08:31.693 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el9 33/164 2023-12-11T17:08:31.693 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:19.0.0-119.ga62fda73.el9.noarch 34/164 2023-12-11T17:08:31.693 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el 35/164 2023-12-11T17:08:31.693 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:19.0.0-119.ga62fda73.el9.noarch 36/164 2023-12-11T17:08:31.694 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:19.0.0-119.ga62fda73.el9.noarch 37/164 2023-12-11T17:08:31.694 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephfs-top-2:19.0.0-119.ga62fda73.el9.noarch 38/164 2023-12-11T17:08:31.694 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/164 2023-12-11T17:08:31.694 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/164 2023-12-11T17:08:31.694 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/164 2023-12-11T17:08:31.694 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/164 2023-12-11T17:08:31.694 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/164 2023-12-11T17:08:31.694 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/164 2023-12-11T17:08:31.694 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/164 2023-12-11T17:08:31.694 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/164 2023-12-11T17:08:31.694 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : jq-1.6-16.el9.x86_64 47/164 2023-12-11T17:08:31.694 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/164 2023-12-11T17:08:31.694 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/164 2023-12-11T17:08:31.695 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/164 2023-12-11T17:08:31.695 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/164 2023-12-11T17:08:31.695 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/164 2023-12-11T17:08:31.695 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/164 2023-12-11T17:08:31.695 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/164 2023-12-11T17:08:31.695 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/164 2023-12-11T17:08:31.695 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/164 2023-12-11T17:08:31.695 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/164 2023-12-11T17:08:31.695 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/164 2023-12-11T17:08:31.695 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/164 2023-12-11T17:08:31.695 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/164 2023-12-11T17:08:31.695 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/164 2023-12-11T17:08:31.695 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/164 2023-12-11T17:08:31.695 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/164 2023-12-11T17:08:31.696 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/164 2023-12-11T17:08:31.696 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/164 2023-12-11T17:08:31.696 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/164 2023-12-11T17:08:31.696 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/164 2023-12-11T17:08:31.696 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/164 2023-12-11T17:08:31.696 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/164 2023-12-11T17:08:31.696 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/164 2023-12-11T17:08:31.696 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/164 2023-12-11T17:08:31.696 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/164 2023-12-11T17:08:31.696 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/164 2023-12-11T17:08:31.696 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/164 2023-12-11T17:08:31.696 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/164 2023-12-11T17:08:31.696 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/164 2023-12-11T17:08:31.696 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/164 2023-12-11T17:08:31.696 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/164 2023-12-11T17:08:31.697 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/164 2023-12-11T17:08:31.697 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/164 2023-12-11T17:08:31.697 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/164 2023-12-11T17:08:31.697 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/164 2023-12-11T17:08:31.697 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/164 2023-12-11T17:08:31.697 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 84/164 2023-12-11T17:08:31.697 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 85/164 2023-12-11T17:08:31.697 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 86/164 2023-12-11T17:08:31.697 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 87/164 2023-12-11T17:08:31.697 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 88/164 2023-12-11T17:08:31.697 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 89/164 2023-12-11T17:08:31.697 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ply-3.11-14.el9.noarch 90/164 2023-12-11T17:08:31.697 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 91/164 2023-12-11T17:08:31.697 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 92/164 2023-12-11T17:08:31.698 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 93/164 2023-12-11T17:08:31.698 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 94/164 2023-12-11T17:08:31.698 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 95/164 2023-12-11T17:08:31.698 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/164 2023-12-11T17:08:31.698 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 97/164 2023-12-11T17:08:31.698 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 98/164 2023-12-11T17:08:31.698 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 99/164 2023-12-11T17:08:31.698 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 100/164 2023-12-11T17:08:31.698 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 101/164 2023-12-11T17:08:31.698 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 102/164 2023-12-11T17:08:31.698 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 103/164 2023-12-11T17:08:31.698 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 104/164 2023-12-11T17:08:31.698 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 105/164 2023-12-11T17:08:31.698 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 106/164 2023-12-11T17:08:31.698 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 107/164 2023-12-11T17:08:31.699 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 108/164 2023-12-11T17:08:31.699 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 109/164 2023-12-11T17:08:31.699 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 110/164 2023-12-11T17:08:31.699 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 111/164 2023-12-11T17:08:31.699 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 112/164 2023-12-11T17:08:31.699 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 113/164 2023-12-11T17:08:31.699 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 114/164 2023-12-11T17:08:31.699 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 115/164 2023-12-11T17:08:31.699 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 116/164 2023-12-11T17:08:31.699 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 117/164 2023-12-11T17:08:31.699 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 118/164 2023-12-11T17:08:31.699 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 119/164 2023-12-11T17:08:31.699 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 120/164 2023-12-11T17:08:31.699 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 121/164 2023-12-11T17:08:31.699 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 122/164 2023-12-11T17:08:31.700 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 123/164 2023-12-11T17:08:31.700 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 124/164 2023-12-11T17:08:31.700 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 125/164 2023-12-11T17:08:31.700 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 126/164 2023-12-11T17:08:31.700 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 127/164 2023-12-11T17:08:31.700 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 128/164 2023-12-11T17:08:31.700 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 129/164 2023-12-11T17:08:31.700 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 130/164 2023-12-11T17:08:31.700 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 131/164 2023-12-11T17:08:31.700 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 132/164 2023-12-11T17:08:31.700 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : re2-1:20211101-3.el9.x86_64 133/164 2023-12-11T17:08:31.700 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 134/164 2023-12-11T17:08:31.700 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:19.0.0-119.ga62fda73.el9.x86_64 135/164 2023-12-11T17:08:31.700 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 136/164 2023-12-11T17:08:31.700 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:19.0.0-119.ga62fda73.el9.x86_64 137/164 2023-12-11T17:08:31.701 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 138/164 2023-12-11T17:08:31.701 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 139/164 2023-12-11T17:08:31.701 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 140/164 2023-12-11T17:08:31.701 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : acl-2.3.1-4.el9.x86_64 141/164 2023-12-11T17:08:31.701 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : acl-2.3.1-3.el9.x86_64 142/164 2023-12-11T17:08:31.701 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/164 2023-12-11T17:08:31.701 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 144/164 2023-12-11T17:08:31.701 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 145/164 2023-12-11T17:08:31.701 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 146/164 2023-12-11T17:08:31.701 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 147/164 2023-12-11T17:08:31.701 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 148/164 2023-12-11T17:08:31.701 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 149/164 2023-12-11T17:08:31.701 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 150/164 2023-12-11T17:08:31.701 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 151/164 2023-12-11T17:08:31.701 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 152/164 2023-12-11T17:08:31.701 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 153/164 2023-12-11T17:08:31.702 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 154/164 2023-12-11T17:08:31.702 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 155/164 2023-12-11T17:08:31.702 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 156/164 2023-12-11T17:08:31.702 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 157/164 2023-12-11T17:08:31.702 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 158/164 2023-12-11T17:08:31.702 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 159/164 2023-12-11T17:08:31.702 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 160/164 2023-12-11T17:08:31.702 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 161/164 2023-12-11T17:08:31.702 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 162/164 2023-12-11T17:08:31.702 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 163/164 2023-12-11T17:08:33.312 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-2:19.0.0-119.ga62fda73.el9.x86_64 1/164 2023-12-11T17:08:33.312 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-base-2:19.0.0-119.ga62fda73.el9.x86_64 2/164 2023-12-11T17:08:33.312 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 3/164 2023-12-11T17:08:33.312 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 4/164 2023-12-11T17:08:33.312 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-immutable-object-cache-2:19.0.0-119.ga62fda 5/164 2023-12-11T17:08:33.312 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mds-2:19.0.0-119.ga62fda73.el9.x86_64 6/164 2023-12-11T17:08:33.312 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-2:19.0.0-119.ga62fda73.el9.x86_64 7/164 2023-12-11T17:08:33.312 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mon-2:19.0.0-119.ga62fda73.el9.x86_64 8/164 2023-12-11T17:08:33.312 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-osd-2:19.0.0-119.ga62fda73.el9.x86_64 9/164 2023-12-11T17:08:33.313 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-radosgw-2:19.0.0-119.ga62fda73.el9.x86_64 10/164 2023-12-11T17:08:33.313 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-selinux-2:19.0.0-119.ga62fda73.el9.x86_64 11/164 2023-12-11T17:08:33.313 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-test-2:19.0.0-119.ga62fda73.el9.x86_64 12/164 2023-12-11T17:08:33.313 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 13/164 2023-12-11T17:08:33.313 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs-devel-2:19.0.0-119.ga62fda73.el9.x86_6 14/164 2023-12-11T17:08:33.313 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs2-2:19.0.0-119.ga62fda73.el9.x86_64 15/164 2023-12-11T17:08:33.313 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephsqlite-2:19.0.0-119.ga62fda73.el9.x86_64 16/164 2023-12-11T17:08:33.313 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados-devel-2:19.0.0-119.ga62fda73.el9.x86_64 17/164 2023-12-11T17:08:33.313 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libradosstriper1-2:19.0.0-119.ga62fda73.el9.x86_ 18/164 2023-12-11T17:08:33.313 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librgw2-2:19.0.0-119.ga62fda73.el9.x86_64 19/164 2023-12-11T17:08:33.313 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-argparse-2:19.0.0-119.ga62fda73.el9 20/164 2023-12-11T17:08:33.313 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-common-2:19.0.0-119.ga62fda73.el9.x 21/164 2023-12-11T17:08:33.313 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cephfs-2:19.0.0-119.ga62fda73.el9.x86_64 22/164 2023-12-11T17:08:33.313 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rados-2:19.0.0-119.ga62fda73.el9.x86_64 23/164 2023-12-11T17:08:33.313 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rbd-2:19.0.0-119.ga62fda73.el9.x86_64 24/164 2023-12-11T17:08:33.313 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rgw-2:19.0.0-119.ga62fda73.el9.x86_64 25/164 2023-12-11T17:08:33.314 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 26/164 2023-12-11T17:08:33.314 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 27/164 2023-12-11T17:08:33.325 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-nbd-2:19.0.0-119.ga62fda73.el9.x86_64 28/164 2023-12-11T17:08:33.325 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.e 29/164 2023-12-11T17:08:33.326 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el9.noar 30/164 2023-12-11T17:08:33.326 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el9.no 31/164 2023-12-11T17:08:33.326 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.0.0-119.ga62f 32/164 2023-12-11T17:08:33.326 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el9 33/164 2023-12-11T17:08:33.326 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-rook-2:19.0.0-119.ga62fda73.el9.noarch 34/164 2023-12-11T17:08:33.326 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el 35/164 2023-12-11T17:08:33.326 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-volume-2:19.0.0-119.ga62fda73.el9.noarch 36/164 2023-12-11T17:08:33.326 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephadm-2:19.0.0-119.ga62fda73.el9.noarch 37/164 2023-12-11T17:08:33.326 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-top-2:19.0.0-119.ga62fda73.el9.noarch 38/164 2023-12-11T17:08:33.326 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : automake-1.16.2-8.el9.noarch 39/164 2023-12-11T17:08:33.326 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : bison-3.7.4-5.el9.x86_64 40/164 2023-12-11T17:08:33.326 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 41/164 2023-12-11T17:08:33.326 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 42/164 2023-12-11T17:08:33.327 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flex-2.6.4-9.el9.x86_64 43/164 2023-12-11T17:08:33.327 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 44/164 2023-12-11T17:08:33.327 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 45/164 2023-12-11T17:08:33.327 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 46/164 2023-12-11T17:08:33.327 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : jq-1.6-16.el9.x86_64 47/164 2023-12-11T17:08:33.327 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 48/164 2023-12-11T17:08:33.327 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 49/164 2023-12-11T17:08:33.327 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 50/164 2023-12-11T17:08:33.327 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 51/164 2023-12-11T17:08:33.327 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 52/164 2023-12-11T17:08:33.327 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 53/164 2023-12-11T17:08:33.327 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 54/164 2023-12-11T17:08:33.327 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 55/164 2023-12-11T17:08:33.327 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lua-5.4.4-4.el9.x86_64 56/164 2023-12-11T17:08:33.327 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/164 2023-12-11T17:08:33.328 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/164 2023-12-11T17:08:33.328 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/164 2023-12-11T17:08:33.328 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/164 2023-12-11T17:08:33.328 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/164 2023-12-11T17:08:33.328 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/164 2023-12-11T17:08:33.328 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/164 2023-12-11T17:08:33.328 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 64/164 2023-12-11T17:08:33.328 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 65/164 2023-12-11T17:08:33.328 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 66/164 2023-12-11T17:08:33.328 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 67/164 2023-12-11T17:08:33.328 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 68/164 2023-12-11T17:08:33.328 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 69/164 2023-12-11T17:08:33.328 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 70/164 2023-12-11T17:08:33.328 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 71/164 2023-12-11T17:08:33.329 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 72/164 2023-12-11T17:08:33.329 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 73/164 2023-12-11T17:08:33.329 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 74/164 2023-12-11T17:08:33.329 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 75/164 2023-12-11T17:08:33.329 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 76/164 2023-12-11T17:08:33.329 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 77/164 2023-12-11T17:08:33.329 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 78/164 2023-12-11T17:08:33.329 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 79/164 2023-12-11T17:08:33.329 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 80/164 2023-12-11T17:08:33.329 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 81/164 2023-12-11T17:08:33.329 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 82/164 2023-12-11T17:08:33.329 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 83/164 2023-12-11T17:08:33.329 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 84/164 2023-12-11T17:08:33.329 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 85/164 2023-12-11T17:08:33.329 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 86/164 2023-12-11T17:08:33.330 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 87/164 2023-12-11T17:08:33.330 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 88/164 2023-12-11T17:08:33.330 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 89/164 2023-12-11T17:08:33.330 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ply-3.11-14.el9.noarch 90/164 2023-12-11T17:08:33.330 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 91/164 2023-12-11T17:08:33.330 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 92/164 2023-12-11T17:08:33.330 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 93/164 2023-12-11T17:08:33.330 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 94/164 2023-12-11T17:08:33.330 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 95/164 2023-12-11T17:08:33.330 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 96/164 2023-12-11T17:08:33.330 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 97/164 2023-12-11T17:08:33.330 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 98/164 2023-12-11T17:08:33.330 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 99/164 2023-12-11T17:08:33.330 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 100/164 2023-12-11T17:08:33.330 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : luarocks-3.9.2-1.el9.noarch 101/164 2023-12-11T17:08:33.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 102/164 2023-12-11T17:08:33.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 103/164 2023-12-11T17:08:33.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 104/164 2023-12-11T17:08:33.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 105/164 2023-12-11T17:08:33.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 106/164 2023-12-11T17:08:33.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 107/164 2023-12-11T17:08:33.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 108/164 2023-12-11T17:08:33.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 109/164 2023-12-11T17:08:33.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 110/164 2023-12-11T17:08:33.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 111/164 2023-12-11T17:08:33.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 112/164 2023-12-11T17:08:33.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 113/164 2023-12-11T17:08:33.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 114/164 2023-12-11T17:08:33.331 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 115/164 2023-12-11T17:08:33.332 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 116/164 2023-12-11T17:08:33.332 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 117/164 2023-12-11T17:08:33.332 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 118/164 2023-12-11T17:08:33.332 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 119/164 2023-12-11T17:08:33.332 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 120/164 2023-12-11T17:08:33.332 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 121/164 2023-12-11T17:08:33.332 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 122/164 2023-12-11T17:08:33.332 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 123/164 2023-12-11T17:08:33.332 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 124/164 2023-12-11T17:08:33.332 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 125/164 2023-12-11T17:08:33.332 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 126/164 2023-12-11T17:08:33.332 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 127/164 2023-12-11T17:08:33.332 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 128/164 2023-12-11T17:08:33.332 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 129/164 2023-12-11T17:08:33.332 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 130/164 2023-12-11T17:08:33.333 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 131/164 2023-12-11T17:08:33.333 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 132/164 2023-12-11T17:08:33.333 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : re2-1:20211101-3.el9.x86_64 133/164 2023-12-11T17:08:33.333 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 134/164 2023-12-11T17:08:33.333 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:19.0.0-119.ga62fda73.el9.x86_64 135/164 2023-12-11T17:08:33.333 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 136/164 2023-12-11T17:08:33.333 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:19.0.0-119.ga62fda73.el9.x86_64 137/164 2023-12-11T17:08:33.333 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 138/164 2023-12-11T17:08:33.333 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 139/164 2023-12-11T17:08:33.333 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 140/164 2023-12-11T17:08:33.333 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : acl-2.3.1-4.el9.x86_64 141/164 2023-12-11T17:08:33.333 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : acl-2.3.1-3.el9.x86_64 142/164 2023-12-11T17:08:33.333 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/164 2023-12-11T17:08:33.333 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 144/164 2023-12-11T17:08:33.333 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 145/164 2023-12-11T17:08:33.334 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 146/164 2023-12-11T17:08:33.334 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 147/164 2023-12-11T17:08:33.334 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 148/164 2023-12-11T17:08:33.334 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 149/164 2023-12-11T17:08:33.334 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 150/164 2023-12-11T17:08:33.334 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 151/164 2023-12-11T17:08:33.334 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 152/164 2023-12-11T17:08:33.334 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 153/164 2023-12-11T17:08:33.334 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 154/164 2023-12-11T17:08:33.334 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 155/164 2023-12-11T17:08:33.334 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 156/164 2023-12-11T17:08:33.334 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 157/164 2023-12-11T17:08:33.334 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 158/164 2023-12-11T17:08:33.334 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 159/164 2023-12-11T17:08:33.335 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 160/164 2023-12-11T17:08:33.335 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 161/164 2023-12-11T17:08:33.335 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 162/164 2023-12-11T17:08:33.335 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 163/164 2023-12-11T17:08:33.817 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 164/164 2023-12-11T17:08:33.818 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:33.818 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2023-12-11T17:08:33.818 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-11T17:08:33.818 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-11T17:08:33.818 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-11T17:08:33.818 INFO:teuthology.orchestra.run.smithi037.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-11T17:08:33.818 INFO:teuthology.orchestra.run.smithi037.stdout: acl-2.3.1-4.el9.x86_64 2023-12-11T17:08:33.818 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-11T17:08:33.818 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-11T17:08:33.818 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-11T17:08:33.818 INFO:teuthology.orchestra.run.smithi037.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-11T17:08:33.818 INFO:teuthology.orchestra.run.smithi037.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-11T17:08:33.819 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.819 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.819 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-11T17:08:33.819 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-11T17:08:33.819 INFO:teuthology.orchestra.run.smithi037.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-11T17:08:33.819 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-12-11T17:08:33.819 INFO:teuthology.orchestra.run.smithi037.stdout: automake-1.16.2-8.el9.noarch 2023-12-11T17:08:33.819 INFO:teuthology.orchestra.run.smithi037.stdout: bison-3.7.4-5.el9.x86_64 2023-12-11T17:08:33.819 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-11T17:08:33.819 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.819 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.819 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.819 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.819 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-11T17:08:33.819 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.820 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.820 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.820 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-11T17:08:33.820 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-11T17:08:33.820 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-11T17:08:33.820 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-11T17:08:33.820 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-11T17:08:33.820 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.820 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.820 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-11T17:08:33.820 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.820 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.820 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.820 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-11T17:08:33.821 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-11T17:08:33.821 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.821 INFO:teuthology.orchestra.run.smithi037.stdout: cephfs-top-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-11T17:08:33.821 INFO:teuthology.orchestra.run.smithi037.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-11T17:08:33.821 INFO:teuthology.orchestra.run.smithi037.stdout: flex-2.6.4-9.el9.x86_64 2023-12-11T17:08:33.821 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-11T17:08:33.821 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-11T17:08:33.821 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-11T17:08:33.821 INFO:teuthology.orchestra.run.smithi037.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-11T17:08:33.821 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-11T17:08:33.821 INFO:teuthology.orchestra.run.smithi037.stdout: jq-1.6-16.el9.x86_64 2023-12-11T17:08:33.821 INFO:teuthology.orchestra.run.smithi037.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-11T17:08:33.821 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-11T17:08:33.821 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-11T17:08:33.821 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.822 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.822 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.822 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-11T17:08:33.822 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-11T17:08:33.822 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-11T17:08:33.822 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-11T17:08:33.822 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-11T17:08:33.822 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.822 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.822 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-11T17:08:33.822 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.822 INFO:teuthology.orchestra.run.smithi037.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-11T17:08:33.822 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-11T17:08:33.822 INFO:teuthology.orchestra.run.smithi037.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-11T17:08:33.822 INFO:teuthology.orchestra.run.smithi037.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-11T17:08:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-11T17:08:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: lua-5.4.4-4.el9.x86_64 2023-12-11T17:08:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-11T17:08:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-11T17:08:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-11T17:08:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-11T17:08:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-11T17:08:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-11T17:08:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-13.11-1.el9.x86_64 2023-12-11T17:08:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-11T17:08:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-11T17:08:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-11T17:08:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-11T17:08:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-11T17:08:33.823 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-11T17:08:33.824 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-11T17:08:33.824 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.824 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.824 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.824 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-11T17:08:33.824 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-11T17:08:33.824 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-11T17:08:33.824 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-11T17:08:33.824 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-11T17:08:33.824 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-11T17:08:33.824 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-11T17:08:33.824 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-11T17:08:33.824 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-11T17:08:33.824 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-11T17:08:33.824 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-11T17:08:33.825 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-11T17:08:33.825 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-11T17:08:33.825 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-11T17:08:33.825 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-11T17:08:33.825 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-11T17:08:33.825 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-11T17:08:33.825 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-11T17:08:33.825 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-11T17:08:33.825 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-11T17:08:33.825 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-11T17:08:33.825 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-11T17:08:33.825 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-11T17:08:33.825 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-11T17:08:33.825 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-11T17:08:33.826 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-11T17:08:33.826 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-11T17:08:33.826 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply-3.11-14.el9.noarch 2023-12-11T17:08:33.826 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-11T17:08:33.826 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-11T17:08:33.826 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-11T17:08:33.826 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-11T17:08:33.826 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-11T17:08:33.826 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-11T17:08:33.826 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-11T17:08:33.826 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.826 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.826 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-11T17:08:33.826 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-11T17:08:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-11T17:08:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-11T17:08:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-11T17:08:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-11T17:08:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-11T17:08:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-11T17:08:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-11T17:08:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-11T17:08:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-11T17:08:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-11T17:08:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-11T17:08:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-11T17:08:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.827 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: re2-1:20211101-3.el9.x86_64 2023-12-11T17:08:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-11T17:08:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-11T17:08:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-11T17:08:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-11T17:08:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-11T17:08:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-11T17:08:33.828 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:33.829 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-12-11T17:08:34.394 DEBUG:teuthology.parallel:result is None 2023-12-11T17:08:35.436 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 164/164 2023-12-11T17:08:35.436 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:35.436 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2023-12-11T17:08:35.436 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-11T17:08:35.437 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-11T17:08:35.437 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-11T17:08:35.437 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-11T17:08:35.437 INFO:teuthology.orchestra.run.smithi151.stdout: acl-2.3.1-4.el9.x86_64 2023-12-11T17:08:35.437 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-11T17:08:35.437 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-11T17:08:35.437 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-11T17:08:35.437 INFO:teuthology.orchestra.run.smithi151.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-11T17:08:35.437 INFO:teuthology.orchestra.run.smithi151.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-11T17:08:35.437 INFO:teuthology.orchestra.run.smithi151.stdout: librados2-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.437 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.437 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-11T17:08:35.437 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-11T17:08:35.437 INFO:teuthology.orchestra.run.smithi151.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-11T17:08:35.437 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2023-12-11T17:08:35.438 INFO:teuthology.orchestra.run.smithi151.stdout: automake-1.16.2-8.el9.noarch 2023-12-11T17:08:35.438 INFO:teuthology.orchestra.run.smithi151.stdout: bison-3.7.4-5.el9.x86_64 2023-12-11T17:08:35.438 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-11T17:08:35.438 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.438 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.438 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.438 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.438 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-11T17:08:35.438 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.438 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.438 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.438 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-11T17:08:35.438 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-11T17:08:35.438 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-11T17:08:35.439 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-11T17:08:35.439 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-11T17:08:35.439 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.439 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.439 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-11T17:08:35.439 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.439 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.439 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.439 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-11T17:08:35.439 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-11T17:08:35.439 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.439 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top-2:19.0.0-119.ga62fda73.el9.noarch 2023-12-11T17:08:35.439 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-11T17:08:35.439 INFO:teuthology.orchestra.run.smithi151.stdout: flex-2.6.4-9.el9.x86_64 2023-12-11T17:08:35.440 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-11T17:08:35.440 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-11T17:08:35.440 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-11T17:08:35.440 INFO:teuthology.orchestra.run.smithi151.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-11T17:08:35.440 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-11T17:08:35.440 INFO:teuthology.orchestra.run.smithi151.stdout: jq-1.6-16.el9.x86_64 2023-12-11T17:08:35.440 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-11T17:08:35.440 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-11T17:08:35.440 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-11T17:08:35.440 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.440 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.440 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.440 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-11T17:08:35.440 INFO:teuthology.orchestra.run.smithi151.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-11T17:08:35.441 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-11T17:08:35.441 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-11T17:08:35.441 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-11T17:08:35.441 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.441 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.441 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-11T17:08:35.441 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.441 INFO:teuthology.orchestra.run.smithi151.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-11T17:08:35.441 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-11T17:08:35.441 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-11T17:08:35.441 INFO:teuthology.orchestra.run.smithi151.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-11T17:08:35.441 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-11T17:08:35.441 INFO:teuthology.orchestra.run.smithi151.stdout: lua-5.4.4-4.el9.x86_64 2023-12-11T17:08:35.441 INFO:teuthology.orchestra.run.smithi151.stdout: luarocks-3.9.2-1.el9.noarch 2023-12-11T17:08:35.441 INFO:teuthology.orchestra.run.smithi151.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-11T17:08:35.442 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-11T17:08:35.442 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-11T17:08:35.442 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-11T17:08:35.442 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-11T17:08:35.442 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-13.11-1.el9.x86_64 2023-12-11T17:08:35.442 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-11T17:08:35.442 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-11T17:08:35.442 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-11T17:08:35.442 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-11T17:08:35.442 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-11T17:08:35.442 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-11T17:08:35.442 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-11T17:08:35.442 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.442 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.443 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.443 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-11T17:08:35.443 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-11T17:08:35.443 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-11T17:08:35.443 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-11T17:08:35.443 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-11T17:08:35.443 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-11T17:08:35.443 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-11T17:08:35.443 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-11T17:08:35.443 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-11T17:08:35.443 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-11T17:08:35.443 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-11T17:08:35.443 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-11T17:08:35.443 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-11T17:08:35.444 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-11T17:08:35.444 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-11T17:08:35.444 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-11T17:08:35.444 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-11T17:08:35.444 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-11T17:08:35.444 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-11T17:08:35.444 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-11T17:08:35.444 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-11T17:08:35.444 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-11T17:08:35.444 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-11T17:08:35.444 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-11T17:08:35.444 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-11T17:08:35.444 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-11T17:08:35.445 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-11T17:08:35.445 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply-3.11-14.el9.noarch 2023-12-11T17:08:35.445 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-11T17:08:35.445 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-11T17:08:35.445 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-11T17:08:35.445 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-11T17:08:35.445 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-11T17:08:35.445 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-11T17:08:35.445 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-11T17:08:35.445 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.445 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.445 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-11T17:08:35.446 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-11T17:08:35.446 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-11T17:08:35.446 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.446 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-11T17:08:35.446 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-11T17:08:35.446 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-11T17:08:35.446 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-11T17:08:35.446 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-11T17:08:35.447 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-11T17:08:35.447 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-11T17:08:35.447 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-11T17:08:35.447 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-11T17:08:35.447 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-11T17:08:35.447 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-11T17:08:35.447 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.447 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.447 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd-2:19.0.0-119.ga62fda73.el9.x86_64 2023-12-11T17:08:35.447 INFO:teuthology.orchestra.run.smithi151.stdout: re2-1:20211101-3.el9.x86_64 2023-12-11T17:08:35.447 INFO:teuthology.orchestra.run.smithi151.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-11T17:08:35.447 INFO:teuthology.orchestra.run.smithi151.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-11T17:08:35.447 INFO:teuthology.orchestra.run.smithi151.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-11T17:08:35.447 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-11T17:08:35.447 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-11T17:08:35.448 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-11T17:08:35.448 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:35.448 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2023-12-11T17:08:36.106 DEBUG:teuthology.parallel:result is None 2023-12-11T17:08:36.106 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-11T17:08:36.248 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-11T17:08:36.313 INFO:teuthology.orchestra.run.smithi037.stdout:19.0.0-119.ga62fda73.el9 2023-12-11T17:08:36.313 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-119.ga62fda73.el9 2023-12-11T17:08:36.313 INFO:teuthology.task.install:The correct ceph version 19.0.0-119.ga62fda73 is installed. 2023-12-11T17:08:36.315 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=a62fda73efba5520d409bb5a21bd8373289dda5d 2023-12-11T17:08:36.476 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-11T17:08:36.539 INFO:teuthology.orchestra.run.smithi151.stdout:19.0.0-119.ga62fda73.el9 2023-12-11T17:08:36.539 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-119.ga62fda73.el9 2023-12-11T17:08:36.539 INFO:teuthology.task.install:The correct ceph version 19.0.0-119.ga62fda73 is installed. 2023-12-11T17:08:36.541 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-11T17:08:36.541 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:08:36.541 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-11T17:08:36.626 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:08:36.626 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-11T17:08:36.706 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-11T17:08:36.706 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:08:36.707 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2023-12-11T17:08:36.806 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-11T17:08:36.884 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:08:36.884 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2023-12-11T17:08:36.962 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-11T17:08:37.075 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-11T17:08:37.076 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:08:37.076 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-11T17:08:37.161 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-11T17:08:37.279 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:08:37.279 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-11T17:08:37.360 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-11T17:08:37.487 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-11T17:08:37.488 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:08:37.488 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2023-12-11T17:08:37.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-11T17:08:37.689 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:08:37.689 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2023-12-11T17:08:37.775 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-11T17:08:37.898 INFO:teuthology.run_tasks:Running task ceph... 2023-12-11T17:08:37.972 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-11T17:08:37.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /var/log/ceph 2023-12-11T17:08:37.977 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /var/log/ceph 2023-12-11T17:08:38.057 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-11T17:08:38.057 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-11T17:08:38.061 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-11T17:08:38.134 INFO:tasks.ceph:Creating extra log directories... 2023-12-11T17:08:38.134 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-11T17:08:38.138 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-11T17:08:38.233 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-11T17:08:38.234 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-11T17:08:38.234 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-11T17:08:38.234 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:08:38.234 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-11T17:08:38.276 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-11T17:08:38.500 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-11T17:08:38.576 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:08:38.576 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-11T17:08:38.620 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-11T17:08:38.840 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-11T17:08:38.920 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-11T17:08:38.920 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-11T17:08:38.921 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi/7487107', 'branch': 'rishabh-2023dec11', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/testing/k-testing ms-die-on-skipped}} objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/xfstests-dev}', 'email': None, 'first_in_suite': False, 'job_id': '7487107', 'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}, 'ktype': 'upstream', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'rishabh-2023-12-11_15:37:57-fs-rishabh-2023dec11-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'rishabh-2023dec11'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d'}}, 'kclient': {'syntax': 'v1'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'rishabh-2023dec11', 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d'}}, 'owner': 'scheduled_rishabh@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 5791, 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'sleep_before_teardown': 0, 'subset': '209/512', 'suite': 'fs', 'suite_branch': 'rishabh-2023dec11', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_a62fda73efba5520d409bb5a21bd8373289dda5d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi037.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA/7D7ZkzOq7K2Vy4XbAMIGUGzRIhWNLg3CTN3r754GJROYw66Cun6ytSp1oNxOcdJKQhv3MD+R6xfhLZx4m67E=', 'smithi151.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKXH1EIyyKqjHalV6CF5u0WgtqYNX0KeGjN3Xaua0ZmGNO2ICbZtS+gESf56TGdyKytnFbIBVPWFQ9/1JKr4N/8='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'branch': 'testing'}, 'flavor': 'default', 'kdb': True, 'sha1': 'cd68252d7b4d7802f3cae7f5945b38e9b20dad4c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': 'a62fda73efba5520d409bb5a21bd8373289dda5d', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.tests_from_xfstests_dev']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-11_15:37:57', 'tube': 'smithi', 'user': 'rishabh', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.232157'} 2023-12-11T17:08:38.922 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-11T17:08:38.928 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-11T17:08:38.973 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/run/ceph 2023-12-11T17:08:38.978 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m0777 -- /var/run/ceph 2023-12-11T17:08:39.086 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:08:39.086 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2023-12-11T17:08:39.132 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-11T17:08:39.133 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2023-12-11T17:08:39.219 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-11T17:08:39.219 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-11T17:08:39.220 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 631 Links: 1 2023-12-11T17:08:39.220 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-11T17:08:39.220 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-12-11T17:08:39.220 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-12-11 17:08:27.532241304 +0000 2023-12-11T17:08:39.220 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-12-11 17:05:52.921035134 +0000 2023-12-11T17:08:39.220 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-12-11 17:05:52.921035134 +0000 2023-12-11T17:08:39.220 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-12-11 17:05:52.921035134 +0000 2023-12-11T17:08:39.220 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-11T17:08:39.333 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-12-11T17:08:39.333 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-12-11T17:08:39.333 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000373773 s, 1.4 MB/s 2023-12-11T17:08:39.336 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-11T17:08:39.389 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2023-12-11T17:08:39.431 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-11T17:08:39.455 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-11T17:08:39.455 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 652 Links: 1 2023-12-11T17:08:39.455 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-11T17:08:39.455 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-12-11T17:08:39.455 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-12-11 17:08:27.533241290 +0000 2023-12-11T17:08:39.456 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-12-11 17:05:53.985019996 +0000 2023-12-11T17:08:39.456 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-12-11 17:05:53.985019996 +0000 2023-12-11T17:08:39.456 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-12-11 17:05:53.985019996 +0000 2023-12-11T17:08:39.456 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-11T17:08:39.546 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-12-11T17:08:39.546 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-12-11T17:08:39.546 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000346618 s, 1.5 MB/s 2023-12-11T17:08:39.550 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-11T17:08:39.592 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2023-12-11T17:08:39.677 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-11T17:08:39.677 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-11T17:08:39.677 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 671 Links: 1 2023-12-11T17:08:39.677 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-11T17:08:39.677 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-12-11T17:08:39.677 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-12-11 17:08:27.533241290 +0000 2023-12-11T17:08:39.677 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-12-11 17:05:55.049004858 +0000 2023-12-11T17:08:39.677 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-12-11 17:05:55.049004858 +0000 2023-12-11T17:08:39.677 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-12-11 17:05:55.049004858 +0000 2023-12-11T17:08:39.678 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-11T17:08:39.790 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-12-11T17:08:39.790 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-12-11T17:08:39.790 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000303131 s, 1.7 MB/s 2023-12-11T17:08:39.794 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-11T17:08:39.838 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2023-12-11T17:08:39.942 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-11T17:08:39.942 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-11T17:08:39.942 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 690 Links: 1 2023-12-11T17:08:39.942 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-11T17:08:39.942 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2023-12-11T17:08:39.942 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2023-12-11 17:08:27.534241276 +0000 2023-12-11T17:08:39.942 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2023-12-11 17:05:56.121989592 +0000 2023-12-11T17:08:39.942 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2023-12-11 17:05:56.121989592 +0000 2023-12-11T17:08:39.942 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2023-12-11 17:05:56.121989592 +0000 2023-12-11T17:08:39.943 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-11T17:08:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2023-12-11T17:08:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2023-12-11T17:08:40.040 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000387814 s, 1.3 MB/s 2023-12-11T17:08:40.045 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-11T17:08:40.102 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-11T17:08:40.102 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:08:40.102 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2023-12-11T17:08:40.150 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-11T17:08:40.150 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2023-12-11T17:08:40.236 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-11T17:08:40.236 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-11T17:08:40.237 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 634 Links: 1 2023-12-11T17:08:40.237 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-11T17:08:40.237 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-12-11T17:08:40.237 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-12-11 17:08:28.862223179 +0000 2023-12-11T17:08:40.237 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-12-11 17:05:31.958023646 +0000 2023-12-11T17:08:40.237 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-12-11 17:05:31.958023646 +0000 2023-12-11T17:08:40.237 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-12-11 17:05:31.958023646 +0000 2023-12-11T17:08:40.237 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-11T17:08:40.318 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-12-11T17:08:40.319 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-12-11T17:08:40.319 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000401098 s, 1.3 MB/s 2023-12-11T17:08:40.322 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-11T17:08:40.363 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2023-12-11T17:08:40.446 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-11T17:08:40.446 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-11T17:08:40.446 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 650 Links: 1 2023-12-11T17:08:40.447 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-11T17:08:40.447 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-12-11T17:08:40.447 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-12-11 17:08:28.864223154 +0000 2023-12-11T17:08:40.447 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-12-11 17:05:32.986011205 +0000 2023-12-11T17:08:40.447 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-12-11 17:05:32.986011205 +0000 2023-12-11T17:08:40.447 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-12-11 17:05:32.986011205 +0000 2023-12-11T17:08:40.447 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-11T17:08:40.556 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-12-11T17:08:40.556 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-12-11T17:08:40.556 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000314413 s, 1.6 MB/s 2023-12-11T17:08:40.559 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-11T17:08:40.602 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2023-12-11T17:08:40.700 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-11T17:08:40.701 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-11T17:08:40.701 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 669 Links: 1 2023-12-11T17:08:40.701 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-11T17:08:40.701 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-12-11T17:08:40.701 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-12-11 17:08:28.864223154 +0000 2023-12-11T17:08:40.701 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-12-11 17:05:34.030998558 +0000 2023-12-11T17:08:40.701 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-12-11 17:05:34.030998558 +0000 2023-12-11T17:08:40.701 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-12-11 17:05:34.030998558 +0000 2023-12-11T17:08:40.701 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-11T17:08:40.793 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-12-11T17:08:40.794 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-12-11T17:08:40.794 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000386548 s, 1.3 MB/s 2023-12-11T17:08:40.797 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-11T17:08:40.853 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2023-12-11T17:08:40.903 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-11T17:08:40.904 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-11T17:08:40.904 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 690 Links: 1 2023-12-11T17:08:40.904 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-11T17:08:40.904 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2023-12-11T17:08:40.904 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2023-12-11 17:08:28.865223142 +0000 2023-12-11T17:08:40.904 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2023-12-11 17:05:35.051986202 +0000 2023-12-11T17:08:40.904 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2023-12-11 17:05:35.051986202 +0000 2023-12-11T17:08:40.904 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2023-12-11 17:05:35.051986202 +0000 2023-12-11T17:08:40.904 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-11T17:08:40.995 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2023-12-11T17:08:40.996 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2023-12-11T17:08:40.996 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000348567 s, 1.5 MB/s 2023-12-11T17:08:40.999 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-11T17:08:41.055 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-11T17:08:41.056 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-11T17:08:41.056 INFO:tasks.ceph:Generating config... 2023-12-11T17:08:41.057 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-11T17:08:41.057 INFO:tasks.ceph:[client] debug client = 20 2023-12-11T17:08:41.057 INFO:tasks.ceph:[client] debug ms = 1 2023-12-11T17:08:41.057 INFO:tasks.ceph:[client] pid file = 2023-12-11T17:08:41.057 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-11T17:08:41.057 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-11T17:08:41.057 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-12-11T17:08:41.057 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-11T17:08:41.057 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-11T17:08:41.058 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-11T17:08:41.058 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-11T17:08:41.058 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-11T17:08:41.058 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-11T17:08:41.058 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-11T17:08:41.058 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-11T17:08:41.058 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-11T17:08:41.058 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-11T17:08:41.058 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-11T17:08:41.058 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-11T17:08:41.058 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-11T17:08:41.058 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-11T17:08:41.058 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-11T17:08:41.058 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-11T17:08:41.058 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-11T17:08:41.059 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-11T17:08:41.059 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-12-11T17:08:41.059 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-12-11T17:08:41.059 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-11T17:08:41.059 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-11T17:08:41.059 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-12-11T17:08:41.059 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-11T17:08:41.059 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-11T17:08:41.059 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-11T17:08:41.059 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-12-11T17:08:41.059 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-12-11T17:08:41.059 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-11T17:08:41.059 INFO:tasks.ceph:Setting up mon.a... 2023-12-11T17:08:41.060 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-11T17:08:41.239 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.keyring 2023-12-11T17:08:41.248 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-11T17:08:41.383 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-11T17:08:41.469 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.37'), ('mon.b', '172.21.15.151'), ('mon.c', '[v2:172.21.15.151:3301,v1:172.21.15.151:6790]')] 2023-12-11T17:08:41.470 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.37,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-11T17:08:41.470 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:08:41.471 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-11T17:08:41.520 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.37 --add b 172.21.15.151 --addv c '[v2:172.21.15.151:3301,v1:172.21.15.151:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-11T17:08:41.670 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-11T17:08:41.671 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: generated fsid 349792a4-57b1-4c92-9cc0-0c9ba4325d41 2023-12-11T17:08:41.671 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = pacific 2023-12-11T17:08:41.671 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 0 2023-12-11T17:08:41.671 INFO:teuthology.orchestra.run.smithi037.stdout:fsid 349792a4-57b1-4c92-9cc0-0c9ba4325d41 2023-12-11T17:08:41.671 INFO:teuthology.orchestra.run.smithi037.stdout:last_changed 2023-12-11T17:08:41.671402+0000 2023-12-11T17:08:41.671 INFO:teuthology.orchestra.run.smithi037.stdout:created 2023-12-11T17:08:41.671402+0000 2023-12-11T17:08:41.671 INFO:teuthology.orchestra.run.smithi037.stdout:min_mon_release 16 (pacific) 2023-12-11T17:08:41.671 INFO:teuthology.orchestra.run.smithi037.stdout:election_strategy: 1 2023-12-11T17:08:41.671 INFO:teuthology.orchestra.run.smithi037.stdout:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2023-12-11T17:08:41.671 INFO:teuthology.orchestra.run.smithi037.stdout:1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.b 2023-12-11T17:08:41.671 INFO:teuthology.orchestra.run.smithi037.stdout:2: [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] mon.c 2023-12-11T17:08:41.671 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-11T17:08:41.674 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-11T17:08:41.719 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 349792a4-57b1-4c92-9cc0-0c9ba4325d41... 2023-12-11T17:08:41.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-11T17:08:41.769 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-11T17:08:41.940 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2023-12-11T17:08:41.940 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2023-12-11T17:08:41.941 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-11T17:08:41.941 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2023-12-11T17:08:41.941 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.941 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2023-12-11T17:08:41.941 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.941 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2023-12-11T17:08:41.941 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.941 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2023-12-11T17:08:41.942 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2023-12-11T17:08:41.942 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.942 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2023-12-11T17:08:41.942 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2023-12-11T17:08:41.942 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.942 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-11T17:08:41.942 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2023-12-11T17:08:41.942 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.942 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2023-12-11T17:08:41.943 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-11T17:08:41.943 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.943 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2023-12-11T17:08:41.943 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.943 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2023-12-11T17:08:41.943 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2023-12-11T17:08:41.943 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2023-12-11T17:08:41.943 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2023-12-11T17:08:41.943 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2023-12-11T17:08:41.943 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2023-12-11T17:08:41.944 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2023-12-11T17:08:41.944 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-11T17:08:41.944 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-11T17:08:41.944 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2023-12-11T17:08:41.944 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.944 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-11T17:08:41.944 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.944 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2023-12-11T17:08:41.944 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.944 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2023-12-11T17:08:41.945 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.945 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2023-12-11T17:08:41.945 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2023-12-11T17:08:41.945 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2023-12-11T17:08:41.945 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = "172.21.15.37,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2023-12-11T17:08:41.945 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on skipped message = False 2023-12-11T17:08:41.945 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = 349792a4-57b1-4c92-9cc0-0c9ba4325d41 2023-12-11T17:08:41.945 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.945 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2023-12-11T17:08:41.945 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2023-12-11T17:08:41.945 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.946 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2023-12-11T17:08:41.946 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2023-12-11T17:08:41.946 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2023-12-11T17:08:41.946 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.946 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2023-12-11T17:08:41.946 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2023-12-11T17:08:41.946 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.946 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2023-12-11T17:08:41.946 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2023-12-11T17:08:41.946 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2023-12-11T17:08:41.947 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug trim objects = true 2023-12-11T17:08:41.947 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.947 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2023-12-11T17:08:41.947 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2023-12-11T17:08:41.947 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.947 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2023-12-11T17:08:41.947 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.947 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2023-12-11T17:08:41.948 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.948 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2023-12-11T17:08:41.948 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.948 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2023-12-11T17:08:41.948 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2023-12-11T17:08:41.948 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.948 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2023-12-11T17:08:41.948 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2023-12-11T17:08:41.948 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2023-12-11T17:08:41.948 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2023-12-11T17:08:41.949 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 20 2023-12-11T17:08:41.949 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 20 2023-12-11T17:08:41.949 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-12-11T17:08:41.949 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2023-12-11T17:08:41.949 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 10 2023-12-11T17:08:41.949 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2023-12-11T17:08:41.949 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2023-12-11T17:08:41.949 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2023-12-11T17:08:41.949 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2023-12-11T17:08:41.949 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2023-12-11T17:08:41.949 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-12-11T17:08:41.950 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.950 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2023-12-11T17:08:41.950 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-12-11T17:08:41.950 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2023-12-11T17:08:41.950 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-12-11T17:08:41.950 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-12-11T17:08:41.950 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-12-11T17:08:41.950 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-12-11T17:08:41.950 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2023-12-11T17:08:41.950 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.951 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2023-12-11T17:08:41.951 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-12-11T17:08:41.951 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2023-12-11T17:08:41.951 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2023-12-11T17:08:41.951 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2023-12-11T17:08:41.951 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2023-12-11T17:08:41.951 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2023-12-11T17:08:41.951 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2023-12-11T17:08:41.951 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2023-12-11T17:08:41.952 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2023-12-11T17:08:41.952 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2023-12-11T17:08:41.952 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.952 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-11T17:08:41.952 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2023-12-11T17:08:41.952 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2023-12-11T17:08:41.952 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.952 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2023-12-11T17:08:41.952 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-11T17:08:41.952 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-11T17:08:41.953 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.953 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2023-12-11T17:08:41.953 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2023-12-11T17:08:41.953 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.953 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2023-12-11T17:08:41.953 INFO:teuthology.orchestra.run.smithi037.stdout: mon op complaint time = 120 2023-12-11T17:08:41.953 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:08:41.953 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2023-12-11T17:08:41.953 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2023-12-11T17:08:41.953 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2023-12-11T17:08:41.954 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2023-12-11T17:08:41.954 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-11T17:08:41.954 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-11T17:08:41.954 INFO:teuthology.orchestra.run.smithi037.stdout: client mount timeout = 600 2023-12-11T17:08:41.954 INFO:teuthology.orchestra.run.smithi037.stdout: debug client = 20 2023-12-11T17:08:41.954 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-12-11T17:08:41.954 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = "" 2023-12-11T17:08:41.954 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-12-11T17:08:41.954 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-12-11T17:08:41.954 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2023-12-11T17:08:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.b] 2023-12-11T17:08:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.c] 2023-12-11T17:08:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-12-11T17:08:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2023-12-11T17:08:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2023-12-11T17:08:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2023-12-11T17:08:41.955 INFO:teuthology.orchestra.run.smithi037.stdout:[mds] 2023-12-11T17:08:41.955 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds = 20 2023-12-11T17:08:41.955 INFO:teuthology.orchestra.run.smithi037.stdout: debug mds balancer = 20 2023-12-11T17:08:41.955 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2023-12-11T17:08:41.955 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug frag = True 2023-12-11T17:08:41.956 INFO:teuthology.orchestra.run.smithi037.stdout: mds debug scatterstat = True 2023-12-11T17:08:41.956 INFO:teuthology.orchestra.run.smithi037.stdout: mds op complaint time = 180 2023-12-11T17:08:41.956 INFO:teuthology.orchestra.run.smithi037.stdout: mds verify scatter = True 2023-12-11T17:08:41.956 INFO:teuthology.orchestra.run.smithi037.stdout: osd op complaint time = 180 2023-12-11T17:08:41.956 INFO:teuthology.orchestra.run.smithi037.stdout: rados mon op timeout = 900 2023-12-11T17:08:41.956 INFO:teuthology.orchestra.run.smithi037.stdout: rados osd op timeout = 900 2023-12-11T17:08:41.957 INFO:teuthology.orchestra.run.smithi151.stdout:[global] 2023-12-11T17:08:41.957 INFO:teuthology.orchestra.run.smithi151.stdout: chdir = "" 2023-12-11T17:08:41.957 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-11T17:08:41.957 INFO:teuthology.orchestra.run.smithi151.stdout: auth supported = cephx 2023-12-11T17:08:41.957 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.957 INFO:teuthology.orchestra.run.smithi151.stdout: filestore xattr use omap = true 2023-12-11T17:08:41.957 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.957 INFO:teuthology.orchestra.run.smithi151.stdout: mon clock drift allowed = 1.000 2023-12-11T17:08:41.957 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.958 INFO:teuthology.orchestra.run.smithi151.stdout: osd crush chooseleaf type = 0 2023-12-11T17:08:41.958 INFO:teuthology.orchestra.run.smithi151.stdout: auth debug = true 2023-12-11T17:08:41.958 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.958 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on old message = true 2023-12-11T17:08:41.958 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on bug = true 2023-12-11T17:08:41.958 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.958 INFO:teuthology.orchestra.run.smithi151.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-11T17:08:41.958 INFO:teuthology.orchestra.run.smithi151.stdout: mon pg warn max object skew = 0 2023-12-11T17:08:41.958 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.959 INFO:teuthology.orchestra.run.smithi151.stdout: # disable pg_autoscaler by default for new pools 2023-12-11T17:08:41.959 INFO:teuthology.orchestra.run.smithi151.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-11T17:08:41.959 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.959 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default size = 2 2023-12-11T17:08:41.959 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.959 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow primary affinity = true 2023-12-11T17:08:41.959 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd allow pg remap = true 2023-12-11T17:08:41.959 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on legacy crush tunables = false 2023-12-11T17:08:41.959 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on crush straw calc version zero = false 2023-12-11T17:08:41.959 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on no sortbitwise = false 2023-12-11T17:08:41.959 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on osd down out interval zero = false 2023-12-11T17:08:41.960 INFO:teuthology.orchestra.run.smithi151.stdout: mon warn on too few osds = false 2023-12-11T17:08:41.960 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-11T17:08:41.960 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-11T17:08:41.960 INFO:teuthology.orchestra.run.smithi151.stdout: mon_allow_pool_size_one = true 2023-12-11T17:08:41.960 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.960 INFO:teuthology.orchestra.run.smithi151.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-11T17:08:41.960 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.960 INFO:teuthology.orchestra.run.smithi151.stdout: osd default data pool replay window = 5 2023-12-11T17:08:41.960 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.960 INFO:teuthology.orchestra.run.smithi151.stdout: mon allow pool delete = true 2023-12-11T17:08:41.960 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.961 INFO:teuthology.orchestra.run.smithi151.stdout: mon cluster log file level = debug 2023-12-11T17:08:41.961 INFO:teuthology.orchestra.run.smithi151.stdout: debug asserts on shutdown = true 2023-12-11T17:08:41.961 INFO:teuthology.orchestra.run.smithi151.stdout: mon health detail to clog = false 2023-12-11T17:08:41.961 INFO:teuthology.orchestra.run.smithi151.stdout: mon host = "172.21.15.37,172.21.15.151,[v2:172.21.15.151:3301,v1:172.21.15.151:6790]" 2023-12-11T17:08:41.961 INFO:teuthology.orchestra.run.smithi151.stdout: ms die on skipped message = False 2023-12-11T17:08:41.961 INFO:teuthology.orchestra.run.smithi151.stdout: fsid = 349792a4-57b1-4c92-9cc0-0c9ba4325d41 2023-12-11T17:08:41.961 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.961 INFO:teuthology.orchestra.run.smithi151.stdout:[osd] 2023-12-11T17:08:41.961 INFO:teuthology.orchestra.run.smithi151.stdout: osd journal size = 100 2023-12-11T17:08:41.961 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.961 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub load threshold = 5.0 2023-12-11T17:08:41.962 INFO:teuthology.orchestra.run.smithi151.stdout: osd scrub max interval = 600 2023-12-11T17:08:41.962 INFO:teuthology.orchestra.run.smithi151.stdout: osd mclock profile = high_recovery_ops 2023-12-11T17:08:41.962 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.962 INFO:teuthology.orchestra.run.smithi151.stdout: osd recover clone overlap = true 2023-12-11T17:08:41.962 INFO:teuthology.orchestra.run.smithi151.stdout: osd recovery max chunk = 1048576 2023-12-11T17:08:41.962 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.962 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug shutdown = true 2023-12-11T17:08:41.962 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug op order = true 2023-12-11T17:08:41.962 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug verify stray on activate = true 2023-12-11T17:08:41.962 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug trim objects = true 2023-12-11T17:08:41.963 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.963 INFO:teuthology.orchestra.run.smithi151.stdout: osd open classes on start = true 2023-12-11T17:08:41.963 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug pg log writeout = true 2023-12-11T17:08:41.963 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.963 INFO:teuthology.orchestra.run.smithi151.stdout: osd deep scrub update digest min age = 30 2023-12-11T17:08:41.963 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.963 INFO:teuthology.orchestra.run.smithi151.stdout: osd map max advance = 10 2023-12-11T17:08:41.963 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.963 INFO:teuthology.orchestra.run.smithi151.stdout: journal zero on create = true 2023-12-11T17:08:41.963 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.964 INFO:teuthology.orchestra.run.smithi151.stdout: filestore ondisk finisher threads = 3 2023-12-11T17:08:41.964 INFO:teuthology.orchestra.run.smithi151.stdout: filestore apply finisher threads = 3 2023-12-11T17:08:41.964 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.964 INFO:teuthology.orchestra.run.smithi151.stdout: bdev debug aio = true 2023-12-11T17:08:41.964 INFO:teuthology.orchestra.run.smithi151.stdout: osd debug misdirected ops = true 2023-12-11T17:08:41.964 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore block size = 96636764160 2023-12-11T17:08:41.964 INFO:teuthology.orchestra.run.smithi151.stdout: bluestore fsck on mount = True 2023-12-11T17:08:41.964 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluefs = 20 2023-12-11T17:08:41.964 INFO:teuthology.orchestra.run.smithi151.stdout: debug bluestore = 20 2023-12-11T17:08:41.964 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-12-11T17:08:41.964 INFO:teuthology.orchestra.run.smithi151.stdout: debug osd = 20 2023-12-11T17:08:41.965 INFO:teuthology.orchestra.run.smithi151.stdout: debug rocksdb = 10 2023-12-11T17:08:41.965 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd backfillfull_ratio = 0.85 2023-12-11T17:08:41.965 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd full ratio = 0.9 2023-12-11T17:08:41.965 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd nearfull ratio = 0.8 2023-12-11T17:08:41.965 INFO:teuthology.orchestra.run.smithi151.stdout: osd failsafe full ratio = 0.95 2023-12-11T17:08:41.965 INFO:teuthology.orchestra.run.smithi151.stdout: osd objectstore = bluestore 2023-12-11T17:08:41.965 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-12-11T17:08:41.965 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.965 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr] 2023-12-11T17:08:41.965 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-12-11T17:08:41.965 INFO:teuthology.orchestra.run.smithi151.stdout: debug mgr = 20 2023-12-11T17:08:41.966 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-12-11T17:08:41.966 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-12-11T17:08:41.966 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-12-11T17:08:41.966 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-12-11T17:08:41.966 INFO:teuthology.orchestra.run.smithi151.stdout: mgr/telemetry/nag = false 2023-12-11T17:08:41.966 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.966 INFO:teuthology.orchestra.run.smithi151.stdout:[mon] 2023-12-11T17:08:41.966 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-12-11T17:08:41.966 INFO:teuthology.orchestra.run.smithi151.stdout: debug mon = 20 2023-12-11T17:08:41.966 INFO:teuthology.orchestra.run.smithi151.stdout: debug paxos = 20 2023-12-11T17:08:41.967 INFO:teuthology.orchestra.run.smithi151.stdout: debug auth = 20 2023-12-11T17:08:41.967 INFO:teuthology.orchestra.run.smithi151.stdout: mon data avail warn = 5 2023-12-11T17:08:41.967 INFO:teuthology.orchestra.run.smithi151.stdout: mon mgr mkfs grace = 240 2023-12-11T17:08:41.967 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min pgs per osd = 4 2023-12-11T17:08:41.967 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd reporter subtree level = osd 2023-12-11T17:08:41.967 INFO:teuthology.orchestra.run.smithi151.stdout: mon osd prime pg temp = true 2023-12-11T17:08:41.967 INFO:teuthology.orchestra.run.smithi151.stdout: mon reweight min bytes per osd = 10 2023-12-11T17:08:41.967 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.967 INFO:teuthology.orchestra.run.smithi151.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-11T17:08:41.967 INFO:teuthology.orchestra.run.smithi151.stdout: auth mon ticket ttl = 660 # 11m 2023-12-11T17:08:41.968 INFO:teuthology.orchestra.run.smithi151.stdout: auth service ticket ttl = 240 # 4m 2023-12-11T17:08:41.968 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.968 INFO:teuthology.orchestra.run.smithi151.stdout: # don't complain about insecure global_id in the test suite 2023-12-11T17:08:41.968 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-11T17:08:41.968 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-11T17:08:41.968 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.968 INFO:teuthology.orchestra.run.smithi151.stdout: # 1m isn't quite enough 2023-12-11T17:08:41.968 INFO:teuthology.orchestra.run.smithi151.stdout: mon_down_mkfs_grace = 2m 2023-12-11T17:08:41.968 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.968 INFO:teuthology.orchestra.run.smithi151.stdout: mon_warn_on_filestore_osds = false 2023-12-11T17:08:41.968 INFO:teuthology.orchestra.run.smithi151.stdout: mon op complaint time = 120 2023-12-11T17:08:41.969 INFO:teuthology.orchestra.run.smithi151.stdout: 2023-12-11T17:08:41.969 INFO:teuthology.orchestra.run.smithi151.stdout:[client] 2023-12-11T17:08:41.969 INFO:teuthology.orchestra.run.smithi151.stdout: rgw cache enabled = true 2023-12-11T17:08:41.969 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable ops log = true 2023-12-11T17:08:41.969 INFO:teuthology.orchestra.run.smithi151.stdout: rgw enable usage log = true 2023-12-11T17:08:41.969 INFO:teuthology.orchestra.run.smithi151.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-11T17:08:41.969 INFO:teuthology.orchestra.run.smithi151.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-11T17:08:41.969 INFO:teuthology.orchestra.run.smithi151.stdout: client mount timeout = 600 2023-12-11T17:08:41.969 INFO:teuthology.orchestra.run.smithi151.stdout: debug client = 20 2023-12-11T17:08:41.969 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-12-11T17:08:41.970 INFO:teuthology.orchestra.run.smithi151.stdout: pid file = "" 2023-12-11T17:08:41.970 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-12-11T17:08:41.970 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-12-11T17:08:41.970 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.a] 2023-12-11T17:08:41.970 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.b] 2023-12-11T17:08:41.970 INFO:teuthology.orchestra.run.smithi151.stdout:[mon.c] 2023-12-11T17:08:41.970 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2023-12-11T17:08:41.970 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c] 2023-12-11T17:08:41.970 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2023-12-11T17:08:41.970 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.d] 2023-12-11T17:08:41.971 INFO:teuthology.orchestra.run.smithi151.stdout:[mds] 2023-12-11T17:08:41.971 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds = 20 2023-12-11T17:08:41.971 INFO:teuthology.orchestra.run.smithi151.stdout: debug mds balancer = 20 2023-12-11T17:08:41.971 INFO:teuthology.orchestra.run.smithi151.stdout: debug ms = 1 2023-12-11T17:08:41.971 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug frag = True 2023-12-11T17:08:41.971 INFO:teuthology.orchestra.run.smithi151.stdout: mds debug scatterstat = True 2023-12-11T17:08:41.971 INFO:teuthology.orchestra.run.smithi151.stdout: mds op complaint time = 180 2023-12-11T17:08:41.971 INFO:teuthology.orchestra.run.smithi151.stdout: mds verify scatter = True 2023-12-11T17:08:41.971 INFO:teuthology.orchestra.run.smithi151.stdout: osd op complaint time = 180 2023-12-11T17:08:41.971 INFO:teuthology.orchestra.run.smithi151.stdout: rados mon op timeout = 900 2023-12-11T17:08:41.971 INFO:teuthology.orchestra.run.smithi151.stdout: rados osd op timeout = 900 2023-12-11T17:08:41.992 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-11T17:08:41.992 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-11T17:08:42.151 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-11T17:08:42.151 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:08:42.151 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-11T17:08:42.203 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:08:42.204 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-11T17:08:42.256 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi037.front.sepia.ceph.com 2023-12-11T17:08:42.256 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:08:42.256 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-11T17:08:42.256 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-11T17:08:42.416 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:08:42.416 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-11T17:08:42.518 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi151.front.sepia.ceph.com 2023-12-11T17:08:42.519 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:08:42.519 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-11T17:08:42.519 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-11T17:08:42.668 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:08:42.668 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-11T17:08:42.762 INFO:tasks.ceph:Setting up mon nodes... 2023-12-11T17:08:42.762 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-11T17:08:42.762 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-11T17:08:42.969 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-11T17:08:42.980 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-11T17:08:43.134 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-11T17:08:43.143 INFO:tasks.ceph:Setting up mds nodes... 2023-12-11T17:08:43.144 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-11T17:08:43.353 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-11T17:08:43.363 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-11T17:08:43.468 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-11T17:08:43.664 INFO:teuthology.orchestra.run.smithi037.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-11T17:08:43.674 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-11T17:08:43.783 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-11T17:08:43.961 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-11T17:08:43.967 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-11T17:08:44.051 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-11T17:08:44.230 INFO:teuthology.orchestra.run.smithi151.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-11T17:08:44.239 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-11T17:08:44.317 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-11T17:08:44.318 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-11T17:08:44.461 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-11T17:08:44.516 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-12-11T17:08:44.651 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-12-11T17:08:44.710 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-11T17:08:44.836 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-11T17:08:44.899 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-12-11T17:08:45.028 INFO:teuthology.orchestra.run.smithi151.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-12-11T17:08:45.084 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-11T17:08:45.084 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi151.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-11T17:08:45.084 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-11T17:08:45.193 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-11T17:08:45.193 INFO:tasks.ceph:role: osd.0 2023-12-11T17:08:45.193 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com 2023-12-11T17:08:45.193 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-11T17:08:45.304 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-11T17:08:45.304 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-11T17:08:45.305 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-11T17:08:45.305 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-11T17:08:45.305 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-11T17:08:45.305 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-12-11T17:08:45.305 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-11T17:08:45.305 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-11T17:08:45.305 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-11T17:08:45.305 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-11T17:08:45.820 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-12-11T17:08:45.827 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-12-11T17:08:45.828 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-11T17:08:46.016 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-11T17:08:46.133 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-11T17:08:46.235 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-11T17:08:46.235 INFO:tasks.ceph:role: osd.1 2023-12-11T17:08:46.236 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com 2023-12-11T17:08:46.236 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-11T17:08:46.347 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-11T17:08:46.347 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-11T17:08:46.347 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-11T17:08:46.347 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-11T17:08:46.348 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-11T17:08:46.348 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-12-11T17:08:46.348 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-11T17:08:46.348 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-11T17:08:46.348 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-11T17:08:46.348 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-11T17:08:46.834 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-12-11T17:08:46.841 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-12-11T17:08:46.841 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-11T17:08:46.986 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-11T17:08:47.089 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-11T17:08:47.191 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-11T17:08:47.191 INFO:tasks.ceph:role: osd.2 2023-12-11T17:08:47.191 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com 2023-12-11T17:08:47.192 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-11T17:08:47.302 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-11T17:08:47.302 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-11T17:08:47.302 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-11T17:08:47.302 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-11T17:08:47.302 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-11T17:08:47.302 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-12-11T17:08:47.302 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-11T17:08:47.302 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-11T17:08:47.302 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-11T17:08:47.302 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-11T17:08:47.813 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-12-11T17:08:47.820 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-12-11T17:08:47.820 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-11T17:08:48.011 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-11T17:08:48.127 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-11T17:08:48.230 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-11T17:08:48.230 INFO:tasks.ceph:role: osd.3 2023-12-11T17:08:48.230 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com 2023-12-11T17:08:48.230 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-11T17:08:48.336 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-11T17:08:48.336 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-11T17:08:48.336 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-11T17:08:48.336 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-11T17:08:48.336 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-11T17:08:48.336 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2023-12-11T17:08:48.336 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-11T17:08:48.336 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-11T17:08:48.336 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-11T17:08:48.336 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-11T17:08:48.813 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2023-12-11T17:08:48.821 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2023-12-11T17:08:48.821 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-11T17:08:48.980 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-11T17:08:49.088 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-11T17:08:49.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:49.246+0000 7fc7a94da500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-11T17:08:49.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:49.247+0000 7fc7a94da500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-11T17:08:49.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:49.247+0000 7fc7a94da500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-11T17:08:49.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:49.247+0000 7fc7a94da500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-11T17:08:49.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:49.247+0000 7fc7a94da500 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-12-11T17:08:49.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:49.255+0000 7fc7a94da500 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-12-11T17:08:52.456 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-11T17:08:52.565 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-11T17:08:52.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:52.713+0000 7f29c400f500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-11T17:08:52.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:52.714+0000 7f29c400f500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-11T17:08:52.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:52.714+0000 7f29c400f500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-11T17:08:52.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:52.714+0000 7f29c400f500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-11T17:08:52.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:52.714+0000 7f29c400f500 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-12-11T17:08:52.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:52.717+0000 7f29c400f500 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-12-11T17:08:55.897 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-11T17:08:56.001 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-11T17:08:56.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:56.147+0000 7f91deb39500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-11T17:08:56.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:56.148+0000 7f91deb39500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-11T17:08:56.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:56.148+0000 7f91deb39500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-11T17:08:56.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:56.148+0000 7f91deb39500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-11T17:08:56.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:56.148+0000 7f91deb39500 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-12-11T17:08:56.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:56.150+0000 7f91deb39500 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-12-11T17:08:59.333 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-11T17:08:59.436 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-11T17:08:59.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:59.594+0000 7ff647800500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-11T17:08:59.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:59.594+0000 7ff647800500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-11T17:08:59.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:59.594+0000 7ff647800500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-11T17:08:59.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:59.594+0000 7ff647800500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-11T17:08:59.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:59.594+0000 7ff647800500 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-12-11T17:08:59.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:08:59.597+0000 7ff647800500 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-12-11T17:09:02.515 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-11T17:09:02.617 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-11T17:09:02.723 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-11T17:09:02.723 INFO:tasks.ceph:role: osd.4 2023-12-11T17:09:02.723 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com 2023-12-11T17:09:02.724 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-11T17:09:02.826 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-11T17:09:02.826 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-11T17:09:02.826 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-11T17:09:02.826 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-11T17:09:02.826 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-11T17:09:02.827 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-12-11T17:09:02.827 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-11T17:09:02.827 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-11T17:09:02.827 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-11T17:09:02.827 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-11T17:09:03.348 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-12-11T17:09:03.355 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-12-11T17:09:03.355 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-11T17:09:03.545 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-11T17:09:03.661 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-11T17:09:03.747 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-11T17:09:03.747 INFO:tasks.ceph:role: osd.5 2023-12-11T17:09:03.747 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com 2023-12-11T17:09:03.747 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-11T17:09:03.833 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-11T17:09:03.834 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-11T17:09:03.834 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-11T17:09:03.834 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-11T17:09:03.834 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-11T17:09:03.834 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-12-11T17:09:03.834 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-11T17:09:03.834 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-11T17:09:03.834 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-11T17:09:03.834 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-11T17:09:04.308 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-12-11T17:09:04.313 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-12-11T17:09:04.314 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-11T17:09:04.443 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-11T17:09:04.527 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-11T17:09:04.603 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-11T17:09:04.603 INFO:tasks.ceph:role: osd.6 2023-12-11T17:09:04.603 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com 2023-12-11T17:09:04.603 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-11T17:09:04.686 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-11T17:09:04.686 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-11T17:09:04.686 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-11T17:09:04.687 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-11T17:09:04.687 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-11T17:09:04.687 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-12-11T17:09:04.687 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-11T17:09:04.687 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-11T17:09:04.687 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-11T17:09:04.687 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-11T17:09:05.202 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-12-11T17:09:05.206 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-12-11T17:09:05.206 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-11T17:09:05.389 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-11T17:09:05.496 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-11T17:09:05.592 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-11T17:09:05.592 INFO:tasks.ceph:role: osd.7 2023-12-11T17:09:05.592 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com 2023-12-11T17:09:05.592 DEBUG:teuthology.orchestra.run.smithi151:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-11T17:09:05.696 INFO:teuthology.orchestra.run.smithi151.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-11T17:09:05.696 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-11T17:09:05.696 INFO:teuthology.orchestra.run.smithi151.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-11T17:09:05.696 INFO:teuthology.orchestra.run.smithi151.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-11T17:09:05.697 INFO:teuthology.orchestra.run.smithi151.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-11T17:09:05.697 INFO:teuthology.orchestra.run.smithi151.stdout: = sunit=0 swidth=0 blks 2023-12-11T17:09:05.697 INFO:teuthology.orchestra.run.smithi151.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-11T17:09:05.697 INFO:teuthology.orchestra.run.smithi151.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-11T17:09:05.697 INFO:teuthology.orchestra.run.smithi151.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-11T17:09:05.697 INFO:teuthology.orchestra.run.smithi151.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-11T17:09:06.155 INFO:teuthology.orchestra.run.smithi151.stdout:Discarding blocks...Done. 2023-12-11T17:09:06.163 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi151.front.sepia.ceph.com -o noatime 2023-12-11T17:09:06.163 DEBUG:teuthology.orchestra.run.smithi151:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-11T17:09:06.312 DEBUG:teuthology.orchestra.run.smithi151:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-11T17:09:06.413 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-11T17:09:06.584 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:06.582+0000 7fa722c1a500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-11T17:09:06.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:06.585+0000 7fa722c1a500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-11T17:09:06.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:06.585+0000 7fa722c1a500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-11T17:09:06.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:06.585+0000 7fa722c1a500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-11T17:09:06.586 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:06.585+0000 7fa722c1a500 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-12-11T17:09:06.592 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:06.591+0000 7fa722c1a500 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-12-11T17:09:08.923 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:09:08.933 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:09:09.517 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-11T17:09:09.619 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-11T17:09:09.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:09.759+0000 7f1862827500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-11T17:09:09.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:09.759+0000 7f1862827500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-11T17:09:09.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:09.759+0000 7f1862827500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-11T17:09:09.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:09.759+0000 7f1862827500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-11T17:09:09.760 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:09.759+0000 7f1862827500 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-12-11T17:09:09.762 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:09.762+0000 7f1862827500 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-12-11T17:09:12.951 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-11T17:09:13.052 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-11T17:09:13.187 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:13.187+0000 7f0f796da500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-11T17:09:13.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:13.187+0000 7f0f796da500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-11T17:09:13.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:13.187+0000 7f0f796da500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-11T17:09:13.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:13.188+0000 7f0f796da500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-11T17:09:13.188 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:13.188+0000 7f0f796da500 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-12-11T17:09:13.190 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:13.190+0000 7f0f796da500 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-12-11T17:09:16.118 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-11T17:09:16.219 DEBUG:teuthology.orchestra.run.smithi151:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-11T17:09:16.358 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:16.358+0000 7f0309c21500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-11T17:09:16.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:16.359+0000 7f0309c21500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-11T17:09:16.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:16.359+0000 7f0309c21500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-11T17:09:16.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:16.359+0000 7f0309c21500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-11T17:09:16.359 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:16.359+0000 7f0309c21500 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-12-11T17:09:16.361 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:16.361+0000 7f0309c21500 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-12-11T17:09:19.297 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-11T17:09:19.394 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-11T17:09:19.394 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:09:19.394 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-11T17:09:19.507 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:09:19.507 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-11T17:09:19.616 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:09:19.616 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-11T17:09:19.720 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:09:19.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-11T17:09:19.822 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:09:19.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-11T17:09:19.927 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:09:19.927 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-11T17:09:20.032 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:09:20.032 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-11T17:09:20.133 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:09:20.133 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-11T17:09:20.237 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:09:20.237 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-11T17:09:20.335 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:09:20.335 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-11T17:09:20.430 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:09:20.430 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-11T17:09:20.525 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:09:20.526 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-11T17:09:20.623 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:09:20.623 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-11T17:09:20.717 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:09:20.717 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-11T17:09:20.814 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:09:20.814 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-11T17:09:20.877 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:09:20.877 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-12-11T17:09:20.934 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:09:20.934 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-11T17:09:20.995 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:09:20.995 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-12-11T17:09:21.048 INFO:tasks.ceph:Adding keys to all mons... 2023-12-11T17:09:21.048 DEBUG:teuthology.orchestra.run.smithi037:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-11T17:09:21.057 DEBUG:teuthology.orchestra.run.smithi151:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-11T17:09:21.150 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.y] 2023-12-11T17:09:21.151 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAaQndlWY7TORAAJ5A6MvYYIo/S1P2z7SGSsw== 2023-12-11T17:09:21.151 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.a] 2023-12-11T17:09:21.151 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAbQndlungdFRAABbCcncYp6gDHgsDrmGgQEg== 2023-12-11T17:09:21.151 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.c] 2023-12-11T17:09:21.151 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAbQndlwMSfJxAA0kjI/HBNFPN893ojKAUSew== 2023-12-11T17:09:21.151 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.0] 2023-12-11T17:09:21.151 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAhQndlQDPFDhAAeg8Nh2I/UzL8yGnqJFl4rA== 2023-12-11T17:09:21.151 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.1] 2023-12-11T17:09:21.151 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAkQndlU/udKhAAuf/IqblDxe+gz5gT9EPRlg== 2023-12-11T17:09:21.151 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.2] 2023-12-11T17:09:21.151 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAoQndlZlLhCBAACHd34bOcIQtXSdk6lNkFgg== 2023-12-11T17:09:21.151 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.3] 2023-12-11T17:09:21.152 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQArQndlI76AIxAALcb2soN0pQIlJYRJzuCx2g== 2023-12-11T17:09:21.152 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.x] 2023-12-11T17:09:21.152 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAbQndlZ8IJCBAAFvb+ICfIlsMnDvvLp8VyOA== 2023-12-11T17:09:21.152 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.b] 2023-12-11T17:09:21.152 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAbQndlPNdUORAAKJejhmXAmDJFHfHHCShAOw== 2023-12-11T17:09:21.152 INFO:teuthology.orchestra.run.smithi037.stdout:[mds.d] 2023-12-11T17:09:21.152 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAcQndl+gjGDRAAjZGXzxk3B/uu+pwIae/3rw== 2023-12-11T17:09:21.152 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.4] 2023-12-11T17:09:21.152 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAyQndlknnbIhAAVWP7erZ6EMjNVJcs6xTLWA== 2023-12-11T17:09:21.152 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.5] 2023-12-11T17:09:21.152 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA1QndlAjpPLRAAnfrommkI81tsCJYmcpMq5w== 2023-12-11T17:09:21.152 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.6] 2023-12-11T17:09:21.152 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA5Qndl61syCxAApiq3q/BjWOVYjdl2R6uvAw== 2023-12-11T17:09:21.153 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.7] 2023-12-11T17:09:21.153 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA8QndltjRnFRAA4PicSbwdLxQ9d5eoxXSIVg== 2023-12-11T17:09:21.153 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-12-11T17:09:21.153 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAcQndliHmLGxAA+EpFpS2I98RG7SN1gAiRLQ== 2023-12-11T17:09:21.153 INFO:teuthology.orchestra.run.smithi037.stdout:[client.2] 2023-12-11T17:09:21.153 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAcQndlwnniJhAAesgB3OB2+RW3+7K3w2TCWw== 2023-12-11T17:09:21.153 INFO:teuthology.orchestra.run.smithi037.stdout:[client.1] 2023-12-11T17:09:21.153 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAcQndlAhjgMRAA6B/hthYWw1PyyXvVVitHnw== 2023-12-11T17:09:21.153 INFO:teuthology.orchestra.run.smithi037.stdout:[client.3] 2023-12-11T17:09:21.153 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAdQndlOdm1ARAANlOZ9dzSBs4+CsEQM5Yf2Q== 2023-12-11T17:09:21.154 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.y] 2023-12-11T17:09:21.154 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAaQndlWY7TORAAJ5A6MvYYIo/S1P2z7SGSsw== 2023-12-11T17:09:21.154 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.a] 2023-12-11T17:09:21.154 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAbQndlungdFRAABbCcncYp6gDHgsDrmGgQEg== 2023-12-11T17:09:21.154 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.c] 2023-12-11T17:09:21.154 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAbQndlwMSfJxAA0kjI/HBNFPN893ojKAUSew== 2023-12-11T17:09:21.154 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.0] 2023-12-11T17:09:21.154 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAhQndlQDPFDhAAeg8Nh2I/UzL8yGnqJFl4rA== 2023-12-11T17:09:21.154 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.1] 2023-12-11T17:09:21.154 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAkQndlU/udKhAAuf/IqblDxe+gz5gT9EPRlg== 2023-12-11T17:09:21.154 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.2] 2023-12-11T17:09:21.154 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAoQndlZlLhCBAACHd34bOcIQtXSdk6lNkFgg== 2023-12-11T17:09:21.154 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.3] 2023-12-11T17:09:21.155 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQArQndlI76AIxAALcb2soN0pQIlJYRJzuCx2g== 2023-12-11T17:09:21.155 INFO:teuthology.orchestra.run.smithi151.stdout:[mgr.x] 2023-12-11T17:09:21.155 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAbQndlZ8IJCBAAFvb+ICfIlsMnDvvLp8VyOA== 2023-12-11T17:09:21.155 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.b] 2023-12-11T17:09:21.155 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAbQndlPNdUORAAKJejhmXAmDJFHfHHCShAOw== 2023-12-11T17:09:21.155 INFO:teuthology.orchestra.run.smithi151.stdout:[mds.d] 2023-12-11T17:09:21.155 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAcQndl+gjGDRAAjZGXzxk3B/uu+pwIae/3rw== 2023-12-11T17:09:21.155 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.4] 2023-12-11T17:09:21.155 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAyQndlknnbIhAAVWP7erZ6EMjNVJcs6xTLWA== 2023-12-11T17:09:21.155 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.5] 2023-12-11T17:09:21.155 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQA1QndlAjpPLRAAnfrommkI81tsCJYmcpMq5w== 2023-12-11T17:09:21.155 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.6] 2023-12-11T17:09:21.155 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQA5Qndl61syCxAApiq3q/BjWOVYjdl2R6uvAw== 2023-12-11T17:09:21.155 INFO:teuthology.orchestra.run.smithi151.stdout:[osd.7] 2023-12-11T17:09:21.155 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQA8QndltjRnFRAA4PicSbwdLxQ9d5eoxXSIVg== 2023-12-11T17:09:21.156 INFO:teuthology.orchestra.run.smithi151.stdout:[client.0] 2023-12-11T17:09:21.156 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAcQndliHmLGxAA+EpFpS2I98RG7SN1gAiRLQ== 2023-12-11T17:09:21.156 INFO:teuthology.orchestra.run.smithi151.stdout:[client.2] 2023-12-11T17:09:21.156 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAcQndlwnniJhAAesgB3OB2+RW3+7K3w2TCWw== 2023-12-11T17:09:21.156 INFO:teuthology.orchestra.run.smithi151.stdout:[client.1] 2023-12-11T17:09:21.156 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAcQndlAhjgMRAA6B/hthYWw1PyyXvVVitHnw== 2023-12-11T17:09:21.156 INFO:teuthology.orchestra.run.smithi151.stdout:[client.3] 2023-12-11T17:09:21.156 INFO:teuthology.orchestra.run.smithi151.stdout: key = AQAdQndlOdm1ARAANlOZ9dzSBs4+CsEQM5Yf2Q== 2023-12-11T17:09:21.158 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-11T17:09:21.166 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-11T17:09:21.319 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-11T17:09:21.329 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-11T17:09:21.477 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-11T17:09:21.485 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-11T17:09:21.636 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-11T17:09:21.641 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-11T17:09:21.794 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-11T17:09:21.803 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-11T17:09:21.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-11T17:09:21.954 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-11T17:09:22.097 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-11T17:09:22.107 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-11T17:09:22.254 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-11T17:09:22.262 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-11T17:09:22.407 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-11T17:09:22.414 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-11T17:09:22.563 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-11T17:09:22.569 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-11T17:09:22.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-11T17:09:22.729 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-11T17:09:22.873 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-11T17:09:22.878 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-11T17:09:23.032 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-11T17:09:23.040 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-11T17:09:23.185 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-11T17:09:23.194 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-11T17:09:23.340 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-11T17:09:23.347 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-11T17:09:23.492 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-11T17:09:23.498 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-11T17:09:23.649 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-11T17:09:23.656 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-11T17:09:23.807 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-11T17:09:23.814 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-11T17:09:23.966 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-11T17:09:23.966 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-11T17:09:24.067 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-11T17:09:24.233 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-11T17:09:24.326 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-11T17:09:24.429 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-11T17:09:24.588 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-11T17:09:24.675 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-11T17:09:24.767 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-11T17:09:24.926 DEBUG:teuthology.orchestra.run.smithi151:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-11T17:09:25.008 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-11T17:09:25.017 DEBUG:teuthology.orchestra.run.smithi151:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-11T17:09:25.073 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-11T17:09:25.073 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-11T17:09:25.073 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-11T17:09:25.082 INFO:tasks.ceph.mon.a:Started 2023-12-11T17:09:25.082 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-11T17:09:25.082 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-11T17:09:25.088 INFO:tasks.ceph.mon.b:Started 2023-12-11T17:09:25.088 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-11T17:09:25.089 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-11T17:09:25.094 INFO:tasks.ceph.mon.c:Started 2023-12-11T17:09:25.094 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-11T17:09:25.094 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-11T17:09:25.095 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-11T17:09:25.104 INFO:tasks.ceph.mgr.y:Started 2023-12-11T17:09:25.104 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-11T17:09:25.104 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-11T17:09:25.108 INFO:tasks.ceph.mgr.x:Started 2023-12-11T17:09:25.108 INFO:tasks.ceph:Setting crush tunables to default 2023-12-11T17:09:25.109 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd crush tunables default 2023-12-11T17:09:25.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.296+0000 7f1cfb652640 1 Processor -- start 2023-12-11T17:09:25.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.297+0000 7f1cfb652640 1 -- start start 2023-12-11T17:09:25.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.298+0000 7f1cfb652640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf406a460 0x7f1cf406a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:25.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.298+0000 7f1cfb652640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf4071cd0 con 0x7f1cf40ce7e0 2023-12-11T17:09:25.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.298+0000 7f1cfb652640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf40719f0 con 0x7f1cf415af50 2023-12-11T17:09:25.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.298+0000 7f1cfb652640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf406ae30 con 0x7f1cf406a460 2023-12-11T17:09:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.298+0000 7f1cf9bef640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf406a460 0x7f1cf406a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.298+0000 7f1cf9bef640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf406a460 0x7f1cf406a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.37:45128/0 (socket says 172.21.15.37:45128) 2023-12-11T17:09:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.298+0000 7f1cf9bef640 1 -- 172.21.15.37:0/2212322285 learned_addr learned my addr 172.21.15.37:0/2212322285 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.299+0000 7f1cf9bef640 1 -- 172.21.15.37:0/2212322285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf406a460 msgr2=0x7f1cf406a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-11T17:09:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.299+0000 7f1cf9bef640 1 -- 172.21.15.37:0/2212322285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf406a460 msgr2=0x7f1cf406a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-11T17:09:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.299+0000 7f1cf9bef640 1 --2- 172.21.15.37:0/2212322285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf406a460 0x7f1cf406a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-11T17:09:25.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.299+0000 7f1cf9bef640 1 --2- 172.21.15.37:0/2212322285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf406a460 0x7f1cf406a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-11T17:09:25.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.316+0000 7f1cebfff640 1 -- 172.21.15.37:0/2212322285 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1168244751 0 0) 0x7f1cf4071cd0 con 0x7f1cf40ce7e0 2023-12-11T17:09:25.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.316+0000 7f1cebfff640 1 -- 172.21.15.37:0/2212322285 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ce0003520 con 0x7f1cf40ce7e0 2023-12-11T17:09:25.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.317+0000 7f1cebfff640 1 -- 172.21.15.37:0/2212322285 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1303127199 0 0) 0x7f1ce0003520 con 0x7f1cf40ce7e0 2023-12-11T17:09:25.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.317+0000 7f1cebfff640 1 -- 172.21.15.37:0/2212322285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf406a460 msgr2=0x7f1cf406a8f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T17:09:25.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.317+0000 7f1cebfff640 1 --2- 172.21.15.37:0/2212322285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf406a460 0x7f1cf406a8f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:25.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.317+0000 7f1cebfff640 1 -- 172.21.15.37:0/2212322285 >> v1:172.21.15.151:6789/0 conn(0x7f1cf415af50 legacy=0x7f1cf406c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:25.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.317+0000 7f1cebfff640 1 -- 172.21.15.37:0/2212322285 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf4071ff0 con 0x7f1cf40ce7e0 2023-12-11T17:09:25.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.317+0000 7f1cebfff640 1 -- 172.21.15.37:0/2212322285 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f1ce4001670 con 0x7f1cf40ce7e0 2023-12-11T17:09:25.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.317+0000 7f1cebfff640 1 -- 172.21.15.37:0/2212322285 >> v1:172.21.15.37:6789/0 conn(0x7f1cf40ce7e0 legacy=0x7f1cf415ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:25.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.317+0000 7f1cebfff640 1 --2- 172.21.15.37:0/2212322285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ce00039a0 0x7f1ce0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:25.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.317+0000 7f1cebfff640 1 --2- 172.21.15.37:0/2212322285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce00047c0 0x7f1ce0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:25.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.317+0000 7f1cebfff640 1 --2- 172.21.15.37:0/2212322285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf406a460 0x7f1ce000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:25.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.317+0000 7f1cebfff640 1 -- 172.21.15.37:0/2212322285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf406ae30 con 0x7f1ce00047c0 2023-12-11T17:09:25.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.317+0000 7f1cebfff640 1 -- 172.21.15.37:0/2212322285 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce00055c0 con 0x7f1ce00039a0 2023-12-11T17:09:25.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.317+0000 7f1cebfff640 1 -- 172.21.15.37:0/2212322285 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce000bec0 con 0x7f1cf406a460 2023-12-11T17:09:25.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.317+0000 7f1cf8bed640 1 --2- 172.21.15.37:0/2212322285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce00047c0 0x7f1ce0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:25.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.317+0000 7f1cf9bef640 1 --2- 172.21.15.37:0/2212322285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf406a460 0x7f1ce000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:25.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.317+0000 7f1cf93ee640 1 --2- 172.21.15.37:0/2212322285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ce00039a0 0x7f1ce0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:25.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.318+0000 7f1cf8bed640 1 -- 172.21.15.37:0/2212322285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf406a460 msgr2=0x7f1ce000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:25.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.318+0000 7f1cf8bed640 1 --2- 172.21.15.37:0/2212322285 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf406a460 0x7f1ce000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:25.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.318+0000 7f1cf8bed640 1 -- 172.21.15.37:0/2212322285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ce00039a0 msgr2=0x7f1ce0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:25.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.318+0000 7f1cf8bed640 1 --2- 172.21.15.37:0/2212322285 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ce00039a0 0x7f1ce0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:25.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.318+0000 7f1cf8bed640 1 -- 172.21.15.37:0/2212322285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce0003520 con 0x7f1ce00047c0 2023-12-11T17:09:25.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.319+0000 7f1cf8bed640 1 --2- 172.21.15.37:0/2212322285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce00047c0 0x7f1ce0004c40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4007f10 tx=0x7f1ce00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a97c2ab787cb710 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:25.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.319+0000 7f1cebfff640 1 -- 172.21.15.37:0/2212322285 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce402c900 con 0x7f1ce00047c0 2023-12-11T17:09:25.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.319+0000 7f1cebfff640 1 -- 172.21.15.37:0/2212322285 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ce402ca60 con 0x7f1ce00047c0 2023-12-11T17:09:25.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.319+0000 7f1cebfff640 1 -- 172.21.15.37:0/2212322285 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ce402ce10 con 0x7f1ce00047c0 2023-12-11T17:09:25.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.320+0000 7f1cfb652640 1 -- 172.21.15.37:0/2212322285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce00047c0 msgr2=0x7f1ce0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:25.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.320+0000 7f1cfb652640 1 --2- 172.21.15.37:0/2212322285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce00047c0 0x7f1ce0004c40 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f1ce4007f10 tx=0x7f1ce00057f0 comp rx=0 tx=0).stop 2023-12-11T17:09:25.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.320+0000 7f1cf9bef640 1 -- 172.21.15.37:0/2212322285 reap_dead start 2023-12-11T17:09:25.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.320+0000 7f1cfb652640 1 -- 172.21.15.37:0/2212322285 shutdown_connections 2023-12-11T17:09:25.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.320+0000 7f1cfb652640 1 -- 172.21.15.37:0/2212322285 >> 172.21.15.37:0/2212322285 conn(0x7f1cf40cee70 msgr2=0x7f1cf40cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:25.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.320+0000 7f1cfb652640 1 -- 172.21.15.37:0/2212322285 shutdown_connections 2023-12-11T17:09:25.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.320+0000 7f1cfb652640 1 -- 172.21.15.37:0/2212322285 wait complete. 2023-12-11T17:09:25.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.322+0000 7f1cfb652640 1 Processor -- start 2023-12-11T17:09:25.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.322+0000 7f1cfb652640 1 -- start start 2023-12-11T17:09:25.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.323+0000 7f1cfb652640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce00047c0 0x7f1cf4152640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:25.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.323+0000 7f1cfb652640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf41581e0 0x7f1cf4153530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:25.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.323+0000 7f1cfb652640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cf4155630 0x7f1cf40c3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:25.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.323+0000 7f1cfb652640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40c27b0 con 0x7f1ce00047c0 2023-12-11T17:09:25.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.323+0000 7f1cfb652640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40c2a90 con 0x7f1cf4155630 2023-12-11T17:09:25.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.323+0000 7f1cfb652640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf40c2d70 con 0x7f1cf41581e0 2023-12-11T17:09:25.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.324+0000 7f1cf9bef640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cf4155630 0x7f1cf40c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:25.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.324+0000 7f1cf9bef640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cf4155630 0x7f1cf40c3550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:57130/0 (socket says 172.21.15.37:57130) 2023-12-11T17:09:25.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.324+0000 7f1cf9bef640 1 -- 172.21.15.37:0/3055966293 learned_addr learned my addr 172.21.15.37:0/3055966293 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:25.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.324+0000 7f1cf93ee640 1 --2- 172.21.15.37:0/3055966293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce00047c0 0x7f1cf4152640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:25.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.324+0000 7f1cf8bed640 1 --2- 172.21.15.37:0/3055966293 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf41581e0 0x7f1cf4153530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:25.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.324+0000 7f1cf9bef640 1 -- 172.21.15.37:0/3055966293 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf41581e0 msgr2=0x7f1cf4153530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:25.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.324+0000 7f1cf9bef640 1 --2- 172.21.15.37:0/3055966293 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf41581e0 0x7f1cf4153530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:25.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.324+0000 7f1cf9bef640 1 -- 172.21.15.37:0/3055966293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce00047c0 msgr2=0x7f1cf4152640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:25.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.324+0000 7f1cf9bef640 1 --2- 172.21.15.37:0/3055966293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce00047c0 0x7f1cf4152640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:25.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.324+0000 7f1cf9bef640 1 -- 172.21.15.37:0/3055966293 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf40c3050 con 0x7f1cf4155630 2023-12-11T17:09:25.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.325+0000 7f1cf93ee640 1 --2- 172.21.15.37:0/3055966293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce00047c0 0x7f1cf4152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:09:25.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.325+0000 7f1cf9bef640 1 --2- 172.21.15.37:0/3055966293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cf4155630 0x7f1cf40c3550 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1cf415eb60 tx=0x7f1cec007e80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:25.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.326+0000 7f1ce9ffb640 1 -- 172.21.15.37:0/3055966293 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec00a500 con 0x7f1cf4155630 2023-12-11T17:09:25.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.326+0000 7f1ce9ffb640 1 -- 172.21.15.37:0/3055966293 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cec00a680 con 0x7f1cf4155630 2023-12-11T17:09:25.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.326+0000 7f1ce9ffb640 1 -- 172.21.15.37:0/3055966293 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cec003bd0 con 0x7f1cf4155630 2023-12-11T17:09:25.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.326+0000 7f1cfb652640 1 -- 172.21.15.37:0/3055966293 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf4152b80 con 0x7f1cf4155630 2023-12-11T17:09:25.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.326+0000 7f1cfb652640 1 -- 172.21.15.37:0/3055966293 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf4153c50 con 0x7f1cf4155630 2023-12-11T17:09:25.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.326+0000 7f1ce9ffb640 1 -- 172.21.15.37:0/3055966293 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f1cec003d30 con 0x7f1cf4155630 2023-12-11T17:09:25.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.326+0000 7f1ce9ffb640 1 -- 172.21.15.37:0/3055966293 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7f1cec00f9b0 con 0x7f1cf4155630 2023-12-11T17:09:25.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.327+0000 7f1cfb652640 1 -- 172.21.15.37:0/3055966293 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf4074450 con 0x7f1cf4155630 2023-12-11T17:09:25.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.330+0000 7f1ce9ffb640 1 -- 172.21.15.37:0/3055966293 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f1cf4153c50 con 0x7f1cf4155630 2023-12-11T17:09:25.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.405+0000 7f1cfb652640 1 -- 172.21.15.37:0/3055966293 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f1cf406dee0 con 0x7f1cf4155630 2023-12-11T17:09:25.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.412+0000 7f1ce9ffb640 1 -- 172.21.15.37:0/3055966293 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f1cec01b070 con 0x7f1cf4155630 2023-12-11T17:09:25.412 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2023-12-11T17:09:25.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.413+0000 7f1cfb652640 1 -- 172.21.15.37:0/3055966293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cf4155630 msgr2=0x7f1cf40c3550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:25.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.413+0000 7f1cfb652640 1 --2- 172.21.15.37:0/3055966293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cf4155630 0x7f1cf40c3550 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1cf415eb60 tx=0x7f1cec007e80 comp rx=0 tx=0).stop 2023-12-11T17:09:25.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.414+0000 7f1cfb652640 1 -- 172.21.15.37:0/3055966293 shutdown_connections 2023-12-11T17:09:25.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.414+0000 7f1cfb652640 1 --2- 172.21.15.37:0/3055966293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1cf4155630 0x7f1cf40c3550 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:25.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.414+0000 7f1cfb652640 1 --2- 172.21.15.37:0/3055966293 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1cf41581e0 0x7f1cf4153530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:25.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.414+0000 7f1cfb652640 1 --2- 172.21.15.37:0/3055966293 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1ce00047c0 0x7f1cf4152640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:25.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.414+0000 7f1cfb652640 1 -- 172.21.15.37:0/3055966293 >> 172.21.15.37:0/3055966293 conn(0x7f1cf40cee70 msgr2=0x7f1cf40cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:25.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.414+0000 7f1cfb652640 1 -- 172.21.15.37:0/3055966293 shutdown_connections 2023-12-11T17:09:25.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:25.414+0000 7f1cfb652640 1 -- 172.21.15.37:0/3055966293 wait complete. 2023-12-11T17:09:25.431 INFO:tasks.ceph:check_enable_crimson: False 2023-12-11T17:09:25.431 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-11T17:09:25.432 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:09:25.432 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-11T17:09:25.516 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:09:25.516 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-11T17:09:25.649 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:09:25.649 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-11T17:09:25.748 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:09:25.748 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-11T17:09:25.839 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:09:25.839 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-11T17:09:25.870 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:25.870+0000 7f50a963b040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-11T17:09:25.896 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:25.896+0000 7f2ad2211040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-11T17:09:25.931 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:09:25.931 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-11T17:09:25.933 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:25.933+0000 7f50a963b040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-11T17:09:25.957 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:25.957+0000 7f2ad2211040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-11T17:09:26.012 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:09:26.012 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-11T17:09:26.139 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:09:26.139 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-11T17:09:26.217 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new b4bafba7-b7d5-488d-be85-93d79e39f8df 0 2023-12-11T17:09:26.458 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.458+0000 7f555c947640 1 Processor -- start 2023-12-11T17:09:26.459 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.458+0000 7f555c947640 1 -- start start 2023-12-11T17:09:26.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.459+0000 7f555c947640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f55580cec20 0x7f5558167d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:26.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.459+0000 7f555c947640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55580b74d0 con 0x7f555815d1f0 2023-12-11T17:09:26.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.459+0000 7f555c947640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55580d1940 con 0x7f55580b8970 2023-12-11T17:09:26.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.459+0000 7f555c947640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55580cf090 con 0x7f55580cec20 2023-12-11T17:09:26.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.460+0000 7f554ffff640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f55580b8970 0x7f55580d1230 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:54082/0 (socket says 172.21.15.151:54082) 2023-12-11T17:09:26.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.460+0000 7f554ffff640 1 -- 172.21.15.151:0/374040781 learned_addr learned my addr 172.21.15.151:0/374040781 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-12-11T17:09:26.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.460+0000 7f5557fff640 1 --2- 172.21.15.151:0/374040781 >> v2:172.21.15.37:3300/0 conn(0x7f55580cec20 0x7f5558167d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:26.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.460+0000 7f5556ffd640 1 -- 172.21.15.151:0/374040781 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1901425390 0 0) 0x7f55580d1940 con 0x7f55580b8970 2023-12-11T17:09:26.461 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.460+0000 7f5556ffd640 1 -- 172.21.15.151:0/374040781 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5544003520 con 0x7f55580b8970 2023-12-11T17:09:26.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.460+0000 7f5556ffd640 1 -- 172.21.15.151:0/374040781 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3617227615 0 0) 0x7f5544003520 con 0x7f55580b8970 2023-12-11T17:09:26.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.460+0000 7f5556ffd640 1 -- 172.21.15.151:0/374040781 >> v2:172.21.15.37:3300/0 conn(0x7f55580cec20 msgr2=0x7f5558167d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:26.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.460+0000 7f5556ffd640 1 --2- 172.21.15.151:0/374040781 >> v2:172.21.15.37:3300/0 conn(0x7f55580cec20 0x7f5558167d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:26.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.460+0000 7f5556ffd640 1 -- 172.21.15.151:0/374040781 >> v1:172.21.15.37:6789/0 conn(0x7f555815d1f0 legacy=0x7f55580d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:26.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.460+0000 7f5556ffd640 1 -- 172.21.15.151:0/374040781 --> v1:172.21.15.151:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55580b68e0 con 0x7f55580b8970 2023-12-11T17:09:26.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.460+0000 7f5556ffd640 1 -- 172.21.15.151:0/374040781 <== mon.1 v1:172.21.15.151:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f5540001670 con 0x7f55580b8970 2023-12-11T17:09:26.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.460+0000 7f5556ffd640 1 -- 172.21.15.151:0/374040781 >> v1:172.21.15.151:6789/0 conn(0x7f55580b8970 legacy=0x7f55580d1230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:26.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.460+0000 7f5556ffd640 1 --2- 172.21.15.151:0/374040781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5544003970 0x7f5544003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:26.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.461+0000 7f5556ffd640 1 --2- 172.21.15.151:0/374040781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5544004370 0x7f5544004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:26.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.461+0000 7f5556ffd640 1 --2- 172.21.15.151:0/374040781 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5544005040 0x7f554400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:26.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.461+0000 7f5556ffd640 1 -- 172.21.15.151:0/374040781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554400bf70 con 0x7f5544003970 2023-12-11T17:09:26.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.461+0000 7f5556ffd640 1 -- 172.21.15.151:0/374040781 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f554400c0e0 con 0x7f5544004370 2023-12-11T17:09:26.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.461+0000 7f5556ffd640 1 -- 172.21.15.151:0/374040781 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f554400c2a0 con 0x7f5544005040 2023-12-11T17:09:26.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.461+0000 7f55577fe640 1 --2- 172.21.15.151:0/374040781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5544003970 0x7f5544003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:26.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.461+0000 7f554ffff640 1 --2- 172.21.15.151:0/374040781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5544004370 0x7f5544004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:26.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.461+0000 7f5557fff640 1 --2- 172.21.15.151:0/374040781 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5544005040 0x7f554400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:26.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.461+0000 7f554ffff640 1 -- 172.21.15.151:0/374040781 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5544005040 msgr2=0x7f554400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:26.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.461+0000 7f554ffff640 1 --2- 172.21.15.151:0/374040781 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5544005040 0x7f554400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:26.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.461+0000 7f554ffff640 1 -- 172.21.15.151:0/374040781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5544003970 msgr2=0x7f5544003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:26.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.461+0000 7f554ffff640 1 --2- 172.21.15.151:0/374040781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5544003970 0x7f5544003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:26.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.462+0000 7f554ffff640 1 -- 172.21.15.151:0/374040781 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5544003520 con 0x7f5544004370 2023-12-11T17:09:26.464 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.462+0000 7f5557fff640 1 -- 172.21.15.151:0/374040781 reap_dead start 2023-12-11T17:09:26.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.463+0000 7f554ffff640 1 --2- 172.21.15.151:0/374040781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5544004370 0x7f5544004840 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f554000c190 tx=0x7f55440057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a73da1dee20262 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:26.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.463+0000 7f5556ffd640 1 -- 172.21.15.151:0/374040781 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5540005ad0 con 0x7f5544004370 2023-12-11T17:09:26.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.463+0000 7f5556ffd640 1 -- 172.21.15.151:0/374040781 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5540005c50 con 0x7f5544004370 2023-12-11T17:09:26.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.463+0000 7f5556ffd640 1 -- 172.21.15.151:0/374040781 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554002c7c0 con 0x7f5544004370 2023-12-11T17:09:26.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.464+0000 7f555c947640 1 -- 172.21.15.151:0/374040781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5544004370 msgr2=0x7f5544004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:26.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.464+0000 7f555c947640 1 --2- 172.21.15.151:0/374040781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5544004370 0x7f5544004840 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f554000c190 tx=0x7f55440057f0 comp rx=0 tx=0).stop 2023-12-11T17:09:26.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.464+0000 7f555c947640 1 -- 172.21.15.151:0/374040781 shutdown_connections 2023-12-11T17:09:26.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.464+0000 7f555c947640 1 --2- 172.21.15.151:0/374040781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5544004370 0x7f5544004840 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:26.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.464+0000 7f555c947640 1 -- 172.21.15.151:0/374040781 >> 172.21.15.151:0/374040781 conn(0x7f55580d2fe0 msgr2=0x7f55580d33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:26.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.464+0000 7f555c947640 1 -- 172.21.15.151:0/374040781 shutdown_connections 2023-12-11T17:09:26.466 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.464+0000 7f555c947640 1 -- 172.21.15.151:0/374040781 wait complete. 2023-12-11T17:09:26.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.466+0000 7f555c947640 1 Processor -- start 2023-12-11T17:09:26.467 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.466+0000 7f555c947640 1 -- start start 2023-12-11T17:09:26.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.467+0000 7f555c947640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5544004370 0x7f555815d7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:26.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.467+0000 7f555c947640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5558155b60 0x7f55580c8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:26.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.467+0000 7f555c947640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5558156110 0x7f5558156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:26.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.467+0000 7f555c947640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f555815dfc0 con 0x7f5558156110 2023-12-11T17:09:26.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.467+0000 7f555c947640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55580cc2b0 con 0x7f5558155b60 2023-12-11T17:09:26.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.467+0000 7f555c947640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f555815dd20 con 0x7f5544004370 2023-12-11T17:09:26.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.467+0000 7f55577fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5544004370 0x7f555815d7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:26.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.467+0000 7f554ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5558155b60 0x7f55580c8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:26.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.467+0000 7f55577fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5544004370 0x7f555815d7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:49190/0 (socket says 172.21.15.151:49190) 2023-12-11T17:09:26.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.467+0000 7f55577fe640 1 -- 172.21.15.151:0/88345260 learned_addr learned my addr 172.21.15.151:0/88345260 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-12-11T17:09:26.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.467+0000 7f5557fff640 1 --2- 172.21.15.151:0/88345260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5558156110 0x7f5558156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:26.469 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.467+0000 7f55577fe640 1 -- 172.21.15.151:0/88345260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5558155b60 msgr2=0x7f55580c8480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:26.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.467+0000 7f55577fe640 1 --2- 172.21.15.151:0/88345260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5558155b60 0x7f55580c8480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:26.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.467+0000 7f55577fe640 1 -- 172.21.15.151:0/88345260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5558156110 msgr2=0x7f5558156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:26.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.467+0000 7f55577fe640 1 --2- 172.21.15.151:0/88345260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5558156110 0x7f5558156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:26.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.467+0000 7f55577fe640 1 -- 172.21.15.151:0/88345260 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55580cb980 con 0x7f5544004370 2023-12-11T17:09:26.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.468+0000 7f55577fe640 1 --2- 172.21.15.151:0/88345260 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5544004370 0x7f555815d7e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f554800f7a0 tx=0x7f554800fc60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:26.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.468+0000 7f5554ff9640 1 -- 172.21.15.151:0/88345260 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554800fe50 con 0x7f5544004370 2023-12-11T17:09:26.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.468+0000 7f5554ff9640 1 -- 172.21.15.151:0/88345260 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55480052e0 con 0x7f5544004370 2023-12-11T17:09:26.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.468+0000 7f5554ff9640 1 -- 172.21.15.151:0/88345260 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554800d8f0 con 0x7f5544004370 2023-12-11T17:09:26.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.468+0000 7f555c947640 1 -- 172.21.15.151:0/88345260 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55580cbc60 con 0x7f5544004370 2023-12-11T17:09:26.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.468+0000 7f555c947640 1 -- 172.21.15.151:0/88345260 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55580c89c0 con 0x7f5544004370 2023-12-11T17:09:26.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.468+0000 7f5554ff9640 1 -- 172.21.15.151:0/88345260 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f554800dd50 con 0x7f5544004370 2023-12-11T17:09:26.470 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.468+0000 7f5554ff9640 1 -- 172.21.15.151:0/88345260 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5548003e30 con 0x7f5544004370 2023-12-11T17:09:26.471 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.469+0000 7f555c947640 1 -- 172.21.15.151:0/88345260 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55580c8b50 con 0x7f5544004370 2023-12-11T17:09:26.472 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.472+0000 7f5554ff9640 1 -- 172.21.15.151:0/88345260 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f5548005450 con 0x7f5544004370 2023-12-11T17:09:26.550 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.549+0000 7f555c947640 1 -- 172.21.15.151:0/88345260 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b4bafba7-b7d5-488d-be85-93d79e39f8df", "id": 0} v 0) v1 -- 0x7f55580673f0 con 0x7f5544004370 2023-12-11T17:09:26.556 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.556+0000 7f5554ff9640 1 -- 172.21.15.151:0/88345260 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b4bafba7-b7d5-488d-be85-93d79e39f8df", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f55480035f0 con 0x7f5544004370 2023-12-11T17:09:26.557 INFO:teuthology.orchestra.run.smithi151.stdout:0 2023-12-11T17:09:26.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.558+0000 7f555c947640 1 -- 172.21.15.151:0/88345260 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5544004370 msgr2=0x7f555815d7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:26.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.558+0000 7f555c947640 1 --2- 172.21.15.151:0/88345260 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5544004370 0x7f555815d7e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f554800f7a0 tx=0x7f554800fc60 comp rx=0 tx=0).stop 2023-12-11T17:09:26.558 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.558+0000 7f555c947640 1 -- 172.21.15.151:0/88345260 shutdown_connections 2023-12-11T17:09:26.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.558+0000 7f555c947640 1 --2- 172.21.15.151:0/88345260 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5558155b60 0x7f55580c8480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:26.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.558+0000 7f555c947640 1 --2- 172.21.15.151:0/88345260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5558156110 0x7f5558156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:26.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.558+0000 7f555c947640 1 --2- 172.21.15.151:0/88345260 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5544004370 0x7f555815d7e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:26.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.558+0000 7f555c947640 1 -- 172.21.15.151:0/88345260 >> 172.21.15.151:0/88345260 conn(0x7f55580d2fe0 msgr2=0x7f555806bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:26.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.558+0000 7f555c947640 1 -- 172.21.15.151:0/88345260 shutdown_connections 2023-12-11T17:09:26.559 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.558+0000 7f555c947640 1 -- 172.21.15.151:0/88345260 wait complete. 2023-12-11T17:09:26.568 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:26.567+0000 7f50a963b040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-11T17:09:26.574 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new fd1160c5-2118-4d05-806f-a69d666cb362 1 2023-12-11T17:09:26.611 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:26.611+0000 7f2ad2211040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-11T17:09:26.633 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:26.633+0000 7f50a963b040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-11T17:09:26.675 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:26.675+0000 7f2ad2211040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-11T17:09:26.687 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:26.687+0000 7f50a963b040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-11T17:09:26.728 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:26.728+0000 7f2ad2211040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-11T17:09:26.751 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:26.751+0000 7f50a963b040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-11T17:09:26.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.767+0000 7fdd04b63640 1 Processor -- start 2023-12-11T17:09:26.767 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.767+0000 7fdd04b63640 1 -- start start 2023-12-11T17:09:26.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.768+0000 7fdd04b63640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdd000b3350 0x7fdd000b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:26.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.769+0000 7fdd04b63640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd000b3730 0x7fdd000cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:26.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.769+0000 7fdd04b63640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd000c6b80 con 0x7fdd000b40e0 2023-12-11T17:09:26.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.769+0000 7fdd04b63640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd000d3bf0 con 0x7fdd000b3350 2023-12-11T17:09:26.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.769+0000 7fdd04b63640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd000d3ed0 con 0x7fdd000b3730 2023-12-11T17:09:26.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.769+0000 7fdcfffff640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fdd000b40e0 0x7fdd00161200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:54094/0 (socket says 172.21.15.151:54094) 2023-12-11T17:09:26.769 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.769+0000 7fdcfffff640 1 -- 172.21.15.151:0/3351160565 learned_addr learned my addr 172.21.15.151:0/3351160565 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-12-11T17:09:26.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.769+0000 7fdcfeffd640 1 --2- 172.21.15.151:0/3351160565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd000b3730 0x7fdd000cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:26.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.769+0000 7fdcfe7fc640 1 -- 172.21.15.151:0/3351160565 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3300500982 0 0) 0x7fdd000c6b80 con 0x7fdd000b40e0 2023-12-11T17:09:26.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.769+0000 7fdcfe7fc640 1 -- 172.21.15.151:0/3351160565 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdce8003520 con 0x7fdd000b40e0 2023-12-11T17:09:26.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.769+0000 7fdcfeffd640 1 -- 172.21.15.151:0/3351160565 >> v2:172.21.15.37:3300/0 conn(0x7fdd000b3350 msgr2=0x7fdd000b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:26.770 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.769+0000 7fdcfeffd640 1 --2- 172.21.15.151:0/3351160565 >> v2:172.21.15.37:3300/0 conn(0x7fdd000b3350 0x7fdd000b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:26.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.769+0000 7fdcfeffd640 1 -- 172.21.15.151:0/3351160565 >> v1:172.21.15.151:6789/0 conn(0x7fdd000b40e0 legacy=0x7fdd00161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:26.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.769+0000 7fdcfeffd640 1 -- 172.21.15.151:0/3351160565 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd000d18c0 con 0x7fdd000b3730 2023-12-11T17:09:26.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.771+0000 7fdcfeffd640 1 --2- 172.21.15.151:0/3351160565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd000b3730 0x7fdd000cf760 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40097a0 tx=0x7fdcf402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d27819304bc09d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:26.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.771+0000 7fdcfe7fc640 1 -- 172.21.15.151:0/3351160565 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4031830 con 0x7fdd000b3730 2023-12-11T17:09:26.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.771+0000 7fdcfe7fc640 1 -- 172.21.15.151:0/3351160565 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf4031990 con 0x7fdd000b3730 2023-12-11T17:09:26.771 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.771+0000 7fdcfe7fc640 1 -- 172.21.15.151:0/3351160565 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf4031d20 con 0x7fdd000b3730 2023-12-11T17:09:26.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.772+0000 7fdd04b63640 1 -- 172.21.15.151:0/3351160565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd000b3730 msgr2=0x7fdd000cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:26.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.772+0000 7fdd04b63640 1 --2- 172.21.15.151:0/3351160565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd000b3730 0x7fdd000cf760 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdcf40097a0 tx=0x7fdcf402b8d0 comp rx=0 tx=0).stop 2023-12-11T17:09:26.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.772+0000 7fdd04b63640 1 -- 172.21.15.151:0/3351160565 shutdown_connections 2023-12-11T17:09:26.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.772+0000 7fdd04b63640 1 --2- 172.21.15.151:0/3351160565 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd000b3730 0x7fdd000cf760 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:26.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.772+0000 7fdd04b63640 1 --2- 172.21.15.151:0/3351160565 >> v2:172.21.15.37:3300/0 conn(0x7fdd000b3350 0x7fdd000b3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:26.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.772+0000 7fdd04b63640 1 -- 172.21.15.151:0/3351160565 >> 172.21.15.151:0/3351160565 conn(0x7fdd000d3030 msgr2=0x7fdd000d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:26.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.772+0000 7fdd04b63640 1 -- 172.21.15.151:0/3351160565 shutdown_connections 2023-12-11T17:09:26.773 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.772+0000 7fdd04b63640 1 -- 172.21.15.151:0/3351160565 wait complete. 2023-12-11T17:09:26.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.774+0000 7fdd04b63640 1 Processor -- start 2023-12-11T17:09:26.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.774+0000 7fdd04b63640 1 -- start start 2023-12-11T17:09:26.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.775+0000 7fdd04b63640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd000b3350 0x7fdd001f2670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:26.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.775+0000 7fdd04b63640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd000b3730 0x7fdd000cc340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:26.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.775+0000 7fdd04b63640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd000b40e0 0x7fdd0006aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:26.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.775+0000 7fdd04b63640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd000b5c10 con 0x7fdd000b3730 2023-12-11T17:09:26.775 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.775+0000 7fdd04b63640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd000cccb0 con 0x7fdd000b3350 2023-12-11T17:09:26.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.775+0000 7fdd04b63640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd000ccf90 con 0x7fdd000b40e0 2023-12-11T17:09:26.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.775+0000 7fdcfffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd000b40e0 0x7fdd0006aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:26.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.775+0000 7fdcff7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd000b3350 0x7fdd001f2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:26.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.775+0000 7fdcff7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd000b3350 0x7fdd001f2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50662/0 (socket says 172.21.15.151:50662) 2023-12-11T17:09:26.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.775+0000 7fdcff7fe640 1 -- 172.21.15.151:0/3053063122 learned_addr learned my addr 172.21.15.151:0/3053063122 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-12-11T17:09:26.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.775+0000 7fdcfffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd000b40e0 0x7fdd0006aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:49206/0 (socket says 172.21.15.151:49206) 2023-12-11T17:09:26.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.775+0000 7fdcfeffd640 1 --2- 172.21.15.151:0/3053063122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd000b3730 0x7fdd000cc340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:26.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.775+0000 7fdcff7fe640 1 -- 172.21.15.151:0/3053063122 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd000b40e0 msgr2=0x7fdd0006aee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:26.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.775+0000 7fdcff7fe640 1 --2- 172.21.15.151:0/3053063122 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd000b40e0 0x7fdd0006aee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:26.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.775+0000 7fdcff7fe640 1 -- 172.21.15.151:0/3053063122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd000b3730 msgr2=0x7fdd000cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:26.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.775+0000 7fdcff7fe640 1 --2- 172.21.15.151:0/3053063122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd000b3730 0x7fdd000cc340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:26.777 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.775+0000 7fdcff7fe640 1 -- 172.21.15.151:0/3053063122 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcf4009400 con 0x7fdd000b3350 2023-12-11T17:09:26.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.776+0000 7fdcfffff640 1 --2- 172.21.15.151:0/3053063122 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd000b40e0 0x7fdd0006aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:09:26.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.776+0000 7fdcff7fe640 1 --2- 172.21.15.151:0/3053063122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd000b3350 0x7fdd001f2670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000b4a0 tx=0x7fdcf000b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:26.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.776+0000 7fdce7fff640 1 -- 172.21.15.151:0/3053063122 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0010610 con 0x7fdd000b3350 2023-12-11T17:09:26.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.776+0000 7fdce7fff640 1 -- 172.21.15.151:0/3053063122 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcf0010770 con 0x7fdd000b3350 2023-12-11T17:09:26.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.776+0000 7fdce7fff640 1 -- 172.21.15.151:0/3053063122 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcf0010b20 con 0x7fdd000b3350 2023-12-11T17:09:26.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.776+0000 7fdd04b63640 1 -- 172.21.15.151:0/3053063122 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd000b48a0 con 0x7fdd000b3350 2023-12-11T17:09:26.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.776+0000 7fdd04b63640 1 -- 172.21.15.151:0/3053063122 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd000b6140 con 0x7fdd000b3350 2023-12-11T17:09:26.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.777+0000 7fdce7fff640 1 -- 172.21.15.151:0/3053063122 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdcf0019450 con 0x7fdd000b3350 2023-12-11T17:09:26.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.777+0000 7fdce7fff640 1 -- 172.21.15.151:0/3053063122 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7fdcf00179c0 con 0x7fdd000b3350 2023-12-11T17:09:26.778 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.778+0000 7fdd04b63640 1 -- 172.21.15.151:0/3053063122 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd00074450 con 0x7fdd000b3350 2023-12-11T17:09:26.781 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.780+0000 7fdce7fff640 1 -- 172.21.15.151:0/3053063122 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fdcf0038ce0 con 0x7fdd000b3350 2023-12-11T17:09:26.794 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:26.794+0000 7f2ad2211040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-11T17:09:26.810 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:26.810+0000 7f50a963b040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-11T17:09:26.846 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:26.846+0000 7f2ad2211040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-11T17:09:26.865 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.864+0000 7fdd04b63640 1 -- 172.21.15.151:0/3053063122 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "fd1160c5-2118-4d05-806f-a69d666cb362", "id": 1} v 0) v1 -- 0x7fdd00072830 con 0x7fdd000b3350 2023-12-11T17:09:26.872 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.871+0000 7fdce7fff640 1 -- 172.21.15.151:0/3053063122 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fd1160c5-2118-4d05-806f-a69d666cb362", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdcf0027030 con 0x7fdd000b3350 2023-12-11T17:09:26.872 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-12-11T17:09:26.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.873+0000 7fdd04b63640 1 -- 172.21.15.151:0/3053063122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd000b3350 msgr2=0x7fdd001f2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:26.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.873+0000 7fdd04b63640 1 --2- 172.21.15.151:0/3053063122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd000b3350 0x7fdd001f2670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fdcf000b4a0 tx=0x7fdcf000b960 comp rx=0 tx=0).stop 2023-12-11T17:09:26.873 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.873+0000 7fdd04b63640 1 -- 172.21.15.151:0/3053063122 shutdown_connections 2023-12-11T17:09:26.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.873+0000 7fdd04b63640 1 --2- 172.21.15.151:0/3053063122 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd000b40e0 0x7fdd0006aee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:26.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.873+0000 7fdd04b63640 1 --2- 172.21.15.151:0/3053063122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd000b3730 0x7fdd000cc340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:26.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.873+0000 7fdd04b63640 1 --2- 172.21.15.151:0/3053063122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd000b3350 0x7fdd001f2670 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:26.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.873+0000 7fdd04b63640 1 -- 172.21.15.151:0/3053063122 >> 172.21.15.151:0/3053063122 conn(0x7fdd000d3030 msgr2=0x7fdd0006c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:26.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.873+0000 7fdd04b63640 1 -- 172.21.15.151:0/3053063122 shutdown_connections 2023-12-11T17:09:26.874 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:26.873+0000 7fdd04b63640 1 -- 172.21.15.151:0/3053063122 wait complete. 2023-12-11T17:09:26.890 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 1a2c713e-b1c9-4828-8e2e-c7dfd1280f37 2 2023-12-11T17:09:26.930 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:26.930+0000 7f50a963b040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-11T17:09:26.966 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:26.966+0000 7f2ad2211040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-11T17:09:27.014 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:27.014+0000 7f50a963b040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-11T17:09:27.050 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:27.049+0000 7f2ad2211040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-11T17:09:27.069 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:27.069+0000 7f50a963b040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-11T17:09:27.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.079+0000 7f65838d0640 1 Processor -- start 2023-12-11T17:09:27.079 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.079+0000 7f65838d0640 1 -- start start 2023-12-11T17:09:27.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.080+0000 7f65838d0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f657c15d620 0x7f657c0d3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:27.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.080+0000 7f65838d0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f657c0d1510 0x7f657c0d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:27.081 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.081+0000 7f65838d0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f657c0cf130 con 0x7f657c0cf810 2023-12-11T17:09:27.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.081+0000 7f65838d0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f657c0b0220 con 0x7f657c0d1510 2023-12-11T17:09:27.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.081+0000 7f65838d0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f657c15da00 con 0x7f657c15d620 2023-12-11T17:09:27.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.081+0000 7f658166c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f657c15d620 0x7f657c0d3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:27.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.081+0000 7f6581e6d640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f657c0cf810 0x7f657c0cfca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:54096/0 (socket says 172.21.15.151:54096) 2023-12-11T17:09:27.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.081+0000 7f658166c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f657c15d620 0x7f657c0d3a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50678/0 (socket says 172.21.15.151:50678) 2023-12-11T17:09:27.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.081+0000 7f6581e6d640 1 -- 172.21.15.151:0/3976927732 learned_addr learned my addr 172.21.15.151:0/3976927732 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-12-11T17:09:27.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.081+0000 7f6580e6b640 1 --2- 172.21.15.151:0/3976927732 >> v2:172.21.15.37:3300/0 conn(0x7f657c0d1510 0x7f657c0d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:27.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.081+0000 7f658166c640 1 -- 172.21.15.151:0/3976927732 >> v2:172.21.15.37:3300/0 conn(0x7f657c0d1510 msgr2=0x7f657c0d1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:27.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.081+0000 7f658166c640 1 --2- 172.21.15.151:0/3976927732 >> v2:172.21.15.37:3300/0 conn(0x7f657c0d1510 0x7f657c0d1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.081+0000 7f658166c640 1 -- 172.21.15.151:0/3976927732 >> v1:172.21.15.151:6789/0 conn(0x7f657c0cf810 legacy=0x7f657c0cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:27.082 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.081+0000 7f658166c640 1 -- 172.21.15.151:0/3976927732 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f657c0d1eb0 con 0x7f657c15d620 2023-12-11T17:09:27.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.082+0000 7f658166c640 1 --2- 172.21.15.151:0/3976927732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f657c15d620 0x7f657c0d3a00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f657c08ca50 tx=0x7f657802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=62baffbdbaed92cb server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:27.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.083+0000 7f6573fff640 1 -- 172.21.15.151:0/3976927732 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6578031830 con 0x7f657c15d620 2023-12-11T17:09:27.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.083+0000 7f6573fff640 1 -- 172.21.15.151:0/3976927732 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6578031990 con 0x7f657c15d620 2023-12-11T17:09:27.083 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.083+0000 7f6573fff640 1 -- 172.21.15.151:0/3976927732 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6578031d20 con 0x7f657c15d620 2023-12-11T17:09:27.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.083+0000 7f65838d0640 1 -- 172.21.15.151:0/3976927732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f657c15d620 msgr2=0x7f657c0d3a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:27.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.083+0000 7f65838d0640 1 --2- 172.21.15.151:0/3976927732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f657c15d620 0x7f657c0d3a00 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f657c08ca50 tx=0x7f657802b8d0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.083+0000 7f65838d0640 1 -- 172.21.15.151:0/3976927732 shutdown_connections 2023-12-11T17:09:27.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.083+0000 7f65838d0640 1 --2- 172.21.15.151:0/3976927732 >> v2:172.21.15.37:3300/0 conn(0x7f657c0d1510 0x7f657c0d1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.083+0000 7f65838d0640 1 --2- 172.21.15.151:0/3976927732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f657c15d620 0x7f657c0d3a00 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.083+0000 7f65838d0640 1 -- 172.21.15.151:0/3976927732 >> 172.21.15.151:0/3976927732 conn(0x7f657c09c420 msgr2=0x7f657c0d30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:27.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.083+0000 7f65838d0640 1 -- 172.21.15.151:0/3976927732 shutdown_connections 2023-12-11T17:09:27.084 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.084+0000 7f65838d0640 1 -- 172.21.15.151:0/3976927732 wait complete. 2023-12-11T17:09:27.085 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.085+0000 7f65838d0640 1 Processor -- start 2023-12-11T17:09:27.085 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.085+0000 7f65838d0640 1 -- start start 2023-12-11T17:09:27.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.086+0000 7f65838d0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f657c0cf810 0x7f657c1514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:27.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.086+0000 7f65838d0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657c0d1510 0x7f657c0cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:27.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.086+0000 7f65838d0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f657c15d620 0x7f657c0b3990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:27.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.086+0000 7f65838d0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c0ca1b0 con 0x7f657c0d1510 2023-12-11T17:09:27.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.086+0000 7f65838d0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f657c15af20 con 0x7f657c15d620 2023-12-11T17:09:27.087 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.086+0000 7f65838d0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f657c0ca400 con 0x7f657c0cf810 2023-12-11T17:09:27.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.086+0000 7f6581e6d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f657c15d620 0x7f657c0b3990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:27.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.086+0000 7f658166c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f657c0cf810 0x7f657c1514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:27.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.086+0000 7f6581e6d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f657c15d620 0x7f657c0b3990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50692/0 (socket says 172.21.15.151:50692) 2023-12-11T17:09:27.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.086+0000 7f6581e6d640 1 -- 172.21.15.151:0/4187900036 learned_addr learned my addr 172.21.15.151:0/4187900036 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-12-11T17:09:27.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.087+0000 7f6580e6b640 1 --2- 172.21.15.151:0/4187900036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657c0d1510 0x7f657c0cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:27.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.087+0000 7f6581e6d640 1 -- 172.21.15.151:0/4187900036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f657c0cf810 msgr2=0x7f657c1514d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:27.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.087+0000 7f6581e6d640 1 --2- 172.21.15.151:0/4187900036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f657c0cf810 0x7f657c1514d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.087+0000 7f6581e6d640 1 -- 172.21.15.151:0/4187900036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657c0d1510 msgr2=0x7f657c0cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:27.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.087+0000 7f6581e6d640 1 --2- 172.21.15.151:0/4187900036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657c0d1510 0x7f657c0cb1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.087+0000 7f6581e6d640 1 -- 172.21.15.151:0/4187900036 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6578009400 con 0x7f657c15d620 2023-12-11T17:09:27.088 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.087+0000 7f6581e6d640 1 --2- 172.21.15.151:0/4187900036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f657c15d620 0x7f657c0b3990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f657400ca80 tx=0x7f657400cf40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:27.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.087+0000 7f6571ffb640 1 -- 172.21.15.151:0/4187900036 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657400ac30 con 0x7f657c15d620 2023-12-11T17:09:27.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.087+0000 7f6571ffb640 1 -- 172.21.15.151:0/4187900036 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657400ad90 con 0x7f657c15d620 2023-12-11T17:09:27.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.087+0000 7f6571ffb640 1 -- 172.21.15.151:0/4187900036 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6574012600 con 0x7f657c15d620 2023-12-11T17:09:27.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.087+0000 7f65838d0640 1 -- 172.21.15.151:0/4187900036 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f657c0ca6e0 con 0x7f657c15d620 2023-12-11T17:09:27.089 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.088+0000 7f65838d0640 1 -- 172.21.15.151:0/4187900036 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f657c0caca0 con 0x7f657c15d620 2023-12-11T17:09:27.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.088+0000 7f6571ffb640 1 -- 172.21.15.151:0/4187900036 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f6574012a60 con 0x7f657c15d620 2023-12-11T17:09:27.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.088+0000 7f6571ffb640 1 -- 172.21.15.151:0/4187900036 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f6574012d10 con 0x7f657c15d620 2023-12-11T17:09:27.090 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.089+0000 7f65838d0640 1 -- 172.21.15.151:0/4187900036 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f657c074450 con 0x7f657c15d620 2023-12-11T17:09:27.091 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.091+0000 7f6571ffb640 1 -- 172.21.15.151:0/4187900036 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f6574021060 con 0x7f657c15d620 2023-12-11T17:09:27.105 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:27.105+0000 7f2ad2211040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-11T17:09:27.134 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:27.133+0000 7f50a963b040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-11T17:09:27.168 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:27.168+0000 7f2ad2211040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-11T17:09:27.169 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.169+0000 7f65838d0640 1 -- 172.21.15.151:0/4187900036 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "1a2c713e-b1c9-4828-8e2e-c7dfd1280f37", "id": 2} v 0) v1 -- 0x7f657c0cd3f0 con 0x7f657c15d620 2023-12-11T17:09:27.176 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.176+0000 7f6571ffb640 1 -- 172.21.15.151:0/4187900036 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "1a2c713e-b1c9-4828-8e2e-c7dfd1280f37", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6574017070 con 0x7f657c15d620 2023-12-11T17:09:27.177 INFO:teuthology.orchestra.run.smithi151.stdout:2 2023-12-11T17:09:27.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.178+0000 7f65838d0640 1 -- 172.21.15.151:0/4187900036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f657c15d620 msgr2=0x7f657c0b3990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:27.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.178+0000 7f65838d0640 1 --2- 172.21.15.151:0/4187900036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f657c15d620 0x7f657c0b3990 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f657400ca80 tx=0x7f657400cf40 comp rx=0 tx=0).stop 2023-12-11T17:09:27.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.178+0000 7f65838d0640 1 -- 172.21.15.151:0/4187900036 shutdown_connections 2023-12-11T17:09:27.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.178+0000 7f65838d0640 1 --2- 172.21.15.151:0/4187900036 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f657c15d620 0x7f657c0b3990 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.178+0000 7f65838d0640 1 --2- 172.21.15.151:0/4187900036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f657c0d1510 0x7f657c0cb1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.178+0000 7f65838d0640 1 --2- 172.21.15.151:0/4187900036 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f657c0cf810 0x7f657c1514d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.178+0000 7f65838d0640 1 -- 172.21.15.151:0/4187900036 >> 172.21.15.151:0/4187900036 conn(0x7f657c09c420 msgr2=0x7f657c15dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:27.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.178+0000 7f65838d0640 1 -- 172.21.15.151:0/4187900036 shutdown_connections 2023-12-11T17:09:27.179 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.178+0000 7f65838d0640 1 -- 172.21.15.151:0/4187900036 wait complete. 2023-12-11T17:09:27.198 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:27.198+0000 7f50a963b040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-11T17:09:27.201 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new d4cfe2e1-3157-484b-a50b-12b6bcd7ae05 3 2023-12-11T17:09:27.226 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:27.226+0000 7f2ad2211040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-11T17:09:27.436 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.436+0000 7fdd2efd4640 1 Processor -- start 2023-12-11T17:09:27.437 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.436+0000 7fdd2efd4640 1 -- start start 2023-12-11T17:09:27.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.438+0000 7fdd2efd4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdd280b3350 0x7fdd280b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:27.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.438+0000 7fdd2efd4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd280c6b80 con 0x7fdd280cfe70 2023-12-11T17:09:27.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.438+0000 7fdd2efd4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd280d3bf0 con 0x7fdd280b3730 2023-12-11T17:09:27.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.438+0000 7fdd2efd4640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd280d3ed0 con 0x7fdd280b3350 2023-12-11T17:09:27.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.438+0000 7fdd2d7d1640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fdd280b3730 0x7fdd280cf760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:54100/0 (socket says 172.21.15.151:54100) 2023-12-11T17:09:27.439 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.438+0000 7fdd2d7d1640 1 -- 172.21.15.151:0/991453037 learned_addr learned my addr 172.21.15.151:0/991453037 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-12-11T17:09:27.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.438+0000 7fdd2dfd2640 1 --2- 172.21.15.151:0/991453037 >> v2:172.21.15.37:3300/0 conn(0x7fdd280b3350 0x7fdd280b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:27.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.439+0000 7fdd2cfd0640 1 -- 172.21.15.151:0/991453037 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284688359 0 0) 0x7fdd280d3bf0 con 0x7fdd280b3730 2023-12-11T17:09:27.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.439+0000 7fdd2cfd0640 1 -- 172.21.15.151:0/991453037 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd14003520 con 0x7fdd280b3730 2023-12-11T17:09:27.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.439+0000 7fdd2cfd0640 1 -- 172.21.15.151:0/991453037 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 702133423 0 0) 0x7fdd14003520 con 0x7fdd280b3730 2023-12-11T17:09:27.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.439+0000 7fdd2dfd2640 1 -- 172.21.15.151:0/991453037 >> v1:172.21.15.151:6789/0 conn(0x7fdd280b3730 legacy=0x7fdd280cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:27.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.439+0000 7fdd2dfd2640 1 -- 172.21.15.151:0/991453037 >> v1:172.21.15.37:6789/0 conn(0x7fdd280cfe70 legacy=0x7fdd280cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:27.440 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.439+0000 7fdd2dfd2640 1 -- 172.21.15.151:0/991453037 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd280d18c0 con 0x7fdd280b3350 2023-12-11T17:09:27.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.440+0000 7fdd2dfd2640 1 --2- 172.21.15.151:0/991453037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd280b3350 0x7fdd280b3ba0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdd24009720 tx=0x7fdd2402b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d383df011f3f62bd server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:27.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.441+0000 7fdd2cfd0640 1 -- 172.21.15.151:0/991453037 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd18001670 con 0x7fdd280b3350 2023-12-11T17:09:27.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.441+0000 7fdd2cfd0640 1 -- 172.21.15.151:0/991453037 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd24031520 con 0x7fdd280b3350 2023-12-11T17:09:27.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.441+0000 7fdd2cfd0640 1 -- 172.21.15.151:0/991453037 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd240316b0 con 0x7fdd280b3350 2023-12-11T17:09:27.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.441+0000 7fdd2efd4640 1 -- 172.21.15.151:0/991453037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd280b3350 msgr2=0x7fdd280b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:27.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.441+0000 7fdd2efd4640 1 --2- 172.21.15.151:0/991453037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd280b3350 0x7fdd280b3ba0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fdd24009720 tx=0x7fdd2402b7c0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.441+0000 7fdd2efd4640 1 -- 172.21.15.151:0/991453037 shutdown_connections 2023-12-11T17:09:27.442 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.441+0000 7fdd2efd4640 1 --2- 172.21.15.151:0/991453037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd280b3350 0x7fdd280b3ba0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.441+0000 7fdd2efd4640 1 -- 172.21.15.151:0/991453037 >> 172.21.15.151:0/991453037 conn(0x7fdd280d3030 msgr2=0x7fdd280d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:27.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.441+0000 7fdd2efd4640 1 -- 172.21.15.151:0/991453037 shutdown_connections 2023-12-11T17:09:27.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.441+0000 7fdd2efd4640 1 -- 172.21.15.151:0/991453037 wait complete. 2023-12-11T17:09:27.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.443+0000 7fdd2efd4640 1 Processor -- start 2023-12-11T17:09:27.443 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.443+0000 7fdd2efd4640 1 -- start start 2023-12-11T17:09:27.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.444+0000 7fdd2efd4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd280b3350 0x7fdd281f66e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:27.446 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.444+0000 7fdd2efd4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd280b3730 0x7fdd280b0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:27.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.444+0000 7fdd2efd4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd280cfe70 0x7fdd280b0080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:27.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.444+0000 7fdd2efd4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd2815e350 con 0x7fdd280b3350 2023-12-11T17:09:27.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.444+0000 7fdd2efd4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd281f75d0 con 0x7fdd280b3730 2023-12-11T17:09:27.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.444+0000 7fdd2efd4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd281f6d30 con 0x7fdd280cfe70 2023-12-11T17:09:27.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.444+0000 7fdd2d7d1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd280b3730 0x7fdd280b0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:27.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.444+0000 7fdd2e7d3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd280cfe70 0x7fdd280b0080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:27.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.444+0000 7fdd2d7d1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd280b3730 0x7fdd280b0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50704/0 (socket says 172.21.15.151:50704) 2023-12-11T17:09:27.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.444+0000 7fdd2d7d1640 1 -- 172.21.15.151:0/4048338870 learned_addr learned my addr 172.21.15.151:0/4048338870 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-12-11T17:09:27.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.445+0000 7fdd2dfd2640 1 --2- 172.21.15.151:0/4048338870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd280b3350 0x7fdd281f66e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:27.447 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.445+0000 7fdd2d7d1640 1 -- 172.21.15.151:0/4048338870 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd280cfe70 msgr2=0x7fdd280b0080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:27.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.445+0000 7fdd2d7d1640 1 --2- 172.21.15.151:0/4048338870 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd280cfe70 0x7fdd280b0080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.445+0000 7fdd2d7d1640 1 -- 172.21.15.151:0/4048338870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd280b3350 msgr2=0x7fdd281f66e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:27.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.445+0000 7fdd2d7d1640 1 --2- 172.21.15.151:0/4048338870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd280b3350 0x7fdd281f66e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.445+0000 7fdd2d7d1640 1 -- 172.21.15.151:0/4048338870 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd24009400 con 0x7fdd280b3730 2023-12-11T17:09:27.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.445+0000 7fdd2dfd2640 1 --2- 172.21.15.151:0/4048338870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd280b3350 0x7fdd281f66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:09:27.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.445+0000 7fdd2e7d3640 1 --2- 172.21.15.151:0/4048338870 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd280cfe70 0x7fdd280b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:09:27.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.445+0000 7fdd2d7d1640 1 --2- 172.21.15.151:0/4048338870 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd280b3730 0x7fdd280b0fa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800c780 tx=0x7fdd1800cc40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:27.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.445+0000 7fdd1e7fc640 1 -- 172.21.15.151:0/4048338870 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd180072d0 con 0x7fdd280b3730 2023-12-11T17:09:27.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.445+0000 7fdd1e7fc640 1 -- 172.21.15.151:0/4048338870 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd18007430 con 0x7fdd280b3730 2023-12-11T17:09:27.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.445+0000 7fdd1e7fc640 1 -- 172.21.15.151:0/4048338870 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd180047e0 con 0x7fdd280b3730 2023-12-11T17:09:27.448 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.445+0000 7fdd2efd4640 1 -- 172.21.15.151:0/4048338870 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd280b48a0 con 0x7fdd280b3730 2023-12-11T17:09:27.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.446+0000 7fdd2efd4640 1 -- 172.21.15.151:0/4048338870 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd281f72f0 con 0x7fdd280b3730 2023-12-11T17:09:27.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.446+0000 7fdd1e7fc640 1 -- 172.21.15.151:0/4048338870 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fdd18004c40 con 0x7fdd280b3730 2023-12-11T17:09:27.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.446+0000 7fdd1e7fc640 1 -- 172.21.15.151:0/4048338870 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7fdd18012400 con 0x7fdd280b3730 2023-12-11T17:09:27.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.447+0000 7fdd2efd4640 1 -- 172.21.15.151:0/4048338870 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd28074450 con 0x7fdd280b3730 2023-12-11T17:09:27.449 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.449+0000 7fdd1e7fc640 1 -- 172.21.15.151:0/4048338870 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7fdd18018070 con 0x7fdd280b3730 2023-12-11T17:09:27.527 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.527+0000 7fdd2efd4640 1 -- 172.21.15.151:0/4048338870 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "d4cfe2e1-3157-484b-a50b-12b6bcd7ae05", "id": 3} v 0) v1 -- 0x7fdd2806b520 con 0x7fdd280b3730 2023-12-11T17:09:27.534 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.534+0000 7fdd1e7fc640 1 -- 172.21.15.151:0/4048338870 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "d4cfe2e1-3157-484b-a50b-12b6bcd7ae05", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7fdd1800a640 con 0x7fdd280b3730 2023-12-11T17:09:27.534 INFO:teuthology.orchestra.run.smithi151.stdout:3 2023-12-11T17:09:27.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.535+0000 7fdd2efd4640 1 -- 172.21.15.151:0/4048338870 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd280b3730 msgr2=0x7fdd280b0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:27.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.535+0000 7fdd2efd4640 1 --2- 172.21.15.151:0/4048338870 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd280b3730 0x7fdd280b0fa0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7fdd1800c780 tx=0x7fdd1800cc40 comp rx=0 tx=0).stop 2023-12-11T17:09:27.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.535+0000 7fdd2efd4640 1 -- 172.21.15.151:0/4048338870 shutdown_connections 2023-12-11T17:09:27.535 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.535+0000 7fdd2efd4640 1 --2- 172.21.15.151:0/4048338870 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd280b3730 0x7fdd280b0fa0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.535+0000 7fdd2efd4640 1 --2- 172.21.15.151:0/4048338870 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdd280cfe70 0x7fdd280b0080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.535+0000 7fdd2efd4640 1 --2- 172.21.15.151:0/4048338870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdd280b3350 0x7fdd281f66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.535+0000 7fdd2efd4640 1 -- 172.21.15.151:0/4048338870 >> 172.21.15.151:0/4048338870 conn(0x7fdd280d3030 msgr2=0x7fdd2806b740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:27.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.535+0000 7fdd2efd4640 1 -- 172.21.15.151:0/4048338870 shutdown_connections 2023-12-11T17:09:27.536 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.535+0000 7fdd2efd4640 1 -- 172.21.15.151:0/4048338870 wait complete. 2023-12-11T17:09:27.552 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 9f129950-acee-449b-849a-5a39a8f06e02 4 2023-12-11T17:09:27.674 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:27.673+0000 7f50a963b040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-11T17:09:27.701 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:27.701+0000 7f2ad2211040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-11T17:09:27.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.745+0000 7f8f17fff640 1 Processor -- start 2023-12-11T17:09:27.746 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.746+0000 7f8f17fff640 1 -- start start 2023-12-11T17:09:27.748 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.747+0000 7f8f17fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8f1815d1f0 0x7f8f180d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:27.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.747+0000 7f8f17fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f180cec20 0x7f8f180d14b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:27.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.747+0000 7f8f17fff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f180b74d0 con 0x7f8f180d1060 2023-12-11T17:09:27.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.748+0000 7f8f17fff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f180d19f0 con 0x7f8f1815d1f0 2023-12-11T17:09:27.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.748+0000 7f8f17fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f180b68e0 con 0x7f8f180cec20 2023-12-11T17:09:27.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.748+0000 7f8f177fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f180cec20 0x7f8f180d14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:27.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.748+0000 7f8f0ffff640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f8f180d1060 0x7f8f180b7960 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:54116/0 (socket says 172.21.15.151:54116) 2023-12-11T17:09:27.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.748+0000 7f8f0ffff640 1 -- 172.21.15.151:0/4212768307 learned_addr learned my addr 172.21.15.151:0/4212768307 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-12-11T17:09:27.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.748+0000 7f8f16ffd640 1 --2- 172.21.15.151:0/4212768307 >> v2:172.21.15.37:3300/0 conn(0x7f8f1815d1f0 0x7f8f180d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:27.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.748+0000 7f8f177fe640 1 -- 172.21.15.151:0/4212768307 >> v2:172.21.15.37:3300/0 conn(0x7f8f1815d1f0 msgr2=0x7f8f180d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:27.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.748+0000 7f8f177fe640 1 --2- 172.21.15.151:0/4212768307 >> v2:172.21.15.37:3300/0 conn(0x7f8f1815d1f0 0x7f8f180d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.749 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.748+0000 7f8f177fe640 1 -- 172.21.15.151:0/4212768307 >> v1:172.21.15.151:6789/0 conn(0x7f8f180d1060 legacy=0x7f8f180b7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:27.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.748+0000 7f8f177fe640 1 -- 172.21.15.151:0/4212768307 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f180b6ba0 con 0x7f8f180cec20 2023-12-11T17:09:27.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.750+0000 7f8f177fe640 1 --2- 172.21.15.151:0/4212768307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f180cec20 0x7f8f180d14b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009d90 tx=0x7f8f1002bce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f4b888912b3d7a12 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:27.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.750+0000 7f8f167fc640 1 -- 172.21.15.151:0/4212768307 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1002ca10 con 0x7f8f180cec20 2023-12-11T17:09:27.750 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.750+0000 7f8f167fc640 1 -- 172.21.15.151:0/4212768307 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1002cb70 con 0x7f8f180cec20 2023-12-11T17:09:27.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.750+0000 7f8f167fc640 1 -- 172.21.15.151:0/4212768307 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f10034440 con 0x7f8f180cec20 2023-12-11T17:09:27.751 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.751+0000 7f8f17fff640 1 -- 172.21.15.151:0/4212768307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f180cec20 msgr2=0x7f8f180d14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:27.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.751+0000 7f8f17fff640 1 --2- 172.21.15.151:0/4212768307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f180cec20 0x7f8f180d14b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f8f10009d90 tx=0x7f8f1002bce0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.751+0000 7f8f17fff640 1 -- 172.21.15.151:0/4212768307 shutdown_connections 2023-12-11T17:09:27.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.751+0000 7f8f17fff640 1 --2- 172.21.15.151:0/4212768307 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f180cec20 0x7f8f180d14b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.751+0000 7f8f17fff640 1 --2- 172.21.15.151:0/4212768307 >> v2:172.21.15.37:3300/0 conn(0x7f8f1815d1f0 0x7f8f180d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.751+0000 7f8f17fff640 1 -- 172.21.15.151:0/4212768307 >> 172.21.15.151:0/4212768307 conn(0x7f8f180d2fe0 msgr2=0x7f8f180d33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:27.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.751+0000 7f8f17fff640 1 -- 172.21.15.151:0/4212768307 shutdown_connections 2023-12-11T17:09:27.752 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.751+0000 7f8f17fff640 1 -- 172.21.15.151:0/4212768307 wait complete. 2023-12-11T17:09:27.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.753+0000 7f8f17fff640 1 Processor -- start 2023-12-11T17:09:27.753 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.753+0000 7f8f17fff640 1 -- start start 2023-12-11T17:09:27.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.754+0000 7f8f17fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f180cec20 0x7f8f1815b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:27.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.754+0000 7f8f17fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f180d1060 0x7f8f181f6c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:27.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.754+0000 7f8f17fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f1815d1f0 0x7f8f180cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:27.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.754+0000 7f8f17fff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f181f71b0 con 0x7f8f1815d1f0 2023-12-11T17:09:27.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.754+0000 7f8f17fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f181e7d00 con 0x7f8f180d1060 2023-12-11T17:09:27.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.754+0000 7f8f17fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f181e6e10 con 0x7f8f180cec20 2023-12-11T17:09:27.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.754+0000 7f8f0ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f180d1060 0x7f8f181f6c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:27.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.754+0000 7f8f16ffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f180cec20 0x7f8f1815b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:27.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.754+0000 7f8f0ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f180d1060 0x7f8f181f6c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50720/0 (socket says 172.21.15.151:50720) 2023-12-11T17:09:27.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.754+0000 7f8f16ffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f180cec20 0x7f8f1815b820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:49260/0 (socket says 172.21.15.151:49260) 2023-12-11T17:09:27.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.754+0000 7f8f0ffff640 1 -- 172.21.15.151:0/826189237 learned_addr learned my addr 172.21.15.151:0/826189237 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-12-11T17:09:27.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.754+0000 7f8f177fe640 1 --2- 172.21.15.151:0/826189237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f1815d1f0 0x7f8f180cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:27.755 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.754+0000 7f8f16ffd640 1 -- 172.21.15.151:0/826189237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f180d1060 msgr2=0x7f8f181f6c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:27.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.754+0000 7f8f16ffd640 1 --2- 172.21.15.151:0/826189237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f180d1060 0x7f8f181f6c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.754+0000 7f8f16ffd640 1 -- 172.21.15.151:0/826189237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f1815d1f0 msgr2=0x7f8f180cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:27.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.754+0000 7f8f16ffd640 1 --2- 172.21.15.151:0/826189237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f1815d1f0 0x7f8f180cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.754+0000 7f8f16ffd640 1 -- 172.21.15.151:0/826189237 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f10009a70 con 0x7f8f180cec20 2023-12-11T17:09:27.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.754+0000 7f8f0ffff640 1 --2- 172.21.15.151:0/826189237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f180d1060 0x7f8f181f6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:09:27.756 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.755+0000 7f8f16ffd640 1 --2- 172.21.15.151:0/826189237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f180cec20 0x7f8f1815b820 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800d520 tx=0x7f8f0800d9e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:27.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.755+0000 7f8f0f7fe640 1 -- 172.21.15.151:0/826189237 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f080125f0 con 0x7f8f180cec20 2023-12-11T17:09:27.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.755+0000 7f8f0f7fe640 1 -- 172.21.15.151:0/826189237 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f08012750 con 0x7f8f180cec20 2023-12-11T17:09:27.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.755+0000 7f8f0f7fe640 1 -- 172.21.15.151:0/826189237 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f08012ae0 con 0x7f8f180cec20 2023-12-11T17:09:27.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.755+0000 7f8f17fff640 1 -- 172.21.15.151:0/826189237 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f181e70f0 con 0x7f8f180cec20 2023-12-11T17:09:27.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.755+0000 7f8f17fff640 1 -- 172.21.15.151:0/826189237 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f181e76b0 con 0x7f8f180cec20 2023-12-11T17:09:27.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.755+0000 7f8f0f7fe640 1 -- 172.21.15.151:0/826189237 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f8f0801e460 con 0x7f8f180cec20 2023-12-11T17:09:27.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.756+0000 7f8f0f7fe640 1 -- 172.21.15.151:0/826189237 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f8f080149e0 con 0x7f8f180cec20 2023-12-11T17:09:27.757 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.756+0000 7f8f17fff640 1 -- 172.21.15.151:0/826189237 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f180673f0 con 0x7f8f180cec20 2023-12-11T17:09:27.759 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.759+0000 7f8f0f7fe640 1 -- 172.21.15.151:0/826189237 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f8f08014c80 con 0x7f8f180cec20 2023-12-11T17:09:27.838 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.837+0000 7f8f17fff640 1 -- 172.21.15.151:0/826189237 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd new", "uuid": "9f129950-acee-449b-849a-5a39a8f06e02", "id": 4} v 0) v1 -- 0x7f8f180b53a0 con 0x7f8f180cec20 2023-12-11T17:09:27.840 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:27.839+0000 7f50a963b040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-11T17:09:27.846 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.845+0000 7f8f0f7fe640 1 -- 172.21.15.151:0/826189237 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9f129950-acee-449b-849a-5a39a8f06e02", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f8f080144d0 con 0x7f8f180cec20 2023-12-11T17:09:27.846 INFO:teuthology.orchestra.run.smithi151.stdout:4 2023-12-11T17:09:27.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.846+0000 7f8f17fff640 1 -- 172.21.15.151:0/826189237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f180cec20 msgr2=0x7f8f1815b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:27.847 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.846+0000 7f8f17fff640 1 --2- 172.21.15.151:0/826189237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f180cec20 0x7f8f1815b820 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f8f0800d520 tx=0x7f8f0800d9e0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.848 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.847+0000 7f8f17fff640 1 -- 172.21.15.151:0/826189237 shutdown_connections 2023-12-11T17:09:27.848 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.847+0000 7f8f17fff640 1 --2- 172.21.15.151:0/826189237 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8f180d1060 0x7f8f181f6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.848 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.847+0000 7f8f17fff640 1 --2- 172.21.15.151:0/826189237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f1815d1f0 0x7f8f180cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.848 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.847+0000 7f8f17fff640 1 --2- 172.21.15.151:0/826189237 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8f180cec20 0x7f8f1815b820 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:27.848 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.847+0000 7f8f17fff640 1 -- 172.21.15.151:0/826189237 >> 172.21.15.151:0/826189237 conn(0x7f8f180d2fe0 msgr2=0x7f8f1806af50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:27.848 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.847+0000 7f8f17fff640 1 -- 172.21.15.151:0/826189237 shutdown_connections 2023-12-11T17:09:27.849 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:27.847+0000 7f8f17fff640 1 -- 172.21.15.151:0/826189237 wait complete. 2023-12-11T17:09:27.863 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new ada36ce6-7b6d-4147-8467-b10da804ef27 5 2023-12-11T17:09:27.870 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:27.870+0000 7f2ad2211040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-11T17:09:27.990 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:27.990+0000 7f50a963b040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-11T17:09:28.008 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:28.008+0000 7f2ad2211040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-11T17:09:28.045 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:28.045+0000 7f50a963b040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-11T17:09:28.055 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.054+0000 7ff7fa21e640 1 Processor -- start 2023-12-11T17:09:28.055 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.055+0000 7ff7fa21e640 1 -- start start 2023-12-11T17:09:28.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.056+0000 7ff7fa21e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7f40d1510 0x7ff7f40d1970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:28.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.056+0000 7ff7fa21e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f40cf130 con 0x7ff7f40b06b0 2023-12-11T17:09:28.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.056+0000 7ff7fa21e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7f40d1eb0 con 0x7ff7f415d620 2023-12-11T17:09:28.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.056+0000 7ff7fa21e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f40b0220 con 0x7ff7f40d1510 2023-12-11T17:09:28.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.056+0000 7ff7f2ffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7f40d1510 0x7ff7f40d1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:28.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.057+0000 7ff7f37fe640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7ff7f415d620 0x7ff7f40d3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.151:54130/0 (socket says 172.21.15.151:54130) 2023-12-11T17:09:28.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.057+0000 7ff7f2ffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7f40d1510 0x7ff7f40d1970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:49276/0 (socket says 172.21.15.151:49276) 2023-12-11T17:09:28.057 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.057+0000 7ff7f37fe640 1 -- 172.21.15.151:0/382936229 learned_addr learned my addr 172.21.15.151:0/382936229 (peer_addr_for_me v1:172.21.15.151:0/0) 2023-12-11T17:09:28.058 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.057+0000 7ff7f2ffd640 1 -- 172.21.15.151:0/382936229 >> v1:172.21.15.151:6789/0 conn(0x7ff7f415d620 legacy=0x7ff7f40d3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:28.058 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.057+0000 7ff7f2ffd640 1 -- 172.21.15.151:0/382936229 >> v1:172.21.15.37:6789/0 conn(0x7ff7f40b06b0 legacy=0x7ff7f40b0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:28.058 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.057+0000 7ff7f2ffd640 1 -- 172.21.15.151:0/382936229 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7f415da00 con 0x7ff7f40d1510 2023-12-11T17:09:28.058 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.058+0000 7ff7f2ffd640 1 --2- 172.21.15.151:0/382936229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7f40d1510 0x7ff7f40d1970 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80097d0 tx=0x7ff7e802b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=886c054f35f34d50 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:28.058 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.058+0000 7ff7f27fc640 1 -- 172.21.15.151:0/382936229 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8031800 con 0x7ff7f40d1510 2023-12-11T17:09:28.059 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.058+0000 7ff7f27fc640 1 -- 172.21.15.151:0/382936229 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7e8031960 con 0x7ff7f40d1510 2023-12-11T17:09:28.059 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.058+0000 7ff7f27fc640 1 -- 172.21.15.151:0/382936229 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7e8031cf0 con 0x7ff7f40d1510 2023-12-11T17:09:28.059 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.059+0000 7ff7fa21e640 1 -- 172.21.15.151:0/382936229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7f40d1510 msgr2=0x7ff7f40d1970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:28.059 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.059+0000 7ff7fa21e640 1 --2- 172.21.15.151:0/382936229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7f40d1510 0x7ff7f40d1970 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7ff7e80097d0 tx=0x7ff7e802b8a0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.059+0000 7ff7fa21e640 1 -- 172.21.15.151:0/382936229 shutdown_connections 2023-12-11T17:09:28.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.059+0000 7ff7fa21e640 1 --2- 172.21.15.151:0/382936229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7f40d1510 0x7ff7f40d1970 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.059+0000 7ff7fa21e640 1 -- 172.21.15.151:0/382936229 >> 172.21.15.151:0/382936229 conn(0x7ff7f409c420 msgr2=0x7ff7f40d30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:28.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.059+0000 7ff7fa21e640 1 -- 172.21.15.151:0/382936229 shutdown_connections 2023-12-11T17:09:28.060 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.059+0000 7ff7fa21e640 1 -- 172.21.15.151:0/382936229 wait complete. 2023-12-11T17:09:28.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.061+0000 7ff7fa21e640 1 Processor -- start 2023-12-11T17:09:28.061 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.061+0000 7ff7fa21e640 1 -- start start 2023-12-11T17:09:28.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.062+0000 7ff7fa21e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7f40b06b0 0x7ff7f4150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:28.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.062+0000 7ff7fa21e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7f40d1510 0x7ff7f415fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:28.063 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.062+0000 7ff7fa21e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7f415d620 0x7ff7f40b6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:28.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.062+0000 7ff7fa21e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f4160180 con 0x7ff7f40d1510 2023-12-11T17:09:28.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.062+0000 7ff7fa21e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f40b6c50 con 0x7ff7f415d620 2023-12-11T17:09:28.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.062+0000 7ff7fa21e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7f4150770 con 0x7ff7f40b06b0 2023-12-11T17:09:28.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.062+0000 7ff7f37fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7f40b06b0 0x7ff7f4150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:28.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.062+0000 7ff7f3fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7f415d620 0x7ff7f40b6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:28.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.062+0000 7ff7f3fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7f415d620 0x7ff7f40b6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50732/0 (socket says 172.21.15.151:50732) 2023-12-11T17:09:28.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.062+0000 7ff7f3fff640 1 -- 172.21.15.151:0/2394919970 learned_addr learned my addr 172.21.15.151:0/2394919970 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-12-11T17:09:28.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.062+0000 7ff7f37fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7f40b06b0 0x7ff7f4150100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:49286/0 (socket says 172.21.15.151:49286) 2023-12-11T17:09:28.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.062+0000 7ff7f2ffd640 1 --2- 172.21.15.151:0/2394919970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7f40d1510 0x7ff7f415fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:28.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.063+0000 7ff7f3fff640 1 -- 172.21.15.151:0/2394919970 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7f40b06b0 msgr2=0x7ff7f4150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:28.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.063+0000 7ff7f3fff640 1 --2- 172.21.15.151:0/2394919970 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7f40b06b0 0x7ff7f4150100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.063+0000 7ff7f3fff640 1 -- 172.21.15.151:0/2394919970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7f40d1510 msgr2=0x7ff7f415fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:28.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.063+0000 7ff7f3fff640 1 --2- 172.21.15.151:0/2394919970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7f40d1510 0x7ff7f415fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.064 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.063+0000 7ff7f3fff640 1 -- 172.21.15.151:0/2394919970 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7e8009400 con 0x7ff7f415d620 2023-12-11T17:09:28.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.063+0000 7ff7f37fe640 1 --2- 172.21.15.151:0/2394919970 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7f40b06b0 0x7ff7f4150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:09:28.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.063+0000 7ff7f2ffd640 1 --2- 172.21.15.151:0/2394919970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7f40d1510 0x7ff7f415fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:09:28.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.063+0000 7ff7f3fff640 1 --2- 172.21.15.151:0/2394919970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7f415d620 0x7ff7f40b6710 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00b970 tx=0x7ff7ec00be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:28.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.063+0000 7ff7dbfff640 1 -- 172.21.15.151:0/2394919970 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec00cb40 con 0x7ff7f415d620 2023-12-11T17:09:28.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.063+0000 7ff7dbfff640 1 -- 172.21.15.151:0/2394919970 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7ec00cca0 con 0x7ff7f415d620 2023-12-11T17:09:28.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.063+0000 7ff7fa21e640 1 -- 172.21.15.151:0/2394919970 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7f40b6ed0 con 0x7ff7f415d620 2023-12-11T17:09:28.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.063+0000 7ff7dbfff640 1 -- 172.21.15.151:0/2394919970 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7ec014680 con 0x7ff7f415d620 2023-12-11T17:09:28.065 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.063+0000 7ff7fa21e640 1 -- 172.21.15.151:0/2394919970 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7f40b7490 con 0x7ff7f415d620 2023-12-11T17:09:28.066 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:28.064+0000 7f2ad2211040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-11T17:09:28.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.064+0000 7ff7dbfff640 1 -- 172.21.15.151:0/2394919970 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ff7ec003970 con 0x7ff7f415d620 2023-12-11T17:09:28.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.064+0000 7ff7dbfff640 1 -- 172.21.15.151:0/2394919970 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7ff7ec003c20 con 0x7ff7f415d620 2023-12-11T17:09:28.066 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.064+0000 7ff7fa21e640 1 -- 172.21.15.151:0/2394919970 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7f4150990 con 0x7ff7f415d620 2023-12-11T17:09:28.068 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.068+0000 7ff7dbfff640 1 -- 172.21.15.151:0/2394919970 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7ff7ec019070 con 0x7ff7f415d620 2023-12-11T17:09:28.147 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.146+0000 7ff7fa21e640 1 -- 172.21.15.151:0/2394919970 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "ada36ce6-7b6d-4147-8467-b10da804ef27", "id": 5} v 0) v1 -- 0x7ff7f4074450 con 0x7ff7f415d620 2023-12-11T17:09:28.154 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.154+0000 7ff7dbfff640 1 -- 172.21.15.151:0/2394919970 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "ada36ce6-7b6d-4147-8467-b10da804ef27", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7ff7ec0147e0 con 0x7ff7f415d620 2023-12-11T17:09:28.154 INFO:teuthology.orchestra.run.smithi151.stdout:5 2023-12-11T17:09:28.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.155+0000 7ff7fa21e640 1 -- 172.21.15.151:0/2394919970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7f415d620 msgr2=0x7ff7f40b6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:28.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.155+0000 7ff7fa21e640 1 --2- 172.21.15.151:0/2394919970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7f415d620 0x7ff7f40b6710 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7ff7ec00b970 tx=0x7ff7ec00be30 comp rx=0 tx=0).stop 2023-12-11T17:09:28.155 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.155+0000 7ff7fa21e640 1 -- 172.21.15.151:0/2394919970 shutdown_connections 2023-12-11T17:09:28.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.155+0000 7ff7fa21e640 1 --2- 172.21.15.151:0/2394919970 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7f415d620 0x7ff7f40b6710 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.155+0000 7ff7fa21e640 1 --2- 172.21.15.151:0/2394919970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7f40d1510 0x7ff7f415fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.155+0000 7ff7fa21e640 1 --2- 172.21.15.151:0/2394919970 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7f40b06b0 0x7ff7f4150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.155+0000 7ff7fa21e640 1 -- 172.21.15.151:0/2394919970 >> 172.21.15.151:0/2394919970 conn(0x7ff7f409c420 msgr2=0x7ff7f40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:28.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.155+0000 7ff7fa21e640 1 -- 172.21.15.151:0/2394919970 shutdown_connections 2023-12-11T17:09:28.156 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.155+0000 7ff7fa21e640 1 -- 172.21.15.151:0/2394919970 wait complete. 2023-12-11T17:09:28.162 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:28.162+0000 7f50a963b040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-11T17:09:28.172 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new 9b1caf4e-dc67-480d-86b6-a9d5e75c85b8 6 2023-12-11T17:09:28.179 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:28.179+0000 7f2ad2211040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-11T17:09:28.281 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:28.281+0000 7f50a963b040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-11T17:09:28.295 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:28.295+0000 7f2ad2211040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-11T17:09:28.364 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.363+0000 7f04cedb5640 1 Processor -- start 2023-12-11T17:09:28.364 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.363+0000 7f04cedb5640 1 -- start start 2023-12-11T17:09:28.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.365+0000 7f04cedb5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f04c815d1f0 0x7f04c80d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:28.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.365+0000 7f04cedb5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04c80d1060 0x7f04c80d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:28.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.365+0000 7f04cedb5640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f04c80b7960 0x7f04c80b7df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:28.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.365+0000 7f04cedb5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c80d19c0 con 0x7f04c815d1f0 2023-12-11T17:09:28.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.365+0000 7f04cedb5640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c80b74d0 con 0x7f04c80b7960 2023-12-11T17:09:28.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.365+0000 7f04cedb5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c80b68e0 con 0x7f04c80d1060 2023-12-11T17:09:28.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.365+0000 7f04cd5b2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04c80d1060 0x7f04c80d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:28.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.365+0000 7f04ce5b4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f04c80b7960 0x7f04c80b7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:28.366 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.365+0000 7f04cd5b2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04c80d1060 0x7f04c80d1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:49290/0 (socket says 172.21.15.151:49290) 2023-12-11T17:09:28.367 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.365+0000 7f04cd5b2640 1 -- 172.21.15.151:0/1817313895 learned_addr learned my addr 172.21.15.151:0/1817313895 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-12-11T17:09:28.367 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.365+0000 7f04cddb3640 1 --2- 172.21.15.151:0/1817313895 >> v2:172.21.15.37:3300/0 conn(0x7f04c815d1f0 0x7f04c80d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:28.367 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.366+0000 7f04ce5b4640 1 -- 172.21.15.151:0/1817313895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04c80d1060 msgr2=0x7f04c80d1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:28.367 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.366+0000 7f04ce5b4640 1 --2- 172.21.15.151:0/1817313895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04c80d1060 0x7f04c80d1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.367 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.366+0000 7f04ce5b4640 1 -- 172.21.15.151:0/1817313895 >> v2:172.21.15.37:3300/0 conn(0x7f04c815d1f0 msgr2=0x7f04c80d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:28.367 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.366+0000 7f04ce5b4640 1 --2- 172.21.15.151:0/1817313895 >> v2:172.21.15.37:3300/0 conn(0x7f04c815d1f0 0x7f04c80d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.367 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.366+0000 7f04ce5b4640 1 -- 172.21.15.151:0/1817313895 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c80b6ba0 con 0x7f04c80b7960 2023-12-11T17:09:28.367 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.366+0000 7f04cd5b2640 1 --2- 172.21.15.151:0/1817313895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04c80d1060 0x7f04c80d1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:09:28.368 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.367+0000 7f04ce5b4640 1 --2- 172.21.15.151:0/1817313895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04c80b7960 0x7f04c80b7df0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f04c80b9050 tx=0x7f04c002be20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cfe71e40dd4d6789 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:28.368 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.367+0000 7f04ccdb1640 1 -- 172.21.15.151:0/1817313895 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c002cbd0 con 0x7f04c80b7960 2023-12-11T17:09:28.368 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.367+0000 7f04ccdb1640 1 -- 172.21.15.151:0/1817313895 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c002cd30 con 0x7f04c80b7960 2023-12-11T17:09:28.368 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.367+0000 7f04ccdb1640 1 -- 172.21.15.151:0/1817313895 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c002cea0 con 0x7f04c80b7960 2023-12-11T17:09:28.368 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.368+0000 7f04cedb5640 1 -- 172.21.15.151:0/1817313895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04c80b7960 msgr2=0x7f04c80b7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:28.368 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.368+0000 7f04cedb5640 1 --2- 172.21.15.151:0/1817313895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04c80b7960 0x7f04c80b7df0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f04c80b9050 tx=0x7f04c002be20 comp rx=0 tx=0).stop 2023-12-11T17:09:28.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.368+0000 7f04cedb5640 1 -- 172.21.15.151:0/1817313895 shutdown_connections 2023-12-11T17:09:28.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.368+0000 7f04cedb5640 1 --2- 172.21.15.151:0/1817313895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04c80b7960 0x7f04c80b7df0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.368+0000 7f04cedb5640 1 --2- 172.21.15.151:0/1817313895 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04c80d1060 0x7f04c80d1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.368+0000 7f04cedb5640 1 --2- 172.21.15.151:0/1817313895 >> v2:172.21.15.37:3300/0 conn(0x7f04c815d1f0 0x7f04c80d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.368+0000 7f04cedb5640 1 -- 172.21.15.151:0/1817313895 >> 172.21.15.151:0/1817313895 conn(0x7f04c80d2fe0 msgr2=0x7f04c80d33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:28.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.368+0000 7f04cedb5640 1 -- 172.21.15.151:0/1817313895 shutdown_connections 2023-12-11T17:09:28.369 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.368+0000 7f04cedb5640 1 -- 172.21.15.151:0/1817313895 wait complete. 2023-12-11T17:09:28.370 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.370+0000 7f04cedb5640 1 Processor -- start 2023-12-11T17:09:28.370 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.370+0000 7f04cedb5640 1 -- start start 2023-12-11T17:09:28.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.371+0000 7f04cedb5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04c80b7960 0x7f04c80b0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:28.373 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.371+0000 7f04cedb5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04c80d1060 0x7f04c814b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:28.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.371+0000 7f04cedb5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c815d1f0 0x7f04c809e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:28.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.371+0000 7f04cedb5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c809f0c0 con 0x7f04c815d1f0 2023-12-11T17:09:28.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.371+0000 7f04cedb5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c809f3a0 con 0x7f04c80b7960 2023-12-11T17:09:28.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.371+0000 7f04cedb5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c809f680 con 0x7f04c80d1060 2023-12-11T17:09:28.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.371+0000 7f04cddb3640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04c80b7960 0x7f04c80b0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:28.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.371+0000 7f04cddb3640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04c80b7960 0x7f04c80b0670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:50738/0 (socket says 172.21.15.151:50738) 2023-12-11T17:09:28.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.371+0000 7f04cddb3640 1 -- 172.21.15.151:0/3902260676 learned_addr learned my addr 172.21.15.151:0/3902260676 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-12-11T17:09:28.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.371+0000 7f04cd5b2640 1 --2- 172.21.15.151:0/3902260676 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04c80d1060 0x7f04c814b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:28.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.371+0000 7f04ce5b4640 1 --2- 172.21.15.151:0/3902260676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c815d1f0 0x7f04c809e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:28.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.371+0000 7f04cddb3640 1 -- 172.21.15.151:0/3902260676 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04c80d1060 msgr2=0x7f04c814b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:28.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.371+0000 7f04cddb3640 1 --2- 172.21.15.151:0/3902260676 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04c80d1060 0x7f04c814b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.374 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.371+0000 7f04cddb3640 1 -- 172.21.15.151:0/3902260676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c815d1f0 msgr2=0x7f04c809e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:28.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.371+0000 7f04cddb3640 1 --2- 172.21.15.151:0/3902260676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c815d1f0 0x7f04c809e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.371+0000 7f04cddb3640 1 -- 172.21.15.151:0/3902260676 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b80094d0 con 0x7f04c80b7960 2023-12-11T17:09:28.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.372+0000 7f04cddb3640 1 --2- 172.21.15.151:0/3902260676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04c80b7960 0x7f04c80b0670 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f04c400d5f0 tx=0x7f04c400dab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:28.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.372+0000 7f04be7fc640 1 -- 172.21.15.151:0/3902260676 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c40125f0 con 0x7f04c80b7960 2023-12-11T17:09:28.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.372+0000 7f04be7fc640 1 -- 172.21.15.151:0/3902260676 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04c4012750 con 0x7f04c80b7960 2023-12-11T17:09:28.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.372+0000 7f04be7fc640 1 -- 172.21.15.151:0/3902260676 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04c4012b00 con 0x7f04c80b7960 2023-12-11T17:09:28.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.372+0000 7f04cedb5640 1 -- 172.21.15.151:0/3902260676 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c0009a70 con 0x7f04c80b7960 2023-12-11T17:09:28.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.372+0000 7f04cedb5640 1 -- 172.21.15.151:0/3902260676 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c809fc40 con 0x7f04c80b7960 2023-12-11T17:09:28.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.372+0000 7f04be7fc640 1 -- 172.21.15.151:0/3902260676 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f04c401e460 con 0x7f04c80b7960 2023-12-11T17:09:28.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.372+0000 7f04be7fc640 1 -- 172.21.15.151:0/3902260676 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7f04c4014a20 con 0x7f04c80b7960 2023-12-11T17:09:28.375 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.373+0000 7f04cedb5640 1 -- 172.21.15.151:0/3902260676 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04c809fe00 con 0x7f04c80b7960 2023-12-11T17:09:28.376 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.375+0000 7f04be7fc640 1 -- 172.21.15.151:0/3902260676 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f04c4014cb0 con 0x7f04c80b7960 2023-12-11T17:09:28.450 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:28.449+0000 7f50a963b040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-11T17:09:28.454 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.453+0000 7f04cedb5640 1 -- 172.21.15.151:0/3902260676 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9b1caf4e-dc67-480d-86b6-a9d5e75c85b8", "id": 6} v 0) v1 -- 0x7f04c814c6a0 con 0x7f04c80b7960 2023-12-11T17:09:28.460 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.460+0000 7f04be7fc640 1 -- 172.21.15.151:0/3902260676 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9b1caf4e-dc67-480d-86b6-a9d5e75c85b8", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7f04c4014430 con 0x7f04c80b7960 2023-12-11T17:09:28.460 INFO:teuthology.orchestra.run.smithi151.stdout:6 2023-12-11T17:09:28.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.461+0000 7f04cedb5640 1 -- 172.21.15.151:0/3902260676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04c80b7960 msgr2=0x7f04c80b0670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:28.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.461+0000 7f04cedb5640 1 --2- 172.21.15.151:0/3902260676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04c80b7960 0x7f04c80b0670 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f04c400d5f0 tx=0x7f04c400dab0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.462+0000 7f04cedb5640 1 -- 172.21.15.151:0/3902260676 shutdown_connections 2023-12-11T17:09:28.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.462+0000 7f04cedb5640 1 --2- 172.21.15.151:0/3902260676 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f04c815d1f0 0x7f04c809e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.462 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.462+0000 7f04cedb5640 1 --2- 172.21.15.151:0/3902260676 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f04c80d1060 0x7f04c814b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.462+0000 7f04cedb5640 1 --2- 172.21.15.151:0/3902260676 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f04c80b7960 0x7f04c80b0670 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.462+0000 7f04cedb5640 1 -- 172.21.15.151:0/3902260676 >> 172.21.15.151:0/3902260676 conn(0x7f04c80d2fe0 msgr2=0x7f04c80cff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:28.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.462+0000 7f04cedb5640 1 -- 172.21.15.151:0/3902260676 shutdown_connections 2023-12-11T17:09:28.463 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.462+0000 7f04cedb5640 1 -- 172.21.15.151:0/3902260676 wait complete. 2023-12-11T17:09:28.464 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:28.464+0000 7f2ad2211040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-11T17:09:28.479 DEBUG:teuthology.orchestra.run.smithi151:> sudo ceph --cluster ceph osd new b709866c-d3eb-4847-b700-c67ed124103c 7 2023-12-11T17:09:28.504 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:28.504+0000 7f50a963b040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-11T17:09:28.516 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:28.516+0000 7f2ad2211040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-11T17:09:28.668 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:28.668+0000 7f50a963b040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-11T17:09:28.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.674+0000 7feaf939e640 1 Processor -- start 2023-12-11T17:09:28.675 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.675+0000 7feaf939e640 1 -- start start 2023-12-11T17:09:28.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.676+0000 7feaf939e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaf415d1f0 0x7feaf40d0b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:28.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.676+0000 7feaf939e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7feaf40d1060 0x7feaf40d1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:28.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.676+0000 7feaf939e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaf40b74d0 con 0x7feaf40b7960 2023-12-11T17:09:28.677 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.676+0000 7feaf939e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feaf40d19c0 con 0x7feaf40d1060 2023-12-11T17:09:28.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.676+0000 7feaf939e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf40b68e0 con 0x7feaf415d1f0 2023-12-11T17:09:28.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.676+0000 7feaf3fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaf415d1f0 0x7feaf40d0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:28.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.676+0000 7feaebfff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7feaf40d1060 0x7feaf40d1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:28.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.676+0000 7feaf3fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaf415d1f0 0x7feaf40d0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:49308/0 (socket says 172.21.15.151:49308) 2023-12-11T17:09:28.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.676+0000 7feaf3fff640 1 -- 172.21.15.151:0/1117899211 learned_addr learned my addr 172.21.15.151:0/1117899211 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-12-11T17:09:28.678 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.677+0000 7feaebfff640 1 -- 172.21.15.151:0/1117899211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaf415d1f0 msgr2=0x7feaf40d0b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:28.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.677+0000 7feaebfff640 1 --2- 172.21.15.151:0/1117899211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaf415d1f0 0x7feaf40d0b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.677+0000 7feaebfff640 1 -- 172.21.15.151:0/1117899211 >> v1:172.21.15.37:6789/0 conn(0x7feaf40b7960 legacy=0x7feaf40b7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:28.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.677+0000 7feaebfff640 1 -- 172.21.15.151:0/1117899211 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaf40b6ba0 con 0x7feaf40d1060 2023-12-11T17:09:28.679 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.677+0000 7feaf3fff640 1 --2- 172.21.15.151:0/1117899211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaf415d1f0 0x7feaf40d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:09:28.680 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.678+0000 7feaebfff640 1 --2- 172.21.15.151:0/1117899211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feaf40d1060 0x7feaf40d1480 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7feadc0097a0 tx=0x7feadc02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3496c02357e66e01 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:28.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.678+0000 7feaf37fe640 1 -- 172.21.15.151:0/1117899211 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc02d040 con 0x7feaf40d1060 2023-12-11T17:09:28.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.678+0000 7feaf37fe640 1 -- 172.21.15.151:0/1117899211 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc031810 con 0x7feaf40d1060 2023-12-11T17:09:28.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.678+0000 7feaf37fe640 1 -- 172.21.15.151:0/1117899211 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc031ba0 con 0x7feaf40d1060 2023-12-11T17:09:28.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.679+0000 7feaf939e640 1 -- 172.21.15.151:0/1117899211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feaf40d1060 msgr2=0x7feaf40d1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:28.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.679+0000 7feaf939e640 1 --2- 172.21.15.151:0/1117899211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feaf40d1060 0x7feaf40d1480 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7feadc0097a0 tx=0x7feadc02b8b0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.679+0000 7feaf939e640 1 -- 172.21.15.151:0/1117899211 shutdown_connections 2023-12-11T17:09:28.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.679+0000 7feaf939e640 1 --2- 172.21.15.151:0/1117899211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feaf40d1060 0x7feaf40d1480 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.679+0000 7feaf939e640 1 --2- 172.21.15.151:0/1117899211 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaf415d1f0 0x7feaf40d0b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.679+0000 7feaf939e640 1 -- 172.21.15.151:0/1117899211 >> 172.21.15.151:0/1117899211 conn(0x7feaf40d2fe0 msgr2=0x7feaf40d33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:28.681 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.679+0000 7feaf939e640 1 -- 172.21.15.151:0/1117899211 shutdown_connections 2023-12-11T17:09:28.682 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.679+0000 7feaf939e640 1 -- 172.21.15.151:0/1117899211 wait complete. 2023-12-11T17:09:28.683 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:28.681+0000 7f2ad2211040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-11T17:09:28.685 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.681+0000 7feaf939e640 1 Processor -- start 2023-12-11T17:09:28.685 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.681+0000 7feaf939e640 1 -- start start 2023-12-11T17:09:28.685 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.682+0000 7feaf939e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feaf40b7960 0x7feaf4151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:28.685 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.682+0000 7feaf939e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaf40d1060 0x7feaf41f6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:28.685 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.682+0000 7feaf939e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feaf415d1f0 0x7feaf41f65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:28.686 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.682+0000 7feaf939e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf40c89b0 con 0x7feaf40b7960 2023-12-11T17:09:28.686 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.682+0000 7feaf939e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaf40c8f10 con 0x7feaf415d1f0 2023-12-11T17:09:28.686 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.682+0000 7feaf939e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaf409cce0 con 0x7feaf40d1060 2023-12-11T17:09:28.686 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.682+0000 7feaebfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaf40d1060 0x7feaf41f6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:28.686 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.682+0000 7feaf8b9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feaf415d1f0 0x7feaf41f65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:28.686 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.682+0000 7feaebfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaf40d1060 0x7feaf41f6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.151:49322/0 (socket says 172.21.15.151:49322) 2023-12-11T17:09:28.686 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.682+0000 7feaebfff640 1 -- 172.21.15.151:0/520576808 learned_addr learned my addr 172.21.15.151:0/520576808 (peer_addr_for_me v2:172.21.15.151:0/0) 2023-12-11T17:09:28.686 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.682+0000 7feaf3fff640 1 --2- 172.21.15.151:0/520576808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feaf40b7960 0x7feaf4151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:28.686 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.683+0000 7feaebfff640 1 -- 172.21.15.151:0/520576808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feaf415d1f0 msgr2=0x7feaf41f65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:28.687 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.683+0000 7feaebfff640 1 --2- 172.21.15.151:0/520576808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feaf415d1f0 0x7feaf41f65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.687 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.683+0000 7feaebfff640 1 -- 172.21.15.151:0/520576808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feaf40b7960 msgr2=0x7feaf4151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:28.687 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.683+0000 7feaebfff640 1 --2- 172.21.15.151:0/520576808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feaf40b7960 0x7feaf4151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.687 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.683+0000 7feaebfff640 1 -- 172.21.15.151:0/520576808 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae40094d0 con 0x7feaf40d1060 2023-12-11T17:09:28.687 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.683+0000 7feaf3fff640 1 --2- 172.21.15.151:0/520576808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feaf40b7960 0x7feaf4151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:09:28.687 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.683+0000 7feaf8b9d640 1 --2- 172.21.15.151:0/520576808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feaf415d1f0 0x7feaf41f65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:09:28.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.683+0000 7feaebfff640 1 --2- 172.21.15.151:0/520576808 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaf40d1060 0x7feaf41f6060 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7feadc0098c0 tx=0x7feadc0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:28.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.683+0000 7feaf17fa640 1 -- 172.21.15.151:0/520576808 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc006e10 con 0x7feaf40d1060 2023-12-11T17:09:28.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.683+0000 7feaf17fa640 1 -- 172.21.15.151:0/520576808 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc03ad60 con 0x7feaf40d1060 2023-12-11T17:09:28.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.683+0000 7feaf17fa640 1 -- 172.21.15.151:0/520576808 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc044630 con 0x7feaf40d1060 2023-12-11T17:09:28.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.683+0000 7feaf939e640 1 -- 172.21.15.151:0/520576808 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feadc009400 con 0x7feaf40d1060 2023-12-11T17:09:28.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.684+0000 7feaf939e640 1 -- 172.21.15.151:0/520576808 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaf409d2a0 con 0x7feaf40d1060 2023-12-11T17:09:28.688 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.684+0000 7feaf17fa640 1 -- 172.21.15.151:0/520576808 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7feadc044a90 con 0x7feaf40d1060 2023-12-11T17:09:28.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.684+0000 7feaf17fa640 1 -- 172.21.15.151:0/520576808 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7feadc044d40 con 0x7feaf40d1060 2023-12-11T17:09:28.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.685+0000 7feaf939e640 1 -- 172.21.15.151:0/520576808 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feaf40c90c0 con 0x7feaf40d1060 2023-12-11T17:09:28.689 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.687+0000 7feaf17fa640 1 -- 172.21.15.151:0/520576808 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7feaf40c90c0 con 0x7feaf40d1060 2023-12-11T17:09:28.765 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.765+0000 7feaf939e640 1 -- 172.21.15.151:0/520576808 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b709866c-d3eb-4847-b700-c67ed124103c", "id": 7} v 0) v1 -- 0x7feaf40673f0 con 0x7feaf40d1060 2023-12-11T17:09:28.774 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.774+0000 7feaf17fa640 1 -- 172.21.15.151:0/520576808 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b709866c-d3eb-4847-b700-c67ed124103c", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7feadc035020 con 0x7feaf40d1060 2023-12-11T17:09:28.775 INFO:teuthology.orchestra.run.smithi151.stdout:7 2023-12-11T17:09:28.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.775+0000 7feaf939e640 1 -- 172.21.15.151:0/520576808 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaf40d1060 msgr2=0x7feaf41f6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:28.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.775+0000 7feaf939e640 1 --2- 172.21.15.151:0/520576808 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaf40d1060 0x7feaf41f6060 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7feadc0098c0 tx=0x7feadc0046c0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.776+0000 7feaf939e640 1 -- 172.21.15.151:0/520576808 shutdown_connections 2023-12-11T17:09:28.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.776+0000 7feaf939e640 1 --2- 172.21.15.151:0/520576808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feaf415d1f0 0x7feaf41f65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.776+0000 7feaf939e640 1 --2- 172.21.15.151:0/520576808 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feaf40d1060 0x7feaf41f6060 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.776+0000 7feaf939e640 1 --2- 172.21.15.151:0/520576808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feaf40b7960 0x7feaf4151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:28.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.776+0000 7feaf939e640 1 -- 172.21.15.151:0/520576808 >> 172.21.15.151:0/520576808 conn(0x7feaf40d2fe0 msgr2=0x7feaf41603e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:28.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.776+0000 7feaf939e640 1 -- 172.21.15.151:0/520576808 shutdown_connections 2023-12-11T17:09:28.776 INFO:teuthology.orchestra.run.smithi151.stderr:2023-12-11T17:09:28.776+0000 7feaf939e640 1 -- 172.21.15.151:0/520576808 wait complete. 2023-12-11T17:09:28.792 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-11T17:09:28.792 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-11T17:09:28.799 INFO:tasks.ceph.osd.0:Started 2023-12-11T17:09:28.799 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-11T17:09:28.799 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-11T17:09:28.805 INFO:tasks.ceph.osd.1:Started 2023-12-11T17:09:28.806 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-11T17:09:28.806 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-11T17:09:28.812 INFO:tasks.ceph.osd.2:Started 2023-12-11T17:09:28.812 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-11T17:09:28.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-11T17:09:28.819 INFO:tasks.ceph.osd.3:Started 2023-12-11T17:09:28.820 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-11T17:09:28.821 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-11T17:09:28.841 INFO:tasks.ceph.osd.4:Started 2023-12-11T17:09:28.841 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-11T17:09:28.841 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-11T17:09:28.849 INFO:tasks.ceph.osd.5:Started 2023-12-11T17:09:28.849 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-11T17:09:28.849 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-11T17:09:28.854 INFO:tasks.ceph.osd.6:Started 2023-12-11T17:09:28.854 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-11T17:09:28.855 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-11T17:09:28.860 INFO:tasks.ceph.osd.7:Started 2023-12-11T17:09:28.861 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:09:29.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.060+0000 7f32bfe36640 1 Processor -- start 2023-12-11T17:09:29.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.060+0000 7f32bfe36640 1 -- start start 2023-12-11T17:09:29.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.061+0000 7f32bfe36640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32b8143e00 0x7f32b80b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:29.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.061+0000 7f32bfe36640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f32b8072180 0x7f32b80b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:29.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.061+0000 7f32bfe36640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32b80b3bb0 con 0x7f32b806c410 2023-12-11T17:09:29.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.061+0000 7f32bfe36640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32b81441e0 con 0x7f32b8072180 2023-12-11T17:09:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.061+0000 7f32bfe36640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b8072680 con 0x7f32b8143e00 2023-12-11T17:09:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.062+0000 7f32bdbd2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32b8143e00 0x7f32b80b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:29.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.062+0000 7f32bdbd2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32b8143e00 0x7f32b80b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.37:55544/0 (socket says 172.21.15.37:55544) 2023-12-11T17:09:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.062+0000 7f32bd3d1640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f32b8072180 0x7f32b80b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.062+0000 7f32bdbd2640 1 -- 172.21.15.37:0/971360371 learned_addr learned my addr 172.21.15.37:0/971360371 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.062+0000 7f32bdbd2640 1 -- 172.21.15.37:0/971360371 >> v2:172.21.15.151:3300/0 conn(0x7f32b8072180 msgr2=0x7f32b80b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.062+0000 7f32bdbd2640 1 --2- 172.21.15.37:0/971360371 >> v2:172.21.15.151:3300/0 conn(0x7f32b8072180 0x7f32b80b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.062+0000 7f32bdbd2640 1 -- 172.21.15.37:0/971360371 >> v1:172.21.15.151:6789/0 conn(0x7f32b806c410 legacy=0x7f32b8070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:29.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.062+0000 7f32bdbd2640 1 -- 172.21.15.37:0/971360371 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b80b1e30 con 0x7f32b8143e00 2023-12-11T17:09:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.063+0000 7f32bdbd2640 1 --2- 172.21.15.37:0/971360371 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32b8143e00 0x7f32b80b4040 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f32b4009870 tx=0x7f32b402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=eac26f655b38e6c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.063+0000 7f32bcbd0640 1 -- 172.21.15.37:0/971360371 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b4030840 con 0x7f32b8143e00 2023-12-11T17:09:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.064+0000 7f32bcbd0640 1 -- 172.21.15.37:0/971360371 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b40309a0 con 0x7f32b8143e00 2023-12-11T17:09:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.064+0000 7f32bcbd0640 1 -- 172.21.15.37:0/971360371 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b4030d30 con 0x7f32b8143e00 2023-12-11T17:09:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.064+0000 7f32bfe36640 1 -- 172.21.15.37:0/971360371 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32b8143e00 msgr2=0x7f32b80b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.064+0000 7f32bfe36640 1 --2- 172.21.15.37:0/971360371 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32b8143e00 0x7f32b80b4040 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f32b4009870 tx=0x7f32b402b980 comp rx=0 tx=0).stop 2023-12-11T17:09:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.064+0000 7f32bfe36640 1 -- 172.21.15.37:0/971360371 shutdown_connections 2023-12-11T17:09:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.064+0000 7f32bfe36640 1 --2- 172.21.15.37:0/971360371 >> v2:172.21.15.151:3300/0 conn(0x7f32b8072180 0x7f32b80b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:29.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.064+0000 7f32bfe36640 1 --2- 172.21.15.37:0/971360371 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32b8143e00 0x7f32b80b4040 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:29.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.064+0000 7f32bfe36640 1 -- 172.21.15.37:0/971360371 >> 172.21.15.37:0/971360371 conn(0x7f32b80b0a90 msgr2=0x7f32b80b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:29.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.064+0000 7f32bfe36640 1 -- 172.21.15.37:0/971360371 shutdown_connections 2023-12-11T17:09:29.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.064+0000 7f32bfe36640 1 -- 172.21.15.37:0/971360371 wait complete. 2023-12-11T17:09:29.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.066+0000 7f32bfe36640 1 Processor -- start 2023-12-11T17:09:29.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.066+0000 7f32bfe36640 1 -- start start 2023-12-11T17:09:29.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.067+0000 7f32bfe36640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32b806c410 0x7f32b813fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:29.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.067+0000 7f32bfe36640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32b8072180 0x7f32b813bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:29.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.067+0000 7f32bfe36640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32b8143e00 0x7f32b8141970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:29.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.067+0000 7f32bfe36640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b813d0e0 con 0x7f32b806c410 2023-12-11T17:09:29.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.067+0000 7f32bfe36640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32b813c200 con 0x7f32b8143e00 2023-12-11T17:09:29.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.067+0000 7f32bfe36640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32b813c4d0 con 0x7f32b8072180 2023-12-11T17:09:29.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.067+0000 7f32bdbd2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32b806c410 0x7f32b813fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:29.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.067+0000 7f32bdbd2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32b806c410 0x7f32b813fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40140/0 (socket says 172.21.15.37:40140) 2023-12-11T17:09:29.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.067+0000 7f32bdbd2640 1 -- 172.21.15.37:0/1161549842 learned_addr learned my addr 172.21.15.37:0/1161549842 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:29.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.067+0000 7f32bd3d1640 1 --2- 172.21.15.37:0/1161549842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32b8072180 0x7f32b813bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:29.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.067+0000 7f32be3d3640 1 --2- 172.21.15.37:0/1161549842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32b8143e00 0x7f32b8141970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:29.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.067+0000 7f32bdbd2640 1 -- 172.21.15.37:0/1161549842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32b8072180 msgr2=0x7f32b813bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:29.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.067+0000 7f32bdbd2640 1 --2- 172.21.15.37:0/1161549842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32b8072180 0x7f32b813bcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:29.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.067+0000 7f32bdbd2640 1 -- 172.21.15.37:0/1161549842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32b8143e00 msgr2=0x7f32b8141970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:29.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.067+0000 7f32bdbd2640 1 --2- 172.21.15.37:0/1161549842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32b8143e00 0x7f32b8141970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:29.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.067+0000 7f32bdbd2640 1 -- 172.21.15.37:0/1161549842 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32b40094d0 con 0x7f32b806c410 2023-12-11T17:09:29.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.068+0000 7f32bdbd2640 1 --2- 172.21.15.37:0/1161549842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32b806c410 0x7f32b813fd30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f32b402b9c0 tx=0x7f32b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:29.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.068+0000 7f32ae7fc640 1 -- 172.21.15.37:0/1161549842 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b403e040 con 0x7f32b806c410 2023-12-11T17:09:29.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.068+0000 7f32ae7fc640 1 -- 172.21.15.37:0/1161549842 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32b4039cb0 con 0x7f32b806c410 2023-12-11T17:09:29.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.068+0000 7f32ae7fc640 1 -- 172.21.15.37:0/1161549842 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32b4044630 con 0x7f32b806c410 2023-12-11T17:09:29.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.069+0000 7f32bfe36640 1 -- 172.21.15.37:0/1161549842 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32b813c7b0 con 0x7f32b806c410 2023-12-11T17:09:29.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.069+0000 7f32bfe36640 1 -- 172.21.15.37:0/1161549842 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32b813cd70 con 0x7f32b806c410 2023-12-11T17:09:29.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.069+0000 7f32ae7fc640 1 -- 172.21.15.37:0/1161549842 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f32b4044a90 con 0x7f32b806c410 2023-12-11T17:09:29.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.069+0000 7f32ae7fc640 1 -- 172.21.15.37:0/1161549842 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f32b404da80 con 0x7f32b806c410 2023-12-11T17:09:29.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.070+0000 7f32bfe36640 1 -- 172.21.15.37:0/1161549842 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32b80cb5e0 con 0x7f32b806c410 2023-12-11T17:09:29.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.073+0000 7f32ae7fc640 1 -- 172.21.15.37:0/1161549842 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f32b4049070 con 0x7f32b806c410 2023-12-11T17:09:29.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.137+0000 7f32bfe36640 1 -- 172.21.15.37:0/1161549842 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f32b80745d0 con 0x7f32b806c410 2023-12-11T17:09:29.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.138+0000 7f32ae7fc640 1 -- 172.21.15.37:0/1161549842 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f32b4034070 con 0x7f32b806c410 2023-12-11T17:09:29.138 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:09:29.138 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":10,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:09:28.767296+0000","last_up_change":"0.000000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:09:29.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.139+0000 7f32bfe36640 1 -- 172.21.15.37:0/1161549842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32b806c410 msgr2=0x7f32b813fd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:29.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.139+0000 7f32bfe36640 1 --2- 172.21.15.37:0/1161549842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32b806c410 0x7f32b813fd30 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f32b402b9c0 tx=0x7f32b4004730 comp rx=0 tx=0).stop 2023-12-11T17:09:29.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.139+0000 7f32bfe36640 1 -- 172.21.15.37:0/1161549842 shutdown_connections 2023-12-11T17:09:29.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.139+0000 7f32bfe36640 1 --2- 172.21.15.37:0/1161549842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32b8143e00 0x7f32b8141970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:29.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.139+0000 7f32bfe36640 1 --2- 172.21.15.37:0/1161549842 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f32b8072180 0x7f32b813bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:29.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.139+0000 7f32bfe36640 1 --2- 172.21.15.37:0/1161549842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f32b806c410 0x7f32b813fd30 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.139+0000 7f32bfe36640 1 -- 172.21.15.37:0/1161549842 >> 172.21.15.37:0/1161549842 conn(0x7f32b80b0a90 msgr2=0x7f32b80af500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.139+0000 7f32bfe36640 1 -- 172.21.15.37:0/1161549842 shutdown_connections 2023-12-11T17:09:29.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:29.139+0000 7f32bfe36640 1 -- 172.21.15.37:0/1161549842 wait complete. 2023-12-11T17:09:29.156 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-11T17:09:29.156 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-11T17:09:29.500 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T17:09:29.500+0000 7f8deb216500 -1 Falling back to public interface 2023-12-11T17:09:29.535 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T17:09:29.535+0000 7f007aada500 -1 Falling back to public interface 2023-12-11T17:09:29.536 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T17:09:29.536+0000 7fdae2af6500 -1 Falling back to public interface 2023-12-11T17:09:29.548 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T17:09:29.548+0000 7fb7854a3500 -1 Falling back to public interface 2023-12-11T17:09:29.556 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T17:09:29.556+0000 7f5abdc10500 -1 Falling back to public interface 2023-12-11T17:09:29.557 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T17:09:29.557+0000 7fb78444a640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6813/0: (98) Address already in use 2023-12-11T17:09:29.563 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T17:09:29.563+0000 7fe984a25500 -1 Falling back to public interface 2023-12-11T17:09:29.565 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T17:09:29.565+0000 7f690eac5500 -1 Falling back to public interface 2023-12-11T17:09:29.570 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T17:09:29.570+0000 7efcd7814500 -1 Falling back to public interface 2023-12-11T17:09:29.821 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:29.820+0000 7f50a963b040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-11T17:09:29.843 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:29.843+0000 7f2ad2211040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-11T17:09:29.962 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-11T17:09:30.123 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.123+0000 7f23e4be6640 1 Processor -- start 2023-12-11T17:09:30.124 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.123+0000 7f23e4be6640 1 -- start start 2023-12-11T17:09:30.125 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.124+0000 7f23e4be6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f23e015d300 0x7f23e00ce5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:30.126 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.125+0000 7f23e4be6640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e015d6e0 con 0x7f23e00d1be0 2023-12-11T17:09:30.126 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.125+0000 7f23e4be6640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23e00cedf0 con 0x7f23e00b8bb0 2023-12-11T17:09:30.126 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.125+0000 7f23e4be6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23e00b5de0 con 0x7f23e015d300 2023-12-11T17:09:30.126 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.125+0000 7f23dffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f23e00d1be0 0x7f23e0166e10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45726/0 (socket says 172.21.15.37:45726) 2023-12-11T17:09:30.126 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.125+0000 7f23dffff640 1 -- 172.21.15.37:0/3349999703 learned_addr learned my addr 172.21.15.37:0/3349999703 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:09:30.126 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.125+0000 7f23df7fe640 1 --2- 172.21.15.37:0/3349999703 >> v2:172.21.15.151:3300/0 conn(0x7f23e015d300 0x7f23e00ce5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:30.126 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.125+0000 7f23de7fc640 1 -- 172.21.15.37:0/3349999703 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2095299637 0 0) 0x7f23e015d6e0 con 0x7f23e00d1be0 2023-12-11T17:09:30.127 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.125+0000 7f23de7fc640 1 -- 172.21.15.37:0/3349999703 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f23c8003520 con 0x7f23e00d1be0 2023-12-11T17:09:30.127 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.125+0000 7f23df7fe640 1 -- 172.21.15.37:0/3349999703 >> v1:172.21.15.151:6789/0 conn(0x7f23e00b8bb0 legacy=0x7f23e00d14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:30.127 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.125+0000 7f23de7fc640 1 -- 172.21.15.37:0/3349999703 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 208514905 0 0) 0x7f23e00cedf0 con 0x7f23e00b8bb0 2023-12-11T17:09:30.127 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.126+0000 7f23df7fe640 1 -- 172.21.15.37:0/3349999703 >> v1:172.21.15.37:6789/0 conn(0x7f23e00d1be0 legacy=0x7f23e0166e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:30.127 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.126+0000 7f23df7fe640 1 -- 172.21.15.37:0/3349999703 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23e00b60c0 con 0x7f23e015d300 2023-12-11T17:09:30.129 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.127+0000 7f23df7fe640 1 --2- 172.21.15.37:0/3349999703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23e015d300 0x7f23e00ce5a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f23d00097a0 tx=0x7f23d002b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e7041d08e20f7d0e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:30.129 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.127+0000 7f23de7fc640 1 -- 172.21.15.37:0/3349999703 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d002f810 con 0x7f23e015d300 2023-12-11T17:09:30.129 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.127+0000 7f23de7fc640 1 -- 172.21.15.37:0/3349999703 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d002f970 con 0x7f23e015d300 2023-12-11T17:09:30.129 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.127+0000 7f23de7fc640 1 -- 172.21.15.37:0/3349999703 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d002fd00 con 0x7f23e015d300 2023-12-11T17:09:30.129 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.127+0000 7f23e4be6640 1 -- 172.21.15.37:0/3349999703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23e015d300 msgr2=0x7f23e00ce5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:30.129 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.127+0000 7f23e4be6640 1 --2- 172.21.15.37:0/3349999703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23e015d300 0x7f23e00ce5a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f23d00097a0 tx=0x7f23d002b9f0 comp rx=0 tx=0).stop 2023-12-11T17:09:30.129 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.128+0000 7f23e4be6640 1 -- 172.21.15.37:0/3349999703 shutdown_connections 2023-12-11T17:09:30.129 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.128+0000 7f23e4be6640 1 --2- 172.21.15.37:0/3349999703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23e015d300 0x7f23e00ce5a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:30.129 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.128+0000 7f23e4be6640 1 -- 172.21.15.37:0/3349999703 >> 172.21.15.37:0/3349999703 conn(0x7f23e009c2a0 msgr2=0x7f23e00d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:30.129 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.128+0000 7f23e4be6640 1 -- 172.21.15.37:0/3349999703 shutdown_connections 2023-12-11T17:09:30.129 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.128+0000 7f23e4be6640 1 -- 172.21.15.37:0/3349999703 wait complete. 2023-12-11T17:09:30.130 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:30.128+0000 7f50a963b040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-11T17:09:30.130 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.130+0000 7f23e4be6640 1 Processor -- start 2023-12-11T17:09:30.130 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.130+0000 7f23e4be6640 1 -- start start 2023-12-11T17:09:30.132 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.131+0000 7f23e4be6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23e00b8bb0 0x7f23e00c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:30.132 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.131+0000 7f23e4be6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23e00d1be0 0x7f23e0152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:30.132 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.131+0000 7f23e4be6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23e015d300 0x7f23e015f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:30.132 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.131+0000 7f23e4be6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e006bcb0 con 0x7f23e00b8bb0 2023-12-11T17:09:30.132 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.131+0000 7f23e4be6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23e0153250 con 0x7f23e00d1be0 2023-12-11T17:09:30.132 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.131+0000 7f23e4be6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23e00c96b0 con 0x7f23e015d300 2023-12-11T17:09:30.132 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.131+0000 7f23df7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23e00b8bb0 0x7f23e00c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:30.132 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.131+0000 7f23df7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23e00b8bb0 0x7f23e00c90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40144/0 (socket says 172.21.15.37:40144) 2023-12-11T17:09:30.132 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.131+0000 7f23df7fe640 1 -- 172.21.15.37:0/1346304910 learned_addr learned my addr 172.21.15.37:0/1346304910 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:30.132 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.132+0000 7f23deffd640 1 --2- 172.21.15.37:0/1346304910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23e00d1be0 0x7f23e0152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:30.132 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.132+0000 7f23dffff640 1 --2- 172.21.15.37:0/1346304910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23e015d300 0x7f23e015f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:30.133 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.132+0000 7f23df7fe640 1 -- 172.21.15.37:0/1346304910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23e015d300 msgr2=0x7f23e015f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:30.133 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.132+0000 7f23df7fe640 1 --2- 172.21.15.37:0/1346304910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23e015d300 0x7f23e015f900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:30.133 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.132+0000 7f23df7fe640 1 -- 172.21.15.37:0/1346304910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23e00d1be0 msgr2=0x7f23e0152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:30.133 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.132+0000 7f23df7fe640 1 --2- 172.21.15.37:0/1346304910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23e00d1be0 0x7f23e0152d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:30.133 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.132+0000 7f23df7fe640 1 -- 172.21.15.37:0/1346304910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23d0009400 con 0x7f23e00b8bb0 2023-12-11T17:09:30.133 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.132+0000 7f23deffd640 1 --2- 172.21.15.37:0/1346304910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23e00d1be0 0x7f23e0152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:09:30.133 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.132+0000 7f23df7fe640 1 --2- 172.21.15.37:0/1346304910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23e00b8bb0 0x7f23e00c90b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f23d00098c0 tx=0x7f23d0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:30.134 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.132+0000 7f23c7fff640 1 -- 172.21.15.37:0/1346304910 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d003c040 con 0x7f23e00b8bb0 2023-12-11T17:09:30.134 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.132+0000 7f23c7fff640 1 -- 172.21.15.37:0/1346304910 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23d0037810 con 0x7f23e00b8bb0 2023-12-11T17:09:30.134 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.132+0000 7f23c7fff640 1 -- 172.21.15.37:0/1346304910 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23d0037ba0 con 0x7f23e00b8bb0 2023-12-11T17:09:30.134 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.132+0000 7f23e4be6640 1 -- 172.21.15.37:0/1346304910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23e006bf00 con 0x7f23e00b8bb0 2023-12-11T17:09:30.134 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.133+0000 7f23e4be6640 1 -- 172.21.15.37:0/1346304910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23e006c4c0 con 0x7f23e00b8bb0 2023-12-11T17:09:30.134 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.133+0000 7f23c7fff640 1 -- 172.21.15.37:0/1346304910 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f23d004b3f0 con 0x7f23e00b8bb0 2023-12-11T17:09:30.134 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.133+0000 7f23c7fff640 1 -- 172.21.15.37:0/1346304910 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f23d004bd70 con 0x7f23e00b8bb0 2023-12-11T17:09:30.135 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.134+0000 7f23e4be6640 1 -- 172.21.15.37:0/1346304910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23e00673f0 con 0x7f23e00b8bb0 2023-12-11T17:09:30.136 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.136+0000 7f23c7fff640 1 -- 172.21.15.37:0/1346304910 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72898 (secure 0 0 0) 0x7f23d0047070 con 0x7f23e00b8bb0 2023-12-11T17:09:30.168 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:30.167+0000 7f2ad2211040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-11T17:09:30.189 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:30.188+0000 7f50a963b040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-11T17:09:30.203 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.203+0000 7f23e4be6640 1 -- 172.21.15.37:0/1346304910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23e015ca30 con 0x7f23e00b8bb0 2023-12-11T17:09:30.204 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.204+0000 7f23c7fff640 1 -- 172.21.15.37:0/1346304910 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f23d004b770 con 0x7f23e00b8bb0 2023-12-11T17:09:30.204 INFO:teuthology.misc.health.smithi037.stdout: 2023-12-11T17:09:30.204 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":10,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:09:28.767296+0000","last_up_change":"0.000000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:09:30.206 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.205+0000 7f23e4be6640 1 -- 172.21.15.37:0/1346304910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23e00b8bb0 msgr2=0x7f23e00c90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:30.206 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.205+0000 7f23e4be6640 1 --2- 172.21.15.37:0/1346304910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23e00b8bb0 0x7f23e00c90b0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f23d00098c0 tx=0x7f23d0004730 comp rx=0 tx=0).stop 2023-12-11T17:09:30.206 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.205+0000 7f23e4be6640 1 -- 172.21.15.37:0/1346304910 shutdown_connections 2023-12-11T17:09:30.206 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.205+0000 7f23e4be6640 1 --2- 172.21.15.37:0/1346304910 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f23e00d1be0 0x7f23e0152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:30.206 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.205+0000 7f23e4be6640 1 --2- 172.21.15.37:0/1346304910 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f23e015d300 0x7f23e015f900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:30.207 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.205+0000 7f23e4be6640 1 --2- 172.21.15.37:0/1346304910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f23e00b8bb0 0x7f23e00c90b0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:30.207 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.205+0000 7f23e4be6640 1 -- 172.21.15.37:0/1346304910 >> 172.21.15.37:0/1346304910 conn(0x7f23e009c2a0 msgr2=0x7f23e00b7db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:30.207 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.205+0000 7f23e4be6640 1 -- 172.21.15.37:0/1346304910 shutdown_connections 2023-12-11T17:09:30.207 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:30.205+0000 7f23e4be6640 1 -- 172.21.15.37:0/1346304910 wait complete. 2023-12-11T17:09:30.218 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-11T17:09:30.231 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:30.231+0000 7f2ad2211040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-11T17:09:30.303 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:30.302+0000 7f50a963b040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-11T17:09:30.354 INFO:tasks.ceph.mgr.y.smithi037.stderr:2023-12-11T17:09:30.354+0000 7f2ad2211040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-11T17:09:31.365 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:31.365+0000 7f504aa11640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-11T17:09:31.366 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-11T17:09:31.366+0000 7f504aa11640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-11T17:09:33.102 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T17:09:33.102+0000 7fe984a25500 -1 osd.4 0 log_to_monitors true 2023-12-11T17:09:33.134 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T17:09:33.134+0000 7f690eac5500 -1 osd.3 0 log_to_monitors true 2023-12-11T17:09:33.138 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T17:09:33.138+0000 7efcd7814500 -1 osd.6 0 log_to_monitors true 2023-12-11T17:09:33.144 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T17:09:33.144+0000 7f5abdc10500 -1 osd.1 0 log_to_monitors true 2023-12-11T17:09:33.316 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T17:09:33.316+0000 7f8deb216500 -1 osd.0 0 log_to_monitors true 2023-12-11T17:09:33.318 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T17:09:33.317+0000 7f007aada500 -1 osd.5 0 log_to_monitors true 2023-12-11T17:09:33.351 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T17:09:33.351+0000 7fdae2af6500 -1 osd.7 0 log_to_monitors true 2023-12-11T17:09:33.379 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T17:09:33.379+0000 7fb7854a3500 -1 osd.2 0 log_to_monitors true 2023-12-11T17:09:36.392 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T17:09:36.392+0000 7f5ab9621640 -1 osd.1 0 waiting for initial osdmap 2023-12-11T17:09:36.401 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T17:09:36.402+0000 7f5ab1448640 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-11T17:09:36.549 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T17:09:36.549+0000 7f690b267640 -1 osd.3 0 waiting for initial osdmap 2023-12-11T17:09:36.561 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T17:09:36.562+0000 7f690287a640 -1 osd.3 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-11T17:09:36.572 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T17:09:36.572+0000 7f8de73d5640 -1 osd.0 0 waiting for initial osdmap 2023-12-11T17:09:36.578 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T17:09:36.578+0000 7f8dde9e8640 -1 osd.0 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-11T17:09:36.670 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T17:09:36.670+0000 7fe9802f4640 -1 osd.4 0 waiting for initial osdmap 2023-12-11T17:09:36.683 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T17:09:36.683+0000 7fe97811b640 -1 osd.4 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-11T17:09:36.801 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T17:09:36.800+0000 7fdadea84640 -1 osd.7 0 waiting for initial osdmap 2023-12-11T17:09:36.804 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T17:09:36.804+0000 7efcd326f640 -1 osd.6 0 waiting for initial osdmap 2023-12-11T17:09:36.810 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T17:09:36.810+0000 7fdad68ab640 -1 osd.7 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-11T17:09:36.822 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T17:09:36.822+0000 7efccb096640 -1 osd.6 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-11T17:09:36.844 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T17:09:36.844+0000 7fb781431640 -1 osd.2 0 waiting for initial osdmap 2023-12-11T17:09:36.852 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T17:09:36.852+0000 7fb779258640 -1 osd.2 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-11T17:09:36.857 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T17:09:36.857+0000 7f0076a68640 -1 osd.5 0 waiting for initial osdmap 2023-12-11T17:09:36.863 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T17:09:36.863+0000 7f006e88f640 -1 osd.5 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-11T17:09:37.024 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-11T17:09:37.216 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.216+0000 7f948bfff640 1 Processor -- start 2023-12-11T17:09:37.216 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.216+0000 7f948bfff640 1 -- start start 2023-12-11T17:09:37.218 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.218+0000 7f948bfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f948c155720 0x7f948c070da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:37.218 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.218+0000 7f948bfff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c072150 con 0x7f948c15b7e0 2023-12-11T17:09:37.219 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.218+0000 7f948bfff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f948c0715d0 con 0x7f948c0cbd30 2023-12-11T17:09:37.219 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.218+0000 7f948bfff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0718b0 con 0x7f948c155720 2023-12-11T17:09:37.219 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.219+0000 7f9483fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f948c15b7e0 0x7f948c0cb620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:45728/0 (socket says 172.21.15.37:45728) 2023-12-11T17:09:37.219 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.219+0000 7f9483fff640 1 -- 172.21.15.37:0/514505199 learned_addr learned my addr 172.21.15.37:0/514505199 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:09:37.221 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.219+0000 7f948affd640 1 --2- 172.21.15.37:0/514505199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f948c155720 0x7f948c070da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:37.221 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.219+0000 7f948a7fc640 1 -- 172.21.15.37:0/514505199 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104765022 0 0) 0x7f948c072150 con 0x7f948c15b7e0 2023-12-11T17:09:37.221 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.219+0000 7f948a7fc640 1 -- 172.21.15.37:0/514505199 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9478003520 con 0x7f948c15b7e0 2023-12-11T17:09:37.221 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.220+0000 7f948a7fc640 1 -- 172.21.15.37:0/514505199 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3908663347 0 0) 0x7f9478003520 con 0x7f948c15b7e0 2023-12-11T17:09:37.221 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.220+0000 7f948a7fc640 1 -- 172.21.15.37:0/514505199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f948c155720 msgr2=0x7f948c070da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:37.221 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.220+0000 7f948a7fc640 1 --2- 172.21.15.37:0/514505199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f948c155720 0x7f948c070da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:37.221 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.220+0000 7f948a7fc640 1 -- 172.21.15.37:0/514505199 >> v1:172.21.15.151:6789/0 conn(0x7f948c0cbd30 legacy=0x7f948c06c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:37.221 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.220+0000 7f948a7fc640 1 -- 172.21.15.37:0/514505199 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c071b90 con 0x7f948c15b7e0 2023-12-11T17:09:37.221 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.220+0000 7f948a7fc640 1 -- 172.21.15.37:0/514505199 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f9474001670 con 0x7f948c15b7e0 2023-12-11T17:09:37.221 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.220+0000 7f948a7fc640 1 -- 172.21.15.37:0/514505199 >> v1:172.21.15.37:6789/0 conn(0x7f948c15b7e0 legacy=0x7f948c0cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:37.221 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.220+0000 7f948a7fc640 1 --2- 172.21.15.37:0/514505199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f948c155720 0x7f94780039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:37.222 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.220+0000 7f948a7fc640 1 --2- 172.21.15.37:0/514505199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9478003f20 0x7f94780047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:37.222 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.220+0000 7f948a7fc640 1 --2- 172.21.15.37:0/514505199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9478004d00 0x7f9478005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:37.222 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.220+0000 7f948a7fc640 1 -- 172.21.15.37:0/514505199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c0718b0 con 0x7f9478003f20 2023-12-11T17:09:37.222 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.220+0000 7f948a7fc640 1 -- 172.21.15.37:0/514505199 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f947800bb10 con 0x7f9478004d00 2023-12-11T17:09:37.222 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.220+0000 7f948a7fc640 1 -- 172.21.15.37:0/514505199 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f947800bcd0 con 0x7f948c155720 2023-12-11T17:09:37.222 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.220+0000 7f9483fff640 1 --2- 172.21.15.37:0/514505199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9478003f20 0x7f94780047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:37.222 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.220+0000 7f948affd640 1 --2- 172.21.15.37:0/514505199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f948c155720 0x7f94780039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:37.222 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.220+0000 7f948b7fe640 1 --2- 172.21.15.37:0/514505199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9478004d00 0x7f9478005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:37.222 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.221+0000 7f9483fff640 1 -- 172.21.15.37:0/514505199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f948c155720 msgr2=0x7f94780039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:37.222 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.221+0000 7f9483fff640 1 --2- 172.21.15.37:0/514505199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f948c155720 0x7f94780039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:37.222 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.221+0000 7f9483fff640 1 -- 172.21.15.37:0/514505199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9478004d00 msgr2=0x7f9478005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:37.222 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.221+0000 7f9483fff640 1 --2- 172.21.15.37:0/514505199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9478004d00 0x7f9478005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:37.222 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.221+0000 7f9483fff640 1 -- 172.21.15.37:0/514505199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9478003520 con 0x7f9478003f20 2023-12-11T17:09:37.223 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.222+0000 7f9483fff640 1 --2- 172.21.15.37:0/514505199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9478003f20 0x7f94780047c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f947400c240 tx=0x7f94780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a98a38d63d0caaf4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:37.223 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.222+0000 7f948a7fc640 1 -- 172.21.15.37:0/514505199 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9474005ad0 con 0x7f9478003f20 2023-12-11T17:09:37.223 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.222+0000 7f948a7fc640 1 -- 172.21.15.37:0/514505199 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9474005c30 con 0x7f9478003f20 2023-12-11T17:09:37.224 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.222+0000 7f948a7fc640 1 -- 172.21.15.37:0/514505199 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947402c8b0 con 0x7f9478003f20 2023-12-11T17:09:37.224 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.222+0000 7f948bfff640 1 -- 172.21.15.37:0/514505199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9478003f20 msgr2=0x7f94780047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:37.224 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.222+0000 7f948bfff640 1 --2- 172.21.15.37:0/514505199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9478003f20 0x7f94780047c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f947400c240 tx=0x7f94780057f0 comp rx=0 tx=0).stop 2023-12-11T17:09:37.224 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.222+0000 7f948b7fe640 1 -- 172.21.15.37:0/514505199 reap_dead start 2023-12-11T17:09:37.224 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.223+0000 7f948bfff640 1 -- 172.21.15.37:0/514505199 shutdown_connections 2023-12-11T17:09:37.224 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.223+0000 7f948bfff640 1 -- 172.21.15.37:0/514505199 >> 172.21.15.37:0/514505199 conn(0x7f948c0b0940 msgr2=0x7f948c0b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:37.224 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.223+0000 7f948bfff640 1 -- 172.21.15.37:0/514505199 shutdown_connections 2023-12-11T17:09:37.224 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.223+0000 7f948bfff640 1 -- 172.21.15.37:0/514505199 wait complete. 2023-12-11T17:09:37.224 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.224+0000 7f948bfff640 1 Processor -- start 2023-12-11T17:09:37.225 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.225+0000 7f948bfff640 1 -- start start 2023-12-11T17:09:37.227 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.225+0000 7f948bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9478003f20 0x7f948c158110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:37.227 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.225+0000 7f948bfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f948c0999f0 0x7f948c09b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:37.227 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.225+0000 7f948bfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f948c099e70 0x7f948c09ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:37.227 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.225+0000 7f948bfff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c158650 con 0x7f9478003f20 2023-12-11T17:09:37.227 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.225+0000 7f948bfff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f948c13be30 con 0x7f948c0999f0 2023-12-11T17:09:37.227 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.225+0000 7f948bfff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f948c09c3f0 con 0x7f948c099e70 2023-12-11T17:09:37.227 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.226+0000 7f948affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9478003f20 0x7f948c158110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:37.227 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.226+0000 7f948affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9478003f20 0x7f948c158110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40204/0 (socket says 172.21.15.37:40204) 2023-12-11T17:09:37.227 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.226+0000 7f948affd640 1 -- 172.21.15.37:0/2421895024 learned_addr learned my addr 172.21.15.37:0/2421895024 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:37.228 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.226+0000 7f948affd640 1 -- 172.21.15.37:0/2421895024 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f948c099e70 msgr2=0x7f948c09ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:37.228 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.226+0000 7f948affd640 1 --2- 172.21.15.37:0/2421895024 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f948c099e70 0x7f948c09ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:37.228 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.226+0000 7f948affd640 1 -- 172.21.15.37:0/2421895024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f948c0999f0 msgr2=0x7f948c09b4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:37.228 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.226+0000 7f948affd640 1 --2- 172.21.15.37:0/2421895024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f948c0999f0 0x7f948c09b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:37.228 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.226+0000 7f948affd640 1 -- 172.21.15.37:0/2421895024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f948c09c6d0 con 0x7f9478003f20 2023-12-11T17:09:37.228 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.226+0000 7f948affd640 1 --2- 172.21.15.37:0/2421895024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9478003f20 0x7f948c158110 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f947c011600 tx=0x7f947c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:37.228 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.227+0000 7f94837fe640 1 -- 172.21.15.37:0/2421895024 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c00f8c0 con 0x7f9478003f20 2023-12-11T17:09:37.228 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.227+0000 7f94837fe640 1 -- 172.21.15.37:0/2421895024 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f947c00fa20 con 0x7f9478003f20 2023-12-11T17:09:37.228 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.227+0000 7f94837fe640 1 -- 172.21.15.37:0/2421895024 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f947c00fd90 con 0x7f9478003f20 2023-12-11T17:09:37.228 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.227+0000 7f948bfff640 1 -- 172.21.15.37:0/2421895024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f948c09c9b0 con 0x7f9478003f20 2023-12-11T17:09:37.228 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.227+0000 7f948bfff640 1 -- 172.21.15.37:0/2421895024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f948c156050 con 0x7f9478003f20 2023-12-11T17:09:37.229 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.228+0000 7f948bfff640 1 -- 172.21.15.37:0/2421895024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f948c070220 con 0x7f9478003f20 2023-12-11T17:09:37.229 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.229+0000 7f94837fe640 1 -- 172.21.15.37:0/2421895024 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f947c015460 con 0x7f9478003f20 2023-12-11T17:09:37.230 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.230+0000 7f94837fe640 1 --2- 172.21.15.37:0/2421895024 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f946c06ae30 0x7f946c06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:37.230 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.230+0000 7f94837fe640 1 -- 172.21.15.37:0/2421895024 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2231+0+0 (secure 0 0 0) 0x7f947c089010 con 0x7f9478003f20 2023-12-11T17:09:37.231 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.231+0000 7f9483fff640 1 --2- 172.21.15.37:0/2421895024 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f946c06ae30 0x7f946c06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:37.232 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.232+0000 7f9483fff640 1 --2- 172.21.15.37:0/2421895024 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f946c06ae30 0x7f946c06d2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f947400c240 tx=0x7f9474007000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:37.237 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.237+0000 7f94837fe640 1 -- 172.21.15.37:0/2421895024 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f947c054f10 con 0x7f9478003f20 2023-12-11T17:09:37.463 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.463+0000 7f948bfff640 1 -- 172.21.15.37:0/2421895024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f948c0cfaa0 con 0x7f9478003f20 2023-12-11T17:09:37.464 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.464+0000 7f94837fe640 1 -- 172.21.15.37:0/2421895024 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10908 (secure 0 0 0) 0x7f947c058530 con 0x7f9478003f20 2023-12-11T17:09:37.464 INFO:teuthology.misc.health.smithi037.stdout: 2023-12-11T17:09:37.464 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":14,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:09:37.390393+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:09:37.466 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.466+0000 7f948bfff640 1 -- 172.21.15.37:0/2421895024 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f946c06ae30 msgr2=0x7f946c06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:37.467 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.466+0000 7f948bfff640 1 --2- 172.21.15.37:0/2421895024 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f946c06ae30 0x7f946c06d2f0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f947400c240 tx=0x7f9474007000 comp rx=0 tx=0).stop 2023-12-11T17:09:37.467 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.466+0000 7f948bfff640 1 -- 172.21.15.37:0/2421895024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9478003f20 msgr2=0x7f948c158110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:37.467 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.466+0000 7f948bfff640 1 --2- 172.21.15.37:0/2421895024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9478003f20 0x7f948c158110 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f947c011600 tx=0x7f947c011ac0 comp rx=0 tx=0).stop 2023-12-11T17:09:37.467 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.466+0000 7f948bfff640 1 -- 172.21.15.37:0/2421895024 shutdown_connections 2023-12-11T17:09:37.467 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.466+0000 7f948bfff640 1 --2- 172.21.15.37:0/2421895024 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f946c06ae30 0x7f946c06d2f0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:37.467 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.466+0000 7f948bfff640 1 --2- 172.21.15.37:0/2421895024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f948c0999f0 0x7f948c09b4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:37.467 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.466+0000 7f948bfff640 1 --2- 172.21.15.37:0/2421895024 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f948c099e70 0x7f948c09ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:37.467 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.466+0000 7f948bfff640 1 --2- 172.21.15.37:0/2421895024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9478003f20 0x7f948c158110 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:37.467 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.466+0000 7f948bfff640 1 -- 172.21.15.37:0/2421895024 >> 172.21.15.37:0/2421895024 conn(0x7f948c0b0940 msgr2=0x7f948c0ce390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:37.467 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.467+0000 7f948bfff640 1 -- 172.21.15.37:0/2421895024 shutdown_connections 2023-12-11T17:09:37.467 INFO:teuthology.misc.health.smithi037.stderr:2023-12-11T17:09:37.467+0000 7f948bfff640 1 -- 172.21.15.37:0/2421895024 wait complete. 2023-12-11T17:09:37.479 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-11T17:09:37.480 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-11T17:09:37.480 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-11T17:09:37.480 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-11T17:09:37.484 INFO:tasks.ceph.mds.a:Started 2023-12-11T17:09:37.484 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-11T17:09:37.484 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-11T17:09:37.489 INFO:tasks.ceph.mds.c:Started 2023-12-11T17:09:37.489 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-11T17:09:37.489 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-11T17:09:37.498 INFO:tasks.ceph.mds.b:Started 2023-12-11T17:09:37.498 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-11T17:09:37.498 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-11T17:09:37.506 INFO:tasks.ceph.mds.d:Started 2023-12-11T17:09:37.507 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-11T17:09:37.507 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:09:37.630 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-12-11T17:09:37.631 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-12-11T17:09:37.661 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-12-11T17:09:37.664 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-12-11T17:09:37.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.692+0000 7f3b8ec1e640 1 Processor -- start 2023-12-11T17:09:37.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.692+0000 7f3b8ec1e640 1 -- start start 2023-12-11T17:09:37.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.694+0000 7f3b8ec1e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3b88143e00 0x7f3b880b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:37.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.694+0000 7f3b8ec1e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b88072180 0x7f3b880b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:37.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.694+0000 7f3b8ec1e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b880b3bb0 con 0x7f3b8806c410 2023-12-11T17:09:37.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.694+0000 7f3b8ec1e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b881441e0 con 0x7f3b88143e00 2023-12-11T17:09:37.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.694+0000 7f3b8ec1e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b88072680 con 0x7f3b88072180 2023-12-11T17:09:37.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.694+0000 7f3b8c9ba640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3b88143e00 0x7f3b880b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:37.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.694+0000 7f3b8c9ba640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3b88143e00 0x7f3b880b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:58030/0 (socket says 172.21.15.37:58030) 2023-12-11T17:09:37.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.694+0000 7f3b8c9ba640 1 -- 172.21.15.37:0/1186602041 learned_addr learned my addr 172.21.15.37:0/1186602041 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:37.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.694+0000 7f3b8d1bb640 1 --1- 172.21.15.37:0/1186602041 >> v1:172.21.15.151:6789/0 conn(0x7f3b8806c410 0x7f3b88070690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.37:46656/0 (socket says 172.21.15.37:46656) 2023-12-11T17:09:37.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.694+0000 7f3b87fff640 1 --2- 172.21.15.37:0/1186602041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b88072180 0x7f3b880b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:37.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.695+0000 7f3b8c9ba640 1 -- 172.21.15.37:0/1186602041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b88072180 msgr2=0x7f3b880b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:37.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.695+0000 7f3b8c9ba640 1 --2- 172.21.15.37:0/1186602041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b88072180 0x7f3b880b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:37.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.695+0000 7f3b8c9ba640 1 -- 172.21.15.37:0/1186602041 >> v1:172.21.15.151:6789/0 conn(0x7f3b8806c410 legacy=0x7f3b88070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:37.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.695+0000 7f3b8c9ba640 1 -- 172.21.15.37:0/1186602041 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b880b1e30 con 0x7f3b88143e00 2023-12-11T17:09:37.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.695+0000 7f3b877fe640 1 -- 172.21.15.37:0/1186602041 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3202530472 0 0) 0x7f3b880b3bb0 con 0x7f3b8806c410 2023-12-11T17:09:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.696+0000 7f3b8c9ba640 1 --2- 172.21.15.37:0/1186602041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b88143e00 0x7f3b880b4040 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009e50 tx=0x7f3b7802bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=445ede704f40e91a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.696+0000 7f3b877fe640 1 -- 172.21.15.37:0/1186602041 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b7802cb00 con 0x7f3b88143e00 2023-12-11T17:09:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.696+0000 7f3b877fe640 1 -- 172.21.15.37:0/1186602041 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b7802cc60 con 0x7f3b88143e00 2023-12-11T17:09:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.696+0000 7f3b877fe640 1 -- 172.21.15.37:0/1186602041 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b780343f0 con 0x7f3b88143e00 2023-12-11T17:09:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.696+0000 7f3b8ec1e640 1 -- 172.21.15.37:0/1186602041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b88143e00 msgr2=0x7f3b880b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:37.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.696+0000 7f3b8ec1e640 1 --2- 172.21.15.37:0/1186602041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b88143e00 0x7f3b880b4040 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f3b78009e50 tx=0x7f3b7802bf60 comp rx=0 tx=0).stop 2023-12-11T17:09:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.697+0000 7f3b8ec1e640 1 -- 172.21.15.37:0/1186602041 shutdown_connections 2023-12-11T17:09:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.697+0000 7f3b8ec1e640 1 --2- 172.21.15.37:0/1186602041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b88072180 0x7f3b880b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.697+0000 7f3b8ec1e640 1 --2- 172.21.15.37:0/1186602041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b88143e00 0x7f3b880b4040 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.697+0000 7f3b8ec1e640 1 -- 172.21.15.37:0/1186602041 >> 172.21.15.37:0/1186602041 conn(0x7f3b880b0a90 msgr2=0x7f3b880b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.697+0000 7f3b8ec1e640 1 -- 172.21.15.37:0/1186602041 shutdown_connections 2023-12-11T17:09:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.697+0000 7f3b8ec1e640 1 -- 172.21.15.37:0/1186602041 wait complete. 2023-12-11T17:09:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.698+0000 7f3b8ec1e640 1 Processor -- start 2023-12-11T17:09:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.698+0000 7f3b8ec1e640 1 -- start start 2023-12-11T17:09:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.699+0000 7f3b8ec1e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b8806c410 0x7f3b8813c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:37.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.699+0000 7f3b8ec1e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b88072180 0x7f3b8815f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:37.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.699+0000 7f3b8ec1e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b88143e00 0x7f3b8813ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:37.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.699+0000 7f3b8ec1e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b881f17d0 con 0x7f3b88143e00 2023-12-11T17:09:37.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.699+0000 7f3b8ec1e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b881f1480 con 0x7f3b8806c410 2023-12-11T17:09:37.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.699+0000 7f3b8ec1e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b8813cc00 con 0x7f3b88072180 2023-12-11T17:09:37.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.700+0000 7f3b8d1bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b88143e00 0x7f3b8813ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:37.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.700+0000 7f3b87fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b88072180 0x7f3b8815f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:37.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.700+0000 7f3b8d1bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b88143e00 0x7f3b8813ec30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40262/0 (socket says 172.21.15.37:40262) 2023-12-11T17:09:37.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.700+0000 7f3b8d1bb640 1 -- 172.21.15.37:0/2042333843 learned_addr learned my addr 172.21.15.37:0/2042333843 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:37.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.700+0000 7f3b8c9ba640 1 --2- 172.21.15.37:0/2042333843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b8806c410 0x7f3b8813c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:37.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.700+0000 7f3b8d1bb640 1 -- 172.21.15.37:0/2042333843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b88072180 msgr2=0x7f3b8815f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:37.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.700+0000 7f3b8d1bb640 1 --2- 172.21.15.37:0/2042333843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b88072180 0x7f3b8815f800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:37.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.700+0000 7f3b8d1bb640 1 -- 172.21.15.37:0/2042333843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b8806c410 msgr2=0x7f3b8813c620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:37.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.700+0000 7f3b8d1bb640 1 --2- 172.21.15.37:0/2042333843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b8806c410 0x7f3b8813c620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:37.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.700+0000 7f3b8d1bb640 1 -- 172.21.15.37:0/2042333843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b78009b30 con 0x7f3b88143e00 2023-12-11T17:09:37.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.700+0000 7f3b8d1bb640 1 --2- 172.21.15.37:0/2042333843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b88143e00 0x7f3b8813ec30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3b80001eb0 tx=0x7f3b8000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:37.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.701+0000 7f3b857fa640 1 -- 172.21.15.37:0/2042333843 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b800074e0 con 0x7f3b88143e00 2023-12-11T17:09:37.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.701+0000 7f3b857fa640 1 -- 172.21.15.37:0/2042333843 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b80007640 con 0x7f3b88143e00 2023-12-11T17:09:37.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.701+0000 7f3b857fa640 1 -- 172.21.15.37:0/2042333843 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b80004a00 con 0x7f3b88143e00 2023-12-11T17:09:37.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.701+0000 7f3b8ec1e640 1 -- 172.21.15.37:0/2042333843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b8813cee0 con 0x7f3b88143e00 2023-12-11T17:09:37.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.701+0000 7f3b8ec1e640 1 -- 172.21.15.37:0/2042333843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b8813f170 con 0x7f3b88143e00 2023-12-11T17:09:37.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.702+0000 7f3b8ec1e640 1 -- 172.21.15.37:0/2042333843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b880cb5e0 con 0x7f3b88143e00 2023-12-11T17:09:37.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.703+0000 7f3b857fa640 1 -- 172.21.15.37:0/2042333843 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f3b80004b60 con 0x7f3b88143e00 2023-12-11T17:09:37.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.704+0000 7f3b857fa640 1 --2- 172.21.15.37:0/2042333843 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3b6806adb0 0x7f3b6806d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:37.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.704+0000 7f3b857fa640 1 -- 172.21.15.37:0/2042333843 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7f3b80088cd0 con 0x7f3b88143e00 2023-12-11T17:09:37.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.704+0000 7f3b8c9ba640 1 --2- 172.21.15.37:0/2042333843 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3b6806adb0 0x7f3b6806d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:37.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.705+0000 7f3b8c9ba640 1 --2- 172.21.15.37:0/2042333843 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3b6806adb0 0x7f3b6806d270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3b78035000 tx=0x7f3b78030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:37.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.709+0000 7f3b857fa640 1 -- 172.21.15.37:0/2042333843 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3b800543d0 con 0x7f3b88143e00 2023-12-11T17:09:37.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.912+0000 7f3b8ec1e640 1 -- 172.21.15.37:0/2042333843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3b880af3b0 con 0x7f3b88143e00 2023-12-11T17:09:37.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.913+0000 7f3b857fa640 1 -- 172.21.15.37:0/2042333843 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+10908 (secure 0 0 0) 0x7f3b800579f0 con 0x7f3b88143e00 2023-12-11T17:09:37.913 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:09:37.913 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":14,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:09:37.390393+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:09:37.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.915+0000 7f3b8ec1e640 1 -- 172.21.15.37:0/2042333843 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3b6806adb0 msgr2=0x7f3b6806d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:37.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.915+0000 7f3b8ec1e640 1 --2- 172.21.15.37:0/2042333843 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3b6806adb0 0x7f3b6806d270 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3b78035000 tx=0x7f3b78030000 comp rx=0 tx=0).stop 2023-12-11T17:09:37.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.915+0000 7f3b8ec1e640 1 -- 172.21.15.37:0/2042333843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b88143e00 msgr2=0x7f3b8813ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:37.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.915+0000 7f3b8ec1e640 1 --2- 172.21.15.37:0/2042333843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b88143e00 0x7f3b8813ec30 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f3b80001eb0 tx=0x7f3b8000c870 comp rx=0 tx=0).stop 2023-12-11T17:09:37.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.916+0000 7f3b8ec1e640 1 -- 172.21.15.37:0/2042333843 shutdown_connections 2023-12-11T17:09:37.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.916+0000 7f3b8ec1e640 1 --2- 172.21.15.37:0/2042333843 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3b6806adb0 0x7f3b6806d270 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:37.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.916+0000 7f3b8ec1e640 1 --2- 172.21.15.37:0/2042333843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b88143e00 0x7f3b8813ec30 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:37.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.916+0000 7f3b8ec1e640 1 --2- 172.21.15.37:0/2042333843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b88072180 0x7f3b8815f800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:37.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.916+0000 7f3b8ec1e640 1 --2- 172.21.15.37:0/2042333843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b8806c410 0x7f3b8813c620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:37.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.916+0000 7f3b8ec1e640 1 -- 172.21.15.37:0/2042333843 >> 172.21.15.37:0/2042333843 conn(0x7f3b880b0a90 msgr2=0x7f3b880af610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:37.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.916+0000 7f3b8ec1e640 1 -- 172.21.15.37:0/2042333843 shutdown_connections 2023-12-11T17:09:37.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:37.916+0000 7f3b8ec1e640 1 -- 172.21.15.37:0/2042333843 wait complete. 2023-12-11T17:09:37.934 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-12-11T17:09:37.934 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T17:09:38.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.152+0000 7ff93601e640 1 Processor -- start 2023-12-11T17:09:38.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.152+0000 7ff93601e640 1 -- start start 2023-12-11T17:09:38.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.153+0000 7ff93601e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff930072180 0x7ff9300b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:38.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.153+0000 7ff93601e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff93006c410 0x7ff93015ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:38.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.153+0000 7ff93601e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9300b3bb0 con 0x7ff930143e00 2023-12-11T17:09:38.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.153+0000 7ff93601e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9301441e0 con 0x7ff930072180 2023-12-11T17:09:38.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.153+0000 7ff93601e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff930072680 con 0x7ff93006c410 2023-12-11T17:09:38.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.154+0000 7ff92effd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff930072180 0x7ff9300b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:38.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.154+0000 7ff92effd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff930072180 0x7ff9300b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:58042/0 (socket says 172.21.15.37:58042) 2023-12-11T17:09:38.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.154+0000 7ff92effd640 1 -- 172.21.15.37:0/3734103778 learned_addr learned my addr 172.21.15.37:0/3734103778 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:38.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.154+0000 7ff92ffff640 1 --2- 172.21.15.37:0/3734103778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff93006c410 0x7ff93015ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:38.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.155+0000 7ff92effd640 1 -- 172.21.15.37:0/3734103778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff93006c410 msgr2=0x7ff93015ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:38.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.155+0000 7ff92effd640 1 --2- 172.21.15.37:0/3734103778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff93006c410 0x7ff93015ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:38.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.155+0000 7ff92effd640 1 -- 172.21.15.37:0/3734103778 >> v1:172.21.15.151:6789/0 conn(0x7ff930143e00 legacy=0x7ff9300b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:38.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.155+0000 7ff92effd640 1 -- 172.21.15.37:0/3734103778 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9300b1e30 con 0x7ff930072180 2023-12-11T17:09:38.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.156+0000 7ff92effd640 1 --2- 172.21.15.37:0/3734103778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff930072180 0x7ff9300b4750 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff918009870 tx=0x7ff91802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b914c523a0e53372 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:38.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.156+0000 7ff92e7fc640 1 -- 172.21.15.37:0/3734103778 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918030840 con 0x7ff930072180 2023-12-11T17:09:38.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.156+0000 7ff92e7fc640 1 -- 172.21.15.37:0/3734103778 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9180309a0 con 0x7ff930072180 2023-12-11T17:09:38.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.156+0000 7ff92e7fc640 1 -- 172.21.15.37:0/3734103778 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff918030d30 con 0x7ff930072180 2023-12-11T17:09:38.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.157+0000 7ff93601e640 1 -- 172.21.15.37:0/3734103778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff930072180 msgr2=0x7ff9300b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:38.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.157+0000 7ff93601e640 1 --2- 172.21.15.37:0/3734103778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff930072180 0x7ff9300b4750 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ff918009870 tx=0x7ff91802b980 comp rx=0 tx=0).stop 2023-12-11T17:09:38.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.157+0000 7ff93601e640 1 -- 172.21.15.37:0/3734103778 shutdown_connections 2023-12-11T17:09:38.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.157+0000 7ff93601e640 1 --2- 172.21.15.37:0/3734103778 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff93006c410 0x7ff93015ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:38.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.157+0000 7ff93601e640 1 --2- 172.21.15.37:0/3734103778 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff930072180 0x7ff9300b4750 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:38.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.157+0000 7ff93601e640 1 -- 172.21.15.37:0/3734103778 >> 172.21.15.37:0/3734103778 conn(0x7ff9300b0a90 msgr2=0x7ff9300b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:38.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.157+0000 7ff93601e640 1 -- 172.21.15.37:0/3734103778 shutdown_connections 2023-12-11T17:09:38.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.157+0000 7ff93601e640 1 -- 172.21.15.37:0/3734103778 wait complete. 2023-12-11T17:09:38.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.159+0000 7ff93601e640 1 Processor -- start 2023-12-11T17:09:38.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.159+0000 7ff93601e640 1 -- start start 2023-12-11T17:09:38.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.160+0000 7ff93601e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff93006c410 0x7ff930139960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:38.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.160+0000 7ff93601e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff930072180 0x7ff930135b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:38.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.160+0000 7ff93601e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff930143e00 0x7ff93013e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:38.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.160+0000 7ff93601e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff930137020 con 0x7ff93006c410 2023-12-11T17:09:38.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.160+0000 7ff93601e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff930139ea0 con 0x7ff930072180 2023-12-11T17:09:38.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.160+0000 7ff93601e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff930136550 con 0x7ff930143e00 2023-12-11T17:09:38.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.160+0000 7ff92f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff93006c410 0x7ff930139960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:38.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.160+0000 7ff92f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff93006c410 0x7ff930139960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40276/0 (socket says 172.21.15.37:40276) 2023-12-11T17:09:38.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.160+0000 7ff92f7fe640 1 -- 172.21.15.37:0/516551958 learned_addr learned my addr 172.21.15.37:0/516551958 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:38.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.161+0000 7ff92ffff640 1 --2- 172.21.15.37:0/516551958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff930143e00 0x7ff93013e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:38.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.161+0000 7ff92effd640 1 --2- 172.21.15.37:0/516551958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff930072180 0x7ff930135b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:38.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.161+0000 7ff92f7fe640 1 -- 172.21.15.37:0/516551958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff930143e00 msgr2=0x7ff93013e6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:38.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.161+0000 7ff92f7fe640 1 --2- 172.21.15.37:0/516551958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff930143e00 0x7ff93013e6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:38.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.161+0000 7ff92f7fe640 1 -- 172.21.15.37:0/516551958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff930072180 msgr2=0x7ff930135b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:38.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.161+0000 7ff92f7fe640 1 --2- 172.21.15.37:0/516551958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff930072180 0x7ff930135b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:38.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.161+0000 7ff92f7fe640 1 -- 172.21.15.37:0/516551958 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9180094d0 con 0x7ff93006c410 2023-12-11T17:09:38.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.161+0000 7ff92f7fe640 1 --2- 172.21.15.37:0/516551958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff93006c410 0x7ff930139960 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff92000c400 tx=0x7ff92000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:38.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.161+0000 7ff927fff640 1 -- 172.21.15.37:0/516551958 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9200052d0 con 0x7ff93006c410 2023-12-11T17:09:38.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.161+0000 7ff927fff640 1 -- 172.21.15.37:0/516551958 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff920005430 con 0x7ff93006c410 2023-12-11T17:09:38.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.161+0000 7ff93601e640 1 -- 172.21.15.37:0/516551958 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff930136830 con 0x7ff93006c410 2023-12-11T17:09:38.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.161+0000 7ff927fff640 1 -- 172.21.15.37:0/516551958 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff920003830 con 0x7ff93006c410 2023-12-11T17:09:38.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.162+0000 7ff93601e640 1 -- 172.21.15.37:0/516551958 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff930136b10 con 0x7ff93006c410 2023-12-11T17:09:38.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.163+0000 7ff93601e640 1 -- 172.21.15.37:0/516551958 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9300745d0 con 0x7ff93006c410 2023-12-11T17:09:38.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.164+0000 7ff927fff640 1 -- 172.21.15.37:0/516551958 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7ff920003990 con 0x7ff93006c410 2023-12-11T17:09:38.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.164+0000 7ff927fff640 1 --2- 172.21.15.37:0/516551958 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff91006adb0 0x7ff91006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:38.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.165+0000 7ff927fff640 1 -- 172.21.15.37:0/516551958 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 4471+0+0 (secure 0 0 0) 0x7ff920088650 con 0x7ff93006c410 2023-12-11T17:09:38.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.165+0000 7ff92effd640 1 --2- 172.21.15.37:0/516551958 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff91006adb0 0x7ff91006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:38.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.166+0000 7ff92effd640 1 --2- 172.21.15.37:0/516551958 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff91006adb0 0x7ff91006d270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff918036000 tx=0x7ff918008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:38.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.169+0000 7ff927fff640 1 -- 172.21.15.37:0/516551958 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff920053c10 con 0x7ff93006c410 2023-12-11T17:09:38.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.393+0000 7ff93601e640 1 -- 172.21.15.37:0/516551958 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff9300ce8e0 con 0x7ff93006c410 2023-12-11T17:09:38.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.416+0000 7ff927fff640 1 -- 172.21.15.37:0/516551958 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1324 (secure 0 0 0) 0x7ff920017090 con 0x7ff93006c410 2023-12-11T17:09:38.416 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:09:38.416 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2590175074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2590175074},{"type":"v1","addr":"172.21.15.37:6833","nonce":2590175074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[]} 2023-12-11T17:09:38.416 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 2 2023-12-11T17:09:38.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.418+0000 7ff93601e640 1 -- 172.21.15.37:0/516551958 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff91006adb0 msgr2=0x7ff91006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:38.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.418+0000 7ff93601e640 1 --2- 172.21.15.37:0/516551958 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff91006adb0 0x7ff91006d270 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff918036000 tx=0x7ff918008030 comp rx=0 tx=0).stop 2023-12-11T17:09:38.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.418+0000 7ff93601e640 1 -- 172.21.15.37:0/516551958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff93006c410 msgr2=0x7ff930139960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:38.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.418+0000 7ff93601e640 1 --2- 172.21.15.37:0/516551958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff93006c410 0x7ff930139960 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff92000c400 tx=0x7ff92000c8c0 comp rx=0 tx=0).stop 2023-12-11T17:09:38.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.419+0000 7ff93601e640 1 -- 172.21.15.37:0/516551958 shutdown_connections 2023-12-11T17:09:38.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.419+0000 7ff93601e640 1 --2- 172.21.15.37:0/516551958 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff91006adb0 0x7ff91006d270 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:38.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.419+0000 7ff93601e640 1 --2- 172.21.15.37:0/516551958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff930072180 0x7ff930135b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:38.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.419+0000 7ff93601e640 1 --2- 172.21.15.37:0/516551958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff930143e00 0x7ff93013e6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:38.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.419+0000 7ff93601e640 1 --2- 172.21.15.37:0/516551958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff93006c410 0x7ff930139960 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:38.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.419+0000 7ff93601e640 1 -- 172.21.15.37:0/516551958 >> 172.21.15.37:0/516551958 conn(0x7ff9300b0a90 msgr2=0x7ff9300af350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:38.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.419+0000 7ff93601e640 1 -- 172.21.15.37:0/516551958 shutdown_connections 2023-12-11T17:09:38.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:38.419+0000 7ff93601e640 1 -- 172.21.15.37:0/516551958 wait complete. 2023-12-11T17:09:39.078 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:09:39.087 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:09:40.439 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T17:09:40.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.671+0000 7f0ef087c640 1 Processor -- start 2023-12-11T17:09:40.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.672+0000 7f0ef087c640 1 -- start start 2023-12-11T17:09:40.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.673+0000 7f0ef087c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f0eec157a60 0x7f0eec06c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:40.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.673+0000 7f0ef087c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0eec06de20 0x7f0eec15dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:40.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.673+0000 7f0ef087c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0eec06ca40 con 0x7f0eec15e0e0 2023-12-11T17:09:40.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.673+0000 7f0ef087c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0eec15e550 con 0x7f0eec157a60 2023-12-11T17:09:40.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.673+0000 7f0ef087c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec071cd0 con 0x7f0eec06de20 2023-12-11T17:09:40.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.673+0000 7f0eead9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0eec15e0e0 0x7f0eec15a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60574/0 (socket says 172.21.15.37:60574) 2023-12-11T17:09:40.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.673+0000 7f0eead9d640 1 -- 172.21.15.37:0/1201070075 learned_addr learned my addr 172.21.15.37:0/1201070075 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:09:40.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.674+0000 7f0eea59c640 1 --2- 172.21.15.37:0/1201070075 >> v2:172.21.15.151:3300/0 conn(0x7f0eec157a60 0x7f0eec06c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:40.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.674+0000 7f0ee3fff640 1 --2- 172.21.15.37:0/1201070075 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0eec06de20 0x7f0eec15dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:40.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.674+0000 7f0eea59c640 1 -- 172.21.15.37:0/1201070075 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0eec06de20 msgr2=0x7f0eec15dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:40.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.674+0000 7f0eea59c640 1 --2- 172.21.15.37:0/1201070075 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0eec06de20 0x7f0eec15dba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:40.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.674+0000 7f0eea59c640 1 -- 172.21.15.37:0/1201070075 >> v1:172.21.15.37:6789/0 conn(0x7f0eec15e0e0 legacy=0x7f0eec15a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:40.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.674+0000 7f0eea59c640 1 -- 172.21.15.37:0/1201070075 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0eec070f10 con 0x7f0eec157a60 2023-12-11T17:09:40.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.676+0000 7f0eea59c640 1 --2- 172.21.15.37:0/1201070075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0eec157a60 0x7f0eec06c410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0edc0097a0 tx=0x7f0edc02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=21cce7fd9ff332c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:40.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.679+0000 7f0ee9d9b640 1 -- 172.21.15.37:0/1201070075 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc02e070 con 0x7f0eec157a60 2023-12-11T17:09:40.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.679+0000 7f0ee9d9b640 1 -- 172.21.15.37:0/1201070075 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc0315a0 con 0x7f0eec157a60 2023-12-11T17:09:40.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.679+0000 7f0ee9d9b640 1 -- 172.21.15.37:0/1201070075 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc031930 con 0x7f0eec157a60 2023-12-11T17:09:40.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.679+0000 7f0ef087c640 1 -- 172.21.15.37:0/1201070075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0eec157a60 msgr2=0x7f0eec06c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:40.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.679+0000 7f0ef087c640 1 --2- 172.21.15.37:0/1201070075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0eec157a60 0x7f0eec06c410 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0edc0097a0 tx=0x7f0edc02b840 comp rx=0 tx=0).stop 2023-12-11T17:09:40.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.680+0000 7f0ef087c640 1 -- 172.21.15.37:0/1201070075 shutdown_connections 2023-12-11T17:09:40.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.680+0000 7f0ef087c640 1 --2- 172.21.15.37:0/1201070075 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0eec06de20 0x7f0eec15dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:40.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.680+0000 7f0ef087c640 1 --2- 172.21.15.37:0/1201070075 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0eec157a60 0x7f0eec06c410 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:40.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.680+0000 7f0ef087c640 1 -- 172.21.15.37:0/1201070075 >> 172.21.15.37:0/1201070075 conn(0x7f0eec0b0a90 msgr2=0x7f0eec0b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:40.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.680+0000 7f0ef087c640 1 -- 172.21.15.37:0/1201070075 shutdown_connections 2023-12-11T17:09:40.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.680+0000 7f0ef087c640 1 -- 172.21.15.37:0/1201070075 wait complete. 2023-12-11T17:09:40.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.682+0000 7f0ef087c640 1 Processor -- start 2023-12-11T17:09:40.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.682+0000 7f0ef087c640 1 -- start start 2023-12-11T17:09:40.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.683+0000 7f0ef087c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eec06de20 0x7f0eec0b4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:40.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.683+0000 7f0ef087c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0eec157a60 0x7f0eec14e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:40.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.683+0000 7f0ef087c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0eec15e0e0 0x7f0eec0b2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:40.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.683+0000 7f0ef087c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec0b32b0 con 0x7f0eec06de20 2023-12-11T17:09:40.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.683+0000 7f0ef087c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec0b3590 con 0x7f0eec157a60 2023-12-11T17:09:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.683+0000 7f0ef087c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0eec0b3870 con 0x7f0eec15e0e0 2023-12-11T17:09:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.684+0000 7f0eea59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eec06de20 0x7f0eec0b4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.684+0000 7f0eea59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eec06de20 0x7f0eec0b4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45432/0 (socket says 172.21.15.37:45432) 2023-12-11T17:09:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.684+0000 7f0eea59c640 1 -- 172.21.15.37:0/426790530 learned_addr learned my addr 172.21.15.37:0/426790530 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.684+0000 7f0ee3fff640 1 --2- 172.21.15.37:0/426790530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0eec157a60 0x7f0eec14e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.684+0000 7f0eead9d640 1 --2- 172.21.15.37:0/426790530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0eec15e0e0 0x7f0eec0b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:40.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.684+0000 7f0eea59c640 1 -- 172.21.15.37:0/426790530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0eec15e0e0 msgr2=0x7f0eec0b2830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:40.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.684+0000 7f0eea59c640 1 --2- 172.21.15.37:0/426790530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0eec15e0e0 0x7f0eec0b2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:40.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.684+0000 7f0eea59c640 1 -- 172.21.15.37:0/426790530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0eec157a60 msgr2=0x7f0eec14e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:40.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.684+0000 7f0eea59c640 1 --2- 172.21.15.37:0/426790530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0eec157a60 0x7f0eec14e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:40.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.684+0000 7f0eea59c640 1 -- 172.21.15.37:0/426790530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0edc009400 con 0x7f0eec06de20 2023-12-11T17:09:40.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.684+0000 7f0eea59c640 1 --2- 172.21.15.37:0/426790530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eec06de20 0x7f0eec0b4350 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0edc034040 tx=0x7f0edc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:40.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.685+0000 7f0ee2ffd640 1 -- 172.21.15.37:0/426790530 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc032840 con 0x7f0eec06de20 2023-12-11T17:09:40.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.685+0000 7f0ee2ffd640 1 -- 172.21.15.37:0/426790530 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0edc031f00 con 0x7f0eec06de20 2023-12-11T17:09:40.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.685+0000 7f0ee2ffd640 1 -- 172.21.15.37:0/426790530 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0edc032be0 con 0x7f0eec06de20 2023-12-11T17:09:40.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.685+0000 7f0ef087c640 1 -- 172.21.15.37:0/426790530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0eec0b3b50 con 0x7f0eec06de20 2023-12-11T17:09:40.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.685+0000 7f0ef087c640 1 -- 172.21.15.37:0/426790530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0eec14ecf0 con 0x7f0eec06de20 2023-12-11T17:09:40.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.686+0000 7f0ef087c640 1 -- 172.21.15.37:0/426790530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0eec0b4070 con 0x7f0eec06de20 2023-12-11T17:09:40.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.687+0000 7f0ee2ffd640 1 -- 172.21.15.37:0/426790530 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f0edc032d40 con 0x7f0eec06de20 2023-12-11T17:09:40.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.688+0000 7f0ee2ffd640 1 --2- 172.21.15.37:0/426790530 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f0ecc06adb0 0x7f0ecc06d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:40.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.688+0000 7f0ee2ffd640 1 -- 172.21.15.37:0/426790530 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0edc0ab090 con 0x7f0eec06de20 2023-12-11T17:09:40.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.688+0000 7f0ee3fff640 1 --2- 172.21.15.37:0/426790530 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f0ecc06adb0 0x7f0ecc06d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:40.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.690+0000 7f0ee3fff640 1 --2- 172.21.15.37:0/426790530 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f0ecc06adb0 0x7f0ecc06d270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0723b0 tx=0x7f0ed4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:40.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.697+0000 7f0ee2ffd640 1 -- 172.21.15.37:0/426790530 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0eec0b4070 con 0x7f0eec06de20 2023-12-11T17:09:40.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.943+0000 7f0ef087c640 1 -- 172.21.15.37:0/426790530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0eec0b4070 con 0x7f0eec06de20 2023-12-11T17:09:40.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.944+0000 7f0ee2ffd640 1 -- 172.21.15.37:0/426790530 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3700 (secure 0 0 0) 0x7f0eec0b4070 con 0x7f0eec06de20 2023-12-11T17:09:40.944 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:09:40.944 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2395601865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2395601865},{"type":"v1","addr":"172.21.15.151:6835","nonce":2395601865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1535809271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1535809271},{"type":"v1","addr":"172.21.15.151:6837","nonce":1535809271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2590175074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2590175074},{"type":"v1","addr":"172.21.15.37:6833","nonce":2590175074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2},{"gid":4251,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/2348606057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2348606057},{"type":"v1","addr":"172.21.15.37:6835","nonce":2348606057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3}],"filesystems":[]} 2023-12-11T17:09:40.944 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 3 2023-12-11T17:09:40.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.946+0000 7f0ef087c640 1 -- 172.21.15.37:0/426790530 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f0ecc06adb0 msgr2=0x7f0ecc06d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:40.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.946+0000 7f0ef087c640 1 --2- 172.21.15.37:0/426790530 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f0ecc06adb0 0x7f0ecc06d270 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0eec0723b0 tx=0x7f0ed4008040 comp rx=0 tx=0).stop 2023-12-11T17:09:40.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.946+0000 7f0ef087c640 1 -- 172.21.15.37:0/426790530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eec06de20 msgr2=0x7f0eec0b4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:40.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.946+0000 7f0ef087c640 1 --2- 172.21.15.37:0/426790530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eec06de20 0x7f0eec0b4350 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f0edc034040 tx=0x7f0edc0046c0 comp rx=0 tx=0).stop 2023-12-11T17:09:40.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.946+0000 7f0ef087c640 1 -- 172.21.15.37:0/426790530 shutdown_connections 2023-12-11T17:09:40.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.946+0000 7f0ef087c640 1 --2- 172.21.15.37:0/426790530 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f0ecc06adb0 0x7f0ecc06d270 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:40.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.946+0000 7f0ef087c640 1 --2- 172.21.15.37:0/426790530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0eec157a60 0x7f0eec14e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:40.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.946+0000 7f0ef087c640 1 --2- 172.21.15.37:0/426790530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0eec15e0e0 0x7f0eec0b2830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:40.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.946+0000 7f0ef087c640 1 --2- 172.21.15.37:0/426790530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0eec06de20 0x7f0eec0b4350 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:40.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.946+0000 7f0ef087c640 1 -- 172.21.15.37:0/426790530 >> 172.21.15.37:0/426790530 conn(0x7f0eec0b0a90 msgr2=0x7f0eec15d910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:40.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.947+0000 7f0ef087c640 1 -- 172.21.15.37:0/426790530 shutdown_connections 2023-12-11T17:09:40.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:40.947+0000 7f0ef087c640 1 -- 172.21.15.37:0/426790530 wait complete. 2023-12-11T17:09:40.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:09:41.170 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.170+0000 7fb9dcdc5640 1 Processor -- start 2023-12-11T17:09:41.171 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.170+0000 7fb9dcdc5640 1 -- start start 2023-12-11T17:09:41.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.172+0000 7fb9dcdc5640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fb9d80cfb20 0x7fb9d80cff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:41.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.172+0000 7fb9dcdc5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d80d04a0 con 0x7fb9d815cd60 2023-12-11T17:09:41.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.172+0000 7fb9dcdc5640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d815dd60 con 0x7fb9d81609b0 2023-12-11T17:09:41.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.172+0000 7fb9dcdc5640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9d8160d90 con 0x7fb9d80cfb20 2023-12-11T17:09:41.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.172+0000 7fb9d6d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb9d815cd60 0x7fb9d815d1b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60582/0 (socket says 172.21.15.37:60582) 2023-12-11T17:09:41.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.172+0000 7fb9d6d9d640 1 -- 172.21.15.37:0/2218154605 learned_addr learned my addr 172.21.15.37:0/2218154605 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:09:41.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.172+0000 7fb9cffff640 1 --2- 172.21.15.37:0/2218154605 >> v2:172.21.15.151:3300/0 conn(0x7fb9d80cfb20 0x7fb9d80cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:41.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.173+0000 7fb9d5d9b640 1 -- 172.21.15.37:0/2218154605 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 711949640 0 0) 0x7fb9d80d04a0 con 0x7fb9d815cd60 2023-12-11T17:09:41.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.173+0000 7fb9d5d9b640 1 -- 172.21.15.37:0/2218154605 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9c4003520 con 0x7fb9d815cd60 2023-12-11T17:09:41.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.173+0000 7fb9d5d9b640 1 -- 172.21.15.37:0/2218154605 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1906097235 0 0) 0x7fb9c4003520 con 0x7fb9d815cd60 2023-12-11T17:09:41.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.173+0000 7fb9d5d9b640 1 -- 172.21.15.37:0/2218154605 >> v2:172.21.15.151:3300/0 conn(0x7fb9d80cfb20 msgr2=0x7fb9d80cff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:41.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.173+0000 7fb9d5d9b640 1 --2- 172.21.15.37:0/2218154605 >> v2:172.21.15.151:3300/0 conn(0x7fb9d80cfb20 0x7fb9d80cff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:41.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.173+0000 7fb9d5d9b640 1 -- 172.21.15.37:0/2218154605 >> v1:172.21.15.151:6789/0 conn(0x7fb9d81609b0 legacy=0x7fb9d80d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:41.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.173+0000 7fb9d5d9b640 1 -- 172.21.15.37:0/2218154605 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d815e040 con 0x7fb9d815cd60 2023-12-11T17:09:41.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.173+0000 7fb9d5d9b640 1 -- 172.21.15.37:0/2218154605 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7fb9d00019f0 con 0x7fb9d815cd60 2023-12-11T17:09:41.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.173+0000 7fb9d5d9b640 1 -- 172.21.15.37:0/2218154605 >> v1:172.21.15.37:6789/0 conn(0x7fb9d815cd60 legacy=0x7fb9d815d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:41.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.173+0000 7fb9d5d9b640 1 --2- 172.21.15.37:0/2218154605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9c40039c0 0x7fb9c4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:41.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.173+0000 7fb9d5d9b640 1 --2- 172.21.15.37:0/2218154605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9c40047c0 0x7fb9c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:41.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.173+0000 7fb9d5d9b640 1 --2- 172.21.15.37:0/2218154605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9c4005180 0x7fb9c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:41.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.173+0000 7fb9d5d9b640 1 -- 172.21.15.37:0/2218154605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d8160d90 con 0x7fb9c40047c0 2023-12-11T17:09:41.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.173+0000 7fb9d5d9b640 1 -- 172.21.15.37:0/2218154605 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c400c080 con 0x7fb9c40039c0 2023-12-11T17:09:41.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.173+0000 7fb9d5d9b640 1 -- 172.21.15.37:0/2218154605 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c400c240 con 0x7fb9c4005180 2023-12-11T17:09:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.174+0000 7fb9cffff640 1 --2- 172.21.15.37:0/2218154605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9c40047c0 0x7fb9c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.174+0000 7fb9d659c640 1 --2- 172.21.15.37:0/2218154605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9c40039c0 0x7fb9c4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.174+0000 7fb9d6d9d640 1 --2- 172.21.15.37:0/2218154605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9c4005180 0x7fb9c400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.174+0000 7fb9cffff640 1 -- 172.21.15.37:0/2218154605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9c4005180 msgr2=0x7fb9c400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.174+0000 7fb9cffff640 1 --2- 172.21.15.37:0/2218154605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9c4005180 0x7fb9c400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.174+0000 7fb9cffff640 1 -- 172.21.15.37:0/2218154605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9c40039c0 msgr2=0x7fb9c4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.174+0000 7fb9cffff640 1 --2- 172.21.15.37:0/2218154605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9c40039c0 0x7fb9c4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:41.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.174+0000 7fb9cffff640 1 -- 172.21.15.37:0/2218154605 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c4003520 con 0x7fb9c40047c0 2023-12-11T17:09:41.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.174+0000 7fb9d659c640 1 --2- 172.21.15.37:0/2218154605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9c40039c0 0x7fb9c4003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:09:41.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.174+0000 7fb9d6d9d640 1 --2- 172.21.15.37:0/2218154605 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9c4005180 0x7fb9c400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:09:41.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.174+0000 7fb9d6d9d640 1 -- 172.21.15.37:0/2218154605 reap_dead start 2023-12-11T17:09:41.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.176+0000 7fb9cffff640 1 --2- 172.21.15.37:0/2218154605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9c40047c0 0x7fb9c4004c40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0009ac0 tx=0x7fb9c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d79a55b04c92641 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:41.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.176+0000 7fb9d5d9b640 1 -- 172.21.15.37:0/2218154605 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c002c6b0 con 0x7fb9c40047c0 2023-12-11T17:09:41.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.176+0000 7fb9d5d9b640 1 -- 172.21.15.37:0/2218154605 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c002c810 con 0x7fb9c40047c0 2023-12-11T17:09:41.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.176+0000 7fb9d5d9b640 1 -- 172.21.15.37:0/2218154605 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c002cba0 con 0x7fb9c40047c0 2023-12-11T17:09:41.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.177+0000 7fb9dcdc5640 1 -- 172.21.15.37:0/2218154605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9c40047c0 msgr2=0x7fb9c4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:41.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.177+0000 7fb9dcdc5640 1 --2- 172.21.15.37:0/2218154605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9c40047c0 0x7fb9c4004c40 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0009ac0 tx=0x7fb9c40057f0 comp rx=0 tx=0).stop 2023-12-11T17:09:41.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.177+0000 7fb9dcdc5640 1 -- 172.21.15.37:0/2218154605 shutdown_connections 2023-12-11T17:09:41.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.177+0000 7fb9dcdc5640 1 --2- 172.21.15.37:0/2218154605 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9c40047c0 0x7fb9c4004c40 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:41.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.177+0000 7fb9dcdc5640 1 -- 172.21.15.37:0/2218154605 >> 172.21.15.37:0/2218154605 conn(0x7fb9d809c450 msgr2=0x7fb9d80d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:41.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.177+0000 7fb9dcdc5640 1 -- 172.21.15.37:0/2218154605 shutdown_connections 2023-12-11T17:09:41.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.177+0000 7fb9dcdc5640 1 -- 172.21.15.37:0/2218154605 wait complete. 2023-12-11T17:09:41.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.180+0000 7fb9dcdc5640 1 Processor -- start 2023-12-11T17:09:41.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.180+0000 7fb9dcdc5640 1 -- start start 2023-12-11T17:09:41.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.181+0000 7fb9dcdc5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9c40047c0 0x7fb9d80cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:41.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.181+0000 7fb9dcdc5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9d8152350 0x7fb9d80cb910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:41.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.181+0000 7fb9dcdc5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9d80cbe50 0x7fb9d815a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:41.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.182+0000 7fb9dcdc5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d80cb580 con 0x7fb9d80cbe50 2023-12-11T17:09:41.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.182+0000 7fb9dcdc5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d80cc360 con 0x7fb9d8152350 2023-12-11T17:09:41.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.182+0000 7fb9dcdc5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d80ca280 con 0x7fb9c40047c0 2023-12-11T17:09:41.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.182+0000 7fb9d6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9d80cbe50 0x7fb9d815a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:41.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.182+0000 7fb9d6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9d80cbe50 0x7fb9d815a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45448/0 (socket says 172.21.15.37:45448) 2023-12-11T17:09:41.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.182+0000 7fb9d6d9d640 1 -- 172.21.15.37:0/3174433995 learned_addr learned my addr 172.21.15.37:0/3174433995 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:41.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.182+0000 7fb9d659c640 1 --2- 172.21.15.37:0/3174433995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9c40047c0 0x7fb9d80cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:41.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.182+0000 7fb9cffff640 1 --2- 172.21.15.37:0/3174433995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9d8152350 0x7fb9d80cb910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:41.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.182+0000 7fb9d6d9d640 1 -- 172.21.15.37:0/3174433995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9c40047c0 msgr2=0x7fb9d80cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:41.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.182+0000 7fb9d6d9d640 1 --2- 172.21.15.37:0/3174433995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9c40047c0 0x7fb9d80cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:41.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.182+0000 7fb9d6d9d640 1 -- 172.21.15.37:0/3174433995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9d8152350 msgr2=0x7fb9d80cb910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:41.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.182+0000 7fb9d6d9d640 1 --2- 172.21.15.37:0/3174433995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9d8152350 0x7fb9d80cb910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:41.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.182+0000 7fb9d6d9d640 1 -- 172.21.15.37:0/3174433995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d80ca560 con 0x7fb9d80cbe50 2023-12-11T17:09:41.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.182+0000 7fb9cffff640 1 --2- 172.21.15.37:0/3174433995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9d8152350 0x7fb9d80cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:09:41.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.183+0000 7fb9d6d9d640 1 --2- 172.21.15.37:0/3174433995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9d80cbe50 0x7fb9d815a530 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb9d808bcc0 tx=0x7fb9d000b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:41.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.183+0000 7fb9ceffd640 1 -- 172.21.15.37:0/3174433995 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d0004d60 con 0x7fb9d80cbe50 2023-12-11T17:09:41.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.183+0000 7fb9ceffd640 1 -- 172.21.15.37:0/3174433995 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d000bb00 con 0x7fb9d80cbe50 2023-12-11T17:09:41.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.183+0000 7fb9dcdc5640 1 -- 172.21.15.37:0/3174433995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d80ca840 con 0x7fb9d80cbe50 2023-12-11T17:09:41.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.183+0000 7fb9ceffd640 1 -- 172.21.15.37:0/3174433995 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d000beb0 con 0x7fb9d80cbe50 2023-12-11T17:09:41.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.183+0000 7fb9dcdc5640 1 -- 172.21.15.37:0/3174433995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d8152b80 con 0x7fb9d80cbe50 2023-12-11T17:09:41.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.184+0000 7fb9dcdc5640 1 -- 172.21.15.37:0/3174433995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d80cad60 con 0x7fb9d80cbe50 2023-12-11T17:09:41.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.185+0000 7fb9ceffd640 1 -- 172.21.15.37:0/3174433995 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7fb9d0007070 con 0x7fb9d80cbe50 2023-12-11T17:09:41.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.187+0000 7fb9ceffd640 1 --2- 172.21.15.37:0/3174433995 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb9b806ade0 0x7fb9b806d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:41.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.187+0000 7fb9ceffd640 1 -- 172.21.15.37:0/3174433995 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb9d0089410 con 0x7fb9d80cbe50 2023-12-11T17:09:41.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.187+0000 7fb9d659c640 1 --2- 172.21.15.37:0/3174433995 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb9b806ade0 0x7fb9b806d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:41.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.188+0000 7fb9d659c640 1 --2- 172.21.15.37:0/3174433995 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb9b806ade0 0x7fb9b806d2a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8152ec0 tx=0x7fb9c8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:41.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.191+0000 7fb9ceffd640 1 -- 172.21.15.37:0/3174433995 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb9d80cad60 con 0x7fb9d80cbe50 2023-12-11T17:09:41.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.389+0000 7fb9dcdc5640 1 -- 172.21.15.37:0/3174433995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9d80cad60 con 0x7fb9d80cbe50 2023-12-11T17:09:41.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.390+0000 7fb9ceffd640 1 -- 172.21.15.37:0/3174433995 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+12850 (secure 0 0 0) 0x7fb9d80cad60 con 0x7fb9d80cbe50 2023-12-11T17:09:41.391 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:09:41.391 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:09:41.284060+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":15,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:09:41.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.394+0000 7fb9dcdc5640 1 -- 172.21.15.37:0/3174433995 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb9b806ade0 msgr2=0x7fb9b806d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:41.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.394+0000 7fb9dcdc5640 1 --2- 172.21.15.37:0/3174433995 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb9b806ade0 0x7fb9b806d2a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8152ec0 tx=0x7fb9c8009040 comp rx=0 tx=0).stop 2023-12-11T17:09:41.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.394+0000 7fb9dcdc5640 1 -- 172.21.15.37:0/3174433995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9d80cbe50 msgr2=0x7fb9d815a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:41.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.394+0000 7fb9dcdc5640 1 --2- 172.21.15.37:0/3174433995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9d80cbe50 0x7fb9d815a530 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fb9d808bcc0 tx=0x7fb9d000b4a0 comp rx=0 tx=0).stop 2023-12-11T17:09:41.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.394+0000 7fb9dcdc5640 1 -- 172.21.15.37:0/3174433995 shutdown_connections 2023-12-11T17:09:41.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.394+0000 7fb9dcdc5640 1 --2- 172.21.15.37:0/3174433995 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb9b806ade0 0x7fb9b806d2a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:41.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.394+0000 7fb9dcdc5640 1 --2- 172.21.15.37:0/3174433995 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb9d8152350 0x7fb9d80cb910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:41.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.394+0000 7fb9dcdc5640 1 --2- 172.21.15.37:0/3174433995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb9d80cbe50 0x7fb9d815a530 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:41.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.394+0000 7fb9dcdc5640 1 --2- 172.21.15.37:0/3174433995 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb9c40047c0 0x7fb9d80cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:41.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.394+0000 7fb9dcdc5640 1 -- 172.21.15.37:0/3174433995 >> 172.21.15.37:0/3174433995 conn(0x7fb9d809c450 msgr2=0x7fb9d8160ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:41.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.394+0000 7fb9dcdc5640 1 -- 172.21.15.37:0/3174433995 shutdown_connections 2023-12-11T17:09:41.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.394+0000 7fb9dcdc5640 1 -- 172.21.15.37:0/3174433995 wait complete. 2023-12-11T17:09:41.411 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T17:09:38.415636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-11T17:09:41.412 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T17:09:41.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.610+0000 7f2d7759e640 1 Processor -- start 2023-12-11T17:09:41.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.610+0000 7f2d7759e640 1 -- start start 2023-12-11T17:09:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.611+0000 7f2d7759e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d780b3350 0x7f2d780b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.611+0000 7f2d7759e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f2d780b3730 0x7f2d780cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.611+0000 7f2d7759e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d780c6b80 con 0x7f2d780b40e0 2023-12-11T17:09:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.611+0000 7f2d7759e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d780d3bf0 con 0x7f2d780b3350 2023-12-11T17:09:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.611+0000 7f2d7759e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d780d3ed0 con 0x7f2d780b3730 2023-12-11T17:09:41.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.612+0000 7f2d7659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d780b3350 0x7f2d780b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.612+0000 7f2d7659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2d780b3350 0x7f2d780b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45454/0 (socket says 172.21.15.37:45454) 2023-12-11T17:09:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.612+0000 7f2d7659c640 1 -- 172.21.15.37:0/4122343791 learned_addr learned my addr 172.21.15.37:0/4122343791 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.612+0000 7f2d6ffff640 1 --2- 172.21.15.37:0/4122343791 >> v2:172.21.15.151:3300/0 conn(0x7f2d780b3730 0x7f2d780cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.612+0000 7f2d7659c640 1 -- 172.21.15.37:0/4122343791 >> v2:172.21.15.151:3300/0 conn(0x7f2d780b3730 msgr2=0x7f2d780cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.612+0000 7f2d7659c640 1 --2- 172.21.15.37:0/4122343791 >> v2:172.21.15.151:3300/0 conn(0x7f2d780b3730 0x7f2d780cf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.612+0000 7f2d7659c640 1 -- 172.21.15.37:0/4122343791 >> v1:172.21.15.151:6789/0 conn(0x7f2d780b40e0 legacy=0x7f2d78161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.612+0000 7f2d7659c640 1 -- 172.21.15.37:0/4122343791 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d780d18c0 con 0x7f2d780b3350 2023-12-11T17:09:41.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.612+0000 7f2d6ffff640 1 --2- 172.21.15.37:0/4122343791 >> v2:172.21.15.151:3300/0 conn(0x7f2d780b3730 0x7f2d780cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:09:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.613+0000 7f2d7659c640 1 --2- 172.21.15.37:0/4122343791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d780b3350 0x7f2d780b3ba0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2d780cf3a0 tx=0x7f2d6802b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e802f11c9252853 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.614+0000 7f2d75d9b640 1 -- 172.21.15.37:0/4122343791 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d68031890 con 0x7f2d780b3350 2023-12-11T17:09:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.614+0000 7f2d75d9b640 1 -- 172.21.15.37:0/4122343791 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d680319f0 con 0x7f2d780b3350 2023-12-11T17:09:41.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.614+0000 7f2d75d9b640 1 -- 172.21.15.37:0/4122343791 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d68031d80 con 0x7f2d780b3350 2023-12-11T17:09:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.614+0000 7f2d7759e640 1 -- 172.21.15.37:0/4122343791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d780b3350 msgr2=0x7f2d780b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.614+0000 7f2d7759e640 1 --2- 172.21.15.37:0/4122343791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d780b3350 0x7f2d780b3ba0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2d780cf3a0 tx=0x7f2d6802b930 comp rx=0 tx=0).stop 2023-12-11T17:09:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.614+0000 7f2d7759e640 1 -- 172.21.15.37:0/4122343791 shutdown_connections 2023-12-11T17:09:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.614+0000 7f2d7759e640 1 --2- 172.21.15.37:0/4122343791 >> v2:172.21.15.151:3300/0 conn(0x7f2d780b3730 0x7f2d780cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.614+0000 7f2d7759e640 1 --2- 172.21.15.37:0/4122343791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d780b3350 0x7f2d780b3ba0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.614+0000 7f2d7759e640 1 -- 172.21.15.37:0/4122343791 >> 172.21.15.37:0/4122343791 conn(0x7f2d780d3030 msgr2=0x7f2d780d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.615+0000 7f2d7759e640 1 -- 172.21.15.37:0/4122343791 shutdown_connections 2023-12-11T17:09:41.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.615+0000 7f2d7759e640 1 -- 172.21.15.37:0/4122343791 wait complete. 2023-12-11T17:09:41.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.616+0000 7f2d7759e640 1 Processor -- start 2023-12-11T17:09:41.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.617+0000 7f2d7759e640 1 -- start start 2023-12-11T17:09:41.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.618+0000 7f2d7759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d780b3350 0x7f2d780cbdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:41.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.618+0000 7f2d7759e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d780b3730 0x7f2d780b8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:41.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.618+0000 7f2d7759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d780b40e0 0x7f2d780cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:41.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.618+0000 7f2d7759e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d780b6a00 con 0x7f2d780b3350 2023-12-11T17:09:41.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.618+0000 7f2d7759e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d780cb930 con 0x7f2d780b3730 2023-12-11T17:09:41.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.618+0000 7f2d7759e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d780cc300 con 0x7f2d780b40e0 2023-12-11T17:09:41.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.618+0000 7f2d7659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d780b3350 0x7f2d780cbdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:41.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.618+0000 7f2d7659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d780b3350 0x7f2d780cbdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45464/0 (socket says 172.21.15.37:45464) 2023-12-11T17:09:41.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.618+0000 7f2d7659c640 1 -- 172.21.15.37:0/183805642 learned_addr learned my addr 172.21.15.37:0/183805642 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:41.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.618+0000 7f2d7659c640 1 -- 172.21.15.37:0/183805642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d780b40e0 msgr2=0x7f2d780cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:41.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.618+0000 7f2d7659c640 1 --2- 172.21.15.37:0/183805642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d780b40e0 0x7f2d780cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:41.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.618+0000 7f2d7659c640 1 -- 172.21.15.37:0/183805642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d780b3730 msgr2=0x7f2d780b8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:41.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.618+0000 7f2d6ffff640 1 --2- 172.21.15.37:0/183805642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d780b3730 0x7f2d780b8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:41.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.618+0000 7f2d7659c640 1 --2- 172.21.15.37:0/183805642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d780b3730 0x7f2d780b8130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:41.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.618+0000 7f2d7659c640 1 -- 172.21.15.37:0/183805642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d680094d0 con 0x7f2d780b3350 2023-12-11T17:09:41.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.619+0000 7f2d7659c640 1 --2- 172.21.15.37:0/183805642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d780b3350 0x7f2d780cbdc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2d68000c00 tx=0x7f2d680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:41.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.619+0000 7f2d6effd640 1 -- 172.21.15.37:0/183805642 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d68031840 con 0x7f2d780b3350 2023-12-11T17:09:41.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.619+0000 7f2d6effd640 1 -- 172.21.15.37:0/183805642 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d680443f0 con 0x7f2d780b3350 2023-12-11T17:09:41.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.619+0000 7f2d6effd640 1 -- 172.21.15.37:0/183805642 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d680447a0 con 0x7f2d780b3350 2023-12-11T17:09:41.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.619+0000 7f2d7759e640 1 -- 172.21.15.37:0/183805642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d780b48a0 con 0x7f2d780b3350 2023-12-11T17:09:41.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.619+0000 7f2d7759e640 1 -- 172.21.15.37:0/183805642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d780cb000 con 0x7f2d780b3350 2023-12-11T17:09:41.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.621+0000 7f2d7759e640 1 -- 172.21.15.37:0/183805642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d78074450 con 0x7f2d780b3350 2023-12-11T17:09:41.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.622+0000 7f2d6effd640 1 -- 172.21.15.37:0/183805642 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f2d6804d450 con 0x7f2d780b3350 2023-12-11T17:09:41.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.623+0000 7f2d6effd640 1 --2- 172.21.15.37:0/183805642 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f2d5806ae00 0x7f2d5806d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:41.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.623+0000 7f2d6effd640 1 -- 172.21.15.37:0/183805642 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2d680aba10 con 0x7f2d780b3350 2023-12-11T17:09:41.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.624+0000 7f2d6ffff640 1 --2- 172.21.15.37:0/183805642 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f2d5806ae00 0x7f2d5806d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:41.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.625+0000 7f2d6ffff640 1 --2- 172.21.15.37:0/183805642 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f2d5806ae00 0x7f2d5806d2c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2d780b26b0 tx=0x7f2d60008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:41.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.627+0000 7f2d6effd640 1 -- 172.21.15.37:0/183805642 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2d68076f60 con 0x7f2d780b3350 2023-12-11T17:09:41.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.820+0000 7f2d7759e640 1 -- 172.21.15.37:0/183805642 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2d7808d0b0 con 0x7f2d780b3350 2023-12-11T17:09:41.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.821+0000 7f2d6effd640 1 -- 172.21.15.37:0/183805642 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v17) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2d680350a0 con 0x7f2d780b3350 2023-12-11T17:09:41.821 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-11T17:09:41.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.824+0000 7f2d7759e640 1 -- 172.21.15.37:0/183805642 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f2d5806ae00 msgr2=0x7f2d5806d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:41.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.824+0000 7f2d7759e640 1 --2- 172.21.15.37:0/183805642 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f2d5806ae00 0x7f2d5806d2c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f2d780b26b0 tx=0x7f2d60008040 comp rx=0 tx=0).stop 2023-12-11T17:09:41.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.824+0000 7f2d7759e640 1 -- 172.21.15.37:0/183805642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d780b3350 msgr2=0x7f2d780cbdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:41.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.824+0000 7f2d7759e640 1 --2- 172.21.15.37:0/183805642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d780b3350 0x7f2d780cbdc0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f2d68000c00 tx=0x7f2d680046c0 comp rx=0 tx=0).stop 2023-12-11T17:09:41.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.824+0000 7f2d7759e640 1 -- 172.21.15.37:0/183805642 shutdown_connections 2023-12-11T17:09:41.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.824+0000 7f2d7759e640 1 --2- 172.21.15.37:0/183805642 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f2d5806ae00 0x7f2d5806d2c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:41.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.824+0000 7f2d7759e640 1 --2- 172.21.15.37:0/183805642 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d780b3730 0x7f2d780b8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:41.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.824+0000 7f2d7759e640 1 --2- 172.21.15.37:0/183805642 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2d780b40e0 0x7f2d780cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:41.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.824+0000 7f2d7759e640 1 --2- 172.21.15.37:0/183805642 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2d780b3350 0x7f2d780cbdc0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:41.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.824+0000 7f2d7759e640 1 -- 172.21.15.37:0/183805642 >> 172.21.15.37:0/183805642 conn(0x7f2d780d3030 msgr2=0x7f2d7806bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:41.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.824+0000 7f2d7759e640 1 -- 172.21.15.37:0/183805642 shutdown_connections 2023-12-11T17:09:41.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:41.824+0000 7f2d7759e640 1 -- 172.21.15.37:0/183805642 wait complete. 2023-12-11T17:09:41.844 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-11T17:09:42.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.056+0000 7f0718b39640 1 Processor -- start 2023-12-11T17:09:42.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.056+0000 7f0718b39640 1 -- start start 2023-12-11T17:09:42.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.058+0000 7f0718b39640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0714146ba0 0x7f071406cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:42.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.058+0000 7f0718b39640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071406d510 con 0x7f07140cd000 2023-12-11T17:09:42.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.058+0000 7f0718b39640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f071406d7f0 con 0x7f07141467c0 2023-12-11T17:09:42.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.058+0000 7f0718b39640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07140ac860 con 0x7f0714146ba0 2023-12-11T17:09:42.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.058+0000 7f070bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f07140cd000 0x7f071406c7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60588/0 (socket says 172.21.15.37:60588) 2023-12-11T17:09:42.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.058+0000 7f070bfff640 1 -- 172.21.15.37:0/1885254334 learned_addr learned my addr 172.21.15.37:0/1885254334 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:09:42.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.058+0000 7f0712d9d640 1 --2- 172.21.15.37:0/1885254334 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0714146ba0 0x7f071406cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:42.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.058+0000 7f0711d9b640 1 -- 172.21.15.37:0/1885254334 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2780782181 0 0) 0x7f071406d510 con 0x7f07140cd000 2023-12-11T17:09:42.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.059+0000 7f0711d9b640 1 -- 172.21.15.37:0/1885254334 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0700003520 con 0x7f07140cd000 2023-12-11T17:09:42.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.059+0000 7f0711d9b640 1 -- 172.21.15.37:0/1885254334 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2893326019 0 0) 0x7f0700003520 con 0x7f07140cd000 2023-12-11T17:09:42.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.059+0000 7f0711d9b640 1 -- 172.21.15.37:0/1885254334 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0714146ba0 msgr2=0x7f071406cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:42.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.059+0000 7f0711d9b640 1 --2- 172.21.15.37:0/1885254334 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0714146ba0 0x7f071406cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:42.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.059+0000 7f0711d9b640 1 -- 172.21.15.37:0/1885254334 >> v1:172.21.15.151:6789/0 conn(0x7f07141467c0 legacy=0x7f07140cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:42.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.059+0000 7f0711d9b640 1 -- 172.21.15.37:0/1885254334 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f071406dad0 con 0x7f07140cd000 2023-12-11T17:09:42.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.059+0000 7f0711d9b640 1 -- 172.21.15.37:0/1885254334 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f06fc001670 con 0x7f07140cd000 2023-12-11T17:09:42.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.059+0000 7f0711d9b640 1 -- 172.21.15.37:0/1885254334 >> v1:172.21.15.37:6789/0 conn(0x7f07140cd000 legacy=0x7f071406c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:42.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.059+0000 7f0711d9b640 1 --2- 172.21.15.37:0/1885254334 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0714146ba0 0x7f07000039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:42.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.059+0000 7f0711d9b640 1 --2- 172.21.15.37:0/1885254334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0700003f70 0x7f07000047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:42.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.059+0000 7f0711d9b640 1 --2- 172.21.15.37:0/1885254334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0700004d00 0x7f0700005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:42.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.059+0000 7f0711d9b640 1 -- 172.21.15.37:0/1885254334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07140ac860 con 0x7f0700004d00 2023-12-11T17:09:42.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.059+0000 7f0711d9b640 1 -- 172.21.15.37:0/1885254334 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070000bac0 con 0x7f0700003f70 2023-12-11T17:09:42.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.059+0000 7f0711d9b640 1 -- 172.21.15.37:0/1885254334 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f070000bc80 con 0x7f0714146ba0 2023-12-11T17:09:42.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.060+0000 7f0712d9d640 1 --2- 172.21.15.37:0/1885254334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0700004d00 0x7f0700005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:42.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.060+0000 7f070bfff640 1 --2- 172.21.15.37:0/1885254334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0700003f70 0x7f07000047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:42.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.060+0000 7f071259c640 1 --2- 172.21.15.37:0/1885254334 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0714146ba0 0x7f07000039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:42.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.060+0000 7f0712d9d640 1 -- 172.21.15.37:0/1885254334 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0714146ba0 msgr2=0x7f07000039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:42.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.060+0000 7f0712d9d640 1 --2- 172.21.15.37:0/1885254334 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0714146ba0 0x7f07000039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:42.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.060+0000 7f0712d9d640 1 -- 172.21.15.37:0/1885254334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0700003f70 msgr2=0x7f07000047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:42.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.060+0000 7f0712d9d640 1 --2- 172.21.15.37:0/1885254334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0700003f70 0x7f07000047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:42.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.060+0000 7f0712d9d640 1 -- 172.21.15.37:0/1885254334 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0700003520 con 0x7f0700004d00 2023-12-11T17:09:42.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.060+0000 7f071259c640 1 --2- 172.21.15.37:0/1885254334 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0714146ba0 0x7f07000039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:09:42.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.060+0000 7f070bfff640 1 --2- 172.21.15.37:0/1885254334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0700003f70 0x7f07000047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:09:42.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.061+0000 7f0712d9d640 1 --2- 172.21.15.37:0/1885254334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0700004d00 0x7f0700005180 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f07140cec20 tx=0x7f07000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=773a57afd1be2b6b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:42.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.061+0000 7f0711d9b640 1 -- 172.21.15.37:0/1885254334 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c02cb90 con 0x7f0700004d00 2023-12-11T17:09:42.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.062+0000 7f0711d9b640 1 -- 172.21.15.37:0/1885254334 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f070c00f040 con 0x7f0700004d00 2023-12-11T17:09:42.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.062+0000 7f0711d9b640 1 -- 172.21.15.37:0/1885254334 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f070c034440 con 0x7f0700004d00 2023-12-11T17:09:42.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.062+0000 7f0718b39640 1 -- 172.21.15.37:0/1885254334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0700004d00 msgr2=0x7f0700005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:42.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.062+0000 7f0718b39640 1 --2- 172.21.15.37:0/1885254334 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0700004d00 0x7f0700005180 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f07140cec20 tx=0x7f07000057f0 comp rx=0 tx=0).stop 2023-12-11T17:09:42.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.062+0000 7f0712d9d640 1 -- 172.21.15.37:0/1885254334 reap_dead start 2023-12-11T17:09:42.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.062+0000 7f0718b39640 1 -- 172.21.15.37:0/1885254334 shutdown_connections 2023-12-11T17:09:42.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.062+0000 7f0718b39640 1 -- 172.21.15.37:0/1885254334 >> 172.21.15.37:0/1885254334 conn(0x7f07140b0a90 msgr2=0x7f07140b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:42.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.062+0000 7f0718b39640 1 -- 172.21.15.37:0/1885254334 shutdown_connections 2023-12-11T17:09:42.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.062+0000 7f0718b39640 1 -- 172.21.15.37:0/1885254334 wait complete. 2023-12-11T17:09:42.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.064+0000 7f0718b39640 1 Processor -- start 2023-12-11T17:09:42.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.064+0000 7f0718b39640 1 -- start start 2023-12-11T17:09:42.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.065+0000 7f0718b39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0700004d00 0x7f07140b2890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:42.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.065+0000 7f0718b39640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07140b2dd0 0x7f07141f35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:42.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.065+0000 7f0718b39640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07141f3b10 0x7f07141f3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:42.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.065+0000 7f0718b39640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07141f44b0 con 0x7f0700004d00 2023-12-11T17:09:42.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.065+0000 7f0718b39640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07140b3db0 con 0x7f07141f3b10 2023-12-11T17:09:42.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.065+0000 7f0718b39640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07141e7e20 con 0x7f07140b2dd0 2023-12-11T17:09:42.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.066+0000 7f071259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0700004d00 0x7f07140b2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:42.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.066+0000 7f071259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0700004d00 0x7f07140b2890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45480/0 (socket says 172.21.15.37:45480) 2023-12-11T17:09:42.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.066+0000 7f071259c640 1 -- 172.21.15.37:0/2469593840 learned_addr learned my addr 172.21.15.37:0/2469593840 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:42.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.066+0000 7f070bfff640 1 --2- 172.21.15.37:0/2469593840 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07140b2dd0 0x7f07141f35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:42.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.066+0000 7f071259c640 1 -- 172.21.15.37:0/2469593840 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07140b2dd0 msgr2=0x7f07141f35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:42.068 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.066+0000 7f0712d9d640 1 --2- 172.21.15.37:0/2469593840 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07141f3b10 0x7f07141f3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:42.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.066+0000 7f071259c640 1 --2- 172.21.15.37:0/2469593840 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07140b2dd0 0x7f07141f35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:42.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.066+0000 7f071259c640 1 -- 172.21.15.37:0/2469593840 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07141f3b10 msgr2=0x7f07141f3f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:42.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.066+0000 7f071259c640 1 --2- 172.21.15.37:0/2469593840 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07141f3b10 0x7f07141f3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:42.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.066+0000 7f071259c640 1 -- 172.21.15.37:0/2469593840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0714145ae0 con 0x7f0700004d00 2023-12-11T17:09:42.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.066+0000 7f071259c640 1 --2- 172.21.15.37:0/2469593840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0700004d00 0x7f07140b2890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f070400e600 tx=0x7f070400eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:42.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.067+0000 7f070affd640 1 -- 172.21.15.37:0/2469593840 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07040052e0 con 0x7f0700004d00 2023-12-11T17:09:42.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.067+0000 7f070affd640 1 -- 172.21.15.37:0/2469593840 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0704005440 con 0x7f0700004d00 2023-12-11T17:09:42.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.067+0000 7f070affd640 1 -- 172.21.15.37:0/2469593840 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07040037f0 con 0x7f0700004d00 2023-12-11T17:09:42.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.067+0000 7f0718b39640 1 -- 172.21.15.37:0/2469593840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07140b3250 con 0x7f0700004d00 2023-12-11T17:09:42.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.067+0000 7f0718b39640 1 -- 172.21.15.37:0/2469593840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07140b37f0 con 0x7f0700004d00 2023-12-11T17:09:42.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.068+0000 7f0718b39640 1 -- 172.21.15.37:0/2469593840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0714067910 con 0x7f0700004d00 2023-12-11T17:09:42.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.069+0000 7f070affd640 1 -- 172.21.15.37:0/2469593840 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f0704003950 con 0x7f0700004d00 2023-12-11T17:09:42.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.070+0000 7f070affd640 1 --2- 172.21.15.37:0/2469593840 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f06f406ade0 0x7f06f406d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:42.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.070+0000 7f070affd640 1 -- 172.21.15.37:0/2469593840 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0704088ff0 con 0x7f0700004d00 2023-12-11T17:09:42.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.071+0000 7f070bfff640 1 --2- 172.21.15.37:0/2469593840 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f06f406ade0 0x7f06f406d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:42.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.072+0000 7f070bfff640 1 --2- 172.21.15.37:0/2469593840 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f06f406ade0 0x7f06f406d2a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f06fc000ff0 tx=0x7f06fc000f80 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:42.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.075+0000 7f070affd640 1 -- 172.21.15.37:0/2469593840 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f07040bbe90 con 0x7f0700004d00 2023-12-11T17:09:42.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.269+0000 7f0718b39640 1 -- 172.21.15.37:0/2469593840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f071406e1f0 con 0x7f0700004d00 2023-12-11T17:09:42.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.269+0000 7f070affd640 1 -- 172.21.15.37:0/2469593840 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v17) v1 ==== 84+0+65 (secure 0 0 0) 0x7f071406e1f0 con 0x7f0700004d00 2023-12-11T17:09:42.270 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:09:42.270 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-12-11T17:09:42.270 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:09:42.270 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-12-11T17:09:42.270 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-12-11T17:09:42.270 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:09:42.270 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-12-11T17:09:42.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.272+0000 7f0718b39640 1 -- 172.21.15.37:0/2469593840 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f06f406ade0 msgr2=0x7f06f406d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:42.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.272+0000 7f0718b39640 1 --2- 172.21.15.37:0/2469593840 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f06f406ade0 0x7f06f406d2a0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f06fc000ff0 tx=0x7f06fc000f80 comp rx=0 tx=0).stop 2023-12-11T17:09:42.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.272+0000 7f0718b39640 1 -- 172.21.15.37:0/2469593840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0700004d00 msgr2=0x7f07140b2890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:42.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.272+0000 7f0718b39640 1 --2- 172.21.15.37:0/2469593840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0700004d00 0x7f07140b2890 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f070400e600 tx=0x7f070400eac0 comp rx=0 tx=0).stop 2023-12-11T17:09:42.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.272+0000 7f0718b39640 1 -- 172.21.15.37:0/2469593840 shutdown_connections 2023-12-11T17:09:42.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.272+0000 7f0718b39640 1 --2- 172.21.15.37:0/2469593840 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f06f406ade0 0x7f06f406d2a0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:42.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.272+0000 7f0718b39640 1 --2- 172.21.15.37:0/2469593840 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f07141f3b10 0x7f07141f3f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.272+0000 7f0718b39640 1 --2- 172.21.15.37:0/2469593840 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f07140b2dd0 0x7f07141f35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.272+0000 7f0718b39640 1 --2- 172.21.15.37:0/2469593840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0700004d00 0x7f07140b2890 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.272+0000 7f0718b39640 1 -- 172.21.15.37:0/2469593840 >> 172.21.15.37:0/2469593840 conn(0x7f07140b0a90 msgr2=0x7f07140b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.272+0000 7f0718b39640 1 -- 172.21.15.37:0/2469593840 shutdown_connections 2023-12-11T17:09:42.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.272+0000 7f0718b39640 1 -- 172.21.15.37:0/2469593840 wait complete. 2023-12-11T17:09:42.291 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-11T17:09:42.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-11T17:09:42.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.520+0000 7f1c92754640 1 Processor -- start 2023-12-11T17:09:42.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.520+0000 7f1c92754640 1 -- start start 2023-12-11T17:09:42.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.522+0000 7f1c92754640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c8c15d4a0 0x7f1c8c0d3a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:42.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.522+0000 7f1c92754640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c8c0ce5d0 con 0x7f1c8c0d15b0 2023-12-11T17:09:42.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.522+0000 7f1c92754640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c8c0ce870 con 0x7f1c8c0d1990 2023-12-11T17:09:42.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.522+0000 7f1c92754640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c15d8d0 con 0x7f1c8c15d4a0 2023-12-11T17:09:42.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.522+0000 7f1c91752640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1c8c0d15b0 0x7f1c8c15cd90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60594/0 (socket says 172.21.15.37:60594) 2023-12-11T17:09:42.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.522+0000 7f1c91752640 1 -- 172.21.15.37:0/3547105130 learned_addr learned my addr 172.21.15.37:0/3547105130 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:09:42.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.522+0000 7f1c91f53640 1 --2- 172.21.15.37:0/3547105130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c8c15d4a0 0x7f1c8c0d3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:42.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.523+0000 7f1c91f53640 1 -- 172.21.15.37:0/3547105130 >> v1:172.21.15.151:6789/0 conn(0x7f1c8c0d1990 legacy=0x7f1c8c0afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:42.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.523+0000 7f1c91f53640 1 -- 172.21.15.37:0/3547105130 >> v1:172.21.15.37:6789/0 conn(0x7f1c8c0d15b0 legacy=0x7f1c8c15cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:42.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.523+0000 7f1c83fff640 1 -- 172.21.15.37:0/3547105130 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2245843164 0 0) 0x7f1c8c0ce5d0 con 0x7f1c8c0d15b0 2023-12-11T17:09:42.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.523+0000 7f1c91f53640 1 -- 172.21.15.37:0/3547105130 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c8c0ceb50 con 0x7f1c8c15d4a0 2023-12-11T17:09:42.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.524+0000 7f1c91f53640 1 --2- 172.21.15.37:0/3547105130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c8c15d4a0 0x7f1c8c0d3a30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1c840097d0 tx=0x7f1c8402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ea56d6d82d10b3d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:42.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.525+0000 7f1c83fff640 1 -- 172.21.15.37:0/3547105130 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c84031800 con 0x7f1c8c15d4a0 2023-12-11T17:09:42.524 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.525+0000 7f1c83fff640 1 -- 172.21.15.37:0/3547105130 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c84031960 con 0x7f1c8c15d4a0 2023-12-11T17:09:42.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.525+0000 7f1c83fff640 1 -- 172.21.15.37:0/3547105130 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c84031cf0 con 0x7f1c8c15d4a0 2023-12-11T17:09:42.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.525+0000 7f1c92754640 1 -- 172.21.15.37:0/3547105130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c8c15d4a0 msgr2=0x7f1c8c0d3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:42.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.525+0000 7f1c92754640 1 --2- 172.21.15.37:0/3547105130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c8c15d4a0 0x7f1c8c0d3a30 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f1c840097d0 tx=0x7f1c8402b8a0 comp rx=0 tx=0).stop 2023-12-11T17:09:42.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.525+0000 7f1c92754640 1 -- 172.21.15.37:0/3547105130 shutdown_connections 2023-12-11T17:09:42.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.525+0000 7f1c92754640 1 --2- 172.21.15.37:0/3547105130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c8c15d4a0 0x7f1c8c0d3a30 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:42.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.525+0000 7f1c92754640 1 -- 172.21.15.37:0/3547105130 >> 172.21.15.37:0/3547105130 conn(0x7f1c8c0d2f10 msgr2=0x7f1c8c0d3320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:42.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.526+0000 7f1c92754640 1 -- 172.21.15.37:0/3547105130 shutdown_connections 2023-12-11T17:09:42.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.526+0000 7f1c92754640 1 -- 172.21.15.37:0/3547105130 wait complete. 2023-12-11T17:09:42.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.527+0000 7f1c92754640 1 Processor -- start 2023-12-11T17:09:42.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.528+0000 7f1c92754640 1 -- start start 2023-12-11T17:09:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.528+0000 7f1c92754640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c8c0d15b0 0x7f1c8c0b5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.528+0000 7f1c92754640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c8c0d1990 0x7f1c8c0b3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.528+0000 7f1c92754640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c8c15d4a0 0x7f1c8c0b3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.528+0000 7f1c92754640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c09f060 con 0x7f1c8c0d15b0 2023-12-11T17:09:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.528+0000 7f1c92754640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c0a0ca0 con 0x7f1c8c15d4a0 2023-12-11T17:09:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.528+0000 7f1c92754640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8c0b6ee0 con 0x7f1c8c0d1990 2023-12-11T17:09:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.529+0000 7f1c91752640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c8c0d15b0 0x7f1c8c0b5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.529+0000 7f1c91752640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c8c0d15b0 0x7f1c8c0b5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45488/0 (socket says 172.21.15.37:45488) 2023-12-11T17:09:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.529+0000 7f1c91752640 1 -- 172.21.15.37:0/2222282037 learned_addr learned my addr 172.21.15.37:0/2222282037 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:42.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.529+0000 7f1c91f53640 1 --2- 172.21.15.37:0/2222282037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c8c15d4a0 0x7f1c8c0b3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:42.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.529+0000 7f1c90f51640 1 --2- 172.21.15.37:0/2222282037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c8c0d1990 0x7f1c8c0b3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:42.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.529+0000 7f1c91752640 1 -- 172.21.15.37:0/2222282037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c8c0d1990 msgr2=0x7f1c8c0b3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:42.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.529+0000 7f1c91752640 1 --2- 172.21.15.37:0/2222282037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c8c0d1990 0x7f1c8c0b3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:42.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.529+0000 7f1c91752640 1 -- 172.21.15.37:0/2222282037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c8c15d4a0 msgr2=0x7f1c8c0b3aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:42.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.529+0000 7f1c91752640 1 --2- 172.21.15.37:0/2222282037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c8c15d4a0 0x7f1c8c0b3aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:42.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.529+0000 7f1c91752640 1 -- 172.21.15.37:0/2222282037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c84009400 con 0x7f1c8c0d15b0 2023-12-11T17:09:42.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.530+0000 7f1c91752640 1 --2- 172.21.15.37:0/2222282037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c8c0d15b0 0x7f1c8c0b5da0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1c8800c780 tx=0x7f1c8800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:42.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.530+0000 7f1c81ffb640 1 -- 172.21.15.37:0/2222282037 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8800ce90 con 0x7f1c8c0d15b0 2023-12-11T17:09:42.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.530+0000 7f1c81ffb640 1 -- 172.21.15.37:0/2222282037 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c8800a640 con 0x7f1c8c0d15b0 2023-12-11T17:09:42.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.530+0000 7f1c81ffb640 1 -- 172.21.15.37:0/2222282037 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c8800aa70 con 0x7f1c8c0d15b0 2023-12-11T17:09:42.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.530+0000 7f1c92754640 1 -- 172.21.15.37:0/2222282037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c8c0b4970 con 0x7f1c8c0d15b0 2023-12-11T17:09:42.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.530+0000 7f1c92754640 1 -- 172.21.15.37:0/2222282037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c8c0b4690 con 0x7f1c8c0d15b0 2023-12-11T17:09:42.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.531+0000 7f1c92754640 1 -- 172.21.15.37:0/2222282037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c8c09f1a0 con 0x7f1c8c0d15b0 2023-12-11T17:09:42.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.532+0000 7f1c81ffb640 1 -- 172.21.15.37:0/2222282037 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) v1 ==== 89175+0+0 (secure 0 0 0) 0x7f1c8800abd0 con 0x7f1c8c0d15b0 2023-12-11T17:09:42.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.533+0000 7f1c81ffb640 1 --2- 172.21.15.37:0/2222282037 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1c7006adb0 0x7f1c7006d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:42.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.533+0000 7f1c81ffb640 1 -- 172.21.15.37:0/2222282037 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1c880886f0 con 0x7f1c8c0d15b0 2023-12-11T17:09:42.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.534+0000 7f1c90f51640 1 --2- 172.21.15.37:0/2222282037 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1c7006adb0 0x7f1c7006d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:42.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.535+0000 7f1c90f51640 1 --2- 172.21.15.37:0/2222282037 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1c7006adb0 0x7f1c7006d270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0d3c70 tx=0x7f1c7c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:42.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.538+0000 7f1c81ffb640 1 -- 172.21.15.37:0/2222282037 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1c8c09f1a0 con 0x7f1c8c0d15b0 2023-12-11T17:09:42.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:42.732+0000 7f1c92754640 1 -- 172.21.15.37:0/2222282037 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f1c8c09f1a0 con 0x7f1c8c0d15b0 2023-12-11T17:09:43.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.144+0000 7f1c81ffb640 1 -- 172.21.15.37:0/2222282037 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v18) v1 ==== 138+0+0 (secure 0 0 0) 0x7f1c88018070 con 0x7f1c8c0d15b0 2023-12-11T17:09:43.144 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-12-11T17:09:43.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.148+0000 7f1c92754640 1 -- 172.21.15.37:0/2222282037 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1c7006adb0 msgr2=0x7f1c7006d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:43.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.148+0000 7f1c92754640 1 --2- 172.21.15.37:0/2222282037 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1c7006adb0 0x7f1c7006d270 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f1c8c0d3c70 tx=0x7f1c7c009040 comp rx=0 tx=0).stop 2023-12-11T17:09:43.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.148+0000 7f1c92754640 1 -- 172.21.15.37:0/2222282037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c8c0d15b0 msgr2=0x7f1c8c0b5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:43.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.148+0000 7f1c92754640 1 --2- 172.21.15.37:0/2222282037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c8c0d15b0 0x7f1c8c0b5da0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f1c8800c780 tx=0x7f1c8800cc40 comp rx=0 tx=0).stop 2023-12-11T17:09:43.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.148+0000 7f1c92754640 1 -- 172.21.15.37:0/2222282037 shutdown_connections 2023-12-11T17:09:43.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.148+0000 7f1c92754640 1 --2- 172.21.15.37:0/2222282037 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1c7006adb0 0x7f1c7006d270 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:43.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.148+0000 7f1c92754640 1 --2- 172.21.15.37:0/2222282037 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c8c15d4a0 0x7f1c8c0b3aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:43.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.148+0000 7f1c92754640 1 --2- 172.21.15.37:0/2222282037 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1c8c0d1990 0x7f1c8c0b3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:43.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.148+0000 7f1c92754640 1 --2- 172.21.15.37:0/2222282037 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1c8c0d15b0 0x7f1c8c0b5da0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:43.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.148+0000 7f1c92754640 1 -- 172.21.15.37:0/2222282037 >> 172.21.15.37:0/2222282037 conn(0x7f1c8c0d2f10 msgr2=0x7f1c8c0b75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:43.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.148+0000 7f1c92754640 1 -- 172.21.15.37:0/2222282037 shutdown_connections 2023-12-11T17:09:43.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.148+0000 7f1c92754640 1 -- 172.21.15.37:0/2222282037 wait complete. 2023-12-11T17:09:43.175 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2023-12-11T17:09:43.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.383+0000 7efdfbfff640 1 Processor -- start 2023-12-11T17:09:43.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.383+0000 7efdfbfff640 1 -- start start 2023-12-11T17:09:43.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.385+0000 7efdfbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efdfc0d1c60 0x7efdfc1682e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:43.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.385+0000 7efdfbfff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdfc0cdb80 con 0x7efdfc15d210 2023-12-11T17:09:43.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.385+0000 7efdfbfff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efdfc0cddb0 con 0x7efdfc15d5f0 2023-12-11T17:09:43.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.385+0000 7efdfbfff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efdfc0b48e0 con 0x7efdfc0d1c60 2023-12-11T17:09:43.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.385+0000 7efdfaffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efdfc15d210 0x7efdfc0d3680 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60610/0 (socket says 172.21.15.37:60610) 2023-12-11T17:09:43.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.385+0000 7efdfaffd640 1 -- 172.21.15.37:0/1702592163 learned_addr learned my addr 172.21.15.37:0/1702592163 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:09:43.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.385+0000 7efdfb7fe640 1 --2- 172.21.15.37:0/1702592163 >> v2:172.21.15.37:3300/0 conn(0x7efdfc0d1c60 0x7efdfc1682e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:43.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.385+0000 7efdfa7fc640 1 -- 172.21.15.37:0/1702592163 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1097332535 0 0) 0x7efdfc0cdb80 con 0x7efdfc15d210 2023-12-11T17:09:43.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.386+0000 7efdfa7fc640 1 -- 172.21.15.37:0/1702592163 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7efde8003520 con 0x7efdfc15d210 2023-12-11T17:09:43.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.386+0000 7efdfb7fe640 1 -- 172.21.15.37:0/1702592163 >> v1:172.21.15.151:6789/0 conn(0x7efdfc15d5f0 legacy=0x7efdfc0d1550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:43.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.386+0000 7efdfb7fe640 1 -- 172.21.15.37:0/1702592163 >> v1:172.21.15.37:6789/0 conn(0x7efdfc15d210 legacy=0x7efdfc0d3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:43.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.386+0000 7efdfb7fe640 1 -- 172.21.15.37:0/1702592163 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdfc0ce050 con 0x7efdfc0d1c60 2023-12-11T17:09:43.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.387+0000 7efdfb7fe640 1 --2- 172.21.15.37:0/1702592163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc0d1c60 0x7efdfc1682e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009dc0 tx=0x7efdf402bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17bef04b9262ea3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:43.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.387+0000 7efdfa7fc640 1 -- 172.21.15.37:0/1702592163 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf402ccd0 con 0x7efdfc0d1c60 2023-12-11T17:09:43.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.387+0000 7efdfa7fc640 1 -- 172.21.15.37:0/1702592163 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf402ce30 con 0x7efdfc0d1c60 2023-12-11T17:09:43.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.387+0000 7efdfa7fc640 1 -- 172.21.15.37:0/1702592163 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf4034660 con 0x7efdfc0d1c60 2023-12-11T17:09:43.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.388+0000 7efdfbfff640 1 -- 172.21.15.37:0/1702592163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc0d1c60 msgr2=0x7efdfc1682e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:43.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.388+0000 7efdfbfff640 1 --2- 172.21.15.37:0/1702592163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc0d1c60 0x7efdfc1682e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7efdf4009dc0 tx=0x7efdf402bf20 comp rx=0 tx=0).stop 2023-12-11T17:09:43.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.388+0000 7efdfbfff640 1 -- 172.21.15.37:0/1702592163 shutdown_connections 2023-12-11T17:09:43.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.388+0000 7efdfbfff640 1 --2- 172.21.15.37:0/1702592163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc0d1c60 0x7efdfc1682e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:43.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.388+0000 7efdfbfff640 1 -- 172.21.15.37:0/1702592163 >> 172.21.15.37:0/1702592163 conn(0x7efdfc09c250 msgr2=0x7efdfc0d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:43.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.388+0000 7efdfbfff640 1 -- 172.21.15.37:0/1702592163 shutdown_connections 2023-12-11T17:09:43.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.388+0000 7efdfbfff640 1 -- 172.21.15.37:0/1702592163 wait complete. 2023-12-11T17:09:43.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.390+0000 7efdfbfff640 1 Processor -- start 2023-12-11T17:09:43.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.390+0000 7efdfbfff640 1 -- start start 2023-12-11T17:09:43.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.391+0000 7efdfbfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdfc0d1c60 0x7efdfc0a05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:43.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.391+0000 7efdfbfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efdfc15d210 0x7efdfc09e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:43.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.391+0000 7efdfbfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc15d5f0 0x7efdfc15f7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:43.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.391+0000 7efdfbfff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc15e470 con 0x7efdfc15d5f0 2023-12-11T17:09:43.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.391+0000 7efdfbfff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc15e750 con 0x7efdfc0d1c60 2023-12-11T17:09:43.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.391+0000 7efdfbfff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efdfc15ea30 con 0x7efdfc15d210 2023-12-11T17:09:43.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.391+0000 7efdfb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc15d5f0 0x7efdfc15f7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:43.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.391+0000 7efdfaffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdfc0d1c60 0x7efdfc0a05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:43.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.391+0000 7efdfb7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc15d5f0 0x7efdfc15f7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45512/0 (socket says 172.21.15.37:45512) 2023-12-11T17:09:43.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.391+0000 7efdfb7fe640 1 -- 172.21.15.37:0/2848024136 learned_addr learned my addr 172.21.15.37:0/2848024136 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:43.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.391+0000 7efdf3fff640 1 --2- 172.21.15.37:0/2848024136 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efdfc15d210 0x7efdfc09e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:43.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.392+0000 7efdfb7fe640 1 -- 172.21.15.37:0/2848024136 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efdfc15d210 msgr2=0x7efdfc09e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:43.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.392+0000 7efdfb7fe640 1 --2- 172.21.15.37:0/2848024136 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efdfc15d210 0x7efdfc09e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:43.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.392+0000 7efdfb7fe640 1 -- 172.21.15.37:0/2848024136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdfc0d1c60 msgr2=0x7efdfc0a05e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:43.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.392+0000 7efdfb7fe640 1 --2- 172.21.15.37:0/2848024136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdfc0d1c60 0x7efdfc0a05e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:43.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.392+0000 7efdfb7fe640 1 -- 172.21.15.37:0/2848024136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdf4009a70 con 0x7efdfc15d5f0 2023-12-11T17:09:43.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.392+0000 7efdfb7fe640 1 --2- 172.21.15.37:0/2848024136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc15d5f0 0x7efdfc15f7f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efdf402dfd0 tx=0x7efdf4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:43.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.393+0000 7efdf37fe640 1 -- 172.21.15.37:0/2848024136 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf403d600 con 0x7efdfc15d5f0 2023-12-11T17:09:43.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.393+0000 7efdf37fe640 1 -- 172.21.15.37:0/2848024136 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdf403d760 con 0x7efdfc15d5f0 2023-12-11T17:09:43.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.393+0000 7efdf37fe640 1 -- 172.21.15.37:0/2848024136 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdf403db10 con 0x7efdfc15d5f0 2023-12-11T17:09:43.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.393+0000 7efdfbfff640 1 -- 172.21.15.37:0/2848024136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efdfc15ed10 con 0x7efdfc15d5f0 2023-12-11T17:09:43.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.393+0000 7efdfbfff640 1 -- 172.21.15.37:0/2848024136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efdfc15f2d0 con 0x7efdfc15d5f0 2023-12-11T17:09:43.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.394+0000 7efdfbfff640 1 -- 172.21.15.37:0/2848024136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efdfc074450 con 0x7efdfc15d5f0 2023-12-11T17:09:43.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.395+0000 7efdf37fe640 1 -- 172.21.15.37:0/2848024136 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efdf403b040 con 0x7efdfc15d5f0 2023-12-11T17:09:43.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.396+0000 7efdf37fe640 1 --2- 172.21.15.37:0/2848024136 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efddc06ae40 0x7efddc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:43.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.397+0000 7efdf37fe640 1 -- 172.21.15.37:0/2848024136 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5227+0+0 (secure 0 0 0) 0x7efdf40ab8a0 con 0x7efdfc15d5f0 2023-12-11T17:09:43.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.397+0000 7efdfaffd640 1 --2- 172.21.15.37:0/2848024136 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efddc06ae40 0x7efddc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:43.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.399+0000 7efdfaffd640 1 --2- 172.21.15.37:0/2848024136 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efddc06ae40 0x7efddc06d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efdec0011e0 tx=0x7efdec007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:43.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.403+0000 7efdf37fe640 1 -- 172.21.15.37:0/2848024136 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efdf4076c60 con 0x7efdfc15d5f0 2023-12-11T17:09:43.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:43.601+0000 7efdfbfff640 1 -- 172.21.15.37:0/2848024136 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) v1 -- 0x7efdfc0afc70 con 0x7efdfc15d5f0 2023-12-11T17:09:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.164+0000 7efdf37fe640 1 -- 172.21.15.37:0/2848024136 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v19) v1 ==== 171+0+0 (secure 0 0 0) 0x7efdf4039020 con 0x7efdfc15d5f0 2023-12-11T17:09:44.165 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-12-11T17:09:44.168 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.168+0000 7efdfbfff640 1 -- 172.21.15.37:0/2848024136 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efddc06ae40 msgr2=0x7efddc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.168+0000 7efdfbfff640 1 --2- 172.21.15.37:0/2848024136 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efddc06ae40 0x7efddc06d300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7efdec0011e0 tx=0x7efdec007d30 comp rx=0 tx=0).stop 2023-12-11T17:09:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.168+0000 7efdfbfff640 1 -- 172.21.15.37:0/2848024136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc15d5f0 msgr2=0x7efdfc15f7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.168+0000 7efdfbfff640 1 --2- 172.21.15.37:0/2848024136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc15d5f0 0x7efdfc15f7f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7efdf402dfd0 tx=0x7efdf4004a40 comp rx=0 tx=0).stop 2023-12-11T17:09:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.168+0000 7efdfbfff640 1 -- 172.21.15.37:0/2848024136 shutdown_connections 2023-12-11T17:09:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.168+0000 7efdfbfff640 1 --2- 172.21.15.37:0/2848024136 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efddc06ae40 0x7efddc06d300 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.168+0000 7efdfbfff640 1 --2- 172.21.15.37:0/2848024136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efdfc15d5f0 0x7efdfc15f7f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.168+0000 7efdfbfff640 1 --2- 172.21.15.37:0/2848024136 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efdfc15d210 0x7efdfc09e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.168+0000 7efdfbfff640 1 --2- 172.21.15.37:0/2848024136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efdfc0d1c60 0x7efdfc0a05e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.168+0000 7efdfbfff640 1 -- 172.21.15.37:0/2848024136 >> 172.21.15.37:0/2848024136 conn(0x7efdfc09c250 msgr2=0x7efdfc06c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.169+0000 7efdfbfff640 1 -- 172.21.15.37:0/2848024136 shutdown_connections 2023-12-11T17:09:44.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.169+0000 7efdfbfff640 1 -- 172.21.15.37:0/2848024136 wait complete. 2023-12-11T17:09:44.201 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-11T17:09:44.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.394+0000 7fcc1759e640 1 Processor -- start 2023-12-11T17:09:44.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.394+0000 7fcc1759e640 1 -- start start 2023-12-11T17:09:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.395+0000 7fcc1759e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcc18155400 0x7fcc1806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.396+0000 7fcc1759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc180ce150 0x7fcc180ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.396+0000 7fcc1759e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcc180cedf0 0x7fcc180cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.396+0000 7fcc1759e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc180cf7c0 con 0x7fcc18155400 2023-12-11T17:09:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.396+0000 7fcc1759e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc1815b4a0 con 0x7fcc180cedf0 2023-12-11T17:09:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.396+0000 7fcc1759e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc180adbb0 con 0x7fcc180ce150 2023-12-11T17:09:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.396+0000 7fcc1659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcc18155400 0x7fcc1806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.396+0000 7fcc1659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcc18155400 0x7fcc1806bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45518/0 (socket says 172.21.15.37:45518) 2023-12-11T17:09:44.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.396+0000 7fcc1659c640 1 -- 172.21.15.37:0/1265206765 learned_addr learned my addr 172.21.15.37:0/1265206765 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:44.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.396+0000 7fcc16d9d640 1 --2- 172.21.15.37:0/1265206765 >> v2:172.21.15.151:3300/0 conn(0x7fcc180cedf0 0x7fcc180cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:44.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.396+0000 7fcc15d9b640 1 --2- 172.21.15.37:0/1265206765 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc180ce150 0x7fcc180ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:44.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.396+0000 7fcc1659c640 1 -- 172.21.15.37:0/1265206765 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc180ce150 msgr2=0x7fcc180ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:44.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.396+0000 7fcc1659c640 1 --2- 172.21.15.37:0/1265206765 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc180ce150 0x7fcc180ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:44.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.396+0000 7fcc1659c640 1 -- 172.21.15.37:0/1265206765 >> v2:172.21.15.151:3300/0 conn(0x7fcc180cedf0 msgr2=0x7fcc180cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:44.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.396+0000 7fcc1659c640 1 --2- 172.21.15.37:0/1265206765 >> v2:172.21.15.151:3300/0 conn(0x7fcc180cedf0 0x7fcc180cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:44.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.396+0000 7fcc1659c640 1 -- 172.21.15.37:0/1265206765 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc180ade90 con 0x7fcc18155400 2023-12-11T17:09:44.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.396+0000 7fcc16d9d640 1 --2- 172.21.15.37:0/1265206765 >> v2:172.21.15.151:3300/0 conn(0x7fcc180cedf0 0x7fcc180cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:09:44.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.397+0000 7fcc1659c640 1 --2- 172.21.15.37:0/1265206765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc18155400 0x7fcc1806bdf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcc1806cf30 tx=0x7fcc0802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71d068cb0bdfe8ab server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:44.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.398+0000 7fcc1559a640 1 -- 172.21.15.37:0/1265206765 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc08031870 con 0x7fcc18155400 2023-12-11T17:09:44.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.398+0000 7fcc1559a640 1 -- 172.21.15.37:0/1265206765 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc080319d0 con 0x7fcc18155400 2023-12-11T17:09:44.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.398+0000 7fcc1559a640 1 -- 172.21.15.37:0/1265206765 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc08031d60 con 0x7fcc18155400 2023-12-11T17:09:44.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.398+0000 7fcc1759e640 1 -- 172.21.15.37:0/1265206765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc18155400 msgr2=0x7fcc1806bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:44.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.398+0000 7fcc1759e640 1 --2- 172.21.15.37:0/1265206765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc18155400 0x7fcc1806bdf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcc1806cf30 tx=0x7fcc0802b910 comp rx=0 tx=0).stop 2023-12-11T17:09:44.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.399+0000 7fcc1759e640 1 -- 172.21.15.37:0/1265206765 shutdown_connections 2023-12-11T17:09:44.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.399+0000 7fcc1759e640 1 --2- 172.21.15.37:0/1265206765 >> v2:172.21.15.151:3300/0 conn(0x7fcc180cedf0 0x7fcc180cf280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:44.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.399+0000 7fcc1759e640 1 --2- 172.21.15.37:0/1265206765 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc180ce150 0x7fcc180ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:44.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.399+0000 7fcc1759e640 1 --2- 172.21.15.37:0/1265206765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc18155400 0x7fcc1806bdf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:44.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.399+0000 7fcc1759e640 1 -- 172.21.15.37:0/1265206765 >> 172.21.15.37:0/1265206765 conn(0x7fcc1806a640 msgr2=0x7fcc1806aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:44.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.399+0000 7fcc1759e640 1 -- 172.21.15.37:0/1265206765 shutdown_connections 2023-12-11T17:09:44.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.399+0000 7fcc1759e640 1 -- 172.21.15.37:0/1265206765 wait complete. 2023-12-11T17:09:44.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.400+0000 7fcc1759e640 1 Processor -- start 2023-12-11T17:09:44.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.401+0000 7fcc1759e640 1 -- start start 2023-12-11T17:09:44.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.401+0000 7fcc1759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc180ce150 0x7fcc1814d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:44.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.402+0000 7fcc1759e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc180cedf0 0x7fcc18150b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:44.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.402+0000 7fcc1759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc18155400 0x7fcc180ae7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:44.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.402+0000 7fcc1759e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc180b07d0 con 0x7fcc180ce150 2023-12-11T17:09:44.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.402+0000 7fcc1759e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc18151360 con 0x7fcc180cedf0 2023-12-11T17:09:44.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.402+0000 7fcc1759e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc180b0a00 con 0x7fcc18155400 2023-12-11T17:09:44.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.402+0000 7fcc1659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc180ce150 0x7fcc1814d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:44.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.402+0000 7fcc1659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc180ce150 0x7fcc1814d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45530/0 (socket says 172.21.15.37:45530) 2023-12-11T17:09:44.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.402+0000 7fcc1659c640 1 -- 172.21.15.37:0/2098265165 learned_addr learned my addr 172.21.15.37:0/2098265165 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:44.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.402+0000 7fcc15d9b640 1 --2- 172.21.15.37:0/2098265165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc180cedf0 0x7fcc18150b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:44.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.402+0000 7fcc16d9d640 1 --2- 172.21.15.37:0/2098265165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc18155400 0x7fcc180ae7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:44.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.402+0000 7fcc1659c640 1 -- 172.21.15.37:0/2098265165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc18155400 msgr2=0x7fcc180ae7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:44.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.402+0000 7fcc1659c640 1 --2- 172.21.15.37:0/2098265165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc18155400 0x7fcc180ae7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:44.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.402+0000 7fcc1659c640 1 -- 172.21.15.37:0/2098265165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc180cedf0 msgr2=0x7fcc18150b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:44.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.402+0000 7fcc1659c640 1 --2- 172.21.15.37:0/2098265165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc180cedf0 0x7fcc18150b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:44.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.402+0000 7fcc1659c640 1 -- 172.21.15.37:0/2098265165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc080094d0 con 0x7fcc180ce150 2023-12-11T17:09:44.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.402+0000 7fcc15d9b640 1 --2- 172.21.15.37:0/2098265165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc180cedf0 0x7fcc18150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:09:44.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.403+0000 7fcc1659c640 1 --2- 172.21.15.37:0/2098265165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc180ce150 0x7fcc1814d580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcc0802b950 tx=0x7fcc080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:44.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.403+0000 7fcc06ffd640 1 -- 172.21.15.37:0/2098265165 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc08031860 con 0x7fcc180ce150 2023-12-11T17:09:44.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.403+0000 7fcc06ffd640 1 -- 172.21.15.37:0/2098265165 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc080443f0 con 0x7fcc180ce150 2023-12-11T17:09:44.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.403+0000 7fcc1759e640 1 -- 172.21.15.37:0/2098265165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc181510c0 con 0x7fcc180ce150 2023-12-11T17:09:44.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.403+0000 7fcc06ffd640 1 -- 172.21.15.37:0/2098265165 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc080447a0 con 0x7fcc180ce150 2023-12-11T17:09:44.405 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.403+0000 7fcc1759e640 1 -- 172.21.15.37:0/2098265165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc180b0f80 con 0x7fcc180ce150 2023-12-11T17:09:44.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.404+0000 7fcc1759e640 1 -- 172.21.15.37:0/2098265165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc180b1780 con 0x7fcc180ce150 2023-12-11T17:09:44.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.405+0000 7fcc06ffd640 1 -- 172.21.15.37:0/2098265165 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcc0804d450 con 0x7fcc180ce150 2023-12-11T17:09:44.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.406+0000 7fcc06ffd640 1 --2- 172.21.15.37:0/2098265165 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcbf806ae40 0x7fcbf806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:44.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.406+0000 7fcc06ffd640 1 -- 172.21.15.37:0/2098265165 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fcc0802d040 con 0x7fcc180ce150 2023-12-11T17:09:44.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.407+0000 7fcc15d9b640 1 --2- 172.21.15.37:0/2098265165 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcbf806ae40 0x7fcbf806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:44.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.408+0000 7fcc15d9b640 1 --2- 172.21.15.37:0/2098265165 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcbf806ae40 0x7fcbf806d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcc1809c6e0 tx=0x7fcc0c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:44.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.411+0000 7fcc06ffd640 1 -- 172.21.15.37:0/2098265165 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcc08076e00 con 0x7fcc180ce150 2023-12-11T17:09:44.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:44.641+0000 7fcc1759e640 1 -- 172.21.15.37:0/2098265165 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcc18074450 con 0x7fcc180ce150 2023-12-11T17:09:45.169 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.169+0000 7fcc06ffd640 1 -- 172.21.15.37:0/2098265165 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7fcc08035020 con 0x7fcc180ce150 2023-12-11T17:09:45.169 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 2 and data pool 3 2023-12-11T17:09:45.172 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.172+0000 7fcc1759e640 1 -- 172.21.15.37:0/2098265165 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcbf806ae40 msgr2=0x7fcbf806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.172+0000 7fcc1759e640 1 --2- 172.21.15.37:0/2098265165 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcbf806ae40 0x7fcbf806d300 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcc1809c6e0 tx=0x7fcc0c008040 comp rx=0 tx=0).stop 2023-12-11T17:09:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.172+0000 7fcc1759e640 1 -- 172.21.15.37:0/2098265165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc180ce150 msgr2=0x7fcc1814d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.172+0000 7fcc1759e640 1 --2- 172.21.15.37:0/2098265165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc180ce150 0x7fcc1814d580 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fcc0802b950 tx=0x7fcc080046c0 comp rx=0 tx=0).stop 2023-12-11T17:09:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.172+0000 7fcc1759e640 1 -- 172.21.15.37:0/2098265165 shutdown_connections 2023-12-11T17:09:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.172+0000 7fcc1759e640 1 --2- 172.21.15.37:0/2098265165 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcbf806ae40 0x7fcbf806d300 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.172+0000 7fcc1759e640 1 --2- 172.21.15.37:0/2098265165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc180cedf0 0x7fcc18150b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.172+0000 7fcc1759e640 1 --2- 172.21.15.37:0/2098265165 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcc18155400 0x7fcc180ae7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.172+0000 7fcc1759e640 1 --2- 172.21.15.37:0/2098265165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcc180ce150 0x7fcc1814d580 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.172+0000 7fcc1759e640 1 -- 172.21.15.37:0/2098265165 >> 172.21.15.37:0/2098265165 conn(0x7fcc1806a640 msgr2=0x7fcc18159f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.173+0000 7fcc1759e640 1 -- 172.21.15.37:0/2098265165 shutdown_connections 2023-12-11T17:09:45.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.173+0000 7fcc1759e640 1 -- 172.21.15.37:0/2098265165 wait complete. 2023-12-11T17:09:45.211 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2023-12-11T17:09:45.212 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2023-12-11T17:09:45.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.408+0000 7f08f7ab2640 1 Processor -- start 2023-12-11T17:09:45.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.408+0000 7f08f7ab2640 1 -- start start 2023-12-11T17:09:45.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.409+0000 7f08f7ab2640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f08f01448a0 0x7f08f006c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:45.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.409+0000 7f08f7ab2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08f00724a0 0x7f08f00b1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:45.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.410+0000 7f08f7ab2640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08f00b3c50 con 0x7f08f00b22d0 2023-12-11T17:09:45.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.410+0000 7f08f7ab2640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f00b3960 con 0x7f08f00724a0 2023-12-11T17:09:45.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.410+0000 7f08f7ab2640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08f0071140 con 0x7f08f01448a0 2023-12-11T17:09:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.410+0000 7f08f504d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08f00724a0 0x7f08f00b1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.410+0000 7f08f504d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08f00724a0 0x7f08f00b1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45534/0 (socket says 172.21.15.37:45534) 2023-12-11T17:09:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.410+0000 7f08f504d640 1 -- 172.21.15.37:0/2258134979 learned_addr learned my addr 172.21.15.37:0/2258134979 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.410+0000 7f08f584e640 1 --2- 172.21.15.37:0/2258134979 >> v2:172.21.15.151:3300/0 conn(0x7f08f01448a0 0x7f08f006c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.410+0000 7f08f504d640 1 -- 172.21.15.37:0/2258134979 >> v2:172.21.15.151:3300/0 conn(0x7f08f01448a0 msgr2=0x7f08f006c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.410+0000 7f08f504d640 1 --2- 172.21.15.37:0/2258134979 >> v2:172.21.15.151:3300/0 conn(0x7f08f01448a0 0x7f08f006c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.410+0000 7f08f504d640 1 -- 172.21.15.37:0/2258134979 >> v1:172.21.15.151:6789/0 conn(0x7f08f00b22d0 legacy=0x7f08f015ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.410+0000 7f08f504d640 1 -- 172.21.15.37:0/2258134979 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f0071420 con 0x7f08f00724a0 2023-12-11T17:09:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.412+0000 7f08f504d640 1 --2- 172.21.15.37:0/2258134979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08f00724a0 0x7f08f00b1d90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f08f00cfd90 tx=0x7f08e002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4bc6b34a98cc3b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:45.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.412+0000 7f08f484c640 1 -- 172.21.15.37:0/2258134979 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0031870 con 0x7f08f00724a0 2023-12-11T17:09:45.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.412+0000 7f08f484c640 1 -- 172.21.15.37:0/2258134979 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e00319d0 con 0x7f08f00724a0 2023-12-11T17:09:45.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.412+0000 7f08f484c640 1 -- 172.21.15.37:0/2258134979 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0031d60 con 0x7f08f00724a0 2023-12-11T17:09:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.413+0000 7f08f7ab2640 1 -- 172.21.15.37:0/2258134979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08f00724a0 msgr2=0x7f08f00b1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.413+0000 7f08f7ab2640 1 --2- 172.21.15.37:0/2258134979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08f00724a0 0x7f08f00b1d90 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f08f00cfd90 tx=0x7f08e002b910 comp rx=0 tx=0).stop 2023-12-11T17:09:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.413+0000 7f08f7ab2640 1 -- 172.21.15.37:0/2258134979 shutdown_connections 2023-12-11T17:09:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.413+0000 7f08f7ab2640 1 --2- 172.21.15.37:0/2258134979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08f00724a0 0x7f08f00b1d90 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.413+0000 7f08f7ab2640 1 --2- 172.21.15.37:0/2258134979 >> v2:172.21.15.151:3300/0 conn(0x7f08f01448a0 0x7f08f006c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.413+0000 7f08f7ab2640 1 -- 172.21.15.37:0/2258134979 >> 172.21.15.37:0/2258134979 conn(0x7f08f00b0a90 msgr2=0x7f08f00b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.413+0000 7f08f7ab2640 1 -- 172.21.15.37:0/2258134979 shutdown_connections 2023-12-11T17:09:45.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.413+0000 7f08f7ab2640 1 -- 172.21.15.37:0/2258134979 wait complete. 2023-12-11T17:09:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.414+0000 7f08f7ab2640 1 Processor -- start 2023-12-11T17:09:45.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.415+0000 7f08f7ab2640 1 -- start start 2023-12-11T17:09:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.415+0000 7f08f7ab2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08f00724a0 0x7f08f00ac370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.415+0000 7f08f7ab2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08f00b22d0 0x7f08f015d8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.416+0000 7f08f7ab2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08f01448a0 0x7f08f015de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.416+0000 7f08f7ab2640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f01322a0 con 0x7f08f00b22d0 2023-12-11T17:09:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.416+0000 7f08f7ab2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08f012fcf0 con 0x7f08f00724a0 2023-12-11T17:09:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.416+0000 7f08f7ab2640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08f012f3c0 con 0x7f08f01448a0 2023-12-11T17:09:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.416+0000 7f08f504d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08f00b22d0 0x7f08f015d8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.416+0000 7f08f504d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08f00b22d0 0x7f08f015d8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45550/0 (socket says 172.21.15.37:45550) 2023-12-11T17:09:45.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.416+0000 7f08f504d640 1 -- 172.21.15.37:0/2314842065 learned_addr learned my addr 172.21.15.37:0/2314842065 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.416+0000 7f08f584e640 1 --2- 172.21.15.37:0/2314842065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08f00724a0 0x7f08f00ac370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:45.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.416+0000 7f08f604f640 1 --2- 172.21.15.37:0/2314842065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08f01448a0 0x7f08f015de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.416+0000 7f08f504d640 1 -- 172.21.15.37:0/2314842065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08f01448a0 msgr2=0x7f08f015de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.416+0000 7f08f504d640 1 --2- 172.21.15.37:0/2314842065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08f01448a0 0x7f08f015de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.416+0000 7f08f504d640 1 -- 172.21.15.37:0/2314842065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08f00724a0 msgr2=0x7f08f00ac370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.416+0000 7f08f504d640 1 --2- 172.21.15.37:0/2314842065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08f00724a0 0x7f08f00ac370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.416+0000 7f08f504d640 1 -- 172.21.15.37:0/2314842065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e00094d0 con 0x7f08f00b22d0 2023-12-11T17:09:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.416+0000 7f08f584e640 1 --2- 172.21.15.37:0/2314842065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08f00724a0 0x7f08f00ac370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:09:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.417+0000 7f08f504d640 1 --2- 172.21.15.37:0/2314842065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08f00b22d0 0x7f08f015d8d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f08e002b950 tx=0x7f08e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.417+0000 7f08e67fc640 1 -- 172.21.15.37:0/2314842065 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e003abe0 con 0x7f08f00b22d0 2023-12-11T17:09:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.417+0000 7f08e67fc640 1 -- 172.21.15.37:0/2314842065 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08e003ad40 con 0x7f08f00b22d0 2023-12-11T17:09:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.417+0000 7f08f7ab2640 1 -- 172.21.15.37:0/2314842065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08f012f6a0 con 0x7f08f00b22d0 2023-12-11T17:09:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.417+0000 7f08e67fc640 1 -- 172.21.15.37:0/2314842065 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08e0044610 con 0x7f08f00b22d0 2023-12-11T17:09:45.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.417+0000 7f08f7ab2640 1 -- 172.21.15.37:0/2314842065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08f00ac8b0 con 0x7f08f00b22d0 2023-12-11T17:09:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.418+0000 7f08f7ab2640 1 -- 172.21.15.37:0/2314842065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08f0074670 con 0x7f08f00b22d0 2023-12-11T17:09:45.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.419+0000 7f08e67fc640 1 -- 172.21.15.37:0/2314842065 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08e0044770 con 0x7f08f00b22d0 2023-12-11T17:09:45.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.421+0000 7f08e67fc640 1 --2- 172.21.15.37:0/2314842065 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f08d406ae40 0x7f08d406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.421+0000 7f08e67fc640 1 -- 172.21.15.37:0/2314842065 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08e002d040 con 0x7f08f00b22d0 2023-12-11T17:09:45.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.421+0000 7f08f584e640 1 --2- 172.21.15.37:0/2314842065 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f08d406ae40 0x7f08d406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:45.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.422+0000 7f08f584e640 1 --2- 172.21.15.37:0/2314842065 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f08d406ae40 0x7f08d406d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f08ec006fd0 tx=0x7f08ec008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:45.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.427+0000 7f08e67fc640 1 -- 172.21.15.37:0/2314842065 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f08e0076d10 con 0x7f08f00b22d0 2023-12-11T17:09:45.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:45.624+0000 7f08f7ab2640 1 -- 172.21.15.37:0/2314842065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) v1 -- 0x7f08f0142010 con 0x7f08f00b22d0 2023-12-11T17:09:46.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.189+0000 7f08e67fc640 1 -- 172.21.15.37:0/2314842065 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v21) v1 ==== 157+0+0 (secure 0 0 0) 0x7f08e007a330 con 0x7f08f00b22d0 2023-12-11T17:09:46.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.193+0000 7f08f7ab2640 1 -- 172.21.15.37:0/2314842065 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f08d406ae40 msgr2=0x7f08d406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:46.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.193+0000 7f08f7ab2640 1 --2- 172.21.15.37:0/2314842065 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f08d406ae40 0x7f08d406d300 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f08ec006fd0 tx=0x7f08ec008040 comp rx=0 tx=0).stop 2023-12-11T17:09:46.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.193+0000 7f08f7ab2640 1 -- 172.21.15.37:0/2314842065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08f00b22d0 msgr2=0x7f08f015d8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:46.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.193+0000 7f08f7ab2640 1 --2- 172.21.15.37:0/2314842065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08f00b22d0 0x7f08f015d8d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f08e002b950 tx=0x7f08e00046c0 comp rx=0 tx=0).stop 2023-12-11T17:09:46.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.193+0000 7f08f7ab2640 1 -- 172.21.15.37:0/2314842065 shutdown_connections 2023-12-11T17:09:46.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.194+0000 7f08f7ab2640 1 --2- 172.21.15.37:0/2314842065 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f08d406ae40 0x7f08d406d300 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:46.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.194+0000 7f08f7ab2640 1 --2- 172.21.15.37:0/2314842065 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08f01448a0 0x7f08f015de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:46.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.194+0000 7f08f7ab2640 1 --2- 172.21.15.37:0/2314842065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08f00b22d0 0x7f08f015d8d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:46.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.194+0000 7f08f7ab2640 1 --2- 172.21.15.37:0/2314842065 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08f00724a0 0x7f08f00ac370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:46.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.194+0000 7f08f7ab2640 1 -- 172.21.15.37:0/2314842065 >> 172.21.15.37:0/2314842065 conn(0x7f08f00b0a90 msgr2=0x7f08f006d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:46.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.194+0000 7f08f7ab2640 1 -- 172.21.15.37:0/2314842065 shutdown_connections 2023-12-11T17:09:46.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.194+0000 7f08f7ab2640 1 -- 172.21.15.37:0/2314842065 wait complete. 2023-12-11T17:09:46.214 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2023-12-11T17:09:46.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.443+0000 7f567759e640 1 Processor -- start 2023-12-11T17:09:46.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.444+0000 7f567759e640 1 -- start start 2023-12-11T17:09:46.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.445+0000 7f567759e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f56781607f0 0x7f56780cf930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:46.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.445+0000 7f567759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56780d3b80 0x7f56780cfe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:46.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.445+0000 7f567759e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56780b3dc0 con 0x7f56780d3670 2023-12-11T17:09:46.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.445+0000 7f567759e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56780b4050 con 0x7f56781607f0 2023-12-11T17:09:46.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.445+0000 7f567759e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56780d1de0 con 0x7f56780d3b80 2023-12-11T17:09:46.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.446+0000 7f567659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f56781607f0 0x7f56780cf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:46.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.446+0000 7f567659c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f56781607f0 0x7f56780cf930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45554/0 (socket says 172.21.15.37:45554) 2023-12-11T17:09:46.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.446+0000 7f567659c640 1 -- 172.21.15.37:0/795694452 learned_addr learned my addr 172.21.15.37:0/795694452 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:46.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.446+0000 7f567659c640 1 -- 172.21.15.37:0/795694452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56780d3b80 msgr2=0x7f56780cfe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:46.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.446+0000 7f5675d9b640 1 --2- 172.21.15.37:0/795694452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56780d3b80 0x7f56780cfe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:46.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.446+0000 7f567659c640 1 --2- 172.21.15.37:0/795694452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56780d3b80 0x7f56780cfe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:46.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.446+0000 7f567659c640 1 -- 172.21.15.37:0/795694452 >> v1:172.21.15.37:6789/0 conn(0x7f56780d3670 legacy=0x7f5678160ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:46.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.446+0000 7f567559a640 1 -- 172.21.15.37:0/795694452 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2964828877 0 0) 0x7f56780b3dc0 con 0x7f56780d3670 2023-12-11T17:09:46.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.446+0000 7f567659c640 1 -- 172.21.15.37:0/795694452 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56780ce7e0 con 0x7f56781607f0 2023-12-11T17:09:46.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.446+0000 7f5675d9b640 1 --2- 172.21.15.37:0/795694452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56780d3b80 0x7f56780cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:09:46.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.447+0000 7f567659c640 1 --2- 172.21.15.37:0/795694452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56781607f0 0x7f56780cf930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5668009e50 tx=0x7f566802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dea92cb8eece140 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:46.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.448+0000 7f567559a640 1 -- 172.21.15.37:0/795694452 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f566802cb00 con 0x7f56781607f0 2023-12-11T17:09:46.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.448+0000 7f567559a640 1 -- 172.21.15.37:0/795694452 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f566802cc60 con 0x7f56781607f0 2023-12-11T17:09:46.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.448+0000 7f567559a640 1 -- 172.21.15.37:0/795694452 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56680343f0 con 0x7f56781607f0 2023-12-11T17:09:46.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.448+0000 7f567759e640 1 -- 172.21.15.37:0/795694452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56781607f0 msgr2=0x7f56780cf930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:46.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.448+0000 7f567759e640 1 --2- 172.21.15.37:0/795694452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56781607f0 0x7f56780cf930 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f5668009e50 tx=0x7f566802bf60 comp rx=0 tx=0).stop 2023-12-11T17:09:46.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.448+0000 7f567759e640 1 -- 172.21.15.37:0/795694452 shutdown_connections 2023-12-11T17:09:46.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.448+0000 7f567759e640 1 --2- 172.21.15.37:0/795694452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56780d3b80 0x7f56780cfe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:46.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.448+0000 7f567759e640 1 --2- 172.21.15.37:0/795694452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56781607f0 0x7f56780cf930 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:46.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.448+0000 7f567759e640 1 -- 172.21.15.37:0/795694452 >> 172.21.15.37:0/795694452 conn(0x7f567809c230 msgr2=0x7f56780d2f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:46.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.448+0000 7f567759e640 1 -- 172.21.15.37:0/795694452 shutdown_connections 2023-12-11T17:09:46.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.448+0000 7f567759e640 1 -- 172.21.15.37:0/795694452 wait complete. 2023-12-11T17:09:46.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.450+0000 7f567759e640 1 Processor -- start 2023-12-11T17:09:46.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.450+0000 7f567759e640 1 -- start start 2023-12-11T17:09:46.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.451+0000 7f567759e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56780d3670 0x7f5678152480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:46.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.451+0000 7f567759e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56780d3b80 0x7f56780b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:46.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.451+0000 7f567759e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56781607f0 0x7f56780b07b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:46.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.451+0000 7f567759e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56780b65c0 con 0x7f56780d3b80 2023-12-11T17:09:46.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.451+0000 7f567759e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56780b68a0 con 0x7f56780d3670 2023-12-11T17:09:46.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.451+0000 7f567759e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56780b6b80 con 0x7f56781607f0 2023-12-11T17:09:46.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.451+0000 7f5675d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56780d3b80 0x7f56780b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:46.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.451+0000 7f5675d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56780d3b80 0x7f56780b5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45560/0 (socket says 172.21.15.37:45560) 2023-12-11T17:09:46.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.451+0000 7f5675d9b640 1 -- 172.21.15.37:0/751283225 learned_addr learned my addr 172.21.15.37:0/751283225 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:46.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.452+0000 7f567659c640 1 --2- 172.21.15.37:0/751283225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56780d3670 0x7f5678152480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:46.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.452+0000 7f5675d9b640 1 -- 172.21.15.37:0/751283225 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56781607f0 msgr2=0x7f56780b07b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:46.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.452+0000 7f5675d9b640 1 --2- 172.21.15.37:0/751283225 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56781607f0 0x7f56780b07b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:46.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.452+0000 7f5675d9b640 1 -- 172.21.15.37:0/751283225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56780d3670 msgr2=0x7f5678152480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:46.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.452+0000 7f5675d9b640 1 --2- 172.21.15.37:0/751283225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56780d3670 0x7f5678152480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:46.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.452+0000 7f5675d9b640 1 -- 172.21.15.37:0/751283225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5668009b30 con 0x7f56780d3b80 2023-12-11T17:09:46.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.452+0000 7f567659c640 1 --2- 172.21.15.37:0/751283225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56780d3670 0x7f5678152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:09:46.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.452+0000 7f5675d9b640 1 --2- 172.21.15.37:0/751283225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56780d3b80 0x7f56780b5b00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f566000c7f0 tx=0x7f566000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:46.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.452+0000 7f566effd640 1 -- 172.21.15.37:0/751283225 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5660007820 con 0x7f56780d3b80 2023-12-11T17:09:46.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.452+0000 7f566effd640 1 -- 172.21.15.37:0/751283225 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5660007980 con 0x7f56780d3b80 2023-12-11T17:09:46.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.452+0000 7f566effd640 1 -- 172.21.15.37:0/751283225 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5660007cf0 con 0x7f56780d3b80 2023-12-11T17:09:46.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.452+0000 7f567759e640 1 -- 172.21.15.37:0/751283225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56780b6e60 con 0x7f56780d3b80 2023-12-11T17:09:46.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.453+0000 7f567759e640 1 -- 172.21.15.37:0/751283225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56780c94c0 con 0x7f56780d3b80 2023-12-11T17:09:46.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.453+0000 7f567759e640 1 -- 172.21.15.37:0/751283225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56780678c0 con 0x7f56780d3b80 2023-12-11T17:09:46.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.454+0000 7f566effd640 1 -- 172.21.15.37:0/751283225 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f56600113f0 con 0x7f56780d3b80 2023-12-11T17:09:46.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.455+0000 7f566effd640 1 --2- 172.21.15.37:0/751283225 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f565806ae40 0x7f565806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:46.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.455+0000 7f566effd640 1 -- 172.21.15.37:0/751283225 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5935+0+0 (secure 0 0 0) 0x7f5660089b60 con 0x7f56780d3b80 2023-12-11T17:09:46.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.456+0000 7f567659c640 1 --2- 172.21.15.37:0/751283225 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f565806ae40 0x7f565806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:46.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.457+0000 7f567659c640 1 --2- 172.21.15.37:0/751283225 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f565806ae40 0x7f565806d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5668035000 tx=0x7f5668030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:46.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.460+0000 7f566effd640 1 -- 172.21.15.37:0/751283225 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5660054a00 con 0x7f56780d3b80 2023-12-11T17:09:46.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:46.648+0000 7f567759e640 1 -- 172.21.15.37:0/751283225 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f5678074450 con 0x7f56780d3b80 2023-12-11T17:09:48.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.224+0000 7f566effd640 1 -- 172.21.15.37:0/751283225 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v23) v1 ==== 228+0+0 (secure 0 0 0) 0x7f566001f020 con 0x7f56780d3b80 2023-12-11T17:09:48.224 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data_ec' created 2023-12-11T17:09:48.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.228+0000 7f567759e640 1 -- 172.21.15.37:0/751283225 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f565806ae40 msgr2=0x7f565806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:48.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.228+0000 7f567759e640 1 --2- 172.21.15.37:0/751283225 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f565806ae40 0x7f565806d300 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f5668035000 tx=0x7f5668030000 comp rx=0 tx=0).stop 2023-12-11T17:09:48.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.228+0000 7f567759e640 1 -- 172.21.15.37:0/751283225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56780d3b80 msgr2=0x7f56780b5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:48.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.228+0000 7f567759e640 1 --2- 172.21.15.37:0/751283225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56780d3b80 0x7f56780b5b00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f566000c7f0 tx=0x7f566000ccb0 comp rx=0 tx=0).stop 2023-12-11T17:09:48.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.229+0000 7f567759e640 1 -- 172.21.15.37:0/751283225 shutdown_connections 2023-12-11T17:09:48.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.229+0000 7f567759e640 1 --2- 172.21.15.37:0/751283225 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f565806ae40 0x7f565806d300 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:48.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.229+0000 7f567759e640 1 --2- 172.21.15.37:0/751283225 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f56781607f0 0x7f56780b07b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:48.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.229+0000 7f567759e640 1 --2- 172.21.15.37:0/751283225 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f56780d3b80 0x7f56780b5b00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:48.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.229+0000 7f567759e640 1 --2- 172.21.15.37:0/751283225 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f56780d3670 0x7f5678152480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:48.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.229+0000 7f567759e640 1 -- 172.21.15.37:0/751283225 >> 172.21.15.37:0/751283225 conn(0x7f567809c230 msgr2=0x7f56780b3260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:48.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.231+0000 7f567759e640 1 -- 172.21.15.37:0/751283225 shutdown_connections 2023-12-11T17:09:48.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.231+0000 7f567759e640 1 -- 172.21.15.37:0/751283225 wait complete. 2023-12-11T17:09:48.260 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2023-12-11T17:09:48.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.460+0000 7fc7fc977640 1 Processor -- start 2023-12-11T17:09:48.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.461+0000 7fc7fc977640 1 -- start start 2023-12-11T17:09:48.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.462+0000 7fc7fc977640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7f8159f30 0x7fc7f80cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:48.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.462+0000 7fc7fc977640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7f80b2610 0x7fc7f80cf4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:48.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.462+0000 7fc7fc977640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f8071020 con 0x7fc7f80720c0 2023-12-11T17:09:48.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.462+0000 7fc7fc977640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f8071300 con 0x7fc7f80b2610 2023-12-11T17:09:48.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.462+0000 7fc7fc977640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f80715e0 con 0x7fc7f8159f30 2023-12-11T17:09:48.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.463+0000 7fc7f759e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc7f80b2610 0x7fc7f80cf4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:48.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.463+0000 7fc7f659c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc7f80720c0 0x7fc7f80b1f00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60622/0 (socket says 172.21.15.37:60622) 2023-12-11T17:09:48.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.463+0000 7fc7f659c640 1 -- 172.21.15.37:0/3032403440 learned_addr learned my addr 172.21.15.37:0/3032403440 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:09:48.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.463+0000 7fc7f6d9d640 1 --2- 172.21.15.37:0/3032403440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7f8159f30 0x7fc7f80cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:48.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.463+0000 7fc7f5d9b640 1 -- 172.21.15.37:0/3032403440 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1053398402 0 0) 0x7fc7f8071020 con 0x7fc7f80720c0 2023-12-11T17:09:48.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.463+0000 7fc7f5d9b640 1 -- 172.21.15.37:0/3032403440 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7e4003520 con 0x7fc7f80720c0 2023-12-11T17:09:48.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.464+0000 7fc7f759e640 1 -- 172.21.15.37:0/3032403440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7f8159f30 msgr2=0x7fc7f80cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:48.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.464+0000 7fc7f759e640 1 --2- 172.21.15.37:0/3032403440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7f8159f30 0x7fc7f80cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:48.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.464+0000 7fc7f759e640 1 -- 172.21.15.37:0/3032403440 >> v1:172.21.15.37:6789/0 conn(0x7fc7f80720c0 legacy=0x7fc7f80b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:48.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.464+0000 7fc7f759e640 1 -- 172.21.15.37:0/3032403440 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f80718c0 con 0x7fc7f80b2610 2023-12-11T17:09:48.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.465+0000 7fc7f759e640 1 --2- 172.21.15.37:0/3032403440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80b2610 0x7fc7f80cf4f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0009d90 tx=0x7fc7f002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a391cd58e43c5a0d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:48.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.466+0000 7fc7f5d9b640 1 -- 172.21.15.37:0/3032403440 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f002cc50 con 0x7fc7f80b2610 2023-12-11T17:09:48.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.466+0000 7fc7f5d9b640 1 -- 172.21.15.37:0/3032403440 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7f002cdb0 con 0x7fc7f80b2610 2023-12-11T17:09:48.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.466+0000 7fc7f5d9b640 1 -- 172.21.15.37:0/3032403440 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7f0034660 con 0x7fc7f80b2610 2023-12-11T17:09:48.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.466+0000 7fc7fc977640 1 -- 172.21.15.37:0/3032403440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80b2610 msgr2=0x7fc7f80cf4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:48.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.466+0000 7fc7fc977640 1 --2- 172.21.15.37:0/3032403440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80b2610 0x7fc7f80cf4f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fc7f0009d90 tx=0x7fc7f002bea0 comp rx=0 tx=0).stop 2023-12-11T17:09:48.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.466+0000 7fc7fc977640 1 -- 172.21.15.37:0/3032403440 shutdown_connections 2023-12-11T17:09:48.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.466+0000 7fc7fc977640 1 --2- 172.21.15.37:0/3032403440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80b2610 0x7fc7f80cf4f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:48.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.466+0000 7fc7fc977640 1 --2- 172.21.15.37:0/3032403440 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7f8159f30 0x7fc7f80cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:48.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.466+0000 7fc7fc977640 1 -- 172.21.15.37:0/3032403440 >> 172.21.15.37:0/3032403440 conn(0x7fc7f806a880 msgr2=0x7fc7f806ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:48.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.467+0000 7fc7fc977640 1 -- 172.21.15.37:0/3032403440 shutdown_connections 2023-12-11T17:09:48.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.467+0000 7fc7fc977640 1 -- 172.21.15.37:0/3032403440 wait complete. 2023-12-11T17:09:48.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.468+0000 7fc7fc977640 1 Processor -- start 2023-12-11T17:09:48.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.469+0000 7fc7fc977640 1 -- start start 2023-12-11T17:09:48.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.469+0000 7fc7fc977640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80720c0 0x7fc7f815cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:48.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.469+0000 7fc7fc977640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7f80b2610 0x7fc7f80acde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:48.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.469+0000 7fc7fc977640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7f8159f30 0x7fc7f80ad320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:48.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.469+0000 7fc7fc977640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f815d330 con 0x7fc7f80720c0 2023-12-11T17:09:48.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.469+0000 7fc7fc977640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f81557b0 con 0x7fc7f80b2610 2023-12-11T17:09:48.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.470+0000 7fc7fc977640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f8155a90 con 0x7fc7f8159f30 2023-12-11T17:09:48.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.470+0000 7fc7f6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80720c0 0x7fc7f815cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:48.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.470+0000 7fc7f6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80720c0 0x7fc7f815cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:45568/0 (socket says 172.21.15.37:45568) 2023-12-11T17:09:48.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.470+0000 7fc7f6d9d640 1 -- 172.21.15.37:0/37129692 learned_addr learned my addr 172.21.15.37:0/37129692 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:48.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.470+0000 7fc7f759e640 1 --2- 172.21.15.37:0/37129692 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7f8159f30 0x7fc7f80ad320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:48.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.470+0000 7fc7f659c640 1 --2- 172.21.15.37:0/37129692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7f80b2610 0x7fc7f80acde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:48.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.470+0000 7fc7f6d9d640 1 -- 172.21.15.37:0/37129692 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7f8159f30 msgr2=0x7fc7f80ad320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:48.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.470+0000 7fc7f6d9d640 1 --2- 172.21.15.37:0/37129692 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7f8159f30 0x7fc7f80ad320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:48.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.470+0000 7fc7f6d9d640 1 -- 172.21.15.37:0/37129692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7f80b2610 msgr2=0x7fc7f80acde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:48.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.470+0000 7fc7f6d9d640 1 --2- 172.21.15.37:0/37129692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7f80b2610 0x7fc7f80acde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:48.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.470+0000 7fc7f6d9d640 1 -- 172.21.15.37:0/37129692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f0009a70 con 0x7fc7f80720c0 2023-12-11T17:09:48.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.471+0000 7fc7f6d9d640 1 --2- 172.21.15.37:0/37129692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80720c0 0x7fc7f815cdf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800d5f0 tx=0x7fc7e800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:48.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.471+0000 7fc7ef7fe640 1 -- 172.21.15.37:0/37129692 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e80125f0 con 0x7fc7f80720c0 2023-12-11T17:09:48.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.471+0000 7fc7ef7fe640 1 -- 172.21.15.37:0/37129692 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e8012750 con 0x7fc7f80720c0 2023-12-11T17:09:48.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.471+0000 7fc7ef7fe640 1 -- 172.21.15.37:0/37129692 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e8012b00 con 0x7fc7f80720c0 2023-12-11T17:09:48.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.471+0000 7fc7fc977640 1 -- 172.21.15.37:0/37129692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f8155d70 con 0x7fc7f80720c0 2023-12-11T17:09:48.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.471+0000 7fc7fc977640 1 -- 172.21.15.37:0/37129692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f8156330 con 0x7fc7f80720c0 2023-12-11T17:09:48.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.472+0000 7fc7fc977640 1 -- 172.21.15.37:0/37129692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f8074450 con 0x7fc7f80720c0 2023-12-11T17:09:48.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.473+0000 7fc7ef7fe640 1 -- 172.21.15.37:0/37129692 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc7e8012c60 con 0x7fc7f80720c0 2023-12-11T17:09:48.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.474+0000 7fc7ef7fe640 1 --2- 172.21.15.37:0/37129692 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc7d806ae70 0x7fc7d806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:48.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.474+0000 7fc7ef7fe640 1 -- 172.21.15.37:0/37129692 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fc7e8089ea0 con 0x7fc7f80720c0 2023-12-11T17:09:48.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.475+0000 7fc7f659c640 1 --2- 172.21.15.37:0/37129692 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc7d806ae70 0x7fc7d806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:48.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.476+0000 7fc7f659c640 1 --2- 172.21.15.37:0/37129692 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc7d806ae70 0x7fc7d806d330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8154150 tx=0x7fc7e0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:48.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.479+0000 7fc7ef7fe640 1 -- 172.21.15.37:0/37129692 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc7e8054b50 con 0x7fc7f80720c0 2023-12-11T17:09:48.669 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-12-11T17:09:48.669+0000 7f60414dc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-11T17:09:48.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:48.672+0000 7fc7fc977640 1 -- 172.21.15.37:0/37129692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) v1 -- 0x7fc7f80cb2a0 con 0x7fc7f80720c0 2023-12-11T17:09:49.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.234+0000 7fc7ef7fe640 1 -- 172.21.15.37:0/37129692 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc7e8058170 con 0x7fc7f80720c0 2023-12-11T17:09:49.234 INFO:teuthology.orchestra.run.smithi037.stderr:set pool 4 allow_ec_overwrites to true 2023-12-11T17:09:49.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.238+0000 7fc7fc977640 1 -- 172.21.15.37:0/37129692 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc7d806ae70 msgr2=0x7fc7d806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:49.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.238+0000 7fc7fc977640 1 --2- 172.21.15.37:0/37129692 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc7d806ae70 0x7fc7d806d330 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fc7f8154150 tx=0x7fc7e0009040 comp rx=0 tx=0).stop 2023-12-11T17:09:49.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.238+0000 7fc7fc977640 1 -- 172.21.15.37:0/37129692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80720c0 msgr2=0x7fc7f815cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:49.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.238+0000 7fc7fc977640 1 --2- 172.21.15.37:0/37129692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80720c0 0x7fc7f815cdf0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc7e800d5f0 tx=0x7fc7e800dab0 comp rx=0 tx=0).stop 2023-12-11T17:09:49.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.239+0000 7fc7fc977640 1 -- 172.21.15.37:0/37129692 shutdown_connections 2023-12-11T17:09:49.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.239+0000 7fc7fc977640 1 --2- 172.21.15.37:0/37129692 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc7d806ae70 0x7fc7d806d330 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:49.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.239+0000 7fc7fc977640 1 --2- 172.21.15.37:0/37129692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc7f80b2610 0x7fc7f80acde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:49.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.239+0000 7fc7fc977640 1 --2- 172.21.15.37:0/37129692 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc7f8159f30 0x7fc7f80ad320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:49.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.239+0000 7fc7fc977640 1 --2- 172.21.15.37:0/37129692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc7f80720c0 0x7fc7f815cdf0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:49.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.239+0000 7fc7fc977640 1 -- 172.21.15.37:0/37129692 >> 172.21.15.37:0/37129692 conn(0x7fc7f806a880 msgr2=0x7fc7f80cb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:49.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.240+0000 7fc7fc977640 1 -- 172.21.15.37:0/37129692 shutdown_connections 2023-12-11T17:09:49.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.244+0000 7fc7fc977640 1 -- 172.21.15.37:0/37129692 wait complete. 2023-12-11T17:09:49.279 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2023-12-11T17:09:49.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.473+0000 7fb8c2eb4640 1 Processor -- start 2023-12-11T17:09:49.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.473+0000 7fb8c2eb4640 1 -- start start 2023-12-11T17:09:49.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.474+0000 7fb8c2eb4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb8bc0cdeb0 0x7fb8bc0cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:49.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.474+0000 7fb8c2eb4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8bc0cc6f0 con 0x7fb8bc0ccb80 2023-12-11T17:09:49.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.474+0000 7fb8c2eb4640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8bc0cbdc0 con 0x7fb8bc15b3a0 2023-12-11T17:09:49.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.474+0000 7fb8c2eb4640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8bc0cff80 con 0x7fb8bc0cdeb0 2023-12-11T17:09:49.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.475+0000 7fb8c1451640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb8bc0ccb80 0x7fb8bc0adc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40770/0 (socket says 172.21.15.37:40770) 2023-12-11T17:09:49.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.475+0000 7fb8c1451640 1 -- 172.21.15.37:0/2978936514 learned_addr learned my addr 172.21.15.37:0/2978936514 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:09:49.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.475+0000 7fb8bbfff640 1 --2- 172.21.15.37:0/2978936514 >> v2:172.21.15.37:3300/0 conn(0x7fb8bc0cdeb0 0x7fb8bc0cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:49.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.475+0000 7fb8bbfff640 1 -- 172.21.15.37:0/2978936514 >> v1:172.21.15.151:6789/0 conn(0x7fb8bc15b3a0 legacy=0x7fb8bc0cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:49.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.475+0000 7fb8bbfff640 1 -- 172.21.15.37:0/2978936514 >> v1:172.21.15.37:6789/0 conn(0x7fb8bc0ccb80 legacy=0x7fb8bc0adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:49.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.475+0000 7fb8bbfff640 1 -- 172.21.15.37:0/2978936514 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8bc0cc0a0 con 0x7fb8bc0cdeb0 2023-12-11T17:09:49.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.475+0000 7fb8bb7fe640 1 -- 172.21.15.37:0/2978936514 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1491995220 0 0) 0x7fb8bc0cc6f0 con 0x7fb8bc0ccb80 2023-12-11T17:09:49.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.476+0000 7fb8bbfff640 1 --2- 172.21.15.37:0/2978936514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc0cdeb0 0x7fb8bc0cfa40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40097a0 tx=0x7fb8a402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b021df443f0d1783 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:49.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.477+0000 7fb8bb7fe640 1 -- 172.21.15.37:0/2978936514 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4030610 con 0x7fb8bc0cdeb0 2023-12-11T17:09:49.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.477+0000 7fb8bb7fe640 1 -- 172.21.15.37:0/2978936514 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8a4030770 con 0x7fb8bc0cdeb0 2023-12-11T17:09:49.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.477+0000 7fb8bb7fe640 1 -- 172.21.15.37:0/2978936514 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8a4030b00 con 0x7fb8bc0cdeb0 2023-12-11T17:09:49.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.477+0000 7fb8c2eb4640 1 -- 172.21.15.37:0/2978936514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc0cdeb0 msgr2=0x7fb8bc0cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:49.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.477+0000 7fb8c2eb4640 1 --2- 172.21.15.37:0/2978936514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc0cdeb0 0x7fb8bc0cfa40 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb8a40097a0 tx=0x7fb8a402b960 comp rx=0 tx=0).stop 2023-12-11T17:09:49.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.477+0000 7fb8c2eb4640 1 -- 172.21.15.37:0/2978936514 shutdown_connections 2023-12-11T17:09:49.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.477+0000 7fb8c2eb4640 1 --2- 172.21.15.37:0/2978936514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc0cdeb0 0x7fb8bc0cfa40 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:49.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.477+0000 7fb8c2eb4640 1 -- 172.21.15.37:0/2978936514 >> 172.21.15.37:0/2978936514 conn(0x7fb8bc0d0ed0 msgr2=0x7fb8bc0d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:49.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.478+0000 7fb8c2eb4640 1 -- 172.21.15.37:0/2978936514 shutdown_connections 2023-12-11T17:09:49.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.478+0000 7fb8c2eb4640 1 -- 172.21.15.37:0/2978936514 wait complete. 2023-12-11T17:09:49.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.479+0000 7fb8c2eb4640 1 Processor -- start 2023-12-11T17:09:49.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.479+0000 7fb8c2eb4640 1 -- start start 2023-12-11T17:09:49.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.480+0000 7fb8c2eb4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc0ccb80 0x7fb8bc0c5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:49.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.480+0000 7fb8c2eb4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8bc0cdeb0 0x7fb8bc09e770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:49.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.480+0000 7fb8c2eb4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8bc15b3a0 0x7fb8bc0c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:49.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.480+0000 7fb8c2eb4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc0c7d30 con 0x7fb8bc0ccb80 2023-12-11T17:09:49.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.480+0000 7fb8c2eb4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc0c5d10 con 0x7fb8bc0cdeb0 2023-12-11T17:09:49.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.480+0000 7fb8c2eb4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8bc0c5ff0 con 0x7fb8bc15b3a0 2023-12-11T17:09:49.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.481+0000 7fb8c0c50640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc0ccb80 0x7fb8bc0c5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:49.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.481+0000 7fb8c0c50640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc0ccb80 0x7fb8bc0c5680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55130/0 (socket says 172.21.15.37:55130) 2023-12-11T17:09:49.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.481+0000 7fb8c0c50640 1 -- 172.21.15.37:0/2561310510 learned_addr learned my addr 172.21.15.37:0/2561310510 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:49.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.481+0000 7fb8c0c50640 1 -- 172.21.15.37:0/2561310510 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8bc15b3a0 msgr2=0x7fb8bc0c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:49.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.481+0000 7fb8c0c50640 1 --2- 172.21.15.37:0/2561310510 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8bc15b3a0 0x7fb8bc0c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:49.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.481+0000 7fb8c0c50640 1 -- 172.21.15.37:0/2561310510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8bc0cdeb0 msgr2=0x7fb8bc09e770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:49.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.481+0000 7fb8bbfff640 1 --2- 172.21.15.37:0/2561310510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8bc0cdeb0 0x7fb8bc09e770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:49.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.481+0000 7fb8c0c50640 1 --2- 172.21.15.37:0/2561310510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8bc0cdeb0 0x7fb8bc09e770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:49.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.481+0000 7fb8c0c50640 1 -- 172.21.15.37:0/2561310510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8a4009400 con 0x7fb8bc0ccb80 2023-12-11T17:09:49.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.481+0000 7fb8c0c50640 1 --2- 172.21.15.37:0/2561310510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc0ccb80 0x7fb8bc0c5680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00c730 tx=0x7fb8ac00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:49.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.482+0000 7fb8b97fa640 1 -- 172.21.15.37:0/2561310510 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac003b70 con 0x7fb8bc0ccb80 2023-12-11T17:09:49.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.482+0000 7fb8b97fa640 1 -- 172.21.15.37:0/2561310510 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ac003cf0 con 0x7fb8bc0ccb80 2023-12-11T17:09:49.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.482+0000 7fb8c2eb4640 1 -- 172.21.15.37:0/2561310510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8bc15d030 con 0x7fb8bc0ccb80 2023-12-11T17:09:49.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.482+0000 7fb8b97fa640 1 -- 172.21.15.37:0/2561310510 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8ac003ea0 con 0x7fb8bc0ccb80 2023-12-11T17:09:49.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.482+0000 7fb8c2eb4640 1 -- 172.21.15.37:0/2561310510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8bc0c62d0 con 0x7fb8bc0ccb80 2023-12-11T17:09:49.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.483+0000 7fb8c2eb4640 1 -- 172.21.15.37:0/2561310510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8bc15d4f0 con 0x7fb8bc0ccb80 2023-12-11T17:09:49.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.484+0000 7fb8b97fa640 1 -- 172.21.15.37:0/2561310510 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb8ac00aa90 con 0x7fb8bc0ccb80 2023-12-11T17:09:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.485+0000 7fb8b97fa640 1 --2- 172.21.15.37:0/2561310510 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb89c06ae40 0x7fb89c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.485+0000 7fb8b97fa640 1 -- 172.21.15.37:0/2561310510 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 6428+0+0 (secure 0 0 0) 0x7fb8ac0897b0 con 0x7fb8bc0ccb80 2023-12-11T17:09:49.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.486+0000 7fb8bbfff640 1 --2- 172.21.15.37:0/2561310510 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb89c06ae40 0x7fb89c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:49.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.487+0000 7fb8bbfff640 1 --2- 172.21.15.37:0/2561310510 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb89c06ae40 0x7fb89c06d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4036000 tx=0x7fb8a403b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:49.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.489+0000 7fb8b97fa640 1 -- 172.21.15.37:0/2561310510 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb8ac0544f0 con 0x7fb8bc0ccb80 2023-12-11T17:09:49.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:49.714+0000 7fb8c2eb4640 1 -- 172.21.15.37:0/2561310510 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) v1 -- 0x7fb8bc0745d0 con 0x7fb8bc0ccb80 2023-12-11T17:09:50.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.251+0000 7fb8b97fa640 1 -- 172.21.15.37:0/2561310510 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v6) v1 ==== 137+0+0 (secure 0 0 0) 0x7fb8ac057b10 con 0x7fb8bc0ccb80 2023-12-11T17:09:50.251 INFO:teuthology.orchestra.run.smithi037.stderr:added data pool 4 to fsmap 2023-12-11T17:09:50.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.254+0000 7fb8c2eb4640 1 -- 172.21.15.37:0/2561310510 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb89c06ae40 msgr2=0x7fb89c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:50.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.254+0000 7fb8c2eb4640 1 --2- 172.21.15.37:0/2561310510 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb89c06ae40 0x7fb89c06d300 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fb8a4036000 tx=0x7fb8a403b040 comp rx=0 tx=0).stop 2023-12-11T17:09:50.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.254+0000 7fb8c2eb4640 1 -- 172.21.15.37:0/2561310510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc0ccb80 msgr2=0x7fb8bc0c5680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:50.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.254+0000 7fb8c2eb4640 1 --2- 172.21.15.37:0/2561310510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc0ccb80 0x7fb8bc0c5680 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fb8ac00c730 tx=0x7fb8ac00cbf0 comp rx=0 tx=0).stop 2023-12-11T17:09:50.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.254+0000 7fb8c2eb4640 1 -- 172.21.15.37:0/2561310510 shutdown_connections 2023-12-11T17:09:50.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.255+0000 7fb8c2eb4640 1 --2- 172.21.15.37:0/2561310510 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb89c06ae40 0x7fb89c06d300 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:50.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.255+0000 7fb8c2eb4640 1 --2- 172.21.15.37:0/2561310510 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb8bc0cdeb0 0x7fb8bc09e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:50.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.255+0000 7fb8c2eb4640 1 --2- 172.21.15.37:0/2561310510 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb8bc15b3a0 0x7fb8bc0c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:50.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.255+0000 7fb8c2eb4640 1 --2- 172.21.15.37:0/2561310510 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb8bc0ccb80 0x7fb8bc0c5680 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:50.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.255+0000 7fb8c2eb4640 1 -- 172.21.15.37:0/2561310510 >> 172.21.15.37:0/2561310510 conn(0x7fb8bc0d0ed0 msgr2=0x7fb8bc06bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:50.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.255+0000 7fb8c2eb4640 1 -- 172.21.15.37:0/2561310510 shutdown_connections 2023-12-11T17:09:50.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.255+0000 7fb8c2eb4640 1 -- 172.21.15.37:0/2561310510 wait complete. 2023-12-11T17:09:50.275 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T17:09:50.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.499+0000 7f9ac9cc3640 1 Processor -- start 2023-12-11T17:09:50.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.499+0000 7f9ac9cc3640 1 -- start start 2023-12-11T17:09:50.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.501+0000 7f9ac9cc3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ac415e5d0 0x7f9ac406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:50.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.501+0000 7f9ac9cc3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9ac40ae200 0x7f9ac4070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:50.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.501+0000 7f9ac9cc3640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9ac406c330 0x7f9ac4071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:50.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.501+0000 7f9ac9cc3640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac4071f90 con 0x7f9ac40ae200 2023-12-11T17:09:50.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.501+0000 7f9ac9cc3640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac4072270 con 0x7f9ac406c330 2023-12-11T17:09:50.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.501+0000 7f9ac9cc3640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac4070070 con 0x7f9ac415e5d0 2023-12-11T17:09:50.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.501+0000 7f9abbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9ac40ae200 0x7f9ac4070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:50.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.501+0000 7f9abbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9ac40ae200 0x7f9ac4070b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55142/0 (socket says 172.21.15.37:55142) 2023-12-11T17:09:50.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.501+0000 7f9abbfff640 1 -- 172.21.15.37:0/1209028914 learned_addr learned my addr 172.21.15.37:0/1209028914 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:50.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.502+0000 7f9ac94c2640 1 --2- 172.21.15.37:0/1209028914 >> v2:172.21.15.151:3300/0 conn(0x7f9ac406c330 0x7f9ac4071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:50.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.502+0000 7f9ac8cc1640 1 --2- 172.21.15.37:0/1209028914 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ac415e5d0 0x7f9ac406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:50.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.502+0000 7f9abbfff640 1 -- 172.21.15.37:0/1209028914 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ac415e5d0 msgr2=0x7f9ac406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:50.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.502+0000 7f9abbfff640 1 --2- 172.21.15.37:0/1209028914 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ac415e5d0 0x7f9ac406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:50.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.502+0000 7f9abbfff640 1 -- 172.21.15.37:0/1209028914 >> v2:172.21.15.151:3300/0 conn(0x7f9ac406c330 msgr2=0x7f9ac4071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:50.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.502+0000 7f9abbfff640 1 --2- 172.21.15.37:0/1209028914 >> v2:172.21.15.151:3300/0 conn(0x7f9ac406c330 0x7f9ac4071090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:50.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.502+0000 7f9abbfff640 1 -- 172.21.15.37:0/1209028914 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac4070350 con 0x7f9ac40ae200 2023-12-11T17:09:50.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.502+0000 7f9ac94c2640 1 --2- 172.21.15.37:0/1209028914 >> v2:172.21.15.151:3300/0 conn(0x7f9ac406c330 0x7f9ac4071090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:09:50.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.502+0000 7f9ac8cc1640 1 --2- 172.21.15.37:0/1209028914 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ac415e5d0 0x7f9ac406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:09:50.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.503+0000 7f9abbfff640 1 --2- 172.21.15.37:0/1209028914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ac40ae200 0x7f9ac4070b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40739e0 tx=0x7f9ab402b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aca7c19ec094d19b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:50.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.503+0000 7f9abb7fe640 1 -- 172.21.15.37:0/1209028914 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4031760 con 0x7f9ac40ae200 2023-12-11T17:09:50.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.503+0000 7f9abb7fe640 1 -- 172.21.15.37:0/1209028914 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ab40318c0 con 0x7f9ac40ae200 2023-12-11T17:09:50.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.503+0000 7f9abb7fe640 1 -- 172.21.15.37:0/1209028914 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ab4031c50 con 0x7f9ac40ae200 2023-12-11T17:09:50.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.504+0000 7f9ac9cc3640 1 -- 172.21.15.37:0/1209028914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ac40ae200 msgr2=0x7f9ac4070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:50.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.504+0000 7f9ac9cc3640 1 --2- 172.21.15.37:0/1209028914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ac40ae200 0x7f9ac4070b50 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f9ac40739e0 tx=0x7f9ab402b800 comp rx=0 tx=0).stop 2023-12-11T17:09:50.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.504+0000 7f9ac9cc3640 1 -- 172.21.15.37:0/1209028914 shutdown_connections 2023-12-11T17:09:50.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.504+0000 7f9ac9cc3640 1 --2- 172.21.15.37:0/1209028914 >> v2:172.21.15.151:3300/0 conn(0x7f9ac406c330 0x7f9ac4071090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:50.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.504+0000 7f9ac9cc3640 1 --2- 172.21.15.37:0/1209028914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ac40ae200 0x7f9ac4070b50 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:50.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.504+0000 7f9ac9cc3640 1 --2- 172.21.15.37:0/1209028914 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ac415e5d0 0x7f9ac406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:50.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.504+0000 7f9ac9cc3640 1 -- 172.21.15.37:0/1209028914 >> 172.21.15.37:0/1209028914 conn(0x7f9ac40b0860 msgr2=0x7f9ac40b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:50.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.504+0000 7f9ac9cc3640 1 -- 172.21.15.37:0/1209028914 shutdown_connections 2023-12-11T17:09:50.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.504+0000 7f9ac9cc3640 1 -- 172.21.15.37:0/1209028914 wait complete. 2023-12-11T17:09:50.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.506+0000 7f9ac9cc3640 1 Processor -- start 2023-12-11T17:09:50.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.506+0000 7f9ac9cc3640 1 -- start start 2023-12-11T17:09:50.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.507+0000 7f9ac9cc3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ac406c330 0x7f9ac40ae870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:50.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.507+0000 7f9ac9cc3640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ac40ae200 0x7f9ac414fbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:50.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.507+0000 7f9ac9cc3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ac415e5d0 0x7f9ac4150100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:50.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.507+0000 7f9ac9cc3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac4153200 con 0x7f9ac406c330 2023-12-11T17:09:50.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.507+0000 7f9ac9cc3640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac4151140 con 0x7f9ac40ae200 2023-12-11T17:09:50.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.507+0000 7f9ac9cc3640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac4151ec0 con 0x7f9ac415e5d0 2023-12-11T17:09:50.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.507+0000 7f9ac8cc1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ac406c330 0x7f9ac40ae870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:50.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.507+0000 7f9ac8cc1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ac406c330 0x7f9ac40ae870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55146/0 (socket says 172.21.15.37:55146) 2023-12-11T17:09:50.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.507+0000 7f9ac8cc1640 1 -- 172.21.15.37:0/3328659563 learned_addr learned my addr 172.21.15.37:0/3328659563 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:50.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.508+0000 7f9ac94c2640 1 --2- 172.21.15.37:0/3328659563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ac415e5d0 0x7f9ac4150100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:50.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.508+0000 7f9ac8cc1640 1 -- 172.21.15.37:0/3328659563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ac415e5d0 msgr2=0x7f9ac4150100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:50.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.508+0000 7f9abbfff640 1 --2- 172.21.15.37:0/3328659563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ac40ae200 0x7f9ac414fbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:50.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.508+0000 7f9ac8cc1640 1 --2- 172.21.15.37:0/3328659563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ac415e5d0 0x7f9ac4150100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:50.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.508+0000 7f9ac8cc1640 1 -- 172.21.15.37:0/3328659563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ac40ae200 msgr2=0x7f9ac414fbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:50.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.508+0000 7f9ac8cc1640 1 --2- 172.21.15.37:0/3328659563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ac40ae200 0x7f9ac414fbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:50.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.508+0000 7f9ac8cc1640 1 -- 172.21.15.37:0/3328659563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ab40094d0 con 0x7f9ac406c330 2023-12-11T17:09:50.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.508+0000 7f9abbfff640 1 --2- 172.21.15.37:0/3328659563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ac40ae200 0x7f9ac414fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:09:50.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.508+0000 7f9ac8cc1640 1 --2- 172.21.15.37:0/3328659563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ac406c330 0x7f9ac40ae870 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9ac000cf60 tx=0x7f9ac000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:50.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.508+0000 7f9ab97fa640 1 -- 172.21.15.37:0/3328659563 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac000d840 con 0x7f9ac406c330 2023-12-11T17:09:50.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.508+0000 7f9ab97fa640 1 -- 172.21.15.37:0/3328659563 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ac000d9a0 con 0x7f9ac406c330 2023-12-11T17:09:50.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.508+0000 7f9ab97fa640 1 -- 172.21.15.37:0/3328659563 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ac000dd30 con 0x7f9ac406c330 2023-12-11T17:09:50.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.508+0000 7f9ac9cc3640 1 -- 172.21.15.37:0/3328659563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac41513e0 con 0x7f9ac406c330 2023-12-11T17:09:50.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.509+0000 7f9ac9cc3640 1 -- 172.21.15.37:0/3328659563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac41519a0 con 0x7f9ac406c330 2023-12-11T17:09:50.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.510+0000 7f9ac9cc3640 1 -- 172.21.15.37:0/3328659563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac4151b90 con 0x7f9ac406c330 2023-12-11T17:09:50.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.511+0000 7f9ab97fa640 1 -- 172.21.15.37:0/3328659563 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9ac0015440 con 0x7f9ac406c330 2023-12-11T17:09:50.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.512+0000 7f9ab97fa640 1 --2- 172.21.15.37:0/3328659563 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9ab006ae70 0x7f9ab006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:50.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.512+0000 7f9ab97fa640 1 -- 172.21.15.37:0/3328659563 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9ac008a1c0 con 0x7f9ac406c330 2023-12-11T17:09:50.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.512+0000 7f9abbfff640 1 --2- 172.21.15.37:0/3328659563 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9ab006ae70 0x7f9ab006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:50.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.513+0000 7f9abbfff640 1 --2- 172.21.15.37:0/3328659563 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9ab006ae70 0x7f9ab006d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4036000 tx=0x7f9ab403d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:50.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.516+0000 7f9ab97fa640 1 -- 172.21.15.37:0/3328659563 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9ac0055020 con 0x7f9ac406c330 2023-12-11T17:09:50.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.749+0000 7f9ac9cc3640 1 -- 172.21.15.37:0/3328659563 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ac40ac9b0 con 0x7f9ac406c330 2023-12-11T17:09:50.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.750+0000 7f9ab97fa640 1 -- 172.21.15.37:0/3328659563 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f9ac40ac9b0 con 0x7f9ac406c330 2023-12-11T17:09:50.750 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:09:50.750 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2395601865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2395601865},{"type":"v1","addr":"172.21.15.151:6835","nonce":2395601865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1535809271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1535809271},{"type":"v1","addr":"172.21.15.151:6837","nonce":1535809271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2590175074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2590175074},{"type":"v1","addr":"172.21.15.37:6833","nonce":2590175074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-11T17:09:44.643511+0000","modified":"2023-12-11T17:09:49.716284+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/2348606057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2348606057},{"type":"v1","addr":"172.21.15.37:6835","nonce":2348606057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-11T17:09:50.751 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 6 2023-12-11T17:09:50.752 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.753+0000 7f9ac9cc3640 1 -- 172.21.15.37:0/3328659563 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9ab006ae70 msgr2=0x7f9ab006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:50.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.753+0000 7f9ac9cc3640 1 --2- 172.21.15.37:0/3328659563 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9ab006ae70 0x7f9ab006d330 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f9ab4036000 tx=0x7f9ab403d040 comp rx=0 tx=0).stop 2023-12-11T17:09:50.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.753+0000 7f9ac9cc3640 1 -- 172.21.15.37:0/3328659563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ac406c330 msgr2=0x7f9ac40ae870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:50.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.753+0000 7f9ac9cc3640 1 --2- 172.21.15.37:0/3328659563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ac406c330 0x7f9ac40ae870 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f9ac000cf60 tx=0x7f9ac000cf90 comp rx=0 tx=0).stop 2023-12-11T17:09:50.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.753+0000 7f9ac9cc3640 1 -- 172.21.15.37:0/3328659563 shutdown_connections 2023-12-11T17:09:50.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.753+0000 7f9ac9cc3640 1 --2- 172.21.15.37:0/3328659563 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9ab006ae70 0x7f9ab006d330 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:50.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.753+0000 7f9ac9cc3640 1 --2- 172.21.15.37:0/3328659563 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9ac40ae200 0x7f9ac414fbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:50.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.753+0000 7f9ac9cc3640 1 --2- 172.21.15.37:0/3328659563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9ac415e5d0 0x7f9ac4150100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:50.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.753+0000 7f9ac9cc3640 1 --2- 172.21.15.37:0/3328659563 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9ac406c330 0x7f9ac40ae870 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:50.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.753+0000 7f9ac9cc3640 1 -- 172.21.15.37:0/3328659563 >> 172.21.15.37:0/3328659563 conn(0x7f9ac40b0860 msgr2=0x7f9ac415aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:50.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.753+0000 7f9ac9cc3640 1 -- 172.21.15.37:0/3328659563 shutdown_connections 2023-12-11T17:09:50.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.753+0000 7f9ac9cc3640 1 -- 172.21.15.37:0/3328659563 wait complete. 2023-12-11T17:09:50.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:09:50.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.997+0000 7f5f79071640 1 Processor -- start 2023-12-11T17:09:50.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.997+0000 7f5f79071640 1 -- start start 2023-12-11T17:09:50.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.999+0000 7f5f79071640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5f7415d150 0x7f5f74071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:50.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.999+0000 7f5f79071640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5f74070780 0x7f5f7406c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:50.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.999+0000 7f5f79071640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f740abd20 con 0x7f5f7406dd00 2023-12-11T17:09:50.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.999+0000 7f5f79071640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f7415d530 con 0x7f5f74070780 2023-12-11T17:09:50.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:50.999+0000 7f5f79071640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f740b2950 con 0x7f5f7415d150 2023-12-11T17:09:51.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.000+0000 7f5f78870640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5f74070780 0x7f5f7406c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:51.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.000+0000 7f5f6bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5f7406dd00 0x7f5f74070070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40778/0 (socket says 172.21.15.37:40778) 2023-12-11T17:09:51.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.000+0000 7f5f6bfff640 1 -- 172.21.15.37:0/3787343975 learned_addr learned my addr 172.21.15.37:0/3787343975 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:09:51.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.000+0000 7f5f73fff640 1 --2- 172.21.15.37:0/3787343975 >> v2:172.21.15.151:3300/0 conn(0x7f5f7415d150 0x7f5f74071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:51.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.000+0000 7f5f78870640 1 -- 172.21.15.37:0/3787343975 >> v2:172.21.15.151:3300/0 conn(0x7f5f7415d150 msgr2=0x7f5f74071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:51.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.000+0000 7f5f78870640 1 --2- 172.21.15.37:0/3787343975 >> v2:172.21.15.151:3300/0 conn(0x7f5f7415d150 0x7f5f74071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.000+0000 7f5f78870640 1 -- 172.21.15.37:0/3787343975 >> v1:172.21.15.37:6789/0 conn(0x7f5f7406dd00 legacy=0x7f5f74070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:51.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.000+0000 7f5f78870640 1 -- 172.21.15.37:0/3787343975 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f740b2c30 con 0x7f5f74070780 2023-12-11T17:09:51.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.001+0000 7f5f78870640 1 --2- 172.21.15.37:0/3787343975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f74070780 0x7f5f7406c690 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5f74072520 tx=0x7f5f6c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9e6d3b2bb1c93b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:51.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.002+0000 7f5f737fe640 1 -- 172.21.15.37:0/3787343975 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c02cc80 con 0x7f5f74070780 2023-12-11T17:09:51.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.002+0000 7f5f737fe640 1 -- 172.21.15.37:0/3787343975 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c02cde0 con 0x7f5f74070780 2023-12-11T17:09:51.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.002+0000 7f5f737fe640 1 -- 172.21.15.37:0/3787343975 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c034660 con 0x7f5f74070780 2023-12-11T17:09:51.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.002+0000 7f5f79071640 1 -- 172.21.15.37:0/3787343975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f74070780 msgr2=0x7f5f7406c690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:51.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.002+0000 7f5f79071640 1 --2- 172.21.15.37:0/3787343975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f74070780 0x7f5f7406c690 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f5f74072520 tx=0x7f5f6c02bed0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.002+0000 7f5f79071640 1 -- 172.21.15.37:0/3787343975 shutdown_connections 2023-12-11T17:09:51.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.002+0000 7f5f79071640 1 --2- 172.21.15.37:0/3787343975 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f74070780 0x7f5f7406c690 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.002+0000 7f5f79071640 1 --2- 172.21.15.37:0/3787343975 >> v2:172.21.15.151:3300/0 conn(0x7f5f7415d150 0x7f5f74071ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.002+0000 7f5f79071640 1 -- 172.21.15.37:0/3787343975 >> 172.21.15.37:0/3787343975 conn(0x7f5f740b0860 msgr2=0x7f5f740b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:51.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.003+0000 7f5f79071640 1 -- 172.21.15.37:0/3787343975 shutdown_connections 2023-12-11T17:09:51.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.003+0000 7f5f79071640 1 -- 172.21.15.37:0/3787343975 wait complete. 2023-12-11T17:09:51.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.004+0000 7f5f79071640 1 Processor -- start 2023-12-11T17:09:51.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.005+0000 7f5f79071640 1 -- start start 2023-12-11T17:09:51.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.005+0000 7f5f79071640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f7406dd00 0x7f5f740af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:51.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.005+0000 7f5f79071640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f74070780 0x7f5f7415e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:51.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.005+0000 7f5f79071640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f7415d150 0x7f5f7415eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:51.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.006+0000 7f5f79071640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f741f3ba0 con 0x7f5f7415d150 2023-12-11T17:09:51.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.006+0000 7f5f79071640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f74099a90 con 0x7f5f7406dd00 2023-12-11T17:09:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.006+0000 7f5f79071640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f74099d70 con 0x7f5f74070780 2023-12-11T17:09:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.006+0000 7f5f78870640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f7415d150 0x7f5f7415eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.006+0000 7f5f78870640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f7415d150 0x7f5f7415eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55162/0 (socket says 172.21.15.37:55162) 2023-12-11T17:09:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.006+0000 7f5f78870640 1 -- 172.21.15.37:0/438206096 learned_addr learned my addr 172.21.15.37:0/438206096 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.006+0000 7f5f73fff640 1 --2- 172.21.15.37:0/438206096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f7406dd00 0x7f5f740af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.006+0000 7f5f6bfff640 1 --2- 172.21.15.37:0/438206096 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f74070780 0x7f5f7415e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.006+0000 7f5f78870640 1 -- 172.21.15.37:0/438206096 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f74070780 msgr2=0x7f5f7415e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.006+0000 7f5f78870640 1 --2- 172.21.15.37:0/438206096 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f74070780 0x7f5f7415e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.006+0000 7f5f78870640 1 -- 172.21.15.37:0/438206096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f7406dd00 msgr2=0x7f5f740af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.006+0000 7f5f78870640 1 --2- 172.21.15.37:0/438206096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f7406dd00 0x7f5f740af640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.006+0000 7f5f78870640 1 -- 172.21.15.37:0/438206096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c009a70 con 0x7f5f7415d150 2023-12-11T17:09:51.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.006+0000 7f5f6bfff640 1 --2- 172.21.15.37:0/438206096 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f74070780 0x7f5f7415e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:09:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.007+0000 7f5f78870640 1 --2- 172.21.15.37:0/438206096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f7415d150 0x7f5f7415eb60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c02c4e0 tx=0x7f5f6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.007+0000 7f5f717fa640 1 -- 172.21.15.37:0/438206096 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c03e610 con 0x7f5f7415d150 2023-12-11T17:09:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.007+0000 7f5f717fa640 1 -- 172.21.15.37:0/438206096 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f6c03e770 con 0x7f5f7415d150 2023-12-11T17:09:51.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.007+0000 7f5f717fa640 1 -- 172.21.15.37:0/438206096 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f6c03eb20 con 0x7f5f7415d150 2023-12-11T17:09:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.007+0000 7f5f79071640 1 -- 172.21.15.37:0/438206096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f7409a050 con 0x7f5f7415d150 2023-12-11T17:09:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.007+0000 7f5f79071640 1 -- 172.21.15.37:0/438206096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f740afb80 con 0x7f5f7415d150 2023-12-11T17:09:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.008+0000 7f5f79071640 1 -- 172.21.15.37:0/438206096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f7409a570 con 0x7f5f7415d150 2023-12-11T17:09:51.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.009+0000 7f5f717fa640 1 -- 172.21.15.37:0/438206096 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5f6c03b050 con 0x7f5f7415d150 2023-12-11T17:09:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.010+0000 7f5f717fa640 1 --2- 172.21.15.37:0/438206096 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5f5406ae40 0x7f5f5406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:51.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.010+0000 7f5f717fa640 1 -- 172.21.15.37:0/438206096 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5f6c0ac180 con 0x7f5f7415d150 2023-12-11T17:09:51.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.011+0000 7f5f73fff640 1 --2- 172.21.15.37:0/438206096 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5f5406ae40 0x7f5f5406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:51.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.012+0000 7f5f73fff640 1 --2- 172.21.15.37:0/438206096 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5f5406ae40 0x7f5f5406d300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5f64006fd0 tx=0x7f5f64008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:51.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.015+0000 7f5f717fa640 1 -- 172.21.15.37:0/438206096 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5f7409a570 con 0x7f5f7415d150 2023-12-11T17:09:51.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.211+0000 7f5f79071640 1 -- 172.21.15.37:0/438206096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f7409a570 con 0x7f5f7415d150 2023-12-11T17:09:51.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.214+0000 7f5f717fa640 1 -- 172.21.15.37:0/438206096 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f5f7409a570 con 0x7f5f7415d150 2023-12-11T17:09:51.217 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:09:51.218 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:09:49.715938+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:09:51.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.217+0000 7f5f79071640 1 -- 172.21.15.37:0/438206096 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5f5406ae40 msgr2=0x7f5f5406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:51.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.217+0000 7f5f79071640 1 --2- 172.21.15.37:0/438206096 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5f5406ae40 0x7f5f5406d300 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f5f64006fd0 tx=0x7f5f64008040 comp rx=0 tx=0).stop 2023-12-11T17:09:51.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.217+0000 7f5f79071640 1 -- 172.21.15.37:0/438206096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f7415d150 msgr2=0x7f5f7415eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:51.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.217+0000 7f5f79071640 1 --2- 172.21.15.37:0/438206096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f7415d150 0x7f5f7415eb60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5f6c02c4e0 tx=0x7f5f6c004a40 comp rx=0 tx=0).stop 2023-12-11T17:09:51.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.218+0000 7f5f79071640 1 -- 172.21.15.37:0/438206096 shutdown_connections 2023-12-11T17:09:51.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.218+0000 7f5f79071640 1 --2- 172.21.15.37:0/438206096 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5f5406ae40 0x7f5f5406d300 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.218+0000 7f5f79071640 1 --2- 172.21.15.37:0/438206096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f7415d150 0x7f5f7415eb60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.218+0000 7f5f79071640 1 --2- 172.21.15.37:0/438206096 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f74070780 0x7f5f7415e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.218+0000 7f5f79071640 1 --2- 172.21.15.37:0/438206096 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f7406dd00 0x7f5f740af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.218+0000 7f5f79071640 1 -- 172.21.15.37:0/438206096 >> 172.21.15.37:0/438206096 conn(0x7f5f740b0860 msgr2=0x7f5f74070070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:51.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.218+0000 7f5f79071640 1 -- 172.21.15.37:0/438206096 shutdown_connections 2023-12-11T17:09:51.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.218+0000 7f5f79071640 1 -- 172.21.15.37:0/438206096 wait complete. 2023-12-11T17:09:51.238 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:09:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.461+0000 7f76d3fff640 1 Processor -- start 2023-12-11T17:09:51.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.462+0000 7f76d3fff640 1 -- start start 2023-12-11T17:09:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.463+0000 7f76d3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f76d415e5d0 0x7f76d406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.463+0000 7f76d3fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f76d40ae200 0x7f76d4070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.463+0000 7f76d3fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76d406c330 0x7f76d4071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.463+0000 7f76d3fff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d4071f90 con 0x7f76d415e5d0 2023-12-11T17:09:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.463+0000 7f76d3fff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d4072270 con 0x7f76d40ae200 2023-12-11T17:09:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.463+0000 7f76d3fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d4070070 con 0x7f76d406c330 2023-12-11T17:09:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.464+0000 7f76d2ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f76d415e5d0 0x7f76d406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.464+0000 7f76d2ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f76d415e5d0 0x7f76d406bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55176/0 (socket says 172.21.15.37:55176) 2023-12-11T17:09:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.464+0000 7f76d2ffd640 1 -- 172.21.15.37:0/339449894 learned_addr learned my addr 172.21.15.37:0/339449894 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.464+0000 7f76d37fe640 1 --2- 172.21.15.37:0/339449894 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76d406c330 0x7f76d4071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:51.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.464+0000 7f76cbfff640 1 --2- 172.21.15.37:0/339449894 >> v2:172.21.15.151:3300/0 conn(0x7f76d40ae200 0x7f76d4070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:51.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.464+0000 7f76d2ffd640 1 -- 172.21.15.37:0/339449894 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76d406c330 msgr2=0x7f76d4071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:51.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.464+0000 7f76d2ffd640 1 --2- 172.21.15.37:0/339449894 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76d406c330 0x7f76d4071090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.464+0000 7f76d2ffd640 1 -- 172.21.15.37:0/339449894 >> v2:172.21.15.151:3300/0 conn(0x7f76d40ae200 msgr2=0x7f76d4070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:51.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.464+0000 7f76d2ffd640 1 --2- 172.21.15.37:0/339449894 >> v2:172.21.15.151:3300/0 conn(0x7f76d40ae200 0x7f76d4070b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.464+0000 7f76d2ffd640 1 -- 172.21.15.37:0/339449894 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d4070350 con 0x7f76d415e5d0 2023-12-11T17:09:51.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.465+0000 7f76d2ffd640 1 --2- 172.21.15.37:0/339449894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76d415e5d0 0x7f76d406bdf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f76d40739e0 tx=0x7f76c402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff7d4972f6d0ec72 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:51.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.466+0000 7f76d27fc640 1 -- 172.21.15.37:0/339449894 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c4031740 con 0x7f76d415e5d0 2023-12-11T17:09:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.466+0000 7f76d27fc640 1 -- 172.21.15.37:0/339449894 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c40318a0 con 0x7f76d415e5d0 2023-12-11T17:09:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.466+0000 7f76d27fc640 1 -- 172.21.15.37:0/339449894 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c4031c30 con 0x7f76d415e5d0 2023-12-11T17:09:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.466+0000 7f76d3fff640 1 -- 172.21.15.37:0/339449894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76d415e5d0 msgr2=0x7f76d406bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.466+0000 7f76d3fff640 1 --2- 172.21.15.37:0/339449894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76d415e5d0 0x7f76d406bdf0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f76d40739e0 tx=0x7f76c402b7e0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.466+0000 7f76d3fff640 1 -- 172.21.15.37:0/339449894 shutdown_connections 2023-12-11T17:09:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.466+0000 7f76d3fff640 1 --2- 172.21.15.37:0/339449894 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76d406c330 0x7f76d4071090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.466+0000 7f76d3fff640 1 --2- 172.21.15.37:0/339449894 >> v2:172.21.15.151:3300/0 conn(0x7f76d40ae200 0x7f76d4070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.466+0000 7f76d3fff640 1 --2- 172.21.15.37:0/339449894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76d415e5d0 0x7f76d406bdf0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.466+0000 7f76d3fff640 1 -- 172.21.15.37:0/339449894 >> 172.21.15.37:0/339449894 conn(0x7f76d40b0860 msgr2=0x7f76d40b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.466+0000 7f76d3fff640 1 -- 172.21.15.37:0/339449894 shutdown_connections 2023-12-11T17:09:51.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.466+0000 7f76d3fff640 1 -- 172.21.15.37:0/339449894 wait complete. 2023-12-11T17:09:51.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.468+0000 7f76d3fff640 1 Processor -- start 2023-12-11T17:09:51.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.468+0000 7f76d3fff640 1 -- start start 2023-12-11T17:09:51.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.469+0000 7f76d3fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76d406c330 0x7f76d41404f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:51.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.469+0000 7f76d3fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76d40ae200 0x7f76d414be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:51.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.469+0000 7f76d3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76d415e5d0 0x7f76d414c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:51.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.469+0000 7f76d3fff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d409c440 con 0x7f76d415e5d0 2023-12-11T17:09:51.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.469+0000 7f76d3fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d409c160 con 0x7f76d40ae200 2023-12-11T17:09:51.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.469+0000 7f76d3fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d4150190 con 0x7f76d406c330 2023-12-11T17:09:51.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.470+0000 7f76d37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76d415e5d0 0x7f76d414c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:51.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.470+0000 7f76d37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76d415e5d0 0x7f76d414c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55184/0 (socket says 172.21.15.37:55184) 2023-12-11T17:09:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.470+0000 7f76d37fe640 1 -- 172.21.15.37:0/3799617031 learned_addr learned my addr 172.21.15.37:0/3799617031 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.470+0000 7f76cbfff640 1 --2- 172.21.15.37:0/3799617031 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76d40ae200 0x7f76d414be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.470+0000 7f76d2ffd640 1 --2- 172.21.15.37:0/3799617031 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76d406c330 0x7f76d41404f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.470+0000 7f76d37fe640 1 -- 172.21.15.37:0/3799617031 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76d406c330 msgr2=0x7f76d41404f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.470+0000 7f76d37fe640 1 --2- 172.21.15.37:0/3799617031 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76d406c330 0x7f76d41404f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.470+0000 7f76d37fe640 1 -- 172.21.15.37:0/3799617031 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76d40ae200 msgr2=0x7f76d414be50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.470+0000 7f76d37fe640 1 --2- 172.21.15.37:0/3799617031 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76d40ae200 0x7f76d414be50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.470+0000 7f76d37fe640 1 -- 172.21.15.37:0/3799617031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c40094d0 con 0x7f76d415e5d0 2023-12-11T17:09:51.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.470+0000 7f76d37fe640 1 --2- 172.21.15.37:0/3799617031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76d415e5d0 0x7f76d414c390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f76cc007e40 tx=0x7f76cc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.471+0000 7f76cb7fe640 1 -- 172.21.15.37:0/3799617031 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc014620 con 0x7f76d415e5d0 2023-12-11T17:09:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.471+0000 7f76cb7fe640 1 -- 172.21.15.37:0/3799617031 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76cc00ee90 con 0x7f76d415e5d0 2023-12-11T17:09:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.471+0000 7f76cb7fe640 1 -- 172.21.15.37:0/3799617031 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76cc0149e0 con 0x7f76d415e5d0 2023-12-11T17:09:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.471+0000 7f76d3fff640 1 -- 172.21.15.37:0/3799617031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d4150470 con 0x7f76d415e5d0 2023-12-11T17:09:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.471+0000 7f76d3fff640 1 -- 172.21.15.37:0/3799617031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d4140a30 con 0x7f76d415e5d0 2023-12-11T17:09:51.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.472+0000 7f76d3fff640 1 -- 172.21.15.37:0/3799617031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d414fff0 con 0x7f76d415e5d0 2023-12-11T17:09:51.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.473+0000 7f76cb7fe640 1 -- 172.21.15.37:0/3799617031 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f76cc014b40 con 0x7f76d415e5d0 2023-12-11T17:09:51.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.474+0000 7f76cb7fe640 1 --2- 172.21.15.37:0/3799617031 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f76b406ae40 0x7f76b406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:51.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.474+0000 7f76cb7fe640 1 -- 172.21.15.37:0/3799617031 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f76cc08a2c0 con 0x7f76d415e5d0 2023-12-11T17:09:51.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.474+0000 7f76d2ffd640 1 --2- 172.21.15.37:0/3799617031 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f76b406ae40 0x7f76b406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:51.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.475+0000 7f76d2ffd640 1 --2- 172.21.15.37:0/3799617031 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f76b406ae40 0x7f76b406d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f76c4035000 tx=0x7f76c4008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:51.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.478+0000 7f76cb7fe640 1 -- 172.21.15.37:0/3799617031 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f76d414fff0 con 0x7f76d415e5d0 2023-12-11T17:09:51.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.675+0000 7f76d3fff640 1 -- 172.21.15.37:0/3799617031 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76d4150990 con 0x7f76d415e5d0 2023-12-11T17:09:51.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.677+0000 7f76cb7fe640 1 -- 172.21.15.37:0/3799617031 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f76d4150990 con 0x7f76d415e5d0 2023-12-11T17:09:51.678 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:09:51.678 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:09:49.715938+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:09:51.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.680+0000 7f76d3fff640 1 -- 172.21.15.37:0/3799617031 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f76b406ae40 msgr2=0x7f76b406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:51.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.680+0000 7f76d3fff640 1 --2- 172.21.15.37:0/3799617031 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f76b406ae40 0x7f76b406d300 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f76c4035000 tx=0x7f76c4008030 comp rx=0 tx=0).stop 2023-12-11T17:09:51.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.680+0000 7f76d3fff640 1 -- 172.21.15.37:0/3799617031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76d415e5d0 msgr2=0x7f76d414c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:51.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.680+0000 7f76d3fff640 1 --2- 172.21.15.37:0/3799617031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76d415e5d0 0x7f76d414c390 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f76cc007e40 tx=0x7f76cc00e4b0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.680+0000 7f76d3fff640 1 -- 172.21.15.37:0/3799617031 shutdown_connections 2023-12-11T17:09:51.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.680+0000 7f76d3fff640 1 --2- 172.21.15.37:0/3799617031 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f76b406ae40 0x7f76b406d300 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.680+0000 7f76d3fff640 1 --2- 172.21.15.37:0/3799617031 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76d40ae200 0x7f76d414be50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.680+0000 7f76d3fff640 1 --2- 172.21.15.37:0/3799617031 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76d415e5d0 0x7f76d414c390 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.680+0000 7f76d3fff640 1 --2- 172.21.15.37:0/3799617031 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f76d406c330 0x7f76d41404f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.680+0000 7f76d3fff640 1 -- 172.21.15.37:0/3799617031 >> 172.21.15.37:0/3799617031 conn(0x7f76d40b0860 msgr2=0x7f76d40ceb30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:51.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.680+0000 7f76d3fff640 1 -- 172.21.15.37:0/3799617031 shutdown_connections 2023-12-11T17:09:51.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.680+0000 7f76d3fff640 1 -- 172.21.15.37:0/3799617031 wait complete. 2023-12-11T17:09:51.719 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T17:09:51.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.948+0000 7f6f41b0f640 1 Processor -- start 2023-12-11T17:09:51.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.948+0000 7f6f41b0f640 1 -- start start 2023-12-11T17:09:51.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.950+0000 7f6f41b0f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6f3c0cfb20 0x7f6f3c0cff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:51.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.950+0000 7f6f41b0f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f3c15cd60 0x7f6f3c15d1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.950+0000 7f6f41b0f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3c0d04a0 con 0x7f6f3c1609b0 2023-12-11T17:09:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.950+0000 7f6f41b0f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3c160d90 con 0x7f6f3c0cfb20 2023-12-11T17:09:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.950+0000 7f6f41b0f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c15dd60 con 0x7f6f3c15cd60 2023-12-11T17:09:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.950+0000 7f6f33fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6f3c0cfb20 0x7f6f3c0cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.950+0000 7f6f33fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6f3c0cfb20 0x7f6f3c0cff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55200/0 (socket says 172.21.15.37:55200) 2023-12-11T17:09:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.950+0000 7f6f33fff640 1 -- 172.21.15.37:0/3451923755 learned_addr learned my addr 172.21.15.37:0/3451923755 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.950+0000 7f6f3bfff640 1 --2- 172.21.15.37:0/3451923755 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f3c15cd60 0x7f6f3c15d1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.950+0000 7f6f33fff640 1 -- 172.21.15.37:0/3451923755 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f3c15cd60 msgr2=0x7f6f3c15d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.950+0000 7f6f33fff640 1 --2- 172.21.15.37:0/3451923755 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f3c15cd60 0x7f6f3c15d1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.950+0000 7f6f33fff640 1 -- 172.21.15.37:0/3451923755 >> v1:172.21.15.151:6789/0 conn(0x7f6f3c1609b0 legacy=0x7f6f3c0d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:51.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.951+0000 7f6f33fff640 1 -- 172.21.15.37:0/3451923755 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3c15e040 con 0x7f6f3c0cfb20 2023-12-11T17:09:51.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.952+0000 7f6f33fff640 1 --2- 172.21.15.37:0/3451923755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f3c0cfb20 0x7f6f3c0cff60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6f24009870 tx=0x7f6f2402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d760a094b43194d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:51.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.952+0000 7f6f3affd640 1 -- 172.21.15.37:0/3451923755 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24030840 con 0x7f6f3c0cfb20 2023-12-11T17:09:51.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.952+0000 7f6f3affd640 1 -- 172.21.15.37:0/3451923755 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f240309a0 con 0x7f6f3c0cfb20 2023-12-11T17:09:51.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.952+0000 7f6f3affd640 1 -- 172.21.15.37:0/3451923755 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24030d30 con 0x7f6f3c0cfb20 2023-12-11T17:09:51.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.953+0000 7f6f41b0f640 1 -- 172.21.15.37:0/3451923755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f3c0cfb20 msgr2=0x7f6f3c0cff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:51.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.953+0000 7f6f41b0f640 1 --2- 172.21.15.37:0/3451923755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f3c0cfb20 0x7f6f3c0cff60 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f6f24009870 tx=0x7f6f2402b980 comp rx=0 tx=0).stop 2023-12-11T17:09:51.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.953+0000 7f6f41b0f640 1 -- 172.21.15.37:0/3451923755 shutdown_connections 2023-12-11T17:09:51.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.953+0000 7f6f41b0f640 1 --2- 172.21.15.37:0/3451923755 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f3c15cd60 0x7f6f3c15d1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.953+0000 7f6f41b0f640 1 --2- 172.21.15.37:0/3451923755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f3c0cfb20 0x7f6f3c0cff60 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.953+0000 7f6f41b0f640 1 -- 172.21.15.37:0/3451923755 >> 172.21.15.37:0/3451923755 conn(0x7f6f3c09c450 msgr2=0x7f6f3c0d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:51.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.953+0000 7f6f41b0f640 1 -- 172.21.15.37:0/3451923755 shutdown_connections 2023-12-11T17:09:51.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.953+0000 7f6f41b0f640 1 -- 172.21.15.37:0/3451923755 wait complete. 2023-12-11T17:09:51.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.955+0000 7f6f41b0f640 1 Processor -- start 2023-12-11T17:09:51.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.955+0000 7f6f41b0f640 1 -- start start 2023-12-11T17:09:51.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.956+0000 7f6f41b0f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f3c0cfb20 0x7f6f3c158920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:51.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.956+0000 7f6f41b0f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f3c15cd60 0x7f6f3c1e7dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:51.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.956+0000 7f6f41b0f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f3c1609b0 0x7f6f3c0ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:51.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.956+0000 7f6f41b0f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c1f2eb0 con 0x7f6f3c15cd60 2023-12-11T17:09:51.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.956+0000 7f6f41b0f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c1e87b0 con 0x7f6f3c0cfb20 2023-12-11T17:09:51.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.956+0000 7f6f41b0f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3c1e8a90 con 0x7f6f3c1609b0 2023-12-11T17:09:51.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.956+0000 7f6f33fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f3c15cd60 0x7f6f3c1e7dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:51.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.957+0000 7f6f33fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f3c15cd60 0x7f6f3c1e7dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55212/0 (socket says 172.21.15.37:55212) 2023-12-11T17:09:51.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.957+0000 7f6f33fff640 1 -- 172.21.15.37:0/3865957373 learned_addr learned my addr 172.21.15.37:0/3865957373 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:51.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.957+0000 7f6f3b7fe640 1 --2- 172.21.15.37:0/3865957373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f3c0cfb20 0x7f6f3c158920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:51.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.957+0000 7f6f3bfff640 1 --2- 172.21.15.37:0/3865957373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f3c1609b0 0x7f6f3c0ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:51.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.957+0000 7f6f33fff640 1 -- 172.21.15.37:0/3865957373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f3c1609b0 msgr2=0x7f6f3c0ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:51.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.957+0000 7f6f33fff640 1 --2- 172.21.15.37:0/3865957373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f3c1609b0 0x7f6f3c0ca1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.957+0000 7f6f33fff640 1 -- 172.21.15.37:0/3865957373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f3c0cfb20 msgr2=0x7f6f3c158920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:51.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.957+0000 7f6f33fff640 1 --2- 172.21.15.37:0/3865957373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f3c0cfb20 0x7f6f3c158920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:51.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.957+0000 7f6f33fff640 1 -- 172.21.15.37:0/3865957373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f240094d0 con 0x7f6f3c15cd60 2023-12-11T17:09:51.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.957+0000 7f6f3b7fe640 1 --2- 172.21.15.37:0/3865957373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f3c0cfb20 0x7f6f3c158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:09:51.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.957+0000 7f6f33fff640 1 --2- 172.21.15.37:0/3865957373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f3c15cd60 0x7f6f3c1e7dd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6f24000c00 tx=0x7f6f24004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:51.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.958+0000 7f6f38ff9640 1 -- 172.21.15.37:0/3865957373 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24039a90 con 0x7f6f3c15cd60 2023-12-11T17:09:51.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.958+0000 7f6f38ff9640 1 -- 172.21.15.37:0/3865957373 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f24039bf0 con 0x7f6f3c15cd60 2023-12-11T17:09:51.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.958+0000 7f6f38ff9640 1 -- 172.21.15.37:0/3865957373 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f24043410 con 0x7f6f3c15cd60 2023-12-11T17:09:51.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.958+0000 7f6f41b0f640 1 -- 172.21.15.37:0/3865957373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f3c1e8d70 con 0x7f6f3c15cd60 2023-12-11T17:09:51.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.958+0000 7f6f41b0f640 1 -- 172.21.15.37:0/3865957373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f3c158e60 con 0x7f6f3c15cd60 2023-12-11T17:09:51.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.959+0000 7f6f41b0f640 1 -- 172.21.15.37:0/3865957373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3c1e8f30 con 0x7f6f3c15cd60 2023-12-11T17:09:51.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.960+0000 7f6f38ff9640 1 -- 172.21.15.37:0/3865957373 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6f2404c3b0 con 0x7f6f3c15cd60 2023-12-11T17:09:51.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.961+0000 7f6f38ff9640 1 --2- 172.21.15.37:0/3865957373 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6f1c06ae90 0x7f6f1c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:51.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.961+0000 7f6f38ff9640 1 -- 172.21.15.37:0/3865957373 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6f240abf30 con 0x7f6f3c15cd60 2023-12-11T17:09:51.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.961+0000 7f6f3b7fe640 1 --2- 172.21.15.37:0/3865957373 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6f1c06ae90 0x7f6f1c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:51.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.962+0000 7f6f3b7fe640 1 --2- 172.21.15.37:0/3865957373 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6f1c06ae90 0x7f6f1c06d350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c15c5b0 tx=0x7f6f2c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:51.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:51.965+0000 7f6f38ff9640 1 -- 172.21.15.37:0/3865957373 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6f3c1e8f30 con 0x7f6f3c15cd60 2023-12-11T17:09:52.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.193+0000 7f6f41b0f640 1 -- 172.21.15.37:0/3865957373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6f3c1f33b0 con 0x7f6f3c15cd60 2023-12-11T17:09:52.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.195+0000 7f6f38ff9640 1 -- 172.21.15.37:0/3865957373 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f6f3c1f33b0 con 0x7f6f3c15cd60 2023-12-11T17:09:52.195 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:09:52.195 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2395601865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2395601865},{"type":"v1","addr":"172.21.15.151:6835","nonce":2395601865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1535809271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1535809271},{"type":"v1","addr":"172.21.15.151:6837","nonce":1535809271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2590175074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2590175074},{"type":"v1","addr":"172.21.15.37:6833","nonce":2590175074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-11T17:09:44.643511+0000","modified":"2023-12-11T17:09:49.716284+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/2348606057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2348606057},{"type":"v1","addr":"172.21.15.37:6835","nonce":2348606057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2023-12-11T17:09:52.195 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 6 2023-12-11T17:09:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.197+0000 7f6f41b0f640 1 -- 172.21.15.37:0/3865957373 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6f1c06ae90 msgr2=0x7f6f1c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.197+0000 7f6f41b0f640 1 --2- 172.21.15.37:0/3865957373 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6f1c06ae90 0x7f6f1c06d350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c15c5b0 tx=0x7f6f2c009040 comp rx=0 tx=0).stop 2023-12-11T17:09:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.197+0000 7f6f41b0f640 1 -- 172.21.15.37:0/3865957373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f3c15cd60 msgr2=0x7f6f3c1e7dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:52.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.197+0000 7f6f41b0f640 1 --2- 172.21.15.37:0/3865957373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f3c15cd60 0x7f6f3c1e7dd0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f6f24000c00 tx=0x7f6f24004730 comp rx=0 tx=0).stop 2023-12-11T17:09:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.198+0000 7f6f41b0f640 1 -- 172.21.15.37:0/3865957373 shutdown_connections 2023-12-11T17:09:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.198+0000 7f6f41b0f640 1 --2- 172.21.15.37:0/3865957373 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6f1c06ae90 0x7f6f1c06d350 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.198+0000 7f6f41b0f640 1 --2- 172.21.15.37:0/3865957373 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6f3c1609b0 0x7f6f3c0ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.198+0000 7f6f41b0f640 1 --2- 172.21.15.37:0/3865957373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f3c15cd60 0x7f6f3c1e7dd0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.198+0000 7f6f41b0f640 1 --2- 172.21.15.37:0/3865957373 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f3c0cfb20 0x7f6f3c158920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:52.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.198+0000 7f6f41b0f640 1 -- 172.21.15.37:0/3865957373 >> 172.21.15.37:0/3865957373 conn(0x7f6f3c09c450 msgr2=0x7f6f3c0d0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.198+0000 7f6f41b0f640 1 -- 172.21.15.37:0/3865957373 shutdown_connections 2023-12-11T17:09:52.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.198+0000 7f6f41b0f640 1 -- 172.21.15.37:0/3865957373 wait complete. 2023-12-11T17:09:52.216 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:09:52.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.415+0000 7f60cb021640 1 Processor -- start 2023-12-11T17:09:52.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.415+0000 7f60cb021640 1 -- start start 2023-12-11T17:09:52.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.417+0000 7f60cb021640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60c40ae200 0x7f60c4070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:52.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.417+0000 7f60cb021640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c4071f90 con 0x7f60c40abd20 2023-12-11T17:09:52.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.417+0000 7f60cb021640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60c4072270 con 0x7f60c415e5d0 2023-12-11T17:09:52.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.417+0000 7f60cb021640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c4070070 con 0x7f60c40ae200 2023-12-11T17:09:52.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.417+0000 7f60ca820640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f60c40abd20 0x7f60c40cded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40790/0 (socket says 172.21.15.37:40790) 2023-12-11T17:09:52.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.417+0000 7f60ca820640 1 -- 172.21.15.37:0/3537455019 learned_addr learned my addr 172.21.15.37:0/3537455019 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:09:52.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.417+0000 7f60c981e640 1 --2- 172.21.15.37:0/3537455019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60c40ae200 0x7f60c4070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:52.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.418+0000 7f60c901d640 1 -- 172.21.15.37:0/3537455019 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107972185 0 0) 0x7f60c4071f90 con 0x7f60c40abd20 2023-12-11T17:09:52.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.418+0000 7f60c901d640 1 -- 172.21.15.37:0/3537455019 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f60b0003520 con 0x7f60c40abd20 2023-12-11T17:09:52.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.418+0000 7f60c901d640 1 -- 172.21.15.37:0/3537455019 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1458854069 0 0) 0x7f60b0003520 con 0x7f60c40abd20 2023-12-11T17:09:52.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.418+0000 7f60c901d640 1 -- 172.21.15.37:0/3537455019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60c40ae200 msgr2=0x7f60c4070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:52.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.418+0000 7f60c901d640 1 --2- 172.21.15.37:0/3537455019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60c40ae200 0x7f60c4070b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:52.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.418+0000 7f60c901d640 1 -- 172.21.15.37:0/3537455019 >> v1:172.21.15.151:6789/0 conn(0x7f60c415e5d0 legacy=0x7f60c406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:52.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.418+0000 7f60c901d640 1 -- 172.21.15.37:0/3537455019 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c4070350 con 0x7f60c40abd20 2023-12-11T17:09:52.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.418+0000 7f60c901d640 1 -- 172.21.15.37:0/3537455019 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f60bc0019f0 con 0x7f60c40abd20 2023-12-11T17:09:52.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.418+0000 7f60c901d640 1 -- 172.21.15.37:0/3537455019 >> v1:172.21.15.37:6789/0 conn(0x7f60c40abd20 legacy=0x7f60c40cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:52.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.418+0000 7f60c901d640 1 --2- 172.21.15.37:0/3537455019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60b00039a0 0x7f60b0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:52.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.418+0000 7f60c901d640 1 --2- 172.21.15.37:0/3537455019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60c40ae200 0x7f60b00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:52.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.418+0000 7f60c901d640 1 --2- 172.21.15.37:0/3537455019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60b0004d00 0x7f60b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:52.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.418+0000 7f60c901d640 1 -- 172.21.15.37:0/3537455019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c4070070 con 0x7f60b00039a0 2023-12-11T17:09:52.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.418+0000 7f60c901d640 1 -- 172.21.15.37:0/3537455019 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b000bb40 con 0x7f60b0004d00 2023-12-11T17:09:52.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.418+0000 7f60c901d640 1 -- 172.21.15.37:0/3537455019 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60b000bd00 con 0x7f60c40ae200 2023-12-11T17:09:52.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.418+0000 7f60ca01f640 1 --2- 172.21.15.37:0/3537455019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60b00039a0 0x7f60b0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:52.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.419+0000 7f60ca820640 1 --2- 172.21.15.37:0/3537455019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60b0004d00 0x7f60b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:52.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.419+0000 7f60ca01f640 1 -- 172.21.15.37:0/3537455019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60c40ae200 msgr2=0x7f60b00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:52.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.419+0000 7f60ca01f640 1 --2- 172.21.15.37:0/3537455019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60c40ae200 0x7f60b00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:52.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.419+0000 7f60ca01f640 1 -- 172.21.15.37:0/3537455019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60b0004d00 msgr2=0x7f60b0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:52.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.419+0000 7f60ca01f640 1 --2- 172.21.15.37:0/3537455019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60b0004d00 0x7f60b0005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:52.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.419+0000 7f60ca01f640 1 -- 172.21.15.37:0/3537455019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60b0003520 con 0x7f60b00039a0 2023-12-11T17:09:52.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.420+0000 7f60ca01f640 1 --2- 172.21.15.37:0/3537455019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60b00039a0 0x7f60b0003dc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f60c0001750 tx=0x7f60b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88491e47cfa3ae81 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:52.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.420+0000 7f60c901d640 1 -- 172.21.15.37:0/3537455019 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c00052d0 con 0x7f60b00039a0 2023-12-11T17:09:52.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.420+0000 7f60c901d640 1 -- 172.21.15.37:0/3537455019 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c002e050 con 0x7f60b00039a0 2023-12-11T17:09:52.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.420+0000 7f60c901d640 1 -- 172.21.15.37:0/3537455019 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c00035f0 con 0x7f60b00039a0 2023-12-11T17:09:52.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.421+0000 7f60cb021640 1 -- 172.21.15.37:0/3537455019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60b00039a0 msgr2=0x7f60b0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:52.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.421+0000 7f60cb021640 1 --2- 172.21.15.37:0/3537455019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60b00039a0 0x7f60b0003dc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f60c0001750 tx=0x7f60b00057f0 comp rx=0 tx=0).stop 2023-12-11T17:09:52.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.421+0000 7f60ca820640 1 -- 172.21.15.37:0/3537455019 reap_dead start 2023-12-11T17:09:52.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.421+0000 7f60cb021640 1 -- 172.21.15.37:0/3537455019 shutdown_connections 2023-12-11T17:09:52.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.421+0000 7f60cb021640 1 -- 172.21.15.37:0/3537455019 >> 172.21.15.37:0/3537455019 conn(0x7f60c40b0860 msgr2=0x7f60c40b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:52.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.421+0000 7f60cb021640 1 -- 172.21.15.37:0/3537455019 shutdown_connections 2023-12-11T17:09:52.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.421+0000 7f60cb021640 1 -- 172.21.15.37:0/3537455019 wait complete. 2023-12-11T17:09:52.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.423+0000 7f60cb021640 1 Processor -- start 2023-12-11T17:09:52.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.423+0000 7f60cb021640 1 -- start start 2023-12-11T17:09:52.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.424+0000 7f60cb021640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60b00039a0 0x7f60c4155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:52.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.424+0000 7f60cb021640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60c41f7140 0x7f60c40b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:52.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.424+0000 7f60cb021640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60c40b2da0 0x7f60c409b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:52.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.424+0000 7f60cb021640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c40b3220 con 0x7f60b00039a0 2023-12-11T17:09:52.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.424+0000 7f60cb021640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60c415a320 con 0x7f60c41f7140 2023-12-11T17:09:52.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.424+0000 7f60cb021640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60c415a5c0 con 0x7f60c40b2da0 2023-12-11T17:09:52.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.424+0000 7f60ca01f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60b00039a0 0x7f60c4155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:52.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.424+0000 7f60ca01f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60b00039a0 0x7f60c4155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55222/0 (socket says 172.21.15.37:55222) 2023-12-11T17:09:52.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.424+0000 7f60ca01f640 1 -- 172.21.15.37:0/2919527853 learned_addr learned my addr 172.21.15.37:0/2919527853 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:52.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.425+0000 7f60ca01f640 1 -- 172.21.15.37:0/2919527853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60c40b2da0 msgr2=0x7f60c409b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:52.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.425+0000 7f60ca01f640 1 --2- 172.21.15.37:0/2919527853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60c40b2da0 0x7f60c409b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:52.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.425+0000 7f60ca01f640 1 -- 172.21.15.37:0/2919527853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60c41f7140 msgr2=0x7f60c40b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:52.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.425+0000 7f60ca01f640 1 --2- 172.21.15.37:0/2919527853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60c41f7140 0x7f60c40b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:52.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.425+0000 7f60ca01f640 1 -- 172.21.15.37:0/2919527853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60c406c680 con 0x7f60b00039a0 2023-12-11T17:09:52.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.425+0000 7f60ca01f640 1 --2- 172.21.15.37:0/2919527853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60b00039a0 0x7f60c4155360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f60c0034040 tx=0x7f60c0001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:52.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.425+0000 7f60baffd640 1 -- 172.21.15.37:0/2919527853 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c0007a30 con 0x7f60b00039a0 2023-12-11T17:09:52.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.425+0000 7f60baffd640 1 -- 172.21.15.37:0/2919527853 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60c003c430 con 0x7f60b00039a0 2023-12-11T17:09:52.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.425+0000 7f60baffd640 1 -- 172.21.15.37:0/2919527853 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60c003c7e0 con 0x7f60b00039a0 2023-12-11T17:09:52.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.425+0000 7f60cb021640 1 -- 172.21.15.37:0/2919527853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60c415a8a0 con 0x7f60b00039a0 2023-12-11T17:09:52.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.425+0000 7f60cb021640 1 -- 172.21.15.37:0/2919527853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60c415ae60 con 0x7f60b00039a0 2023-12-11T17:09:52.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.426+0000 7f60cb021640 1 -- 172.21.15.37:0/2919527853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60c40b31c0 con 0x7f60b00039a0 2023-12-11T17:09:52.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.427+0000 7f60baffd640 1 -- 172.21.15.37:0/2919527853 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f60c003c940 con 0x7f60b00039a0 2023-12-11T17:09:52.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.428+0000 7f60baffd640 1 --2- 172.21.15.37:0/2919527853 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f60a806ae70 0x7f60a806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:52.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.428+0000 7f60baffd640 1 -- 172.21.15.37:0/2919527853 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f60c00ab530 con 0x7f60b00039a0 2023-12-11T17:09:52.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.429+0000 7f60c981e640 1 --2- 172.21.15.37:0/2919527853 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f60a806ae70 0x7f60a806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:52.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.430+0000 7f60c981e640 1 --2- 172.21.15.37:0/2919527853 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f60a806ae70 0x7f60a806d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f60b4006e80 tx=0x7f60b4006dd0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:52.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.433+0000 7f60baffd640 1 -- 172.21.15.37:0/2919527853 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f60c40b31c0 con 0x7f60b00039a0 2023-12-11T17:09:52.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.628+0000 7f60cb021640 1 -- 172.21.15.37:0/2919527853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60c415a700 con 0x7f60b00039a0 2023-12-11T17:09:52.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.632+0000 7f60baffd640 1 -- 172.21.15.37:0/2919527853 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f60c415a700 con 0x7f60b00039a0 2023-12-11T17:09:52.634 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:09:52.634 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:09:49.715938+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:09:52.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.634+0000 7f60cb021640 1 -- 172.21.15.37:0/2919527853 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f60a806ae70 msgr2=0x7f60a806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:52.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.634+0000 7f60cb021640 1 --2- 172.21.15.37:0/2919527853 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f60a806ae70 0x7f60a806d330 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f60b4006e80 tx=0x7f60b4006dd0 comp rx=0 tx=0).stop 2023-12-11T17:09:52.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.634+0000 7f60cb021640 1 -- 172.21.15.37:0/2919527853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60b00039a0 msgr2=0x7f60c4155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:52.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.634+0000 7f60cb021640 1 --2- 172.21.15.37:0/2919527853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60b00039a0 0x7f60c4155360 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f60c0034040 tx=0x7f60c0001120 comp rx=0 tx=0).stop 2023-12-11T17:09:52.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.634+0000 7f60cb021640 1 -- 172.21.15.37:0/2919527853 shutdown_connections 2023-12-11T17:09:52.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.634+0000 7f60cb021640 1 --2- 172.21.15.37:0/2919527853 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f60a806ae70 0x7f60a806d330 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:52.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.634+0000 7f60cb021640 1 --2- 172.21.15.37:0/2919527853 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60c41f7140 0x7f60c40b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:52.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.635+0000 7f60cb021640 1 --2- 172.21.15.37:0/2919527853 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f60c40b2da0 0x7f60c409b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:52.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.635+0000 7f60cb021640 1 --2- 172.21.15.37:0/2919527853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f60b00039a0 0x7f60c4155360 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:52.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.635+0000 7f60cb021640 1 -- 172.21.15.37:0/2919527853 >> 172.21.15.37:0/2919527853 conn(0x7f60c40b0860 msgr2=0x7f60c40af130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:52.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.635+0000 7f60cb021640 1 -- 172.21.15.37:0/2919527853 shutdown_connections 2023-12-11T17:09:52.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:52.635+0000 7f60cb021640 1 -- 172.21.15.37:0/2919527853 wait complete. 2023-12-11T17:09:53.057 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-11T17:09:44.643511+0000', 'modified': '2023-12-11T17:09:49.716284+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4251}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4251': {'gid': 4251, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/2348606057', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6834', 'nonce': 2348606057}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 2348606057}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1} 2023-12-11T17:09:53.057 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-11T17:09:53.057 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-11T17:09:53.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.299+0000 7fddbb623640 1 Processor -- start 2023-12-11T17:09:53.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.300+0000 7fddbb623640 1 -- start start 2023-12-11T17:09:53.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.301+0000 7fddbb623640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddb4143e00 0x7fddb40b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.301+0000 7fddbb623640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb40b3bb0 con 0x7fddb406c410 2023-12-11T17:09:53.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.301+0000 7fddbb623640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb41441e0 con 0x7fddb4072180 2023-12-11T17:09:53.301 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.301+0000 7fddbb623640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb4072680 con 0x7fddb4143e00 2023-12-11T17:09:53.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.302+0000 7fddb9bc0640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fddb406c410 0x7fddb415ecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40804/0 (socket says 172.21.15.37:40804) 2023-12-11T17:09:53.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.302+0000 7fddb9bc0640 1 -- 172.21.15.37:0/2260923251 learned_addr learned my addr 172.21.15.37:0/2260923251 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:09:53.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.302+0000 7fddb93bf640 1 --2- 172.21.15.37:0/2260923251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddb4143e00 0x7fddb40b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.302+0000 7fddabfff640 1 -- 172.21.15.37:0/2260923251 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4259725997 0 0) 0x7fddb40b3bb0 con 0x7fddb406c410 2023-12-11T17:09:53.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.302+0000 7fddabfff640 1 -- 172.21.15.37:0/2260923251 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdda0003520 con 0x7fddb406c410 2023-12-11T17:09:53.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.302+0000 7fddabfff640 1 -- 172.21.15.37:0/2260923251 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2440692973 0 0) 0x7fdda0003520 con 0x7fddb406c410 2023-12-11T17:09:53.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.303+0000 7fddabfff640 1 -- 172.21.15.37:0/2260923251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddb4143e00 msgr2=0x7fddb40b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:53.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.303+0000 7fddabfff640 1 --2- 172.21.15.37:0/2260923251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddb4143e00 0x7fddb40b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.303+0000 7fddabfff640 1 -- 172.21.15.37:0/2260923251 >> v1:172.21.15.151:6789/0 conn(0x7fddb4072180 legacy=0x7fddb40b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:53.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.303+0000 7fddabfff640 1 -- 172.21.15.37:0/2260923251 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb40b1e30 con 0x7fddb406c410 2023-12-11T17:09:53.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.303+0000 7fddabfff640 1 -- 172.21.15.37:0/2260923251 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7fddac0019f0 con 0x7fddb406c410 2023-12-11T17:09:53.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.303+0000 7fddabfff640 1 -- 172.21.15.37:0/2260923251 >> v1:172.21.15.37:6789/0 conn(0x7fddb406c410 legacy=0x7fddb415ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:53.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.303+0000 7fddabfff640 1 --2- 172.21.15.37:0/2260923251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddb4143e00 0x7fdda00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.303+0000 7fddabfff640 1 --2- 172.21.15.37:0/2260923251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdda0003f70 0x7fdda00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.303+0000 7fddabfff640 1 --2- 172.21.15.37:0/2260923251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda0004d00 0x7fdda0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.303+0000 7fddabfff640 1 -- 172.21.15.37:0/2260923251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb4072680 con 0x7fdda0004d00 2023-12-11T17:09:53.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.303+0000 7fddabfff640 1 -- 172.21.15.37:0/2260923251 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdda000bac0 con 0x7fdda0003f70 2023-12-11T17:09:53.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.303+0000 7fddabfff640 1 -- 172.21.15.37:0/2260923251 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdda000bc80 con 0x7fddb4143e00 2023-12-11T17:09:53.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.303+0000 7fddb9bc0640 1 --2- 172.21.15.37:0/2260923251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda0004d00 0x7fdda0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.303+0000 7fddb93bf640 1 --2- 172.21.15.37:0/2260923251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddb4143e00 0x7fdda00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.303+0000 7fddb8bbe640 1 --2- 172.21.15.37:0/2260923251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdda0003f70 0x7fdda00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.303+0000 7fddb9bc0640 1 -- 172.21.15.37:0/2260923251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddb4143e00 msgr2=0x7fdda00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:53.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.303+0000 7fddb9bc0640 1 --2- 172.21.15.37:0/2260923251 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddb4143e00 0x7fdda00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.303+0000 7fddb9bc0640 1 -- 172.21.15.37:0/2260923251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdda0003f70 msgr2=0x7fdda00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:53.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.303+0000 7fddb9bc0640 1 --2- 172.21.15.37:0/2260923251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdda0003f70 0x7fdda00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.305 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.303+0000 7fddb9bc0640 1 -- 172.21.15.37:0/2260923251 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdda0003520 con 0x7fdda0004d00 2023-12-11T17:09:53.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.304+0000 7fddb8bbe640 1 --2- 172.21.15.37:0/2260923251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdda0003f70 0x7fdda00047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:09:53.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.305+0000 7fddb9bc0640 1 --2- 172.21.15.37:0/2260923251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda0004d00 0x7fdda0005180 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fddac00a760 tx=0x7fdda00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c49a52dfcd07ad42 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:53.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.305+0000 7fddabfff640 1 -- 172.21.15.37:0/2260923251 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac034630 con 0x7fdda0004d00 2023-12-11T17:09:53.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.305+0000 7fddabfff640 1 -- 172.21.15.37:0/2260923251 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddac02f070 con 0x7fdda0004d00 2023-12-11T17:09:53.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.305+0000 7fddabfff640 1 -- 172.21.15.37:0/2260923251 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddac034a50 con 0x7fdda0004d00 2023-12-11T17:09:53.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.305+0000 7fddbb623640 1 -- 172.21.15.37:0/2260923251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda0004d00 msgr2=0x7fdda0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:53.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.305+0000 7fddbb623640 1 --2- 172.21.15.37:0/2260923251 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda0004d00 0x7fdda0005180 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fddac00a760 tx=0x7fdda00057f0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.305+0000 7fddb9bc0640 1 -- 172.21.15.37:0/2260923251 reap_dead start 2023-12-11T17:09:53.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.305+0000 7fddbb623640 1 -- 172.21.15.37:0/2260923251 shutdown_connections 2023-12-11T17:09:53.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.306+0000 7fddbb623640 1 -- 172.21.15.37:0/2260923251 >> 172.21.15.37:0/2260923251 conn(0x7fddb40b0a90 msgr2=0x7fddb40b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:53.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.306+0000 7fddbb623640 1 -- 172.21.15.37:0/2260923251 shutdown_connections 2023-12-11T17:09:53.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.306+0000 7fddbb623640 1 -- 172.21.15.37:0/2260923251 wait complete. 2023-12-11T17:09:53.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.307+0000 7fddbb623640 1 Processor -- start 2023-12-11T17:09:53.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.308+0000 7fddbb623640 1 -- start start 2023-12-11T17:09:53.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.309+0000 7fddbb623640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda0004d00 0x7fddb41f3130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.309+0000 7fddbb623640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddb4136de0 0x7fddb4140130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.309+0000 7fddbb623640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddb4137240 0x7fddb4140670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.309+0000 7fddbb623640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb41f6510 con 0x7fdda0004d00 2023-12-11T17:09:53.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.309+0000 7fddbb623640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb4140ca0 con 0x7fddb4136de0 2023-12-11T17:09:53.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.309+0000 7fddbb623640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb4140f80 con 0x7fddb4137240 2023-12-11T17:09:53.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.309+0000 7fddb93bf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda0004d00 0x7fddb41f3130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.309+0000 7fddb93bf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda0004d00 0x7fddb41f3130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55240/0 (socket says 172.21.15.37:55240) 2023-12-11T17:09:53.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.309+0000 7fddb93bf640 1 -- 172.21.15.37:0/2664725981 learned_addr learned my addr 172.21.15.37:0/2664725981 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:53.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.309+0000 7fddb93bf640 1 -- 172.21.15.37:0/2664725981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddb4137240 msgr2=0x7fddb4140670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:53.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.309+0000 7fddb93bf640 1 --2- 172.21.15.37:0/2664725981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddb4137240 0x7fddb4140670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.309+0000 7fddb93bf640 1 -- 172.21.15.37:0/2664725981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddb4136de0 msgr2=0x7fddb4140130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:53.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.309+0000 7fddb93bf640 1 --2- 172.21.15.37:0/2664725981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddb4136de0 0x7fddb4140130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.309+0000 7fddb93bf640 1 -- 172.21.15.37:0/2664725981 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb4141260 con 0x7fdda0004d00 2023-12-11T17:09:53.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.310+0000 7fddb93bf640 1 --2- 172.21.15.37:0/2664725981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda0004d00 0x7fddb41f3130 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fddb0011600 tx=0x7fddb0011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:53.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.310+0000 7fdda9ffb640 1 -- 172.21.15.37:0/2664725981 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0015870 con 0x7fdda0004d00 2023-12-11T17:09:53.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.310+0000 7fdda9ffb640 1 -- 172.21.15.37:0/2664725981 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb00159d0 con 0x7fdda0004d00 2023-12-11T17:09:53.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.310+0000 7fddbb623640 1 -- 172.21.15.37:0/2664725981 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb4141540 con 0x7fdda0004d00 2023-12-11T17:09:53.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.310+0000 7fdda9ffb640 1 -- 172.21.15.37:0/2664725981 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0015d40 con 0x7fdda0004d00 2023-12-11T17:09:53.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.310+0000 7fddbb623640 1 -- 172.21.15.37:0/2664725981 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb415ab60 con 0x7fdda0004d00 2023-12-11T17:09:53.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.313+0000 7fdda9ffb640 1 -- 172.21.15.37:0/2664725981 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fddb000f490 con 0x7fdda0004d00 2023-12-11T17:09:53.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.313+0000 7fdda9ffb640 1 --2- 172.21.15.37:0/2664725981 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdd9806ae70 0x7fdd9806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.314+0000 7fdda9ffb640 1 -- 172.21.15.37:0/2664725981 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fddb008a200 con 0x7fdda0004d00 2023-12-11T17:09:53.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.314+0000 7fddbe1bd740 1 Processor -- start 2023-12-11T17:09:53.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.314+0000 7fddb8bbe640 1 --2- 172.21.15.37:0/2664725981 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdd9806ae70 0x7fdd9806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.314+0000 7fddbe1bd740 1 -- start start 2023-12-11T17:09:53.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.315+0000 7fddbe1bd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562240a23010 0x562240a233f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.315+0000 7fddbe1bd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622409f32c0 0x562240a20280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.315+0000 7fddbe1bd740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622409f6b90 0x562240a207c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.315+0000 7fddbe1bd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x562240965f40 con 0x5622409f32c0 2023-12-11T17:09:53.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.315+0000 7fddbe1bd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562240963630 con 0x562240a23010 2023-12-11T17:09:53.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.315+0000 7fddbe1bd740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56224095ef20 con 0x5622409f6b90 2023-12-11T17:09:53.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.315+0000 7fddb8bbe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622409f32c0 0x562240a20280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.315+0000 7fddb8bbe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622409f32c0 0x562240a20280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55242/0 (socket says 172.21.15.37:55242) 2023-12-11T17:09:53.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.315+0000 7fddb8bbe640 1 -- 172.21.15.37:0/1775476865 learned_addr learned my addr 172.21.15.37:0/1775476865 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:53.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.315+0000 7fddb8bbe640 1 --2- 172.21.15.37:0/2664725981 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdd9806ae70 0x7fdd9806d330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fddb415a850 tx=0x7fdda4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:53.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.315+0000 7fddb93bf640 1 --2- 172.21.15.37:0/1775476865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562240a23010 0x562240a233f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.316+0000 7fddb9bc0640 1 --2- 172.21.15.37:0/1775476865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622409f6b90 0x562240a207c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.316+0000 7fddb8bbe640 1 -- 172.21.15.37:0/1775476865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622409f6b90 msgr2=0x562240a207c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:53.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.316+0000 7fddb8bbe640 1 --2- 172.21.15.37:0/1775476865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622409f6b90 0x562240a207c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.316+0000 7fddb8bbe640 1 -- 172.21.15.37:0/1775476865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562240a23010 msgr2=0x562240a233f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:53.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.316+0000 7fddb8bbe640 1 --2- 172.21.15.37:0/1775476865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562240a23010 0x562240a233f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.316+0000 7fddb8bbe640 1 -- 172.21.15.37:0/1775476865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562240921910 con 0x5622409f32c0 2023-12-11T17:09:53.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.316+0000 7fddb8bbe640 1 --2- 172.21.15.37:0/1775476865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622409f32c0 0x562240a20280 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdda400d7d0 tx=0x7fdda4010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fd06933382c304 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:53.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.316+0000 7fdd9effd640 1 -- 172.21.15.37:0/1775476865 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda4014db0 con 0x5622409f32c0 2023-12-11T17:09:53.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.316+0000 7fdd9effd640 1 -- 172.21.15.37:0/1775476865 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda400de10 con 0x5622409f32c0 2023-12-11T17:09:53.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.316+0000 7fdd9effd640 1 -- 172.21.15.37:0/1775476865 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda401f640 con 0x5622409f32c0 2023-12-11T17:09:53.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.317+0000 7fddbe1bd740 1 -- 172.21.15.37:0/1775476865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622409f32c0 msgr2=0x562240a20280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:53.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.317+0000 7fddbe1bd740 1 --2- 172.21.15.37:0/1775476865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622409f32c0 0x562240a20280 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdda400d7d0 tx=0x7fdda4010000 comp rx=0 tx=0).stop 2023-12-11T17:09:53.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.317+0000 7fddbe1bd740 1 -- 172.21.15.37:0/1775476865 shutdown_connections 2023-12-11T17:09:53.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.317+0000 7fddbe1bd740 1 --2- 172.21.15.37:0/1775476865 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622409f6b90 0x562240a207c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.317+0000 7fddbe1bd740 1 --2- 172.21.15.37:0/1775476865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622409f32c0 0x562240a20280 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.317+0000 7fddbe1bd740 1 --2- 172.21.15.37:0/1775476865 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562240a23010 0x562240a233f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.317+0000 7fddbe1bd740 1 -- 172.21.15.37:0/1775476865 >> 172.21.15.37:0/1775476865 conn(0x5622409f5530 msgr2=0x562240a3de20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:53.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.317+0000 7fddbe1bd740 1 -- 172.21.15.37:0/1775476865 shutdown_connections 2023-12-11T17:09:53.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.317+0000 7fddbe1bd740 1 -- 172.21.15.37:0/1775476865 wait complete. 2023-12-11T17:09:53.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.318+0000 7fddbe1bd740 1 -- start start 2023-12-11T17:09:53.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.318+0000 7fddbe1bd740 1 Processor -- start 2023-12-11T17:09:53.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.319+0000 7fddbe1bd740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622409f6b90 0x562240a1d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.319+0000 7fddbe1bd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562240a23010 0x562240a07920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.319+0000 7fddbe1bd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562240a18ce0 0x562240a19160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.319+0000 7fddbe1bd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5622408fb2f0 con 0x562240a23010 2023-12-11T17:09:53.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.319+0000 7fddbe1bd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562240918c70 con 0x562240a18ce0 2023-12-11T17:09:53.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.319+0000 7fddbe1bd740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5622406c1f20 con 0x5622409f6b90 2023-12-11T17:09:53.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.319+0000 7fddbe1bd740 10 client.0 _ll_register_callbacks cb 0x56224091d3b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T17:09:53.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.320+0000 7fddb8bbe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562240a23010 0x562240a07920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.320+0000 7fddb8bbe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562240a23010 0x562240a07920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55252/0 (socket says 172.21.15.37:55252) 2023-12-11T17:09:53.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.320+0000 7fddb8bbe640 1 -- 172.21.15.37:0/2254166358 learned_addr learned my addr 172.21.15.37:0/2254166358 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:53.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.320+0000 7fddb93bf640 1 --2- 172.21.15.37:0/2254166358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622409f6b90 0x562240a1d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.320+0000 7fddb9bc0640 1 --2- 172.21.15.37:0/2254166358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562240a18ce0 0x562240a19160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.320+0000 7fddb8bbe640 1 -- 172.21.15.37:0/2254166358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622409f6b90 msgr2=0x562240a1d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:53.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.320+0000 7fddb8bbe640 1 --2- 172.21.15.37:0/2254166358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622409f6b90 0x562240a1d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.320+0000 7fddb8bbe640 1 -- 172.21.15.37:0/2254166358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562240a18ce0 msgr2=0x562240a19160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:53.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.320+0000 7fddb8bbe640 1 --2- 172.21.15.37:0/2254166358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562240a18ce0 0x562240a19160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.320+0000 7fddb8bbe640 1 -- 172.21.15.37:0/2254166358 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb41441e0 con 0x562240a23010 2023-12-11T17:09:53.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.320+0000 7fddb9bc0640 1 --2- 172.21.15.37:0/2254166358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562240a18ce0 0x562240a19160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:09:53.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.320+0000 7fddb8bbe640 1 --2- 172.21.15.37:0/2254166358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562240a23010 0x562240a07920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdda4001500 tx=0x7fdda4013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=496c85dfc1e16304 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:53.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.320+0000 7fdd93fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-12-11T17:09:53.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.321+0000 7fdd93fff640 1 -- 172.21.15.37:0/2254166358 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda402b860 con 0x562240a23010 2023-12-11T17:09:53.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.321+0000 7fdd93fff640 1 -- 172.21.15.37:0/2254166358 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdda402b9c0 con 0x562240a23010 2023-12-11T17:09:53.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.321+0000 7fddbe1bd740 1 -- 172.21.15.37:0/2254166358 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562240957db0 con 0x562240a23010 2023-12-11T17:09:53.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.321+0000 7fdd93fff640 1 -- 172.21.15.37:0/2254166358 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdda402bb80 con 0x562240a23010 2023-12-11T17:09:53.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.321+0000 7fddbe1bd740 10 client.4395 fetch_fsmap learned FSMap version 6 2023-12-11T17:09:53.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.321+0000 7fddbe1bd740 1 -- 172.21.15.37:0/2254166358 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x56224095d5a0 con 0x562240a23010 2023-12-11T17:09:53.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.321+0000 7fdd93fff640 1 -- 172.21.15.37:0/2254166358 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562240957db0 con 0x562240a23010 2023-12-11T17:09:53.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.321+0000 7fdd93fff640 1 -- 172.21.15.37:0/2254166358 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 6) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fdda402bce0 con 0x562240a23010 2023-12-11T17:09:53.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.321+0000 7fddbe1bd740 10 client.4395 fetch_fsmap finished waiting for FSMap version 6 2023-12-11T17:09:53.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.321+0000 7fddbe1bd740 10 client.4395 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-11T17:09:53.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.321+0000 7fddbe1bd740 20 client.4395 populate_metadata read hostname 'smithi037' 2023-12-11T17:09:53.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.322+0000 7fddbe1bd740 1 --2- 172.21.15.37:0/2254166358 >> [v2:172.21.15.37:6834/2348606057,v1:172.21.15.37:6835/2348606057] conn(0x562240a070f0 0x562240a1b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.322+0000 7fddbe1bd740 4 client.4395 mds_command: new command op to 4251 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T17:09:53.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.322+0000 7fddbe1bd740 1 -- 172.21.15.37:0/2254166358 --> [v2:172.21.15.37:6834/2348606057,v1:172.21.15.37:6835/2348606057] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562240957ad0 con 0x562240a070f0 2023-12-11T17:09:53.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.322+0000 7fddb93bf640 1 --2- 172.21.15.37:0/2254166358 >> [v2:172.21.15.37:6834/2348606057,v1:172.21.15.37:6835/2348606057] conn(0x562240a070f0 0x562240a1b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.322+0000 7fddb93bf640 1 --2- 172.21.15.37:0/2254166358 >> [v2:172.21.15.37:6834/2348606057,v1:172.21.15.37:6835/2348606057] conn(0x562240a070f0 0x562240a1b3b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86a3d06c3f03d8de server_cookie=875ced0fae2dcb5f in_seq=0 out_seq=0 2023-12-11T17:09:53.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.322+0000 7fdd93fff640 10 client.4395 ms_handle_connect on v2:172.21.15.37:6834/2348606057 2023-12-11T17:09:53.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.323+0000 7fdd93fff640 1 -- 172.21.15.37:0/2254166358 <== mds.0 v2:172.21.15.37:6834/2348606057 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x562240957ad0 con 0x562240a070f0 2023-12-11T17:09:53.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.323+0000 7fdd93fff640 10 client.4395 handle_command_reply: tid=0 2023-12-11T17:09:53.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.323+0000 7fddbe1bd740 1 client.4395 shutdown 2023-12-11T17:09:53.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.323+0000 7fddbe1bd740 1 -- 172.21.15.37:0/2254166358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562240a23010 msgr2=0x562240a07920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:53.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.323+0000 7fddbe1bd740 1 --2- 172.21.15.37:0/2254166358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562240a23010 0x562240a07920 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdda4001500 tx=0x7fdda4013000 comp rx=0 tx=0).stop 2023-12-11T17:09:53.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.323+0000 7fddbe1bd740 1 -- 172.21.15.37:0/2254166358 shutdown_connections 2023-12-11T17:09:53.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.323+0000 7fddbe1bd740 1 --2- 172.21.15.37:0/2254166358 >> [v2:172.21.15.37:6834/2348606057,v1:172.21.15.37:6835/2348606057] conn(0x562240a070f0 0x562240a1b3b0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.323+0000 7fddbe1bd740 1 --2- 172.21.15.37:0/2254166358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562240a18ce0 0x562240a19160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.323+0000 7fddbe1bd740 1 --2- 172.21.15.37:0/2254166358 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562240a23010 0x562240a07920 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.323+0000 7fddbe1bd740 1 --2- 172.21.15.37:0/2254166358 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5622409f6b90 0x562240a1d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.323+0000 7fdd93fff640 0 client.4395 ms_handle_reset on v2:172.21.15.37:6834/2348606057 2023-12-11T17:09:53.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.323+0000 7fddbe1bd740 1 -- 172.21.15.37:0/2254166358 >> 172.21.15.37:0/2254166358 conn(0x5622409f32c0 msgr2=0x562240a26db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:53.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.324+0000 7fddbe1bd740 1 -- 172.21.15.37:0/2254166358 shutdown_connections 2023-12-11T17:09:53.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.324+0000 7fddbe1bd740 1 -- 172.21.15.37:0/2254166358 wait complete. 2023-12-11T17:09:53.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.324+0000 7fddbe1bd740 20 client.4395 trim_cache size 0 max 16384 2023-12-11T17:09:53.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.341+0000 7fddbe1bd740 1 Processor -- start 2023-12-11T17:09:53.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.341+0000 7fddbe1bd740 1 -- start start 2023-12-11T17:09:53.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.342+0000 7fddbe1bd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622409f6b90 0x5622409eeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.342+0000 7fddbe1bd740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562240a18ce0 0x562240a4da30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.342+0000 7fddbe1bd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562240a23010 0x562240a25b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.342+0000 7fddbe1bd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x562240a19290 con 0x5622409f6b90 2023-12-11T17:09:53.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.342+0000 7fddbe1bd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562240a1c640 con 0x562240a23010 2023-12-11T17:09:53.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.342+0000 7fddbe1bd740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x562240a1a160 con 0x562240a18ce0 2023-12-11T17:09:53.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.343+0000 7fddb93bf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622409f6b90 0x5622409eeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.343+0000 7fddb93bf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622409f6b90 0x5622409eeb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55260/0 (socket says 172.21.15.37:55260) 2023-12-11T17:09:53.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.343+0000 7fddb93bf640 1 -- 172.21.15.37:0/3520413124 learned_addr learned my addr 172.21.15.37:0/3520413124 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:53.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.343+0000 7fddb8bbe640 1 --2- 172.21.15.37:0/3520413124 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562240a18ce0 0x562240a4da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.343+0000 7fddb9bc0640 1 --2- 172.21.15.37:0/3520413124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562240a23010 0x562240a25b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.343+0000 7fddb93bf640 1 -- 172.21.15.37:0/3520413124 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562240a18ce0 msgr2=0x562240a4da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.343+0000 7fddb93bf640 1 --2- 172.21.15.37:0/3520413124 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562240a18ce0 0x562240a4da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.343+0000 7fddb93bf640 1 -- 172.21.15.37:0/3520413124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562240a23010 msgr2=0x562240a25b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.343+0000 7fddb93bf640 1 --2- 172.21.15.37:0/3520413124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562240a23010 0x562240a25b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.343+0000 7fddb93bf640 1 -- 172.21.15.37:0/3520413124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5622408fab80 con 0x5622409f6b90 2023-12-11T17:09:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.343+0000 7fddb9bc0640 1 --2- 172.21.15.37:0/3520413124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562240a23010 0x562240a25b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:09:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.343+0000 7fddb93bf640 1 --2- 172.21.15.37:0/3520413124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622409f6b90 0x5622409eeb90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fddb0058ae0 tx=0x7fddb0088270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2191d582d46a24f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.344+0000 7fdd9f7fe640 1 -- 172.21.15.37:0/3520413124 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0060ee0 con 0x5622409f6b90 2023-12-11T17:09:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.344+0000 7fdd9f7fe640 1 -- 172.21.15.37:0/3520413124 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddb00884b0 con 0x5622409f6b90 2023-12-11T17:09:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.344+0000 7fdd9f7fe640 1 -- 172.21.15.37:0/3520413124 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddb0055260 con 0x5622409f6b90 2023-12-11T17:09:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.344+0000 7fddbe1bd740 1 -- 172.21.15.37:0/3520413124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622409f6b90 msgr2=0x5622409eeb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:53.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.344+0000 7fddbe1bd740 1 --2- 172.21.15.37:0/3520413124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622409f6b90 0x5622409eeb90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fddb0058ae0 tx=0x7fddb0088270 comp rx=0 tx=0).stop 2023-12-11T17:09:53.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.344+0000 7fddbe1bd740 1 -- 172.21.15.37:0/3520413124 shutdown_connections 2023-12-11T17:09:53.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.344+0000 7fddbe1bd740 1 --2- 172.21.15.37:0/3520413124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x562240a23010 0x562240a25b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.344+0000 7fddbe1bd740 1 --2- 172.21.15.37:0/3520413124 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562240a18ce0 0x562240a4da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.344+0000 7fddbe1bd740 1 --2- 172.21.15.37:0/3520413124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5622409f6b90 0x5622409eeb90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.344+0000 7fddbe1bd740 1 -- 172.21.15.37:0/3520413124 >> 172.21.15.37:0/3520413124 conn(0x5622409f32c0 msgr2=0x5622409f22e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:53.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.344+0000 7fddbe1bd740 1 -- 172.21.15.37:0/3520413124 shutdown_connections 2023-12-11T17:09:53.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.344+0000 7fddbe1bd740 1 -- 172.21.15.37:0/3520413124 wait complete. 2023-12-11T17:09:53.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.345+0000 7fddbe1bd740 1 -- start start 2023-12-11T17:09:53.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.345+0000 7fddbe1bd740 1 Processor -- start 2023-12-11T17:09:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.346+0000 7fddbe1bd740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622409f6b90 0x562240a17ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.346+0000 7fddbe1bd740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562240a18ce0 0x562240a18420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.346+0000 7fddbe1bd740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562240a23010 0x562240a25b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.346+0000 7fddbe1bd740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x562240a18a20 con 0x562240a18ce0 2023-12-11T17:09:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.346+0000 7fddbe1bd740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x562240a619c0 con 0x5622409f6b90 2023-12-11T17:09:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.346+0000 7fddbe1bd740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x562240a61c10 con 0x562240a23010 2023-12-11T17:09:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.346+0000 7fddbe1bd740 10 client.0 _ll_register_callbacks cb 0x7fdda4022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T17:09:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.347+0000 7fddb8bbe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562240a18ce0 0x562240a18420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.347+0000 7fddb8bbe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562240a18ce0 0x562240a18420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55270/0 (socket says 172.21.15.37:55270) 2023-12-11T17:09:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.347+0000 7fddb8bbe640 1 -- 172.21.15.37:0/1139038665 learned_addr learned my addr 172.21.15.37:0/1139038665 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.347+0000 7fddb8bbe640 1 -- 172.21.15.37:0/1139038665 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562240a23010 msgr2=0x562240a25b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.347+0000 7fddb8bbe640 1 --2- 172.21.15.37:0/1139038665 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562240a23010 0x562240a25b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.347+0000 7fddb8bbe640 1 -- 172.21.15.37:0/1139038665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622409f6b90 msgr2=0x562240a17ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.347+0000 7fddb8bbe640 1 --2- 172.21.15.37:0/1139038665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622409f6b90 0x562240a17ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.347+0000 7fddb8bbe640 1 -- 172.21.15.37:0/1139038665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb415ab60 con 0x562240a18ce0 2023-12-11T17:09:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.347+0000 7fddb8bbe640 1 --2- 172.21.15.37:0/1139038665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562240a18ce0 0x562240a18420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdda4016010 tx=0x7fdda40078d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24274b0a0ec27746 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.347+0000 7fdd93fff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-12-11T17:09:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.347+0000 7fdd93fff640 1 -- 172.21.15.37:0/1139038665 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda402ba70 con 0x562240a18ce0 2023-12-11T17:09:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.348+0000 7fdd93fff640 1 -- 172.21.15.37:0/1139038665 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fdda402bbd0 con 0x562240a18ce0 2023-12-11T17:09:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.348+0000 7fddbe1bd740 1 -- 172.21.15.37:0/1139038665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdda400de10 con 0x562240a18ce0 2023-12-11T17:09:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.348+0000 7fdd93fff640 1 -- 172.21.15.37:0/1139038665 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdda40147f0 con 0x562240a18ce0 2023-12-11T17:09:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.348+0000 7fddbe1bd740 10 client.4401 fetch_fsmap learned FSMap version 6 2023-12-11T17:09:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.348+0000 7fddbe1bd740 1 -- 172.21.15.37:0/1139038665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x562240920170 con 0x562240a18ce0 2023-12-11T17:09:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.348+0000 7fdd93fff640 1 -- 172.21.15.37:0/1139038665 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda400de10 con 0x562240a18ce0 2023-12-11T17:09:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.348+0000 7fdd93fff640 1 -- 172.21.15.37:0/1139038665 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 6) v1 ==== 3302+0+0 (secure 0 0 0) 0x7fdda4029400 con 0x562240a18ce0 2023-12-11T17:09:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.348+0000 7fddbe1bd740 10 client.4401 fetch_fsmap finished waiting for FSMap version 6 2023-12-11T17:09:53.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.348+0000 7fddbe1bd740 10 client.4401 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-11T17:09:53.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.348+0000 7fddbe1bd740 20 client.4401 populate_metadata read hostname 'smithi037' 2023-12-11T17:09:53.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.348+0000 7fddbe1bd740 1 --2- 172.21.15.37:0/1139038665 >> [v2:172.21.15.37:6834/2348606057,v1:172.21.15.37:6835/2348606057] conn(0x5622409f8ac0 0x562240a260a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.348+0000 7fddbe1bd740 4 client.4401 mds_command: new command op to 4251 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-11T17:09:53.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.348+0000 7fddbe1bd740 1 -- 172.21.15.37:0/1139038665 --> [v2:172.21.15.37:6834/2348606057,v1:172.21.15.37:6835/2348606057] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56224065f6c0 con 0x5622409f8ac0 2023-12-11T17:09:53.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.348+0000 7fddb93bf640 1 --2- 172.21.15.37:0/1139038665 >> [v2:172.21.15.37:6834/2348606057,v1:172.21.15.37:6835/2348606057] conn(0x5622409f8ac0 0x562240a260a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.349+0000 7fddb93bf640 1 --2- 172.21.15.37:0/1139038665 >> [v2:172.21.15.37:6834/2348606057,v1:172.21.15.37:6835/2348606057] conn(0x5622409f8ac0 0x562240a260a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba706268e6daf9c8 server_cookie=ebeaa88846161370 in_seq=0 out_seq=0 2023-12-11T17:09:53.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.349+0000 7fdd93fff640 10 client.4401 ms_handle_connect on v2:172.21.15.37:6834/2348606057 2023-12-11T17:09:53.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.349+0000 7fdd93fff640 1 -- 172.21.15.37:0/1139038665 <== mds.0 v2:172.21.15.37:6834/2348606057 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x56224065f6c0 con 0x5622409f8ac0 2023-12-11T17:09:53.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.349+0000 7fdd93fff640 10 client.4401 handle_command_reply: tid=0 2023-12-11T17:09:53.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.349+0000 7fddbe1bd740 1 client.4401 shutdown 2023-12-11T17:09:53.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.349+0000 7fddbe1bd740 1 -- 172.21.15.37:0/1139038665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562240a18ce0 msgr2=0x562240a18420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:53.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.349+0000 7fddbe1bd740 1 --2- 172.21.15.37:0/1139038665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562240a18ce0 0x562240a18420 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdda4016010 tx=0x7fdda40078d0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.349+0000 7fddbe1bd740 1 -- 172.21.15.37:0/1139038665 shutdown_connections 2023-12-11T17:09:53.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.349+0000 7fddbe1bd740 1 --2- 172.21.15.37:0/1139038665 >> [v2:172.21.15.37:6834/2348606057,v1:172.21.15.37:6835/2348606057] conn(0x5622409f8ac0 0x562240a260a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.350+0000 7fddbe1bd740 1 --2- 172.21.15.37:0/1139038665 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x562240a23010 0x562240a25b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.350+0000 7fddbe1bd740 1 --2- 172.21.15.37:0/1139038665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562240a18ce0 0x562240a18420 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.350+0000 7fddbe1bd740 1 --2- 172.21.15.37:0/1139038665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622409f6b90 0x562240a17ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.350+0000 7fdd93fff640 0 client.4401 ms_handle_reset on v2:172.21.15.37:6834/2348606057 2023-12-11T17:09:53.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.350+0000 7fddbe1bd740 1 -- 172.21.15.37:0/1139038665 >> 172.21.15.37:0/1139038665 conn(0x5622409f32c0 msgr2=0x5622409f2630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:53.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.350+0000 7fddbe1bd740 1 -- 172.21.15.37:0/1139038665 shutdown_connections 2023-12-11T17:09:53.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.350+0000 7fddbe1bd740 1 -- 172.21.15.37:0/1139038665 wait complete. 2023-12-11T17:09:53.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.350+0000 7fddbe1bd740 20 client.4401 trim_cache size 0 max 16384 2023-12-11T17:09:53.353 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-12-11T17:09:53.353 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "349792a4-57b1-4c92-9cc0-0c9ba4325d41", 2023-12-11T17:09:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-12-11T17:09:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4251, 2023-12-11T17:09:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-12-11T17:09:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-12-11T17:09:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-12-11T17:09:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 8.1789209140000008, 2023-12-11T17:09:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 6, 2023-12-11T17:09:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 25, 2023-12-11T17:09:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 25, 2023-12-11T17:09:53.354 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 15.711441083 2023-12-11T17:09:53.354 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-12-11T17:09:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.350+0000 7fddbb623640 1 -- 172.21.15.37:0/2664725981 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdd9806ae70 msgr2=0x7fdd9806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.350+0000 7fddbb623640 1 --2- 172.21.15.37:0/2664725981 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdd9806ae70 0x7fdd9806d330 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fddb415a850 tx=0x7fdda4009040 comp rx=0 tx=0).stop 2023-12-11T17:09:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.350+0000 7fddbb623640 1 -- 172.21.15.37:0/2664725981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda0004d00 msgr2=0x7fddb41f3130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.350+0000 7fddbb623640 1 --2- 172.21.15.37:0/2664725981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda0004d00 0x7fddb41f3130 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fddb0011600 tx=0x7fddb0011ac0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.351+0000 7fddbb623640 1 -- 172.21.15.37:0/2664725981 shutdown_connections 2023-12-11T17:09:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.351+0000 7fddbb623640 1 --2- 172.21.15.37:0/2664725981 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdd9806ae70 0x7fdd9806d330 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.351+0000 7fddbb623640 1 --2- 172.21.15.37:0/2664725981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fddb4136de0 0x7fddb4140130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.351+0000 7fddbb623640 1 --2- 172.21.15.37:0/2664725981 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fddb4137240 0x7fddb4140670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.351+0000 7fddbb623640 1 --2- 172.21.15.37:0/2664725981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdda0004d00 0x7fddb41f3130 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.351+0000 7fddbb623640 1 -- 172.21.15.37:0/2664725981 >> 172.21.15.37:0/2664725981 conn(0x7fddb40b0a90 msgr2=0x7fddb406c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:53.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.351+0000 7fddbb623640 1 -- 172.21.15.37:0/2664725981 shutdown_connections 2023-12-11T17:09:53.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.351+0000 7fddbb623640 1 -- 172.21.15.37:0/2664725981 wait complete. 2023-12-11T17:09:53.367 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-11T17:09:53.367 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-11T17:09:53.367 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-11T17:09:53.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.566+0000 7f22a05c9640 1 Processor -- start 2023-12-11T17:09:53.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.567+0000 7f22a05c9640 1 -- start start 2023-12-11T17:09:53.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.568+0000 7f22a05c9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2298143e00 0x7f22980b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.568+0000 7f22a05c9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f229806c410 0x7f229815ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.568+0000 7f22a05c9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22980b3bb0 con 0x7f2298072180 2023-12-11T17:09:53.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.568+0000 7f22a05c9640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22981441e0 con 0x7f2298143e00 2023-12-11T17:09:53.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.568+0000 7f22a05c9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2298072680 con 0x7f229806c410 2023-12-11T17:09:53.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.568+0000 7f229e365640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2298143e00 0x7f22980b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.568+0000 7f229db64640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2298072180 0x7f22980b4580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40820/0 (socket says 172.21.15.37:40820) 2023-12-11T17:09:53.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.568+0000 7f229db64640 1 -- 172.21.15.37:0/2225336175 learned_addr learned my addr 172.21.15.37:0/2225336175 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:09:53.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.569+0000 7f229eb66640 1 --2- 172.21.15.37:0/2225336175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f229806c410 0x7f229815ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.569+0000 7f229e365640 1 -- 172.21.15.37:0/2225336175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f229806c410 msgr2=0x7f229815ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:53.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.569+0000 7f229e365640 1 --2- 172.21.15.37:0/2225336175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f229806c410 0x7f229815ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.569+0000 7f229e365640 1 -- 172.21.15.37:0/2225336175 >> v1:172.21.15.37:6789/0 conn(0x7f2298072180 legacy=0x7f22980b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:53.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.569+0000 7f229e365640 1 -- 172.21.15.37:0/2225336175 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22980b1e30 con 0x7f2298143e00 2023-12-11T17:09:53.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.569+0000 7f229d363640 1 -- 172.21.15.37:0/2225336175 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3491938696 0 0) 0x7f22980b3bb0 con 0x7f2298072180 2023-12-11T17:09:53.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.570+0000 7f229e365640 1 --2- 172.21.15.37:0/2225336175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2298143e00 0x7f22980b4040 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f22940097a0 tx=0x7f229402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0587c05210e20b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:53.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.570+0000 7f229d363640 1 -- 172.21.15.37:0/2225336175 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294031830 con 0x7f2298143e00 2023-12-11T17:09:53.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.570+0000 7f229d363640 1 -- 172.21.15.37:0/2225336175 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2294031990 con 0x7f2298143e00 2023-12-11T17:09:53.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.570+0000 7f229d363640 1 -- 172.21.15.37:0/2225336175 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2294031d20 con 0x7f2298143e00 2023-12-11T17:09:53.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.571+0000 7f22a05c9640 1 -- 172.21.15.37:0/2225336175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2298143e00 msgr2=0x7f22980b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:53.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.571+0000 7f22a05c9640 1 --2- 172.21.15.37:0/2225336175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2298143e00 0x7f22980b4040 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f22940097a0 tx=0x7f229402b8d0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.571+0000 7f22a05c9640 1 -- 172.21.15.37:0/2225336175 shutdown_connections 2023-12-11T17:09:53.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.571+0000 7f22a05c9640 1 --2- 172.21.15.37:0/2225336175 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f229806c410 0x7f229815ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.571+0000 7f22a05c9640 1 --2- 172.21.15.37:0/2225336175 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2298143e00 0x7f22980b4040 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.571+0000 7f22a05c9640 1 -- 172.21.15.37:0/2225336175 >> 172.21.15.37:0/2225336175 conn(0x7f22980b0a90 msgr2=0x7f22980b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:53.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.571+0000 7f22a05c9640 1 -- 172.21.15.37:0/2225336175 shutdown_connections 2023-12-11T17:09:53.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.571+0000 7f22a05c9640 1 -- 172.21.15.37:0/2225336175 wait complete. 2023-12-11T17:09:53.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.573+0000 7f22a05c9640 1 Processor -- start 2023-12-11T17:09:53.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.573+0000 7f22a05c9640 1 -- start start 2023-12-11T17:09:53.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.574+0000 7f22a05c9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f229806c410 0x7f22981f3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.574+0000 7f22a05c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2298072180 0x7f229815a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.574+0000 7f22a05c9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2298143e00 0x7f2298141fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.574+0000 7f22a05c9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f229815ad60 con 0x7f2298072180 2023-12-11T17:09:53.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.574+0000 7f22a05c9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22981f3780 con 0x7f229806c410 2023-12-11T17:09:53.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.574+0000 7f22a05c9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22981f3a60 con 0x7f2298143e00 2023-12-11T17:09:53.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.574+0000 7f229db64640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2298072180 0x7f229815a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.574+0000 7f229db64640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2298072180 0x7f229815a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55292/0 (socket says 172.21.15.37:55292) 2023-12-11T17:09:53.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.574+0000 7f229db64640 1 -- 172.21.15.37:0/507497377 learned_addr learned my addr 172.21.15.37:0/507497377 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:53.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.574+0000 7f229eb66640 1 --2- 172.21.15.37:0/507497377 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2298143e00 0x7f2298141fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.575+0000 7f229e365640 1 --2- 172.21.15.37:0/507497377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f229806c410 0x7f22981f3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.575+0000 7f229db64640 1 -- 172.21.15.37:0/507497377 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2298143e00 msgr2=0x7f2298141fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:53.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.575+0000 7f229db64640 1 --2- 172.21.15.37:0/507497377 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2298143e00 0x7f2298141fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.575+0000 7f229db64640 1 -- 172.21.15.37:0/507497377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f229806c410 msgr2=0x7f22981f3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:53.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.575+0000 7f229db64640 1 --2- 172.21.15.37:0/507497377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f229806c410 0x7f22981f3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.575+0000 7f229db64640 1 -- 172.21.15.37:0/507497377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2294009400 con 0x7f2298072180 2023-12-11T17:09:53.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.575+0000 7f229db64640 1 --2- 172.21.15.37:0/507497377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2298072180 0x7f229815a820 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f228800c4b0 tx=0x7f228800c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:53.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.575+0000 7f228effd640 1 -- 172.21.15.37:0/507497377 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22880074e0 con 0x7f2298072180 2023-12-11T17:09:53.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.575+0000 7f228effd640 1 -- 172.21.15.37:0/507497377 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2288007660 con 0x7f2298072180 2023-12-11T17:09:53.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.575+0000 7f228effd640 1 -- 172.21.15.37:0/507497377 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2288004a20 con 0x7f2298072180 2023-12-11T17:09:53.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.575+0000 7f22a05c9640 1 -- 172.21.15.37:0/507497377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22981f3d40 con 0x7f2298072180 2023-12-11T17:09:53.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.575+0000 7f22a05c9640 1 -- 172.21.15.37:0/507497377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2298137670 con 0x7f2298072180 2023-12-11T17:09:53.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.577+0000 7f22a05c9640 1 -- 172.21.15.37:0/507497377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2298137860 con 0x7f2298072180 2023-12-11T17:09:53.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.578+0000 7f228effd640 1 -- 172.21.15.37:0/507497377 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2288004b80 con 0x7f2298072180 2023-12-11T17:09:53.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.579+0000 7f228effd640 1 --2- 172.21.15.37:0/507497377 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f227c06ae40 0x7f227c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:53.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.579+0000 7f228effd640 1 -- 172.21.15.37:0/507497377 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2288088b60 con 0x7f2298072180 2023-12-11T17:09:53.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.579+0000 7f229e365640 1 --2- 172.21.15.37:0/507497377 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f227c06ae40 0x7f227c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:53.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.581+0000 7f229e365640 1 --2- 172.21.15.37:0/507497377 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f227c06ae40 0x7f227c06d300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2294036000 tx=0x7f229403c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:53.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.583+0000 7f228effd640 1 -- 172.21.15.37:0/507497377 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2288053950 con 0x7f2298072180 2023-12-11T17:09:53.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.820+0000 7f22a05c9640 1 -- 172.21.15.37:0/507497377 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f22980745d0 con 0x7f2298072180 2023-12-11T17:09:53.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.821+0000 7f228effd640 1 -- 172.21.15.37:0/507497377 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+88 (secure 0 0 0) 0x7f2288018070 con 0x7f2298072180 2023-12-11T17:09:53.821 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-11T17:09:53.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.823+0000 7f22a05c9640 1 -- 172.21.15.37:0/507497377 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f227c06ae40 msgr2=0x7f227c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:53.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.823+0000 7f22a05c9640 1 --2- 172.21.15.37:0/507497377 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f227c06ae40 0x7f227c06d300 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2294036000 tx=0x7f229403c040 comp rx=0 tx=0).stop 2023-12-11T17:09:53.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.823+0000 7f22a05c9640 1 -- 172.21.15.37:0/507497377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2298072180 msgr2=0x7f229815a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:53.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.823+0000 7f22a05c9640 1 --2- 172.21.15.37:0/507497377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2298072180 0x7f229815a820 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f228800c4b0 tx=0x7f228800c970 comp rx=0 tx=0).stop 2023-12-11T17:09:53.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.823+0000 7f22a05c9640 1 -- 172.21.15.37:0/507497377 shutdown_connections 2023-12-11T17:09:53.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.823+0000 7f22a05c9640 1 --2- 172.21.15.37:0/507497377 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f227c06ae40 0x7f227c06d300 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.823+0000 7f22a05c9640 1 --2- 172.21.15.37:0/507497377 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2298143e00 0x7f2298141fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.823+0000 7f22a05c9640 1 --2- 172.21.15.37:0/507497377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2298072180 0x7f229815a820 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.823+0000 7f22a05c9640 1 --2- 172.21.15.37:0/507497377 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f229806c410 0x7f22981f3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:53.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.824+0000 7f22a05c9640 1 -- 172.21.15.37:0/507497377 >> 172.21.15.37:0/507497377 conn(0x7f22980b0a90 msgr2=0x7f22980af9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:53.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.824+0000 7f22a05c9640 1 -- 172.21.15.37:0/507497377 shutdown_connections 2023-12-11T17:09:53.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:53.824+0000 7f22a05c9640 1 -- 172.21.15.37:0/507497377 wait complete. 2023-12-11T17:09:53.842 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-11T17:09:53.842 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-11T17:09:53.842 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-12-11T17:09:53.842 INFO:tasks.cephfs.mount:self.client.name = client.admin 2023-12-11T17:09:53.842 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2023-12-11T17:09:53.842 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-11T17:09:53.843 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-11T17:09:53.843 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-11T17:09:53.843 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2023-12-11T17:09:53.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:09:53.843 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-12-11T17:09:53.897 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-11T17:09:53.897 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-11T17:09:53.897 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-12-11T17:09:53.897 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:09:53.897 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-12-11T17:09:53.897 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:09:53.897 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-11T17:09:53.898 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-12-11T17:09:53.898 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-12-11T17:09:53.898 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-11T17:09:53.898 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-12-11T17:09:53.898 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-12-11T17:09:53.898 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-11T17:09:53.898 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-12-11T17:09:53.898 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-12-11T17:09:53.898 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-11T17:09:53.898 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42381sec preferred_lft 42381sec 2023-12-11T17:09:53.898 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2023-12-11T17:09:53.898 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:09:53.898 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-11T17:09:53.898 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-12-11T17:09:53.899 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-12-11T17:09:53.900 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-11T17:09:53.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:09:53.900 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-12-11T17:09:53.900 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-12-11T17:09:53.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2023-12-11T17:09:53.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2023-12-11T17:09:53.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2023-12-11T17:09:53.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-11T17:09:53.900 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-12-11T17:09:54.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:09:54.389 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-11T17:09:54.471 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-12-11T17:09:54.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:09:54.474 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-12-11T17:09:54.528 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-12-11T17:09:54.529 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-11T17:09:54.529 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-11T17:09:54.529 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-11T17:09:54.529 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-11T17:09:54.529 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:09:54.529 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-12-11T17:09:54.529 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-12-11T17:09:54.530 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-11T17:09:54.530 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-11T17:09:54.530 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-11T17:09:54.530 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-12-11T17:09:55.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:09:55.271 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-12-11T17:09:55.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:09:55.330 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2023-12-11T17:09:55.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:09:55.389 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-12-11T17:09:55.389 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-12-11T17:09:55.389 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-11T17:09:55.389 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2023-12-11T17:09:55.389 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-12-11T17:09:55.547 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2023-12-11T17:09:55.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:09:55.548 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-12-11T17:09:55.548 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-12-11T17:09:55.548 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2023-12-11T17:09:55.548 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-11T17:09:55.548 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2023-12-11T17:09:55.548 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2023-12-11T17:09:55.548 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2023-12-11T17:09:55.548 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-12-11T17:09:55.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:09:55.845 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-12-11T17:09:55.845 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-12-11T17:09:55.845 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-12-11T17:09:55.846 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2023-12-11T17:09:55.846 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-12-11T17:09:56.015 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2023-12-11T17:09:56.016 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-11T17:09:56.016 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2023-12-11T17:09:56.068 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2023-12-11T17:09:56.069 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-11T17:09:56.069 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2023-12-11T17:09:56.121 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-12-11T17:09:56.224 DEBUG:teuthology.orchestra.run.smithi037:> cat /proc/self/mounts | awk '{print $2}' 2023-12-11T17:09:56.283 INFO:teuthology.orchestra.run.smithi037.stdout:/proc 2023-12-11T17:09:56.283 INFO:teuthology.orchestra.run.smithi037.stdout:/sys 2023-12-11T17:09:56.283 INFO:teuthology.orchestra.run.smithi037.stdout:/dev 2023-12-11T17:09:56.283 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/security 2023-12-11T17:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/shm 2023-12-11T17:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/pts 2023-12-11T17:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout:/run 2023-12-11T17:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/cgroup 2023-12-11T17:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/pstore 2023-12-11T17:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout:/ 2023-12-11T17:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/selinux 2023-12-11T17:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2023-12-11T17:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/mqueue 2023-12-11T17:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/hugepages 2023-12-11T17:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/debug 2023-12-11T17:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/tracing 2023-12-11T17:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-11T17:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/fuse/connections 2023-12-11T17:09:56.284 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/config 2023-12-11T17:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysctl.service 2023-12-11T17:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-11T17:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/nfs/rpc_pipefs 2023-12-11T17:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/1000 2023-12-11T17:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph 2023-12-11T17:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph/osd/ceph-0 2023-12-11T17:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph/osd/ceph-1 2023-12-11T17:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph/osd/ceph-2 2023-12-11T17:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph/osd/ceph-3 2023-12-11T17:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns 2023-12-11T17:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-11T17:09:56.285 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-11T17:09:56.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:09:56.286 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-12-11T17:09:56.337 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-11T17:09:56.337 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2023-12-11T17:09:56.342 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-12-11T17:09:56.420 DEBUG:teuthology.orchestra.run.smithi037:> cat /proc/self/mounts | awk '{print $2}' 2023-12-11T17:09:56.469 INFO:teuthology.orchestra.run.smithi037.stdout:/proc 2023-12-11T17:09:56.469 INFO:teuthology.orchestra.run.smithi037.stdout:/sys 2023-12-11T17:09:56.469 INFO:teuthology.orchestra.run.smithi037.stdout:/dev 2023-12-11T17:09:56.469 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/security 2023-12-11T17:09:56.469 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/shm 2023-12-11T17:09:56.469 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/pts 2023-12-11T17:09:56.469 INFO:teuthology.orchestra.run.smithi037.stdout:/run 2023-12-11T17:09:56.469 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/cgroup 2023-12-11T17:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/pstore 2023-12-11T17:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout:/ 2023-12-11T17:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/selinux 2023-12-11T17:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2023-12-11T17:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/mqueue 2023-12-11T17:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/hugepages 2023-12-11T17:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/debug 2023-12-11T17:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/tracing 2023-12-11T17:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-11T17:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/fuse/connections 2023-12-11T17:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/config 2023-12-11T17:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysctl.service 2023-12-11T17:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-11T17:09:56.470 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/nfs/rpc_pipefs 2023-12-11T17:09:56.471 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/1000 2023-12-11T17:09:56.471 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph 2023-12-11T17:09:56.471 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph/osd/ceph-0 2023-12-11T17:09:56.471 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph/osd/ceph-1 2023-12-11T17:09:56.471 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph/osd/ceph-2 2023-12-11T17:09:56.471 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph/osd/ceph-3 2023-12-11T17:09:56.471 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns 2023-12-11T17:09:56.471 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-11T17:09:56.471 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-11T17:09:56.472 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:09:56.472 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-12-11T17:09:56.557 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:2023-12-11T17:09:56.556+0000 7f96f7a48480 -1 init, newargv = 0x55b94dbabe50 newargc=15 2023-12-11T17:09:56.557 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[94431]: starting ceph client 2023-12-11T17:09:56.570 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[94431]: starting fuse 2023-12-11T17:09:57.667 DEBUG:teuthology.orchestra.run.smithi037:> sudo modprobe fuse 2023-12-11T17:09:57.779 DEBUG:teuthology.orchestra.run.smithi037:> cat /proc/self/mounts | awk '{print $2}' 2023-12-11T17:09:57.835 INFO:teuthology.orchestra.run.smithi037.stdout:/proc 2023-12-11T17:09:57.835 INFO:teuthology.orchestra.run.smithi037.stdout:/sys 2023-12-11T17:09:57.835 INFO:teuthology.orchestra.run.smithi037.stdout:/dev 2023-12-11T17:09:57.835 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/security 2023-12-11T17:09:57.835 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/shm 2023-12-11T17:09:57.835 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/pts 2023-12-11T17:09:57.835 INFO:teuthology.orchestra.run.smithi037.stdout:/run 2023-12-11T17:09:57.836 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/cgroup 2023-12-11T17:09:57.836 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/pstore 2023-12-11T17:09:57.836 INFO:teuthology.orchestra.run.smithi037.stdout:/ 2023-12-11T17:09:57.836 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/selinux 2023-12-11T17:09:57.836 INFO:teuthology.orchestra.run.smithi037.stdout:/proc/sys/fs/binfmt_misc 2023-12-11T17:09:57.836 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/mqueue 2023-12-11T17:09:57.836 INFO:teuthology.orchestra.run.smithi037.stdout:/dev/hugepages 2023-12-11T17:09:57.836 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/debug 2023-12-11T17:09:57.836 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/tracing 2023-12-11T17:09:57.836 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2023-12-11T17:09:57.836 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/fs/fuse/connections 2023-12-11T17:09:57.836 INFO:teuthology.orchestra.run.smithi037.stdout:/sys/kernel/config 2023-12-11T17:09:57.836 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-sysctl.service 2023-12-11T17:09:57.836 INFO:teuthology.orchestra.run.smithi037.stdout:/run/credentials/systemd-tmpfiles-setup.service 2023-12-11T17:09:57.837 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/nfs/rpc_pipefs 2023-12-11T17:09:57.837 INFO:teuthology.orchestra.run.smithi037.stdout:/run/user/1000 2023-12-11T17:09:57.837 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph 2023-12-11T17:09:57.837 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph/osd/ceph-0 2023-12-11T17:09:57.837 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph/osd/ceph-1 2023-12-11T17:09:57.837 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph/osd/ceph-2 2023-12-11T17:09:57.837 INFO:teuthology.orchestra.run.smithi037.stdout:/var/lib/ceph/osd/ceph-3 2023-12-11T17:09:57.837 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns 2023-12-11T17:09:57.837 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-11T17:09:57.837 INFO:teuthology.orchestra.run.smithi037.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-11T17:09:57.837 INFO:teuthology.orchestra.run.smithi037.stdout:/home/ubuntu/cephtest/mnt.admin 2023-12-11T17:09:57.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:09:57.838 DEBUG:teuthology.orchestra.run.smithi037:> ls /sys/fs/fuse/connections 2023-12-11T17:09:57.895 INFO:teuthology.orchestra.run.smithi037.stdout:39 2023-12-11T17:09:57.895 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [39] 2023-12-11T17:09:57.895 DEBUG:teuthology.orchestra.run.smithi037:> sudo stdin-killer -- python3 -c ' 2023-12-11T17:09:57.895 DEBUG:teuthology.orchestra.run.smithi037:> import glob 2023-12-11T17:09:57.896 DEBUG:teuthology.orchestra.run.smithi037:> import re 2023-12-11T17:09:57.896 DEBUG:teuthology.orchestra.run.smithi037:> import os 2023-12-11T17:09:57.896 DEBUG:teuthology.orchestra.run.smithi037:> import subprocess 2023-12-11T17:09:57.896 DEBUG:teuthology.orchestra.run.smithi037:> 2023-12-11T17:09:57.896 DEBUG:teuthology.orchestra.run.smithi037:> def _find_admin_socket(client_name): 2023-12-11T17:09:57.896 DEBUG:teuthology.orchestra.run.smithi037:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2023-12-11T17:09:57.896 DEBUG:teuthology.orchestra.run.smithi037:> files = glob.glob(asok_path) 2023-12-11T17:09:57.896 DEBUG:teuthology.orchestra.run.smithi037:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2023-12-11T17:09:57.896 DEBUG:teuthology.orchestra.run.smithi037:> 2023-12-11T17:09:57.896 DEBUG:teuthology.orchestra.run.smithi037:> # Given a non-glob path, it better be there 2023-12-11T17:09:57.896 DEBUG:teuthology.orchestra.run.smithi037:> if "*" not in asok_path: 2023-12-11T17:09:57.896 DEBUG:teuthology.orchestra.run.smithi037:> assert(len(files) == 1) 2023-12-11T17:09:57.896 DEBUG:teuthology.orchestra.run.smithi037:> return files[0] 2023-12-11T17:09:57.896 DEBUG:teuthology.orchestra.run.smithi037:> 2023-12-11T17:09:57.896 DEBUG:teuthology.orchestra.run.smithi037:> for f in files: 2023-12-11T17:09:57.896 DEBUG:teuthology.orchestra.run.smithi037:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-11T17:09:57.897 DEBUG:teuthology.orchestra.run.smithi037:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-11T17:09:57.897 DEBUG:teuthology.orchestra.run.smithi037:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-11T17:09:57.897 DEBUG:teuthology.orchestra.run.smithi037:> contents = proc_f.read() 2023-12-11T17:09:57.897 DEBUG:teuthology.orchestra.run.smithi037:> if mountpoint in contents: 2023-12-11T17:09:57.897 DEBUG:teuthology.orchestra.run.smithi037:> return f 2023-12-11T17:09:57.897 DEBUG:teuthology.orchestra.run.smithi037:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-11T17:09:57.897 DEBUG:teuthology.orchestra.run.smithi037:> 2023-12-11T17:09:57.897 DEBUG:teuthology.orchestra.run.smithi037:> print(_find_admin_socket("client.admin")) 2023-12-11T17:09:57.897 DEBUG:teuthology.orchestra.run.smithi037:> ' 2023-12-11T17:09:58.085 INFO:teuthology.orchestra.run.smithi037.stdout:/var/run/ceph/ceph-client.admin.94431.asok 2023-12-11T17:09:58.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2023-12-11T17:09:58.103 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.94431.asok 2023-12-11T17:09:58.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:09:58.104 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.94431.asok status 2023-12-11T17:09:58.360 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-12-11T17:09:58.361 INFO:teuthology.orchestra.run.smithi037.stdout: "metadata": { 2023-12-11T17:09:58.361 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_sha1": "a62fda73efba5520d409bb5a21bd8373289dda5d", 2023-12-11T17:09:58.361 INFO:teuthology.orchestra.run.smithi037.stdout: "ceph_version": "ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev)", 2023-12-11T17:09:58.361 INFO:teuthology.orchestra.run.smithi037.stdout: "entity_id": "admin", 2023-12-11T17:09:58.361 INFO:teuthology.orchestra.run.smithi037.stdout: "hostname": "smithi037", 2023-12-11T17:09:58.361 INFO:teuthology.orchestra.run.smithi037.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2023-12-11T17:09:58.361 INFO:teuthology.orchestra.run.smithi037.stdout: "pid": "94431", 2023-12-11T17:09:58.361 INFO:teuthology.orchestra.run.smithi037.stdout: "root": "/" 2023-12-11T17:09:58.361 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:09:58.361 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_count": 0, 2023-12-11T17:09:58.361 INFO:teuthology.orchestra.run.smithi037.stdout: "dentry_pinned_count": 0, 2023-12-11T17:09:58.361 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4416, 2023-12-11T17:09:58.362 INFO:teuthology.orchestra.run.smithi037.stdout: "inst": { 2023-12-11T17:09:58.362 INFO:teuthology.orchestra.run.smithi037.stdout: "name": { 2023-12-11T17:09:58.362 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "client", 2023-12-11T17:09:58.362 INFO:teuthology.orchestra.run.smithi037.stdout: "num": 4416 2023-12-11T17:09:58.362 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:09:58.362 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-12-11T17:09:58.362 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-12-11T17:09:58.362 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-12-11T17:09:58.362 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2968671567 2023-12-11T17:09:58.362 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:09:58.362 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:09:58.362 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": { 2023-12-11T17:09:58.362 INFO:teuthology.orchestra.run.smithi037.stdout: "type": "v1", 2023-12-11T17:09:58.362 INFO:teuthology.orchestra.run.smithi037.stdout: "addr": "192.168.0.1:0", 2023-12-11T17:09:58.362 INFO:teuthology.orchestra.run.smithi037.stdout: "nonce": 2968671567 2023-12-11T17:09:58.363 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:09:58.363 INFO:teuthology.orchestra.run.smithi037.stdout: "inst_str": "client.4416 192.168.0.1:0/2968671567", 2023-12-11T17:09:58.363 INFO:teuthology.orchestra.run.smithi037.stdout: "addr_str": "192.168.0.1:0/2968671567", 2023-12-11T17:09:58.363 INFO:teuthology.orchestra.run.smithi037.stdout: "inode_count": 1, 2023-12-11T17:09:58.363 INFO:teuthology.orchestra.run.smithi037.stdout: "mds_epoch": 6, 2023-12-11T17:09:58.363 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch": 25, 2023-12-11T17:09:58.363 INFO:teuthology.orchestra.run.smithi037.stdout: "osd_epoch_barrier": 0, 2023-12-11T17:09:58.363 INFO:teuthology.orchestra.run.smithi037.stdout: "blocklisted": false, 2023-12-11T17:09:58.363 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs" 2023-12-11T17:09:58.363 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-12-11T17:09:58.376 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:09:58.376 DEBUG:teuthology.orchestra.run.smithi037:> stat --file-system '--printf=%T 2023-12-11T17:09:58.376 DEBUG:teuthology.orchestra.run.smithi037:> ' -- /home/ubuntu/cephtest/mnt.admin 2023-12-11T17:09:58.435 INFO:teuthology.orchestra.run.smithi037.stdout:fuseblk 2023-12-11T17:09:58.435 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2023-12-11T17:09:58.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:09:58.436 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2023-12-11T17:09:58.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:09:58.538 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.admin && exec bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2023-12-11T17:09:58.627 INFO:teuthology.orchestra.run.smithi037.stdout:# file: . 2023-12-11T17:09:58.627 INFO:teuthology.orchestra.run.smithi037.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2023-12-11T17:09:58.627 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:09:58.628 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:09:58.628 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-11T17:09:58.687 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:09:58.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.909+0000 7fac1b17a640 1 Processor -- start 2023-12-11T17:09:58.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.909+0000 7fac1b17a640 1 -- start start 2023-12-11T17:09:58.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.911+0000 7fac1b17a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fac1415e5d0 0x7fac1406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.911+0000 7fac1b17a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fac140ae200 0x7fac14070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.911+0000 7fac1b17a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac14071f90 con 0x7fac1406c330 2023-12-11T17:09:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.911+0000 7fac1b17a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac14072270 con 0x7fac140ae200 2023-12-11T17:09:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.911+0000 7fac1b17a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac14070070 con 0x7fac1415e5d0 2023-12-11T17:09:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.911+0000 7fac19977640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fac140ae200 0x7fac14070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.911+0000 7fac19977640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fac140ae200 0x7fac14070b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44336/0 (socket says 172.21.15.37:44336) 2023-12-11T17:09:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.911+0000 7fac1a979640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fac1406c330 0x7fac140cded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51248/0 (socket says 172.21.15.37:51248) 2023-12-11T17:09:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.911+0000 7fac19977640 1 -- 172.21.15.37:0/1302291248 learned_addr learned my addr 172.21.15.37:0/1302291248 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.912+0000 7fac1a178640 1 --2- 172.21.15.37:0/1302291248 >> v2:172.21.15.151:3300/0 conn(0x7fac1415e5d0 0x7fac1406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.912+0000 7fac19977640 1 -- 172.21.15.37:0/1302291248 >> v2:172.21.15.151:3300/0 conn(0x7fac1415e5d0 msgr2=0x7fac1406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.912+0000 7fac19977640 1 --2- 172.21.15.37:0/1302291248 >> v2:172.21.15.151:3300/0 conn(0x7fac1415e5d0 0x7fac1406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.912+0000 7fac19977640 1 -- 172.21.15.37:0/1302291248 >> v1:172.21.15.37:6789/0 conn(0x7fac1406c330 legacy=0x7fac140cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:58.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.912+0000 7fac19977640 1 -- 172.21.15.37:0/1302291248 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac14070350 con 0x7fac140ae200 2023-12-11T17:09:58.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.913+0000 7fac19977640 1 --2- 172.21.15.37:0/1302291248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac140ae200 0x7fac14070b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fac1406bb50 tx=0x7fac0402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=760408752d8053c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:58.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.913+0000 7fac19176640 1 -- 172.21.15.37:0/1302291248 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04031870 con 0x7fac140ae200 2023-12-11T17:09:58.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.913+0000 7fac19176640 1 -- 172.21.15.37:0/1302291248 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac040319d0 con 0x7fac140ae200 2023-12-11T17:09:58.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.913+0000 7fac19176640 1 -- 172.21.15.37:0/1302291248 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac04031d60 con 0x7fac140ae200 2023-12-11T17:09:58.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.914+0000 7fac1b17a640 1 -- 172.21.15.37:0/1302291248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac140ae200 msgr2=0x7fac14070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:58.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.914+0000 7fac1b17a640 1 --2- 172.21.15.37:0/1302291248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac140ae200 0x7fac14070b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fac1406bb50 tx=0x7fac0402b910 comp rx=0 tx=0).stop 2023-12-11T17:09:58.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.914+0000 7fac1b17a640 1 -- 172.21.15.37:0/1302291248 shutdown_connections 2023-12-11T17:09:58.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.914+0000 7fac1b17a640 1 --2- 172.21.15.37:0/1302291248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac140ae200 0x7fac14070b50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:58.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.914+0000 7fac1b17a640 1 --2- 172.21.15.37:0/1302291248 >> v2:172.21.15.151:3300/0 conn(0x7fac1415e5d0 0x7fac1406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:58.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.914+0000 7fac1b17a640 1 -- 172.21.15.37:0/1302291248 >> 172.21.15.37:0/1302291248 conn(0x7fac140b0860 msgr2=0x7fac140b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:58.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.914+0000 7fac1b17a640 1 -- 172.21.15.37:0/1302291248 shutdown_connections 2023-12-11T17:09:58.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.914+0000 7fac1b17a640 1 -- 172.21.15.37:0/1302291248 wait complete. 2023-12-11T17:09:58.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.916+0000 7fac1b17a640 1 Processor -- start 2023-12-11T17:09:58.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.916+0000 7fac1b17a640 1 -- start start 2023-12-11T17:09:58.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.917+0000 7fac1b17a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac1406c330 0x7fac141465a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:58.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.917+0000 7fac1b17a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac140ae200 0x7fac1414cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:58.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.917+0000 7fac1b17a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac1415e5d0 0x7fac1414ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:58.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.917+0000 7fac1b17a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac14071850 con 0x7fac1415e5d0 2023-12-11T17:09:58.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.917+0000 7fac1b17a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac1409b8a0 con 0x7fac140ae200 2023-12-11T17:09:58.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.917+0000 7fac1b17a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac1409bb80 con 0x7fac1406c330 2023-12-11T17:09:58.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.917+0000 7fac1a979640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac1415e5d0 0x7fac1414ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:58.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.917+0000 7fac1a979640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac1415e5d0 0x7fac1414ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44338/0 (socket says 172.21.15.37:44338) 2023-12-11T17:09:58.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.917+0000 7fac1a979640 1 -- 172.21.15.37:0/3179905098 learned_addr learned my addr 172.21.15.37:0/3179905098 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.918+0000 7fac19977640 1 --2- 172.21.15.37:0/3179905098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac140ae200 0x7fac1414cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.918+0000 7fac1a178640 1 --2- 172.21.15.37:0/3179905098 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac1406c330 0x7fac141465a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.918+0000 7fac1a979640 1 -- 172.21.15.37:0/3179905098 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac1406c330 msgr2=0x7fac141465a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.918+0000 7fac1a979640 1 --2- 172.21.15.37:0/3179905098 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac1406c330 0x7fac141465a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.918+0000 7fac1a979640 1 -- 172.21.15.37:0/3179905098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac140ae200 msgr2=0x7fac1414cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.918+0000 7fac1a979640 1 --2- 172.21.15.37:0/3179905098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac140ae200 0x7fac1414cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.918+0000 7fac1a979640 1 -- 172.21.15.37:0/3179905098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac040094d0 con 0x7fac1415e5d0 2023-12-11T17:09:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.918+0000 7fac1a178640 1 --2- 172.21.15.37:0/3179905098 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac1406c330 0x7fac141465a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:09:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.918+0000 7fac1a979640 1 --2- 172.21.15.37:0/3179905098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac1415e5d0 0x7fac1414ad00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00c780 tx=0x7fac0c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:58.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.918+0000 7fac0affd640 1 -- 172.21.15.37:0/3179905098 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c00ce90 con 0x7fac1415e5d0 2023-12-11T17:09:58.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.919+0000 7fac0affd640 1 -- 172.21.15.37:0/3179905098 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac0c00a640 con 0x7fac1415e5d0 2023-12-11T17:09:58.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.919+0000 7fac0affd640 1 -- 172.21.15.37:0/3179905098 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac0c00a9f0 con 0x7fac1415e5d0 2023-12-11T17:09:58.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.919+0000 7fac1b17a640 1 -- 172.21.15.37:0/3179905098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac1409be60 con 0x7fac1415e5d0 2023-12-11T17:09:58.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.919+0000 7fac1b17a640 1 -- 172.21.15.37:0/3179905098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac1409c420 con 0x7fac1415e5d0 2023-12-11T17:09:58.921 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.920+0000 7fac1b17a640 1 -- 172.21.15.37:0/3179905098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac1409c610 con 0x7fac1415e5d0 2023-12-11T17:09:58.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.921+0000 7fac0affd640 1 -- 172.21.15.37:0/3179905098 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fac0c00ab50 con 0x7fac1415e5d0 2023-12-11T17:09:58.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.922+0000 7fac0affd640 1 --2- 172.21.15.37:0/3179905098 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fabf806ae70 0x7fabf806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:58.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.922+0000 7fac0affd640 1 -- 172.21.15.37:0/3179905098 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fac0c088ff0 con 0x7fac1415e5d0 2023-12-11T17:09:58.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.923+0000 7fac1a178640 1 --2- 172.21.15.37:0/3179905098 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fabf806ae70 0x7fabf806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:58.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.924+0000 7fac1a178640 1 --2- 172.21.15.37:0/3179905098 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fabf806ae70 0x7fabf806d330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fac10006fd0 tx=0x7fac10008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:58.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:58.927+0000 7fac0affd640 1 -- 172.21.15.37:0/3179905098 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fac0c053e60 con 0x7fac1415e5d0 2023-12-11T17:09:59.122 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.121+0000 7fac1b17a640 1 -- 172.21.15.37:0/3179905098 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fac14074450 con 0x7fac1415e5d0 2023-12-11T17:09:59.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.125+0000 7fac0affd640 1 -- 172.21.15.37:0/3179905098 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fac0c017090 con 0x7fac1415e5d0 2023-12-11T17:09:59.126 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:09:59.126 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:09:49.715938+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:09:59.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.127+0000 7fac1b17a640 1 -- 172.21.15.37:0/3179905098 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fabf806ae70 msgr2=0x7fabf806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.127+0000 7fac1b17a640 1 --2- 172.21.15.37:0/3179905098 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fabf806ae70 0x7fabf806d330 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fac10006fd0 tx=0x7fac10008040 comp rx=0 tx=0).stop 2023-12-11T17:09:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.127+0000 7fac1b17a640 1 -- 172.21.15.37:0/3179905098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac1415e5d0 msgr2=0x7fac1414ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.127+0000 7fac1b17a640 1 --2- 172.21.15.37:0/3179905098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac1415e5d0 0x7fac1414ad00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fac0c00c780 tx=0x7fac0c00cc40 comp rx=0 tx=0).stop 2023-12-11T17:09:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.127+0000 7fac1b17a640 1 -- 172.21.15.37:0/3179905098 shutdown_connections 2023-12-11T17:09:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.127+0000 7fac1b17a640 1 --2- 172.21.15.37:0/3179905098 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fabf806ae70 0x7fabf806d330 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.127+0000 7fac1b17a640 1 --2- 172.21.15.37:0/3179905098 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fac140ae200 0x7fac1414cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.127+0000 7fac1b17a640 1 --2- 172.21.15.37:0/3179905098 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fac1415e5d0 0x7fac1414ad00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.127+0000 7fac1b17a640 1 --2- 172.21.15.37:0/3179905098 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fac1406c330 0x7fac141465a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.127+0000 7fac1b17a640 1 -- 172.21.15.37:0/3179905098 >> 172.21.15.37:0/3179905098 conn(0x7fac140b0860 msgr2=0x7fac140aec80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.127+0000 7fac1b17a640 1 -- 172.21.15.37:0/3179905098 shutdown_connections 2023-12-11T17:09:59.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.128+0000 7fac1b17a640 1 -- 172.21.15.37:0/3179905098 wait complete. 2023-12-11T17:09:59.149 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T17:09:38.415636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T17:09:42.786774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T17:09:43.660585+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-11T17:09:47.272351+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-11T17:09:59.149 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T17:09:59.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.381+0000 7f38725c9640 1 Processor -- start 2023-12-11T17:09:59.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.381+0000 7f38725c9640 1 -- start start 2023-12-11T17:09:59.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.383+0000 7f38725c9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f386c0b3730 0x7f386c0cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:59.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.383+0000 7f38725c9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f386c0c6b80 con 0x7f386c0b3350 2023-12-11T17:09:59.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.383+0000 7f38725c9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f386c0d00d0 con 0x7f386c0cfca0 2023-12-11T17:09:59.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.383+0000 7f38725c9640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f386c0d3bf0 con 0x7f386c0b3730 2023-12-11T17:09:59.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.384+0000 7f3870dc6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f386c0b3730 0x7f386c0cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:59.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.384+0000 7f38715c7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f386c0b3350 0x7f386c0b3ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51262/0 (socket says 172.21.15.37:51262) 2023-12-11T17:09:59.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.384+0000 7f38715c7640 1 -- 172.21.15.37:0/1484911634 learned_addr learned my addr 172.21.15.37:0/1484911634 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:09:59.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.384+0000 7f3870dc6640 1 -- 172.21.15.37:0/1484911634 >> v1:172.21.15.151:6789/0 conn(0x7f386c0cfca0 legacy=0x7f386c0cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:59.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.384+0000 7f3870dc6640 1 -- 172.21.15.37:0/1484911634 >> v1:172.21.15.37:6789/0 conn(0x7f386c0b3350 legacy=0x7f386c0b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:59.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.384+0000 7f3870dc6640 1 -- 172.21.15.37:0/1484911634 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f386c0d3ed0 con 0x7f386c0b3730 2023-12-11T17:09:59.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.384+0000 7f3863fff640 1 -- 172.21.15.37:0/1484911634 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2436911256 0 0) 0x7f386c0c6b80 con 0x7f386c0b3350 2023-12-11T17:09:59.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.385+0000 7f3870dc6640 1 --2- 172.21.15.37:0/1484911634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f386c0b3730 0x7f386c0cf760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f385c0097a0 tx=0x7f385c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f5a063f01396334 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:59.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.386+0000 7f3863fff640 1 -- 172.21.15.37:0/1484911634 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c031830 con 0x7f386c0b3730 2023-12-11T17:09:59.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.386+0000 7f3863fff640 1 -- 172.21.15.37:0/1484911634 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385c031990 con 0x7f386c0b3730 2023-12-11T17:09:59.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.386+0000 7f3863fff640 1 -- 172.21.15.37:0/1484911634 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c031d20 con 0x7f386c0b3730 2023-12-11T17:09:59.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.386+0000 7f38725c9640 1 -- 172.21.15.37:0/1484911634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f386c0b3730 msgr2=0x7f386c0cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:59.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.386+0000 7f38725c9640 1 --2- 172.21.15.37:0/1484911634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f386c0b3730 0x7f386c0cf760 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f385c0097a0 tx=0x7f385c02b8d0 comp rx=0 tx=0).stop 2023-12-11T17:09:59.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.386+0000 7f38725c9640 1 -- 172.21.15.37:0/1484911634 shutdown_connections 2023-12-11T17:09:59.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.386+0000 7f38725c9640 1 --2- 172.21.15.37:0/1484911634 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f386c0b3730 0x7f386c0cf760 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:59.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.386+0000 7f38725c9640 1 -- 172.21.15.37:0/1484911634 >> 172.21.15.37:0/1484911634 conn(0x7f386c0d3030 msgr2=0x7f386c0d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:59.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.387+0000 7f38725c9640 1 -- 172.21.15.37:0/1484911634 shutdown_connections 2023-12-11T17:09:59.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.387+0000 7f38725c9640 1 -- 172.21.15.37:0/1484911634 wait complete. 2023-12-11T17:09:59.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.388+0000 7f38725c9640 1 Processor -- start 2023-12-11T17:09:59.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.388+0000 7f38725c9640 1 -- start start 2023-12-11T17:09:59.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.389+0000 7f38725c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f386c0b3350 0x7f386c0aff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:59.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.389+0000 7f38725c9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f386c0b3730 0x7f386c0b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:59.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.389+0000 7f38725c9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f386c0cfca0 0x7f386c151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:59.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.389+0000 7f38725c9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c0b2ba0 con 0x7f386c0b3350 2023-12-11T17:09:59.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.389+0000 7f38725c9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f386c0b1760 con 0x7f386c0cfca0 2023-12-11T17:09:59.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.389+0000 7f38725c9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f386c0b1a40 con 0x7f386c0b3730 2023-12-11T17:09:59.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.390+0000 7f38715c7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f386c0b3350 0x7f386c0aff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:59.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.390+0000 7f38715c7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f386c0b3350 0x7f386c0aff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44342/0 (socket says 172.21.15.37:44342) 2023-12-11T17:09:59.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.390+0000 7f38715c7640 1 -- 172.21.15.37:0/1802330106 learned_addr learned my addr 172.21.15.37:0/1802330106 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:59.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.390+0000 7f38715c7640 1 -- 172.21.15.37:0/1802330106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f386c0b3730 msgr2=0x7f386c0b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:59.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.390+0000 7f38715c7640 1 --2- 172.21.15.37:0/1802330106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f386c0b3730 0x7f386c0b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:59.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.390+0000 7f38715c7640 1 -- 172.21.15.37:0/1802330106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f386c0cfca0 msgr2=0x7f386c151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:59.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.390+0000 7f38715c7640 1 --2- 172.21.15.37:0/1802330106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f386c0cfca0 0x7f386c151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:59.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.390+0000 7f38715c7640 1 -- 172.21.15.37:0/1802330106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f385c009400 con 0x7f386c0b3350 2023-12-11T17:09:59.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.390+0000 7f38715c7640 1 --2- 172.21.15.37:0/1802330106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f386c0b3350 0x7f386c0aff20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f386800c430 tx=0x7f386800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:59.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.391+0000 7f3861ffb640 1 -- 172.21.15.37:0/1802330106 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38680074e0 con 0x7f386c0b3350 2023-12-11T17:09:59.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.391+0000 7f3861ffb640 1 -- 172.21.15.37:0/1802330106 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3868007660 con 0x7f386c0b3350 2023-12-11T17:09:59.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.391+0000 7f38725c9640 1 -- 172.21.15.37:0/1802330106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f386c0b25e0 con 0x7f386c0b3350 2023-12-11T17:09:59.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.391+0000 7f3861ffb640 1 -- 172.21.15.37:0/1802330106 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3868004a20 con 0x7f386c0b3350 2023-12-11T17:09:59.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.391+0000 7f38725c9640 1 -- 172.21.15.37:0/1802330106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f386c1518c0 con 0x7f386c0b3350 2023-12-11T17:09:59.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.392+0000 7f38725c9640 1 -- 172.21.15.37:0/1802330106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386c0b46d0 con 0x7f386c0b3350 2023-12-11T17:09:59.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.393+0000 7f3861ffb640 1 -- 172.21.15.37:0/1802330106 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3868004b80 con 0x7f386c0b3350 2023-12-11T17:09:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.394+0000 7f3861ffb640 1 --2- 172.21.15.37:0/1802330106 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f385006ae40 0x7f385006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.394+0000 7f3861ffb640 1 -- 172.21.15.37:0/1802330106 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f38680897a0 con 0x7f386c0b3350 2023-12-11T17:09:59.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.395+0000 7f3870dc6640 1 --2- 172.21.15.37:0/1802330106 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f385006ae40 0x7f385006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:59.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.396+0000 7f3870dc6640 1 --2- 172.21.15.37:0/1802330106 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f385006ae40 0x7f385006d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f385c036000 tx=0x7f385c030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:59.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.400+0000 7f3861ffb640 1 -- 172.21.15.37:0/1802330106 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3868054550 con 0x7f386c0b3350 2023-12-11T17:09:59.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.592+0000 7f38725c9640 1 -- 172.21.15.37:0/1802330106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f386c074450 con 0x7f386c0b3350 2023-12-11T17:09:59.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.593+0000 7f3861ffb640 1 -- 172.21.15.37:0/1802330106 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3868057b70 con 0x7f386c0b3350 2023-12-11T17:09:59.594 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-11T17:09:59.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.596+0000 7f38725c9640 1 -- 172.21.15.37:0/1802330106 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f385006ae40 msgr2=0x7f385006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:59.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.596+0000 7f38725c9640 1 --2- 172.21.15.37:0/1802330106 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f385006ae40 0x7f385006d300 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f385c036000 tx=0x7f385c030000 comp rx=0 tx=0).stop 2023-12-11T17:09:59.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.597+0000 7f38725c9640 1 -- 172.21.15.37:0/1802330106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f386c0b3350 msgr2=0x7f386c0aff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:59.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.597+0000 7f38725c9640 1 --2- 172.21.15.37:0/1802330106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f386c0b3350 0x7f386c0aff20 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f386800c430 tx=0x7f386800c8f0 comp rx=0 tx=0).stop 2023-12-11T17:09:59.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.597+0000 7f38725c9640 1 -- 172.21.15.37:0/1802330106 shutdown_connections 2023-12-11T17:09:59.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.597+0000 7f38725c9640 1 --2- 172.21.15.37:0/1802330106 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f385006ae40 0x7f385006d300 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:59.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.597+0000 7f38725c9640 1 --2- 172.21.15.37:0/1802330106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f386c0cfca0 0x7f386c151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:59.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.597+0000 7f38725c9640 1 --2- 172.21.15.37:0/1802330106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f386c0b3730 0x7f386c0b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:59.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.597+0000 7f38725c9640 1 --2- 172.21.15.37:0/1802330106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f386c0b3350 0x7f386c0aff20 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:59.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.597+0000 7f38725c9640 1 -- 172.21.15.37:0/1802330106 >> 172.21.15.37:0/1802330106 conn(0x7f386c0d3030 msgr2=0x7f386c0d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:59.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.597+0000 7f38725c9640 1 -- 172.21.15.37:0/1802330106 shutdown_connections 2023-12-11T17:09:59.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.597+0000 7f38725c9640 1 -- 172.21.15.37:0/1802330106 wait complete. 2023-12-11T17:09:59.617 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T17:09:59.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.849+0000 7fc9065ec640 1 Processor -- start 2023-12-11T17:09:59.851 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.850+0000 7fc9065ec640 1 -- start start 2023-12-11T17:09:59.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.851+0000 7fc9065ec640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc90006dc10 0x7fc900164f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:59.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.851+0000 7fc9065ec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc9000b4980 con 0x7fc900142de0 2023-12-11T17:09:59.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.851+0000 7fc9065ec640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc900071260 con 0x7fc9001432b0 2023-12-11T17:09:59.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.851+0000 7fc9065ec640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9000b4050 con 0x7fc90006dc10 2023-12-11T17:09:59.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.851+0000 7fc8fffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fc900142de0 0x7fc9000cdd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51264/0 (socket says 172.21.15.37:51264) 2023-12-11T17:09:59.852 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.851+0000 7fc8fffff640 1 -- 172.21.15.37:0/3118325937 learned_addr learned my addr 172.21.15.37:0/3118325937 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:09:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.852+0000 7fc904b89640 1 --2- 172.21.15.37:0/3118325937 >> v2:172.21.15.151:3300/0 conn(0x7fc90006dc10 0x7fc900164f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.852+0000 7fc8feffd640 1 -- 172.21.15.37:0/3118325937 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3705684529 0 0) 0x7fc9000b4980 con 0x7fc900142de0 2023-12-11T17:09:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.852+0000 7fc8feffd640 1 -- 172.21.15.37:0/3118325937 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8e8003520 con 0x7fc900142de0 2023-12-11T17:09:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.852+0000 7fc8feffd640 1 -- 172.21.15.37:0/3118325937 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3056647041 0 0) 0x7fc8e8003520 con 0x7fc900142de0 2023-12-11T17:09:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.852+0000 7fc8feffd640 1 -- 172.21.15.37:0/3118325937 >> v2:172.21.15.151:3300/0 conn(0x7fc90006dc10 msgr2=0x7fc900164f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.852+0000 7fc8feffd640 1 --2- 172.21.15.37:0/3118325937 >> v2:172.21.15.151:3300/0 conn(0x7fc90006dc10 0x7fc900164f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.852+0000 7fc8feffd640 1 -- 172.21.15.37:0/3118325937 >> v1:172.21.15.151:6789/0 conn(0x7fc9001432b0 legacy=0x7fc90006d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.852+0000 7fc8feffd640 1 -- 172.21.15.37:0/3118325937 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9000b4330 con 0x7fc900142de0 2023-12-11T17:09:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.852+0000 7fc8feffd640 1 -- 172.21.15.37:0/3118325937 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7fc8f0001670 con 0x7fc900142de0 2023-12-11T17:09:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.852+0000 7fc8feffd640 1 -- 172.21.15.37:0/3118325937 >> v1:172.21.15.37:6789/0 conn(0x7fc900142de0 legacy=0x7fc9000cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.852+0000 7fc8feffd640 1 --2- 172.21.15.37:0/3118325937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8e8003970 0x7fc8e8003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:59.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.852+0000 7fc8feffd640 1 --2- 172.21.15.37:0/3118325937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8e80047c0 0x7fc8e8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:59.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.852+0000 7fc8feffd640 1 --2- 172.21.15.37:0/3118325937 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8e8005180 0x7fc8e800db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:59.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.853+0000 7fc8feffd640 1 -- 172.21.15.37:0/3118325937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9000b4050 con 0x7fc8e80047c0 2023-12-11T17:09:59.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.853+0000 7fc8feffd640 1 -- 172.21.15.37:0/3118325937 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e800e2c0 con 0x7fc8e8003970 2023-12-11T17:09:59.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.853+0000 7fc8feffd640 1 -- 172.21.15.37:0/3118325937 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e800e480 con 0x7fc8e8005180 2023-12-11T17:09:59.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.853+0000 7fc8ff7fe640 1 --2- 172.21.15.37:0/3118325937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8e80047c0 0x7fc8e8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:59.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.853+0000 7fc8fffff640 1 --2- 172.21.15.37:0/3118325937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8e8003970 0x7fc8e8003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:59.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.853+0000 7fc904b89640 1 --2- 172.21.15.37:0/3118325937 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8e8005180 0x7fc8e800db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:59.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.853+0000 7fc8ff7fe640 1 -- 172.21.15.37:0/3118325937 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8e8005180 msgr2=0x7fc8e800db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:59.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.853+0000 7fc8ff7fe640 1 --2- 172.21.15.37:0/3118325937 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc8e8005180 0x7fc8e800db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:59.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.853+0000 7fc8ff7fe640 1 -- 172.21.15.37:0/3118325937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8e8003970 msgr2=0x7fc8e8003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:09:59.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.853+0000 7fc8ff7fe640 1 --2- 172.21.15.37:0/3118325937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8e8003970 0x7fc8e8003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:59.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.853+0000 7fc8ff7fe640 1 -- 172.21.15.37:0/3118325937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e8003520 con 0x7fc8e80047c0 2023-12-11T17:09:59.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.853+0000 7fc8fffff640 1 --2- 172.21.15.37:0/3118325937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8e8003970 0x7fc8e8003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:09:59.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.853+0000 7fc904b89640 1 -- 172.21.15.37:0/3118325937 reap_dead start 2023-12-11T17:09:59.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.854+0000 7fc8ff7fe640 1 --2- 172.21.15.37:0/3118325937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8e80047c0 0x7fc8e8004c40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4003db0 tx=0x7fc8e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca82534b3a80117 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.855+0000 7fc8feffd640 1 -- 172.21.15.37:0/3118325937 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f4032600 con 0x7fc8e80047c0 2023-12-11T17:09:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.855+0000 7fc8feffd640 1 -- 172.21.15.37:0/3118325937 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f402e050 con 0x7fc8e80047c0 2023-12-11T17:09:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.855+0000 7fc8feffd640 1 -- 172.21.15.37:0/3118325937 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f40329e0 con 0x7fc8e80047c0 2023-12-11T17:09:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.855+0000 7fc9065ec640 1 -- 172.21.15.37:0/3118325937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8e80047c0 msgr2=0x7fc8e8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.855+0000 7fc9065ec640 1 --2- 172.21.15.37:0/3118325937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8e80047c0 0x7fc8e8004c40 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc8f4003db0 tx=0x7fc8e80057f0 comp rx=0 tx=0).stop 2023-12-11T17:09:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.855+0000 7fc9065ec640 1 -- 172.21.15.37:0/3118325937 shutdown_connections 2023-12-11T17:09:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.855+0000 7fc9065ec640 1 --2- 172.21.15.37:0/3118325937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc8e80047c0 0x7fc8e8004c40 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.855+0000 7fc9065ec640 1 -- 172.21.15.37:0/3118325937 >> 172.21.15.37:0/3118325937 conn(0x7fc9000cb850 msgr2=0x7fc9000cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:09:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.855+0000 7fc9065ec640 1 -- 172.21.15.37:0/3118325937 shutdown_connections 2023-12-11T17:09:59.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.855+0000 7fc9065ec640 1 -- 172.21.15.37:0/3118325937 wait complete. 2023-12-11T17:09:59.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.857+0000 7fc9065ec640 1 Processor -- start 2023-12-11T17:09:59.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.857+0000 7fc9065ec640 1 -- start start 2023-12-11T17:09:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.858+0000 7fc9065ec640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8e80047c0 0x7fc900140850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.858+0000 7fc9065ec640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc900140d90 0x7fc9000ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.858+0000 7fc9065ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9000ad770 0x7fc9000adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.858+0000 7fc9065ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9001418d0 con 0x7fc9000ad770 2023-12-11T17:09:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.858+0000 7fc9065ec640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc90014fba0 con 0x7fc8e80047c0 2023-12-11T17:09:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.858+0000 7fc9065ec640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9000ae130 con 0x7fc900140d90 2023-12-11T17:09:59.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.859+0000 7fc904b89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9000ad770 0x7fc9000adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.859+0000 7fc904b89640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9000ad770 0x7fc9000adbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44360/0 (socket says 172.21.15.37:44360) 2023-12-11T17:09:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.859+0000 7fc904b89640 1 -- 172.21.15.37:0/2247935701 learned_addr learned my addr 172.21.15.37:0/2247935701 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:09:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.859+0000 7fc8fffff640 1 --2- 172.21.15.37:0/2247935701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8e80047c0 0x7fc900140850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.859+0000 7fc8ff7fe640 1 --2- 172.21.15.37:0/2247935701 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc900140d90 0x7fc9000ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.859+0000 7fc904b89640 1 -- 172.21.15.37:0/2247935701 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc900140d90 msgr2=0x7fc9000ad230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.859+0000 7fc904b89640 1 --2- 172.21.15.37:0/2247935701 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc900140d90 0x7fc9000ad230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.859+0000 7fc904b89640 1 -- 172.21.15.37:0/2247935701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8e80047c0 msgr2=0x7fc900140850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:09:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.859+0000 7fc904b89640 1 --2- 172.21.15.37:0/2247935701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8e80047c0 0x7fc900140850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:09:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.859+0000 7fc904b89640 1 -- 172.21.15.37:0/2247935701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc900141310 con 0x7fc9000ad770 2023-12-11T17:09:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.859+0000 7fc8ff7fe640 1 --2- 172.21.15.37:0/2247935701 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc900140d90 0x7fc9000ad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:09:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.859+0000 7fc904b89640 1 --2- 172.21.15.37:0/2247935701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9000ad770 0x7fc9000adbf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc90006fdf0 tx=0x7fc8f800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.860+0000 7fc8fcff9640 1 -- 172.21.15.37:0/2247935701 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8016620 con 0x7fc9000ad770 2023-12-11T17:09:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.860+0000 7fc8fcff9640 1 -- 172.21.15.37:0/2247935701 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8f80167a0 con 0x7fc9000ad770 2023-12-11T17:09:59.862 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.860+0000 7fc9065ec640 1 -- 172.21.15.37:0/2247935701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9001415f0 con 0x7fc9000ad770 2023-12-11T17:09:59.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.860+0000 7fc8fcff9640 1 -- 172.21.15.37:0/2247935701 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8016b50 con 0x7fc9000ad770 2023-12-11T17:09:59.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.860+0000 7fc9065ec640 1 -- 172.21.15.37:0/2247935701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9001f2870 con 0x7fc9000ad770 2023-12-11T17:09:59.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.861+0000 7fc9065ec640 1 -- 172.21.15.37:0/2247935701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc90014f690 con 0x7fc9000ad770 2023-12-11T17:09:59.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.862+0000 7fc8fcff9640 1 -- 172.21.15.37:0/2247935701 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc8f8016cb0 con 0x7fc9000ad770 2023-12-11T17:09:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.864+0000 7fc8fcff9640 1 --2- 172.21.15.37:0/2247935701 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc8ec06ae70 0x7fc8ec06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:09:59.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.864+0000 7fc8fcff9640 1 -- 172.21.15.37:0/2247935701 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc8f808a950 con 0x7fc9000ad770 2023-12-11T17:09:59.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.864+0000 7fc8fffff640 1 --2- 172.21.15.37:0/2247935701 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc8ec06ae70 0x7fc8ec06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:09:59.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.865+0000 7fc8fffff640 1 --2- 172.21.15.37:0/2247935701 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc8ec06ae70 0x7fc8ec06d330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0000f60 tx=0x7fc8f0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:09:59.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:09:59.868+0000 7fc8fcff9640 1 -- 172.21.15.37:0/2247935701 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc90014f690 con 0x7fc9000ad770 2023-12-11T17:10:00.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.061+0000 7fc9065ec640 1 -- 172.21.15.37:0/2247935701 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fc90014f690 con 0x7fc9000ad770 2023-12-11T17:10:00.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.062+0000 7fc8fcff9640 1 -- 172.21.15.37:0/2247935701 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7fc90014f690 con 0x7fc9000ad770 2023-12-11T17:10:00.063 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:10:00.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.064+0000 7fc9065ec640 1 -- 172.21.15.37:0/2247935701 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc8ec06ae70 msgr2=0x7fc8ec06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:00.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.064+0000 7fc9065ec640 1 --2- 172.21.15.37:0/2247935701 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc8ec06ae70 0x7fc8ec06d330 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc8f0000f60 tx=0x7fc8f0009040 comp rx=0 tx=0).stop 2023-12-11T17:10:00.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.064+0000 7fc9065ec640 1 -- 172.21.15.37:0/2247935701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9000ad770 msgr2=0x7fc9000adbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:00.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.064+0000 7fc9065ec640 1 --2- 172.21.15.37:0/2247935701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9000ad770 0x7fc9000adbf0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc90006fdf0 tx=0x7fc8f800f520 comp rx=0 tx=0).stop 2023-12-11T17:10:00.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.064+0000 7fc9065ec640 1 -- 172.21.15.37:0/2247935701 shutdown_connections 2023-12-11T17:10:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.064+0000 7fc9065ec640 1 --2- 172.21.15.37:0/2247935701 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc8ec06ae70 0x7fc8ec06d330 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.064+0000 7fc9065ec640 1 --2- 172.21.15.37:0/2247935701 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc9000ad770 0x7fc9000adbf0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.064+0000 7fc9065ec640 1 --2- 172.21.15.37:0/2247935701 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc900140d90 0x7fc9000ad230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.064+0000 7fc9065ec640 1 --2- 172.21.15.37:0/2247935701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc8e80047c0 0x7fc900140850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.064+0000 7fc9065ec640 1 -- 172.21.15.37:0/2247935701 >> 172.21.15.37:0/2247935701 conn(0x7fc9000cb850 msgr2=0x7fc9000aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.064+0000 7fc9065ec640 1 -- 172.21.15.37:0/2247935701 shutdown_connections 2023-12-11T17:10:00.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.064+0000 7fc9065ec640 1 -- 172.21.15.37:0/2247935701 wait complete. 2023-12-11T17:10:00.084 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T17:10:00.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.305+0000 7f9fa049b640 1 Processor -- start 2023-12-11T17:10:00.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.305+0000 7f9fa049b640 1 -- start start 2023-12-11T17:10:00.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.307+0000 7f9fa049b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9f9815af50 0x7f9f9806c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:00.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.307+0000 7f9fa049b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9f980ce7e0 0x7f9f9815ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:00.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.307+0000 7f9fa049b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f98071cd0 con 0x7f9f9806a460 2023-12-11T17:10:00.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.307+0000 7f9fa049b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f980717e0 con 0x7f9f9815af50 2023-12-11T17:10:00.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.307+0000 7f9fa049b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f9806c6b0 con 0x7f9f980ce7e0 2023-12-11T17:10:00.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.307+0000 7f9f9e237640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9f9815af50 0x7f9f9806c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:00.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.307+0000 7f9f9e237640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9f9815af50 0x7f9f9806c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44376/0 (socket says 172.21.15.37:44376) 2023-12-11T17:10:00.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.307+0000 7f9f9e237640 1 -- 172.21.15.37:0/1351361637 learned_addr learned my addr 172.21.15.37:0/1351361637 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:00.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.308+0000 7f9f9da36640 1 --2- 172.21.15.37:0/1351361637 >> v2:172.21.15.151:3300/0 conn(0x7f9f980ce7e0 0x7f9f9815ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:00.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.308+0000 7f9f9e237640 1 -- 172.21.15.37:0/1351361637 >> v2:172.21.15.151:3300/0 conn(0x7f9f980ce7e0 msgr2=0x7f9f9815ec00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:00.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.308+0000 7f9f9e237640 1 --2- 172.21.15.37:0/1351361637 >> v2:172.21.15.151:3300/0 conn(0x7f9f980ce7e0 0x7f9f9815ec00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.308+0000 7f9f9e237640 1 -- 172.21.15.37:0/1351361637 >> v1:172.21.15.151:6789/0 conn(0x7f9f9806a460 legacy=0x7f9f980ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:00.309 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.308+0000 7f9f9e237640 1 -- 172.21.15.37:0/1351361637 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f980719f0 con 0x7f9f9815af50 2023-12-11T17:10:00.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.309+0000 7f9f9e237640 1 --2- 172.21.15.37:0/1351361637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f9815af50 0x7f9f9806c170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9f9809d070 tx=0x7f9f9402b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d224cf1794a04b56 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:00.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.310+0000 7f9f9d235640 1 -- 172.21.15.37:0/1351361637 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f94031750 con 0x7f9f9815af50 2023-12-11T17:10:00.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.310+0000 7f9f9d235640 1 -- 172.21.15.37:0/1351361637 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f940318b0 con 0x7f9f9815af50 2023-12-11T17:10:00.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.310+0000 7f9f9d235640 1 -- 172.21.15.37:0/1351361637 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f94031c40 con 0x7f9f9815af50 2023-12-11T17:10:00.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.311+0000 7f9fa049b640 1 -- 172.21.15.37:0/1351361637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f9815af50 msgr2=0x7f9f9806c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:00.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.311+0000 7f9fa049b640 1 --2- 172.21.15.37:0/1351361637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f9815af50 0x7f9f9806c170 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9f9809d070 tx=0x7f9f9402b7f0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.311+0000 7f9fa049b640 1 -- 172.21.15.37:0/1351361637 shutdown_connections 2023-12-11T17:10:00.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.311+0000 7f9fa049b640 1 --2- 172.21.15.37:0/1351361637 >> v2:172.21.15.151:3300/0 conn(0x7f9f980ce7e0 0x7f9f9815ec00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.311+0000 7f9fa049b640 1 --2- 172.21.15.37:0/1351361637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f9815af50 0x7f9f9806c170 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.311+0000 7f9fa049b640 1 -- 172.21.15.37:0/1351361637 >> 172.21.15.37:0/1351361637 conn(0x7f9f980cee70 msgr2=0x7f9f980cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:00.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.311+0000 7f9fa049b640 1 -- 172.21.15.37:0/1351361637 shutdown_connections 2023-12-11T17:10:00.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.311+0000 7f9fa049b640 1 -- 172.21.15.37:0/1351361637 wait complete. 2023-12-11T17:10:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.313+0000 7f9fa049b640 1 Processor -- start 2023-12-11T17:10:00.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.313+0000 7f9fa049b640 1 -- start start 2023-12-11T17:10:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.314+0000 7f9fa049b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f9806a460 0x7f9f98155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.314+0000 7f9fa049b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f980ce7e0 0x7f9f981e4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.314+0000 7f9fa049b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f9815af50 0x7f9f980c4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.314+0000 7f9fa049b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f980c4eb0 con 0x7f9f9806a460 2023-12-11T17:10:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.314+0000 7f9fa049b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f98155b90 con 0x7f9f9815af50 2023-12-11T17:10:00.316 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.314+0000 7f9fa049b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f980c4bd0 con 0x7f9f980ce7e0 2023-12-11T17:10:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.315+0000 7f9f9e237640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f9806a460 0x7f9f98155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.315+0000 7f9f9e237640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f9806a460 0x7f9f98155650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44388/0 (socket says 172.21.15.37:44388) 2023-12-11T17:10:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.315+0000 7f9f9e237640 1 -- 172.21.15.37:0/2945890611 learned_addr learned my addr 172.21.15.37:0/2945890611 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.315+0000 7f9f9da36640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f980ce7e0 0x7f9f981e4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:00.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.315+0000 7f9f9ea38640 1 --2- 172.21.15.37:0/2945890611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f9815af50 0x7f9f980c4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.316+0000 7f9f9e237640 1 -- 172.21.15.37:0/2945890611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f980ce7e0 msgr2=0x7f9f981e4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.316+0000 7f9f9e237640 1 --2- 172.21.15.37:0/2945890611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f980ce7e0 0x7f9f981e4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.316+0000 7f9f9e237640 1 -- 172.21.15.37:0/2945890611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f9815af50 msgr2=0x7f9f980c4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.316+0000 7f9f9e237640 1 --2- 172.21.15.37:0/2945890611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f9815af50 0x7f9f980c4150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.316+0000 7f9f9e237640 1 -- 172.21.15.37:0/2945890611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f940094d0 con 0x7f9f9806a460 2023-12-11T17:10:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.316+0000 7f9f9ea38640 1 --2- 172.21.15.37:0/2945890611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f9815af50 0x7f9f980c4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:10:00.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.316+0000 7f9f9e237640 1 --2- 172.21.15.37:0/2945890611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f9806a460 0x7f9f98155650 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9f94000c00 tx=0x7f9f940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.316+0000 7f9f8effd640 1 -- 172.21.15.37:0/2945890611 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f94033c80 con 0x7f9f9806a460 2023-12-11T17:10:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.316+0000 7f9f8effd640 1 -- 172.21.15.37:0/2945890611 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f94033de0 con 0x7f9f9806a460 2023-12-11T17:10:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.316+0000 7f9fa049b640 1 -- 172.21.15.37:0/2945890611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f980c7120 con 0x7f9f9806a460 2023-12-11T17:10:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.316+0000 7f9f8effd640 1 -- 172.21.15.37:0/2945890611 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f9403c640 con 0x7f9f9806a460 2023-12-11T17:10:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.317+0000 7f9fa049b640 1 -- 172.21.15.37:0/2945890611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f980c76e0 con 0x7f9f9806a460 2023-12-11T17:10:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.318+0000 7f9fa049b640 1 -- 172.21.15.37:0/2945890611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f980c6f80 con 0x7f9f9806a460 2023-12-11T17:10:00.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.319+0000 7f9f8effd640 1 -- 172.21.15.37:0/2945890611 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9f9403a040 con 0x7f9f9806a460 2023-12-11T17:10:00.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.319+0000 7f9f8effd640 1 --2- 172.21.15.37:0/2945890611 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9f7c06ae40 0x7f9f7c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:00.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.320+0000 7f9f8effd640 1 -- 172.21.15.37:0/2945890611 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9f940ab4f0 con 0x7f9f9806a460 2023-12-11T17:10:00.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.320+0000 7f9f9da36640 1 --2- 172.21.15.37:0/2945890611 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9f7c06ae40 0x7f9f7c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:00.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.321+0000 7f9f9da36640 1 --2- 172.21.15.37:0/2945890611 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9f7c06ae40 0x7f9f7c06d300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9f980cdb70 tx=0x7f9f88008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:00.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.324+0000 7f9f8effd640 1 -- 172.21.15.37:0/2945890611 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9f980c6f80 con 0x7f9f9806a460 2023-12-11T17:10:00.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.515+0000 7f9fa049b640 1 -- 172.21.15.37:0/2945890611 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9f980c6f80 con 0x7f9f9806a460 2023-12-11T17:10:00.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.515+0000 7f9f8effd640 1 -- 172.21.15.37:0/2945890611 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9f980c6f80 con 0x7f9f9806a460 2023-12-11T17:10:00.516 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-11T17:10:00.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.518+0000 7f9fa049b640 1 -- 172.21.15.37:0/2945890611 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9f7c06ae40 msgr2=0x7f9f7c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:00.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.518+0000 7f9fa049b640 1 --2- 172.21.15.37:0/2945890611 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9f7c06ae40 0x7f9f7c06d300 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9f980cdb70 tx=0x7f9f88008040 comp rx=0 tx=0).stop 2023-12-11T17:10:00.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.518+0000 7f9fa049b640 1 -- 172.21.15.37:0/2945890611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f9806a460 msgr2=0x7f9f98155650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:00.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.518+0000 7f9fa049b640 1 --2- 172.21.15.37:0/2945890611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f9806a460 0x7f9f98155650 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f9f94000c00 tx=0x7f9f940046c0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.518+0000 7f9fa049b640 1 -- 172.21.15.37:0/2945890611 shutdown_connections 2023-12-11T17:10:00.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.518+0000 7f9fa049b640 1 --2- 172.21.15.37:0/2945890611 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9f7c06ae40 0x7f9f7c06d300 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.518+0000 7f9fa049b640 1 --2- 172.21.15.37:0/2945890611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f9815af50 0x7f9f980c4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.518+0000 7f9fa049b640 1 --2- 172.21.15.37:0/2945890611 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9f980ce7e0 0x7f9f981e4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.518+0000 7f9fa049b640 1 --2- 172.21.15.37:0/2945890611 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9f9806a460 0x7f9f98155650 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.518+0000 7f9fa049b640 1 -- 172.21.15.37:0/2945890611 >> 172.21.15.37:0/2945890611 conn(0x7f9f980cee70 msgr2=0x7f9f9806c7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.518+0000 7f9fa049b640 1 -- 172.21.15.37:0/2945890611 shutdown_connections 2023-12-11T17:10:00.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.518+0000 7f9fa049b640 1 -- 172.21.15.37:0/2945890611 wait complete. 2023-12-11T17:10:00.536 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-11T17:10:00.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.751+0000 7fe16ea2b640 1 Processor -- start 2023-12-11T17:10:00.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.752+0000 7fe16ea2b640 1 -- start start 2023-12-11T17:10:00.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.753+0000 7fe16ea2b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe168142de0 0x7fe1680cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:00.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.753+0000 7fe16ea2b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe1681432b0 0x7fe16806d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:00.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.753+0000 7fe16ea2b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1680b4980 con 0x7fe16806da40 2023-12-11T17:10:00.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.753+0000 7fe16ea2b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe16806ded0 con 0x7fe1681432b0 2023-12-11T17:10:00.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.753+0000 7fe16ea2b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1680ce2a0 con 0x7fe168142de0 2023-12-11T17:10:00.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.754+0000 7fe167fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe168142de0 0x7fe1680cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:00.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.754+0000 7fe15ffff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe1681432b0 0x7fe16806d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:00.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.754+0000 7fe167fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe168142de0 0x7fe1680cdd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.37:36174/0 (socket says 172.21.15.37:36174) 2023-12-11T17:10:00.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.754+0000 7fe15ffff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe1681432b0 0x7fe16806d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:46660/0 (socket says 172.21.15.37:46660) 2023-12-11T17:10:00.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.754+0000 7fe167fff640 1 -- 172.21.15.37:0/2969616027 learned_addr learned my addr 172.21.15.37:0/2969616027 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:00.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.755+0000 7fe15ffff640 1 -- 172.21.15.37:0/2969616027 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe168142de0 msgr2=0x7fe1680cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:00.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.755+0000 7fe15ffff640 1 --2- 172.21.15.37:0/2969616027 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe168142de0 0x7fe1680cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.755+0000 7fe15ffff640 1 -- 172.21.15.37:0/2969616027 >> v1:172.21.15.151:6789/0 conn(0x7fe16806da40 legacy=0x7fe16815dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:00.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.755+0000 7fe15ffff640 1 -- 172.21.15.37:0/2969616027 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe168071260 con 0x7fe1681432b0 2023-12-11T17:10:00.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.757+0000 7fe15ffff640 1 --2- 172.21.15.37:0/2969616027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1681432b0 0x7fe16806d500 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe1500097a0 tx=0x7fe15002b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9758e26a3bc8c3c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:00.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.757+0000 7fe1677fe640 1 -- 172.21.15.37:0/2969616027 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15002e070 con 0x7fe1681432b0 2023-12-11T17:10:00.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.757+0000 7fe1677fe640 1 -- 172.21.15.37:0/2969616027 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1500315a0 con 0x7fe1681432b0 2023-12-11T17:10:00.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.757+0000 7fe1677fe640 1 -- 172.21.15.37:0/2969616027 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe150031930 con 0x7fe1681432b0 2023-12-11T17:10:00.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.758+0000 7fe16ea2b640 1 -- 172.21.15.37:0/2969616027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1681432b0 msgr2=0x7fe16806d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:00.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.758+0000 7fe16ea2b640 1 --2- 172.21.15.37:0/2969616027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1681432b0 0x7fe16806d500 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe1500097a0 tx=0x7fe15002b840 comp rx=0 tx=0).stop 2023-12-11T17:10:00.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.758+0000 7fe16ea2b640 1 -- 172.21.15.37:0/2969616027 shutdown_connections 2023-12-11T17:10:00.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.758+0000 7fe16ea2b640 1 --2- 172.21.15.37:0/2969616027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe1681432b0 0x7fe16806d500 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.758+0000 7fe16ea2b640 1 --2- 172.21.15.37:0/2969616027 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe168142de0 0x7fe1680cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.758+0000 7fe16ea2b640 1 -- 172.21.15.37:0/2969616027 >> 172.21.15.37:0/2969616027 conn(0x7fe1680cb850 msgr2=0x7fe1680cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:00.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.758+0000 7fe16ea2b640 1 -- 172.21.15.37:0/2969616027 shutdown_connections 2023-12-11T17:10:00.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.758+0000 7fe16ea2b640 1 -- 172.21.15.37:0/2969616027 wait complete. 2023-12-11T17:10:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.761+0000 7fe16ea2b640 1 Processor -- start 2023-12-11T17:10:00.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.761+0000 7fe16ea2b640 1 -- start start 2023-12-11T17:10:00.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.762+0000 7fe16ea2b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe16806da40 0x7fe1681f7400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:00.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.762+0000 7fe16ea2b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe168142de0 0x7fe168141f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:00.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.762+0000 7fe16ea2b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1681432b0 0x7fe16806ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:00.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.762+0000 7fe16ea2b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe168140200 con 0x7fe1681432b0 2023-12-11T17:10:00.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.762+0000 7fe16ea2b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1681f7940 con 0x7fe16806da40 2023-12-11T17:10:00.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.762+0000 7fe16ea2b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1680ad6f0 con 0x7fe168142de0 2023-12-11T17:10:00.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.763+0000 7fe16cfc8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1681432b0 0x7fe16806ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:00.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.763+0000 7fe16cfc8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1681432b0 0x7fe16806ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44404/0 (socket says 172.21.15.37:44404) 2023-12-11T17:10:00.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.763+0000 7fe16cfc8640 1 -- 172.21.15.37:0/905225814 learned_addr learned my addr 172.21.15.37:0/905225814 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:00.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.763+0000 7fe167fff640 1 --2- 172.21.15.37:0/905225814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe16806da40 0x7fe1681f7400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.763+0000 7fe15ffff640 1 --2- 172.21.15.37:0/905225814 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe168142de0 0x7fe168141f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.763+0000 7fe16cfc8640 1 -- 172.21.15.37:0/905225814 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe168142de0 msgr2=0x7fe168141f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.763+0000 7fe16cfc8640 1 --2- 172.21.15.37:0/905225814 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe168142de0 0x7fe168141f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.763+0000 7fe16cfc8640 1 -- 172.21.15.37:0/905225814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe16806da40 msgr2=0x7fe1681f7400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.763+0000 7fe16cfc8640 1 --2- 172.21.15.37:0/905225814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe16806da40 0x7fe1681f7400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.763+0000 7fe16cfc8640 1 -- 172.21.15.37:0/905225814 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe150009400 con 0x7fe1681432b0 2023-12-11T17:10:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.763+0000 7fe15ffff640 1 --2- 172.21.15.37:0/905225814 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe168142de0 0x7fe168141f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.764+0000 7fe16cfc8640 1 --2- 172.21.15.37:0/905225814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1681432b0 0x7fe16806ca90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe16000c6b0 tx=0x7fe16000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.764+0000 7fe1657fa640 1 -- 172.21.15.37:0/905225814 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe160003b70 con 0x7fe1681432b0 2023-12-11T17:10:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.764+0000 7fe1657fa640 1 -- 172.21.15.37:0/905225814 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe160003cf0 con 0x7fe1681432b0 2023-12-11T17:10:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.764+0000 7fe1657fa640 1 -- 172.21.15.37:0/905225814 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe160003ea0 con 0x7fe1681432b0 2023-12-11T17:10:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.764+0000 7fe16ea2b640 1 -- 172.21.15.37:0/905225814 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1680ad9d0 con 0x7fe1681432b0 2023-12-11T17:10:00.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.764+0000 7fe16ea2b640 1 -- 172.21.15.37:0/905225814 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1680adf90 con 0x7fe1681432b0 2023-12-11T17:10:00.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.765+0000 7fe16ea2b640 1 -- 172.21.15.37:0/905225814 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1680745d0 con 0x7fe1681432b0 2023-12-11T17:10:00.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.766+0000 7fe1657fa640 1 -- 172.21.15.37:0/905225814 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe160005310 con 0x7fe1681432b0 2023-12-11T17:10:00.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.768+0000 7fe1657fa640 1 --2- 172.21.15.37:0/905225814 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe14806ae40 0x7fe14806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:00.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.768+0000 7fe1657fa640 1 -- 172.21.15.37:0/905225814 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe1600896c0 con 0x7fe1681432b0 2023-12-11T17:10:00.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.768+0000 7fe167fff640 1 --2- 172.21.15.37:0/905225814 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe14806ae40 0x7fe14806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:00.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.769+0000 7fe167fff640 1 --2- 172.21.15.37:0/905225814 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe14806ae40 0x7fe14806d300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe158009b60 tx=0x7fe158008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:00.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.772+0000 7fe1657fa640 1 -- 172.21.15.37:0/905225814 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe160054470 con 0x7fe1681432b0 2023-12-11T17:10:00.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.967+0000 7fe16ea2b640 1 -- 172.21.15.37:0/905225814 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe1680cb5d0 con 0x7fe1681432b0 2023-12-11T17:10:00.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.968+0000 7fe1657fa640 1 -- 172.21.15.37:0/905225814 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe160057a90 con 0x7fe1681432b0 2023-12-11T17:10:00.969 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:10:00.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.970+0000 7fe16ea2b640 1 -- 172.21.15.37:0/905225814 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe14806ae40 msgr2=0x7fe14806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:00.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.970+0000 7fe16ea2b640 1 --2- 172.21.15.37:0/905225814 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe14806ae40 0x7fe14806d300 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe158009b60 tx=0x7fe158008040 comp rx=0 tx=0).stop 2023-12-11T17:10:00.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.970+0000 7fe16ea2b640 1 -- 172.21.15.37:0/905225814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1681432b0 msgr2=0x7fe16806ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:00.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.970+0000 7fe16ea2b640 1 --2- 172.21.15.37:0/905225814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1681432b0 0x7fe16806ca90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fe16000c6b0 tx=0x7fe16000cb70 comp rx=0 tx=0).stop 2023-12-11T17:10:00.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.971+0000 7fe16ea2b640 1 -- 172.21.15.37:0/905225814 shutdown_connections 2023-12-11T17:10:00.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.971+0000 7fe16ea2b640 1 --2- 172.21.15.37:0/905225814 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe14806ae40 0x7fe14806d300 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.971+0000 7fe16ea2b640 1 --2- 172.21.15.37:0/905225814 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe1681432b0 0x7fe16806ca90 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.971+0000 7fe16ea2b640 1 --2- 172.21.15.37:0/905225814 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe168142de0 0x7fe168141f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.971+0000 7fe16ea2b640 1 --2- 172.21.15.37:0/905225814 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe16806da40 0x7fe1681f7400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:00.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.971+0000 7fe16ea2b640 1 -- 172.21.15.37:0/905225814 >> 172.21.15.37:0/905225814 conn(0x7fe1680cb850 msgr2=0x7fe1680af040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:00.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.971+0000 7fe16ea2b640 1 -- 172.21.15.37:0/905225814 shutdown_connections 2023-12-11T17:10:00.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:00.971+0000 7fe16ea2b640 1 -- 172.21.15.37:0/905225814 wait complete. 2023-12-11T17:10:00.990 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-11T17:10:01.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.207+0000 7f7754f21640 1 Processor -- start 2023-12-11T17:10:01.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.208+0000 7f7754f21640 1 -- start start 2023-12-11T17:10:01.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.209+0000 7f7754f21640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77500b35c0 0x7f775006a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:01.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.209+0000 7f7754f21640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7750146320 0x7f775006a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:01.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.209+0000 7f7754f21640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7750146150 con 0x7f7750146870 2023-12-11T17:10:01.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.209+0000 7f7754f21640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77500b5060 con 0x7f7750146320 2023-12-11T17:10:01.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.209+0000 7f7754f21640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77500cfa50 con 0x7f77500b35c0 2023-12-11T17:10:01.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.210+0000 7f774ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7750146870 0x7f7750160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51274/0 (socket says 172.21.15.37:51274) 2023-12-11T17:10:01.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.210+0000 7f774ffff640 1 -- 172.21.15.37:0/422412184 learned_addr learned my addr 172.21.15.37:0/422412184 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:01.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.210+0000 7f774f7fe640 1 --2- 172.21.15.37:0/422412184 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77500b35c0 0x7f775006a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:01.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.210+0000 7f774effd640 1 --2- 172.21.15.37:0/422412184 >> v2:172.21.15.151:3300/0 conn(0x7f7750146320 0x7f775006a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:01.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.211+0000 7f774e7fc640 1 -- 172.21.15.37:0/422412184 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1856971690 0 0) 0x7f7750146150 con 0x7f7750146870 2023-12-11T17:10:01.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.211+0000 7f774e7fc640 1 -- 172.21.15.37:0/422412184 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7738003520 con 0x7f7750146870 2023-12-11T17:10:01.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.211+0000 7f774e7fc640 1 -- 172.21.15.37:0/422412184 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3448201771 0 0) 0x7f7738003520 con 0x7f7750146870 2023-12-11T17:10:01.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.211+0000 7f774e7fc640 1 -- 172.21.15.37:0/422412184 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77500b35c0 msgr2=0x7f775006a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:01.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.211+0000 7f774e7fc640 1 --2- 172.21.15.37:0/422412184 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77500b35c0 0x7f775006a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:01.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.211+0000 7f774e7fc640 1 -- 172.21.15.37:0/422412184 >> v2:172.21.15.151:3300/0 conn(0x7f7750146320 msgr2=0x7f775006a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:01.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.211+0000 7f774e7fc640 1 --2- 172.21.15.37:0/422412184 >> v2:172.21.15.151:3300/0 conn(0x7f7750146320 0x7f775006a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:01.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.211+0000 7f774e7fc640 1 -- 172.21.15.37:0/422412184 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77500cfd30 con 0x7f7750146870 2023-12-11T17:10:01.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.211+0000 7f774e7fc640 1 -- 172.21.15.37:0/422412184 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f77480019f0 con 0x7f7750146870 2023-12-11T17:10:01.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.211+0000 7f774e7fc640 1 -- 172.21.15.37:0/422412184 >> v1:172.21.15.37:6789/0 conn(0x7f7750146870 legacy=0x7f7750160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:01.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.211+0000 7f774e7fc640 1 --2- 172.21.15.37:0/422412184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7738003970 0x7f7738003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:01.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.211+0000 7f774e7fc640 1 --2- 172.21.15.37:0/422412184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77380047c0 0x7f7738004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:01.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.211+0000 7f774e7fc640 1 --2- 172.21.15.37:0/422412184 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7738005180 0x7f773800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:01.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.211+0000 7f774e7fc640 1 -- 172.21.15.37:0/422412184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77500b5060 con 0x7f7738003970 2023-12-11T17:10:01.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.211+0000 7f774e7fc640 1 -- 172.21.15.37:0/422412184 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77500cfa50 con 0x7f77380047c0 2023-12-11T17:10:01.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.211+0000 7f774e7fc640 1 -- 172.21.15.37:0/422412184 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7738004560 con 0x7f7738005180 2023-12-11T17:10:01.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.211+0000 7f774f7fe640 1 --2- 172.21.15.37:0/422412184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7738003970 0x7f7738003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:01.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.212+0000 7f774f7fe640 1 -- 172.21.15.37:0/422412184 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7738005180 msgr2=0x7f773800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:01.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.212+0000 7f774f7fe640 1 --2- 172.21.15.37:0/422412184 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7738005180 0x7f773800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:01.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.212+0000 7f774f7fe640 1 -- 172.21.15.37:0/422412184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77380047c0 msgr2=0x7f7738004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:01.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.212+0000 7f774f7fe640 1 --2- 172.21.15.37:0/422412184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f77380047c0 0x7f7738004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:01.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.212+0000 7f774f7fe640 1 -- 172.21.15.37:0/422412184 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7738003520 con 0x7f7738003970 2023-12-11T17:10:01.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.213+0000 7f774f7fe640 1 --2- 172.21.15.37:0/422412184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7738003970 0x7f7738003d90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7740009ac0 tx=0x7f77380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dacc2c83b9daa05 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:01.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.213+0000 7f774e7fc640 1 -- 172.21.15.37:0/422412184 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774002c710 con 0x7f7738003970 2023-12-11T17:10:01.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.214+0000 7f774e7fc640 1 -- 172.21.15.37:0/422412184 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774002c870 con 0x7f7738003970 2023-12-11T17:10:01.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.214+0000 7f774e7fc640 1 -- 172.21.15.37:0/422412184 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774002cc00 con 0x7f7738003970 2023-12-11T17:10:01.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.214+0000 7f7754f21640 1 -- 172.21.15.37:0/422412184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7738003970 msgr2=0x7f7738003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:01.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.214+0000 7f7754f21640 1 --2- 172.21.15.37:0/422412184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7738003970 0x7f7738003d90 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7740009ac0 tx=0x7f77380057f0 comp rx=0 tx=0).stop 2023-12-11T17:10:01.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.214+0000 7f774ffff640 1 -- 172.21.15.37:0/422412184 reap_dead start 2023-12-11T17:10:01.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.214+0000 7f7754f21640 1 -- 172.21.15.37:0/422412184 shutdown_connections 2023-12-11T17:10:01.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.214+0000 7f7754f21640 1 -- 172.21.15.37:0/422412184 >> 172.21.15.37:0/422412184 conn(0x7f77500b1840 msgr2=0x7f77500b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:01.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.214+0000 7f7754f21640 1 -- 172.21.15.37:0/422412184 shutdown_connections 2023-12-11T17:10:01.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.214+0000 7f7754f21640 1 -- 172.21.15.37:0/422412184 wait complete. 2023-12-11T17:10:01.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.216+0000 7f7754f21640 1 Processor -- start 2023-12-11T17:10:01.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.216+0000 7f7754f21640 1 -- start start 2023-12-11T17:10:01.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.218+0000 7f7754f21640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7738003970 0x7f77501f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:01.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.218+0000 7f7754f21640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77501602a0 0x7f77500b0c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:01.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.218+0000 7f7754f21640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500b11a0 0x7f77500ad9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:01.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.218+0000 7f7754f21640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77500b1650 con 0x7f77500b11a0 2023-12-11T17:10:01.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.218+0000 7f7754f21640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f775014df30 con 0x7f7738003970 2023-12-11T17:10:01.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.218+0000 7f7754f21640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f775014e1f0 con 0x7f77501602a0 2023-12-11T17:10:01.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.218+0000 7f774ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500b11a0 0x7f77500ad9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:01.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.218+0000 7f774ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500b11a0 0x7f77500ad9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44418/0 (socket says 172.21.15.37:44418) 2023-12-11T17:10:01.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.218+0000 7f774ffff640 1 -- 172.21.15.37:0/3462604898 learned_addr learned my addr 172.21.15.37:0/3462604898 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:01.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.218+0000 7f774f7fe640 1 --2- 172.21.15.37:0/3462604898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7738003970 0x7f77501f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:01.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.218+0000 7f774effd640 1 --2- 172.21.15.37:0/3462604898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77501602a0 0x7f77500b0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:01.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.218+0000 7f774ffff640 1 -- 172.21.15.37:0/3462604898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77501602a0 msgr2=0x7f77500b0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:01.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.218+0000 7f774ffff640 1 --2- 172.21.15.37:0/3462604898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77501602a0 0x7f77500b0c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:01.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.218+0000 7f774ffff640 1 -- 172.21.15.37:0/3462604898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7738003970 msgr2=0x7f77501f2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:01.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.218+0000 7f774ffff640 1 --2- 172.21.15.37:0/3462604898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7738003970 0x7f77501f2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:01.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.218+0000 7f774ffff640 1 -- 172.21.15.37:0/3462604898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f775014e4d0 con 0x7f77500b11a0 2023-12-11T17:10:01.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.219+0000 7f774ffff640 1 --2- 172.21.15.37:0/3462604898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500b11a0 0x7f77500ad9e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f77480012e0 tx=0x7f774800cec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:01.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.219+0000 7f7737fff640 1 -- 172.21.15.37:0/3462604898 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774800a610 con 0x7f77500b11a0 2023-12-11T17:10:01.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.219+0000 7f7737fff640 1 -- 172.21.15.37:0/3462604898 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774800a770 con 0x7f77500b11a0 2023-12-11T17:10:01.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.219+0000 7f7737fff640 1 -- 172.21.15.37:0/3462604898 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774800ab20 con 0x7f77500b11a0 2023-12-11T17:10:01.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.219+0000 7f7754f21640 1 -- 172.21.15.37:0/3462604898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f775014e7b0 con 0x7f77500b11a0 2023-12-11T17:10:01.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.219+0000 7f7754f21640 1 -- 172.21.15.37:0/3462604898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f775014ed70 con 0x7f77500b11a0 2023-12-11T17:10:01.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.220+0000 7f7754f21640 1 -- 172.21.15.37:0/3462604898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77500673f0 con 0x7f77500b11a0 2023-12-11T17:10:01.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.222+0000 7f7737fff640 1 -- 172.21.15.37:0/3462604898 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f774800ac80 con 0x7f77500b11a0 2023-12-11T17:10:01.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.222+0000 7f7737fff640 1 --2- 172.21.15.37:0/3462604898 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f773c06ae40 0x7f773c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:01.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.223+0000 7f7737fff640 1 -- 172.21.15.37:0/3462604898 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7748089260 con 0x7f77500b11a0 2023-12-11T17:10:01.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.223+0000 7f774f7fe640 1 --2- 172.21.15.37:0/3462604898 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f773c06ae40 0x7f773c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:01.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.225+0000 7f774f7fe640 1 --2- 172.21.15.37:0/3462604898 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f773c06ae40 0x7f773c06d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7740009ac0 tx=0x7f7740030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:01.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.227+0000 7f7737fff640 1 -- 172.21.15.37:0/3462604898 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7748053f80 con 0x7f77500b11a0 2023-12-11T17:10:01.429 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.428+0000 7f7754f21640 1 -- 172.21.15.37:0/3462604898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f775006e8f0 con 0x7f77500b11a0 2023-12-11T17:10:01.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.429+0000 7f7737fff640 1 -- 172.21.15.37:0/3462604898 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7f77480575a0 con 0x7f77500b11a0 2023-12-11T17:10:01.430 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-12-11T17:10:01.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.431+0000 7f7754f21640 1 -- 172.21.15.37:0/3462604898 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f773c06ae40 msgr2=0x7f773c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.431+0000 7f7754f21640 1 --2- 172.21.15.37:0/3462604898 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f773c06ae40 0x7f773c06d300 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7740009ac0 tx=0x7f7740030000 comp rx=0 tx=0).stop 2023-12-11T17:10:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.431+0000 7f7754f21640 1 -- 172.21.15.37:0/3462604898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500b11a0 msgr2=0x7f77500ad9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.431+0000 7f7754f21640 1 --2- 172.21.15.37:0/3462604898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500b11a0 0x7f77500ad9e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f77480012e0 tx=0x7f774800cec0 comp rx=0 tx=0).stop 2023-12-11T17:10:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.431+0000 7f7754f21640 1 -- 172.21.15.37:0/3462604898 shutdown_connections 2023-12-11T17:10:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.431+0000 7f7754f21640 1 --2- 172.21.15.37:0/3462604898 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f773c06ae40 0x7f773c06d300 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.431+0000 7f7754f21640 1 --2- 172.21.15.37:0/3462604898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f77500b11a0 0x7f77500ad9e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.431+0000 7f7754f21640 1 --2- 172.21.15.37:0/3462604898 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f77501602a0 0x7f77500b0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.431+0000 7f7754f21640 1 --2- 172.21.15.37:0/3462604898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7738003970 0x7f77501f2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.431+0000 7f7754f21640 1 -- 172.21.15.37:0/3462604898 >> 172.21.15.37:0/3462604898 conn(0x7f77500b1840 msgr2=0x7f77500b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.432+0000 7f7754f21640 1 -- 172.21.15.37:0/3462604898 shutdown_connections 2023-12-11T17:10:01.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.432+0000 7f7754f21640 1 -- 172.21.15.37:0/3462604898 wait complete. 2023-12-11T17:10:01.452 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:10:01.452 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-11T17:10:01.506 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:10:01.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.767+0000 7f44848c9640 1 Processor -- start 2023-12-11T17:10:01.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.767+0000 7f44848c9640 1 -- start start 2023-12-11T17:10:01.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.768+0000 7f44848c9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f44801467c0 0x7f44800cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:01.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.769+0000 7f44848c9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4480146ba0 0x7f44800cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:01.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.769+0000 7f44848c9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f448006d510 con 0x7f448006c7e0 2023-12-11T17:10:01.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.769+0000 7f44848c9640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44800ac860 con 0x7f44801467c0 2023-12-11T17:10:01.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.769+0000 7f44848c9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f448006d7f0 con 0x7f4480146ba0 2023-12-11T17:10:01.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.769+0000 7f447e59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f44801467c0 0x7f44800cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:01.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.769+0000 7f447e59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f44801467c0 0x7f44800cc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44420/0 (socket says 172.21.15.37:44420) 2023-12-11T17:10:01.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.769+0000 7f447ed9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f448006c7e0 0x7f448006cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51282/0 (socket says 172.21.15.37:51282) 2023-12-11T17:10:01.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.769+0000 7f447e59c640 1 -- 172.21.15.37:0/357317562 learned_addr learned my addr 172.21.15.37:0/357317562 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:01.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.769+0000 7f447dd9b640 1 --2- 172.21.15.37:0/357317562 >> v2:172.21.15.151:3300/0 conn(0x7f4480146ba0 0x7f44800cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:01.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.769+0000 7f447e59c640 1 -- 172.21.15.37:0/357317562 >> v2:172.21.15.151:3300/0 conn(0x7f4480146ba0 msgr2=0x7f44800cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:01.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.769+0000 7f447e59c640 1 --2- 172.21.15.37:0/357317562 >> v2:172.21.15.151:3300/0 conn(0x7f4480146ba0 0x7f44800cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:01.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.769+0000 7f447e59c640 1 -- 172.21.15.37:0/357317562 >> v1:172.21.15.37:6789/0 conn(0x7f448006c7e0 legacy=0x7f448006cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:01.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.769+0000 7f447e59c640 1 -- 172.21.15.37:0/357317562 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f448006dad0 con 0x7f44801467c0 2023-12-11T17:10:01.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.769+0000 7f447dd9b640 1 --2- 172.21.15.37:0/357317562 >> v2:172.21.15.151:3300/0 conn(0x7f4480146ba0 0x7f44800cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:01.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.770+0000 7f447e59c640 1 --2- 172.21.15.37:0/357317562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44801467c0 0x7f44800cc8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f448006b7e0 tx=0x7f447002bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993a212c89c9c514 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:01.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.771+0000 7f447d59a640 1 -- 172.21.15.37:0/357317562 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447002cb10 con 0x7f44801467c0 2023-12-11T17:10:01.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.771+0000 7f447d59a640 1 -- 172.21.15.37:0/357317562 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447002cc70 con 0x7f44801467c0 2023-12-11T17:10:01.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.771+0000 7f447d59a640 1 -- 172.21.15.37:0/357317562 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44700343f0 con 0x7f44801467c0 2023-12-11T17:10:01.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.771+0000 7f44848c9640 1 -- 172.21.15.37:0/357317562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44801467c0 msgr2=0x7f44800cc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:01.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.771+0000 7f44848c9640 1 --2- 172.21.15.37:0/357317562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44801467c0 0x7f44800cc8f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f448006b7e0 tx=0x7f447002bf70 comp rx=0 tx=0).stop 2023-12-11T17:10:01.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.771+0000 7f44848c9640 1 -- 172.21.15.37:0/357317562 shutdown_connections 2023-12-11T17:10:01.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.771+0000 7f44848c9640 1 --2- 172.21.15.37:0/357317562 >> v2:172.21.15.151:3300/0 conn(0x7f4480146ba0 0x7f44800cce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:01.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.771+0000 7f44848c9640 1 --2- 172.21.15.37:0/357317562 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44801467c0 0x7f44800cc8f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:01.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.771+0000 7f44848c9640 1 -- 172.21.15.37:0/357317562 >> 172.21.15.37:0/357317562 conn(0x7f44800b0a90 msgr2=0x7f44800b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:01.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.772+0000 7f44848c9640 1 -- 172.21.15.37:0/357317562 shutdown_connections 2023-12-11T17:10:01.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.772+0000 7f44848c9640 1 -- 172.21.15.37:0/357317562 wait complete. 2023-12-11T17:10:01.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.773+0000 7f44848c9640 1 Processor -- start 2023-12-11T17:10:01.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.773+0000 7f44848c9640 1 -- start start 2023-12-11T17:10:01.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.774+0000 7f44848c9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f448006c7e0 0x7f44800b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:01.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.774+0000 7f44848c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44801467c0 0x7f448015a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:01.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.774+0000 7f44848c9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4480146ba0 0x7f44801453d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:01.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.774+0000 7f44848c9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4480158900 con 0x7f44801467c0 2023-12-11T17:10:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.774+0000 7f44848c9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44800b4850 con 0x7f448006c7e0 2023-12-11T17:10:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.774+0000 7f44848c9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448015a8d0 con 0x7f4480146ba0 2023-12-11T17:10:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.775+0000 7f447dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44801467c0 0x7f448015a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.775+0000 7f447dd9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44801467c0 0x7f448015a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44426/0 (socket says 172.21.15.37:44426) 2023-12-11T17:10:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.775+0000 7f447dd9b640 1 -- 172.21.15.37:0/1633173907 learned_addr learned my addr 172.21.15.37:0/1633173907 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.775+0000 7f447ed9d640 1 --2- 172.21.15.37:0/1633173907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4480146ba0 0x7f44801453d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.775+0000 7f447e59c640 1 --2- 172.21.15.37:0/1633173907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f448006c7e0 0x7f44800b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.775+0000 7f447dd9b640 1 -- 172.21.15.37:0/1633173907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4480146ba0 msgr2=0x7f44801453d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.775+0000 7f447dd9b640 1 --2- 172.21.15.37:0/1633173907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4480146ba0 0x7f44801453d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.775+0000 7f447dd9b640 1 -- 172.21.15.37:0/1633173907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f448006c7e0 msgr2=0x7f44800b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.775+0000 7f447dd9b640 1 --2- 172.21.15.37:0/1633173907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f448006c7e0 0x7f44800b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.775+0000 7f447dd9b640 1 -- 172.21.15.37:0/1633173907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4470009b30 con 0x7f44801467c0 2023-12-11T17:10:01.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.775+0000 7f447ed9d640 1 --2- 172.21.15.37:0/1633173907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4480146ba0 0x7f44801453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:01.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.776+0000 7f447dd9b640 1 --2- 172.21.15.37:0/1633173907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44801467c0 0x7f448015a390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f446800c820 tx=0x7f446800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:01.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.776+0000 7f4476ffd640 1 -- 172.21.15.37:0/1633173907 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4468007a30 con 0x7f44801467c0 2023-12-11T17:10:01.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.776+0000 7f4476ffd640 1 -- 172.21.15.37:0/1633173907 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4468007b90 con 0x7f44801467c0 2023-12-11T17:10:01.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.776+0000 7f4476ffd640 1 -- 172.21.15.37:0/1633173907 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f446800ce10 con 0x7f44801467c0 2023-12-11T17:10:01.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.776+0000 7f44848c9640 1 -- 172.21.15.37:0/1633173907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44800b4a40 con 0x7f44801467c0 2023-12-11T17:10:01.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.776+0000 7f44848c9640 1 -- 172.21.15.37:0/1633173907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4480158240 con 0x7f44801467c0 2023-12-11T17:10:01.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.777+0000 7f44848c9640 1 -- 172.21.15.37:0/1633173907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4480158a40 con 0x7f44801467c0 2023-12-11T17:10:01.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.778+0000 7f4476ffd640 1 -- 172.21.15.37:0/1633173907 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f44680113f0 con 0x7f44801467c0 2023-12-11T17:10:01.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.779+0000 7f4476ffd640 1 --2- 172.21.15.37:0/1633173907 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f446006ae40 0x7f446006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:01.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.779+0000 7f4476ffd640 1 -- 172.21.15.37:0/1633173907 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f4468089a20 con 0x7f44801467c0 2023-12-11T17:10:01.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.780+0000 7f447e59c640 1 --2- 172.21.15.37:0/1633173907 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f446006ae40 0x7f446006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:01.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.781+0000 7f447e59c640 1 --2- 172.21.15.37:0/1633173907 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f446006ae40 0x7f446006d300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4470035000 tx=0x7f4470030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:01.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.783+0000 7f4476ffd640 1 -- 172.21.15.37:0/1633173907 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4480158a40 con 0x7f44801467c0 2023-12-11T17:10:01.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.977+0000 7f44848c9640 1 -- 172.21.15.37:0/1633173907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4480158a40 con 0x7f44801467c0 2023-12-11T17:10:01.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.981+0000 7f4476ffd640 1 -- 172.21.15.37:0/1633173907 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f4480158a40 con 0x7f44801467c0 2023-12-11T17:10:01.982 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:01.982 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:09:49.715938+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:10:01.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.983+0000 7f44848c9640 1 -- 172.21.15.37:0/1633173907 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f446006ae40 msgr2=0x7f446006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:01.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.983+0000 7f44848c9640 1 --2- 172.21.15.37:0/1633173907 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f446006ae40 0x7f446006d300 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f4470035000 tx=0x7f4470030000 comp rx=0 tx=0).stop 2023-12-11T17:10:01.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.983+0000 7f44848c9640 1 -- 172.21.15.37:0/1633173907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44801467c0 msgr2=0x7f448015a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:01.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.983+0000 7f44848c9640 1 --2- 172.21.15.37:0/1633173907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44801467c0 0x7f448015a390 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f446800c820 tx=0x7f446800cce0 comp rx=0 tx=0).stop 2023-12-11T17:10:01.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.983+0000 7f44848c9640 1 -- 172.21.15.37:0/1633173907 shutdown_connections 2023-12-11T17:10:01.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.983+0000 7f44848c9640 1 --2- 172.21.15.37:0/1633173907 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f446006ae40 0x7f446006d300 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:01.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.983+0000 7f44848c9640 1 --2- 172.21.15.37:0/1633173907 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4480146ba0 0x7f44801453d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:01.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.983+0000 7f44848c9640 1 --2- 172.21.15.37:0/1633173907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44801467c0 0x7f448015a390 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:01.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.983+0000 7f44848c9640 1 --2- 172.21.15.37:0/1633173907 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f448006c7e0 0x7f44800b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:01.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.983+0000 7f44848c9640 1 -- 172.21.15.37:0/1633173907 >> 172.21.15.37:0/1633173907 conn(0x7f44800b0a90 msgr2=0x7f4480070230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:01.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.984+0000 7f44848c9640 1 -- 172.21.15.37:0/1633173907 shutdown_connections 2023-12-11T17:10:01.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:01.984+0000 7f44848c9640 1 -- 172.21.15.37:0/1633173907 wait complete. 2023-12-11T17:10:02.005 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T17:09:38.415636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T17:09:42.786774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T17:09:43.660585+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-11T17:09:47.272351+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-11T17:10:02.006 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T17:10:02.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.242+0000 7fcd3ffff640 1 Processor -- start 2023-12-11T17:10:02.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.242+0000 7fcd3ffff640 1 -- start start 2023-12-11T17:10:02.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.244+0000 7fcd3ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd400cf500 0x7fcd400ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:02.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.244+0000 7fcd3ffff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd4006c500 con 0x7fcd400ce150 2023-12-11T17:10:02.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.244+0000 7fcd3ffff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd4015b4a0 con 0x7fcd40155400 2023-12-11T17:10:02.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.244+0000 7fcd3ffff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd400adbb0 con 0x7fcd400cf500 2023-12-11T17:10:02.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.244+0000 7fcd3f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd400cf500 0x7fcd400ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:02.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.244+0000 7fcd3f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcd400cf500 0x7fcd400ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44438/0 (socket says 172.21.15.37:44438) 2023-12-11T17:10:02.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.244+0000 7fcd3f7fe640 1 -- 172.21.15.37:0/988466345 learned_addr learned my addr 172.21.15.37:0/988466345 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:02.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.244+0000 7fcd37fff640 1 --1- 172.21.15.37:0/988466345 >> v1:172.21.15.37:6789/0 conn(0x7fcd400ce150 0x7fcd400cedf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51288/0 (socket says 172.21.15.37:51288) 2023-12-11T17:10:02.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.244+0000 7fcd3f7fe640 1 -- 172.21.15.37:0/988466345 >> v1:172.21.15.151:6789/0 conn(0x7fcd40155400 legacy=0x7fcd4006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:02.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.245+0000 7fcd3f7fe640 1 -- 172.21.15.37:0/988466345 >> v1:172.21.15.37:6789/0 conn(0x7fcd400ce150 legacy=0x7fcd400cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:02.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.245+0000 7fcd3f7fe640 1 -- 172.21.15.37:0/988466345 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd400ade90 con 0x7fcd400cf500 2023-12-11T17:10:02.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.245+0000 7fcd3e7fc640 1 -- 172.21.15.37:0/988466345 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1865406933 0 0) 0x7fcd4006c500 con 0x7fcd400ce150 2023-12-11T17:10:02.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.246+0000 7fcd3f7fe640 1 --2- 172.21.15.37:0/988466345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd400cf500 0x7fcd400ce5b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009e50 tx=0x7fcd3802bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7e4719bee2f6b18 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:02.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.246+0000 7fcd3e7fc640 1 -- 172.21.15.37:0/988466345 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd3802cb90 con 0x7fcd400cf500 2023-12-11T17:10:02.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.246+0000 7fcd3e7fc640 1 -- 172.21.15.37:0/988466345 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3802ccf0 con 0x7fcd400cf500 2023-12-11T17:10:02.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.246+0000 7fcd3e7fc640 1 -- 172.21.15.37:0/988466345 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd38034610 con 0x7fcd400cf500 2023-12-11T17:10:02.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.246+0000 7fcd3ffff640 1 -- 172.21.15.37:0/988466345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd400cf500 msgr2=0x7fcd400ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:02.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.246+0000 7fcd3ffff640 1 --2- 172.21.15.37:0/988466345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd400cf500 0x7fcd400ce5b0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fcd38009e50 tx=0x7fcd3802bff0 comp rx=0 tx=0).stop 2023-12-11T17:10:02.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.247+0000 7fcd3ffff640 1 -- 172.21.15.37:0/988466345 shutdown_connections 2023-12-11T17:10:02.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.247+0000 7fcd3ffff640 1 --2- 172.21.15.37:0/988466345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd400cf500 0x7fcd400ce5b0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:02.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.247+0000 7fcd3ffff640 1 -- 172.21.15.37:0/988466345 >> 172.21.15.37:0/988466345 conn(0x7fcd4006a640 msgr2=0x7fcd4006aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:02.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.247+0000 7fcd3ffff640 1 -- 172.21.15.37:0/988466345 shutdown_connections 2023-12-11T17:10:02.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.247+0000 7fcd3ffff640 1 -- 172.21.15.37:0/988466345 wait complete. 2023-12-11T17:10:02.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.249+0000 7fcd3ffff640 1 Processor -- start 2023-12-11T17:10:02.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.249+0000 7fcd3ffff640 1 -- start start 2023-12-11T17:10:02.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.250+0000 7fcd3ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd400ce150 0x7fcd40151d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:02.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.250+0000 7fcd3ffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd400cf500 0x7fcd4009bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:02.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.250+0000 7fcd3ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd40155400 0x7fcd4009c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:02.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.250+0000 7fcd3ffff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4009a3c0 con 0x7fcd400ce150 2023-12-11T17:10:02.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.250+0000 7fcd3ffff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd40152280 con 0x7fcd40155400 2023-12-11T17:10:02.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.250+0000 7fcd3ffff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd40099a90 con 0x7fcd400cf500 2023-12-11T17:10:02.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.250+0000 7fcd3effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd400ce150 0x7fcd40151d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:02.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.250+0000 7fcd3effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd400ce150 0x7fcd40151d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44446/0 (socket says 172.21.15.37:44446) 2023-12-11T17:10:02.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.250+0000 7fcd3effd640 1 -- 172.21.15.37:0/3752451954 learned_addr learned my addr 172.21.15.37:0/3752451954 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:02.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.251+0000 7fcd3f7fe640 1 --2- 172.21.15.37:0/3752451954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd40155400 0x7fcd4009c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:02.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.251+0000 7fcd37fff640 1 --2- 172.21.15.37:0/3752451954 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd400cf500 0x7fcd4009bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:02.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.251+0000 7fcd3effd640 1 -- 172.21.15.37:0/3752451954 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd400cf500 msgr2=0x7fcd4009bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:02.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.251+0000 7fcd3effd640 1 --2- 172.21.15.37:0/3752451954 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd400cf500 0x7fcd4009bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:02.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.251+0000 7fcd3effd640 1 -- 172.21.15.37:0/3752451954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd40155400 msgr2=0x7fcd4009c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:02.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.251+0000 7fcd3effd640 1 --2- 172.21.15.37:0/3752451954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd40155400 0x7fcd4009c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:02.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.251+0000 7fcd3effd640 1 -- 172.21.15.37:0/3752451954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd38009b30 con 0x7fcd400ce150 2023-12-11T17:10:02.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.251+0000 7fcd3f7fe640 1 --2- 172.21.15.37:0/3752451954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd40155400 0x7fcd4009c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:02.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.251+0000 7fcd3effd640 1 --2- 172.21.15.37:0/3752451954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd400ce150 0x7fcd40151d40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000c430 tx=0x7fcd3000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:02.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.251+0000 7fcd377fe640 1 -- 172.21.15.37:0/3752451954 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd300052d0 con 0x7fcd400ce150 2023-12-11T17:10:02.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.251+0000 7fcd377fe640 1 -- 172.21.15.37:0/3752451954 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd30005430 con 0x7fcd400ce150 2023-12-11T17:10:02.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.251+0000 7fcd377fe640 1 -- 172.21.15.37:0/3752451954 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd30003830 con 0x7fcd400ce150 2023-12-11T17:10:02.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.251+0000 7fcd3ffff640 1 -- 172.21.15.37:0/3752451954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd40099d00 con 0x7fcd400ce150 2023-12-11T17:10:02.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.251+0000 7fcd3ffff640 1 -- 172.21.15.37:0/3752451954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd400aff20 con 0x7fcd400ce150 2023-12-11T17:10:02.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.252+0000 7fcd3ffff640 1 -- 172.21.15.37:0/3752451954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd4009a500 con 0x7fcd400ce150 2023-12-11T17:10:02.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.253+0000 7fcd377fe640 1 -- 172.21.15.37:0/3752451954 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcd30003990 con 0x7fcd400ce150 2023-12-11T17:10:02.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.254+0000 7fcd377fe640 1 --2- 172.21.15.37:0/3752451954 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcd2006ae40 0x7fcd2006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:02.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.254+0000 7fcd377fe640 1 -- 172.21.15.37:0/3752451954 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcd30088e70 con 0x7fcd400ce150 2023-12-11T17:10:02.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.255+0000 7fcd37fff640 1 --2- 172.21.15.37:0/3752451954 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcd2006ae40 0x7fcd2006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:02.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.256+0000 7fcd37fff640 1 --2- 172.21.15.37:0/3752451954 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcd2006ae40 0x7fcd2006d300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcd40072190 tx=0x7fcd28009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:02.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.259+0000 7fcd377fe640 1 -- 172.21.15.37:0/3752451954 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcd4009a500 con 0x7fcd400ce150 2023-12-11T17:10:02.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.455+0000 7fcd3ffff640 1 -- 172.21.15.37:0/3752451954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcd40074450 con 0x7fcd400ce150 2023-12-11T17:10:02.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.456+0000 7fcd377fe640 1 -- 172.21.15.37:0/3752451954 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcd300170a0 con 0x7fcd400ce150 2023-12-11T17:10:02.457 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-11T17:10:02.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.459+0000 7fcd3ffff640 1 -- 172.21.15.37:0/3752451954 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcd2006ae40 msgr2=0x7fcd2006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:02.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.459+0000 7fcd3ffff640 1 --2- 172.21.15.37:0/3752451954 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcd2006ae40 0x7fcd2006d300 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fcd40072190 tx=0x7fcd28009040 comp rx=0 tx=0).stop 2023-12-11T17:10:02.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.459+0000 7fcd3ffff640 1 -- 172.21.15.37:0/3752451954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd400ce150 msgr2=0x7fcd40151d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:02.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.459+0000 7fcd3ffff640 1 --2- 172.21.15.37:0/3752451954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd400ce150 0x7fcd40151d40 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000c430 tx=0x7fcd3000c8f0 comp rx=0 tx=0).stop 2023-12-11T17:10:02.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.459+0000 7fcd3ffff640 1 -- 172.21.15.37:0/3752451954 shutdown_connections 2023-12-11T17:10:02.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.459+0000 7fcd3ffff640 1 --2- 172.21.15.37:0/3752451954 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcd2006ae40 0x7fcd2006d300 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:02.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.459+0000 7fcd3ffff640 1 --2- 172.21.15.37:0/3752451954 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd40155400 0x7fcd4009c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:02.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.459+0000 7fcd3ffff640 1 --2- 172.21.15.37:0/3752451954 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd400cf500 0x7fcd4009bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:02.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.459+0000 7fcd3ffff640 1 --2- 172.21.15.37:0/3752451954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd400ce150 0x7fcd40151d40 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:02.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.459+0000 7fcd3ffff640 1 -- 172.21.15.37:0/3752451954 >> 172.21.15.37:0/3752451954 conn(0x7fcd4006a640 msgr2=0x7fcd4015b8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:02.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.459+0000 7fcd3ffff640 1 -- 172.21.15.37:0/3752451954 shutdown_connections 2023-12-11T17:10:02.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.459+0000 7fcd3ffff640 1 -- 172.21.15.37:0/3752451954 wait complete. 2023-12-11T17:10:02.480 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T17:10:02.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.703+0000 7f18a3009640 1 Processor -- start 2023-12-11T17:10:02.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.704+0000 7f18a3009640 1 -- start start 2023-12-11T17:10:02.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.705+0000 7f18a3009640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f189c0cece0 0x7f189c0d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:02.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.705+0000 7f18a3009640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f189c0d1a70 0x7f189c0b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:02.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.705+0000 7f18a3009640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f189c0d3d70 con 0x7f189c15d360 2023-12-11T17:10:02.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.705+0000 7f18a3009640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f189c0d1f00 con 0x7f189c0d1a70 2023-12-11T17:10:02.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.705+0000 7f18a3009640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f189c0cdf20 con 0x7f189c0cece0 2023-12-11T17:10:02.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.706+0000 7f18a2007640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f189c15d360 0x7f189c0d3660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:51304/0 (socket says 172.21.15.37:51304) 2023-12-11T17:10:02.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.706+0000 7f18a2007640 1 -- 172.21.15.37:0/1476312686 learned_addr learned my addr 172.21.15.37:0/1476312686 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:02.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.706+0000 7f18a2808640 1 --2- 172.21.15.37:0/1476312686 >> v2:172.21.15.37:3300/0 conn(0x7f189c0d1a70 0x7f189c0b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:02.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.706+0000 7f18a1806640 1 --2- 172.21.15.37:0/1476312686 >> v2:172.21.15.151:3300/0 conn(0x7f189c0cece0 0x7f189c0d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:02.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.706+0000 7f18a2808640 1 -- 172.21.15.37:0/1476312686 >> v2:172.21.15.151:3300/0 conn(0x7f189c0cece0 msgr2=0x7f189c0d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:02.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.706+0000 7f18a2808640 1 --2- 172.21.15.37:0/1476312686 >> v2:172.21.15.151:3300/0 conn(0x7f189c0cece0 0x7f189c0d1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:02.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.706+0000 7f18a2808640 1 -- 172.21.15.37:0/1476312686 >> v1:172.21.15.37:6789/0 conn(0x7f189c15d360 legacy=0x7f189c0d3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:02.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.706+0000 7f18a2808640 1 -- 172.21.15.37:0/1476312686 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f189c0ce200 con 0x7f189c0d1a70 2023-12-11T17:10:02.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.706+0000 7f18a1005640 1 -- 172.21.15.37:0/1476312686 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260335089 0 0) 0x7f189c0d3d70 con 0x7f189c15d360 2023-12-11T17:10:02.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.708+0000 7f18a2808640 1 --2- 172.21.15.37:0/1476312686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f189c0d1a70 0x7f189c0b28b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f189c08baa0 tx=0x7f189402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c8273d1befbb8aa server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:02.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.708+0000 7f18a1005640 1 -- 172.21.15.37:0/1476312686 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1894030610 con 0x7f189c0d1a70 2023-12-11T17:10:02.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.708+0000 7f18a1005640 1 -- 172.21.15.37:0/1476312686 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1894030770 con 0x7f189c0d1a70 2023-12-11T17:10:02.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.708+0000 7f18a1005640 1 -- 172.21.15.37:0/1476312686 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1894030b00 con 0x7f189c0d1a70 2023-12-11T17:10:02.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.709+0000 7f18a3009640 1 -- 172.21.15.37:0/1476312686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f189c0d1a70 msgr2=0x7f189c0b28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:02.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.709+0000 7f18a3009640 1 --2- 172.21.15.37:0/1476312686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f189c0d1a70 0x7f189c0b28b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f189c08baa0 tx=0x7f189402b960 comp rx=0 tx=0).stop 2023-12-11T17:10:02.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.709+0000 7f18a3009640 1 -- 172.21.15.37:0/1476312686 shutdown_connections 2023-12-11T17:10:02.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.709+0000 7f18a3009640 1 --2- 172.21.15.37:0/1476312686 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f189c0d1a70 0x7f189c0b28b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:02.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.709+0000 7f18a3009640 1 --2- 172.21.15.37:0/1476312686 >> v2:172.21.15.151:3300/0 conn(0x7f189c0cece0 0x7f189c0d1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:02.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.709+0000 7f18a3009640 1 -- 172.21.15.37:0/1476312686 >> 172.21.15.37:0/1476312686 conn(0x7f189c09c230 msgr2=0x7f189c0d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:02.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.709+0000 7f18a3009640 1 -- 172.21.15.37:0/1476312686 shutdown_connections 2023-12-11T17:10:02.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.709+0000 7f18a3009640 1 -- 172.21.15.37:0/1476312686 wait complete. 2023-12-11T17:10:02.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.711+0000 7f18a3009640 1 Processor -- start 2023-12-11T17:10:02.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.711+0000 7f18a3009640 1 -- start start 2023-12-11T17:10:02.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.712+0000 7f18a3009640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f189c0cece0 0x7f189c0ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:02.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.712+0000 7f18a3009640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f189c0d1a70 0x7f189c158a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:02.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.712+0000 7f18a3009640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f189c15d360 0x7f189c160050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:02.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.712+0000 7f18a3009640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189c159660 con 0x7f189c0cece0 2023-12-11T17:10:02.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.712+0000 7f18a3009640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f189c0cce30 con 0x7f189c0d1a70 2023-12-11T17:10:02.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.712+0000 7f18a3009640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f189c0ca560 con 0x7f189c15d360 2023-12-11T17:10:02.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.712+0000 7f18a2007640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f189c0cece0 0x7f189c0ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:02.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.712+0000 7f18a2007640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f189c0cece0 0x7f189c0ca020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44460/0 (socket says 172.21.15.37:44460) 2023-12-11T17:10:02.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.712+0000 7f18a2007640 1 -- 172.21.15.37:0/498244103 learned_addr learned my addr 172.21.15.37:0/498244103 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:02.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.712+0000 7f18a1806640 1 --2- 172.21.15.37:0/498244103 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f189c0d1a70 0x7f189c158a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:02.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.713+0000 7f18a2007640 1 -- 172.21.15.37:0/498244103 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f189c15d360 msgr2=0x7f189c160050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:02.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.713+0000 7f18a2007640 1 --2- 172.21.15.37:0/498244103 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f189c15d360 0x7f189c160050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:02.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.713+0000 7f18a2007640 1 -- 172.21.15.37:0/498244103 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f189c0d1a70 msgr2=0x7f189c158a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:02.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.713+0000 7f18a2007640 1 --2- 172.21.15.37:0/498244103 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f189c0d1a70 0x7f189c158a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:02.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.713+0000 7f18a2007640 1 -- 172.21.15.37:0/498244103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1894009400 con 0x7f189c0cece0 2023-12-11T17:10:02.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.713+0000 7f18a1806640 1 --2- 172.21.15.37:0/498244103 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f189c0d1a70 0x7f189c158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:02.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.713+0000 7f18a2007640 1 --2- 172.21.15.37:0/498244103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f189c0cece0 0x7f189c0ca020 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f188c00c7f0 tx=0x7f188c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:02.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.713+0000 7f189affd640 1 -- 172.21.15.37:0/498244103 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c00a640 con 0x7f189c0cece0 2023-12-11T17:10:02.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.713+0000 7f189affd640 1 -- 172.21.15.37:0/498244103 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f188c00a7c0 con 0x7f189c0cece0 2023-12-11T17:10:02.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.713+0000 7f189affd640 1 -- 172.21.15.37:0/498244103 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f188c00ab70 con 0x7f189c0cece0 2023-12-11T17:10:02.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.713+0000 7f18a3009640 1 -- 172.21.15.37:0/498244103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f189c15e130 con 0x7f189c0cece0 2023-12-11T17:10:02.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.713+0000 7f18a3009640 1 -- 172.21.15.37:0/498244103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f189c0ccac0 con 0x7f189c0cece0 2023-12-11T17:10:02.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.715+0000 7f18a3009640 1 -- 172.21.15.37:0/498244103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f189c0678e0 con 0x7f189c0cece0 2023-12-11T17:10:02.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.716+0000 7f189affd640 1 -- 172.21.15.37:0/498244103 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f188c00acd0 con 0x7f189c0cece0 2023-12-11T17:10:02.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.717+0000 7f189affd640 1 --2- 172.21.15.37:0/498244103 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f188806ae40 0x7f188806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:02.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.717+0000 7f189affd640 1 -- 172.21.15.37:0/498244103 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f188c088e00 con 0x7f189c0cece0 2023-12-11T17:10:02.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.718+0000 7f18a1806640 1 --2- 172.21.15.37:0/498244103 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f188806ae40 0x7f188806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:02.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.719+0000 7f18a1806640 1 --2- 172.21.15.37:0/498244103 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f188806ae40 0x7f188806d300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1890006fd0 tx=0x7f1890008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:02.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.721+0000 7f189affd640 1 -- 172.21.15.37:0/498244103 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f188c053b20 con 0x7f189c0cece0 2023-12-11T17:10:02.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.914+0000 7f18a3009640 1 -- 172.21.15.37:0/498244103 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f189c0b4330 con 0x7f189c0cece0 2023-12-11T17:10:02.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.915+0000 7f189affd640 1 -- 172.21.15.37:0/498244103 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f188c0180a0 con 0x7f189c0cece0 2023-12-11T17:10:02.916 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:10:02.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.917+0000 7f18a3009640 1 -- 172.21.15.37:0/498244103 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f188806ae40 msgr2=0x7f188806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:02.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.917+0000 7f18a3009640 1 --2- 172.21.15.37:0/498244103 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f188806ae40 0x7f188806d300 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f1890006fd0 tx=0x7f1890008040 comp rx=0 tx=0).stop 2023-12-11T17:10:02.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.917+0000 7f18a3009640 1 -- 172.21.15.37:0/498244103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f189c0cece0 msgr2=0x7f189c0ca020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:02.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.917+0000 7f18a3009640 1 --2- 172.21.15.37:0/498244103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f189c0cece0 0x7f189c0ca020 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f188c00c7f0 tx=0x7f188c00ccb0 comp rx=0 tx=0).stop 2023-12-11T17:10:02.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.917+0000 7f18a3009640 1 -- 172.21.15.37:0/498244103 shutdown_connections 2023-12-11T17:10:02.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.917+0000 7f18a3009640 1 --2- 172.21.15.37:0/498244103 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f188806ae40 0x7f188806d300 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:02.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.917+0000 7f18a3009640 1 --2- 172.21.15.37:0/498244103 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f189c0d1a70 0x7f189c158a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:02.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.917+0000 7f18a3009640 1 --2- 172.21.15.37:0/498244103 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f189c15d360 0x7f189c160050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:02.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.917+0000 7f18a3009640 1 --2- 172.21.15.37:0/498244103 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f189c0cece0 0x7f189c0ca020 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:02.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.917+0000 7f18a3009640 1 -- 172.21.15.37:0/498244103 >> 172.21.15.37:0/498244103 conn(0x7f189c09c230 msgr2=0x7f189c0b3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:02.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.918+0000 7f18a3009640 1 -- 172.21.15.37:0/498244103 shutdown_connections 2023-12-11T17:10:02.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:02.918+0000 7f18a3009640 1 -- 172.21.15.37:0/498244103 wait complete. 2023-12-11T17:10:02.939 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T17:10:03.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.174+0000 7f0f7bfff640 1 Processor -- start 2023-12-11T17:10:03.175 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.174+0000 7f0f7bfff640 1 -- start start 2023-12-11T17:10:03.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.176+0000 7f0f7bfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f7c155400 0x7f0f7c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:03.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.176+0000 7f0f7bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0f7c0cf500 0x7f0f7c0ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:03.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.176+0000 7f0f7bfff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f7c15b4a0 con 0x7f0f7c0ce150 2023-12-11T17:10:03.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.176+0000 7f0f7bfff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f7c0adbb0 con 0x7f0f7c0cf500 2023-12-11T17:10:03.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.176+0000 7f0f7bfff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c0ade90 con 0x7f0f7c155400 2023-12-11T17:10:03.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.176+0000 7f0f7b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0f7c0cf500 0x7f0f7c0ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:03.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.176+0000 7f0f7b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0f7c0cf500 0x7f0f7c0ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44470/0 (socket says 172.21.15.37:44470) 2023-12-11T17:10:03.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.176+0000 7f0f7b7fe640 1 -- 172.21.15.37:0/3643208736 learned_addr learned my addr 172.21.15.37:0/3643208736 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:03.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.177+0000 7f0f7affd640 1 --2- 172.21.15.37:0/3643208736 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f7c155400 0x7f0f7c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:03.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.177+0000 7f0f7b7fe640 1 -- 172.21.15.37:0/3643208736 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f7c155400 msgr2=0x7f0f7c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:03.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.177+0000 7f0f7b7fe640 1 --2- 172.21.15.37:0/3643208736 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f7c155400 0x7f0f7c06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:03.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.177+0000 7f0f7b7fe640 1 -- 172.21.15.37:0/3643208736 >> v1:172.21.15.151:6789/0 conn(0x7f0f7c0ce150 legacy=0x7f0f7c0cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:03.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.177+0000 7f0f7b7fe640 1 -- 172.21.15.37:0/3643208736 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f7c0ae170 con 0x7f0f7c0cf500 2023-12-11T17:10:03.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.178+0000 7f0f7b7fe640 1 --2- 172.21.15.37:0/3643208736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f7c0cf500 0x7f0f7c0ce5b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009e80 tx=0x7f0f7402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e836f3203e4f6794 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:03.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.178+0000 7f0f7a7fc640 1 -- 172.21.15.37:0/3643208736 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7402ca50 con 0x7f0f7c0cf500 2023-12-11T17:10:03.179 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.179+0000 7f0f7a7fc640 1 -- 172.21.15.37:0/3643208736 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7402cbb0 con 0x7f0f7c0cf500 2023-12-11T17:10:03.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.179+0000 7f0f7a7fc640 1 -- 172.21.15.37:0/3643208736 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f740343f0 con 0x7f0f7c0cf500 2023-12-11T17:10:03.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.179+0000 7f0f7bfff640 1 -- 172.21.15.37:0/3643208736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f7c0cf500 msgr2=0x7f0f7c0ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:03.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.179+0000 7f0f7bfff640 1 --2- 172.21.15.37:0/3643208736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f7c0cf500 0x7f0f7c0ce5b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009e80 tx=0x7f0f7402beb0 comp rx=0 tx=0).stop 2023-12-11T17:10:03.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.179+0000 7f0f7bfff640 1 -- 172.21.15.37:0/3643208736 shutdown_connections 2023-12-11T17:10:03.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.179+0000 7f0f7bfff640 1 --2- 172.21.15.37:0/3643208736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f7c0cf500 0x7f0f7c0ce5b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:03.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.179+0000 7f0f7bfff640 1 --2- 172.21.15.37:0/3643208736 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f7c155400 0x7f0f7c06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:03.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.179+0000 7f0f7bfff640 1 -- 172.21.15.37:0/3643208736 >> 172.21.15.37:0/3643208736 conn(0x7f0f7c06a640 msgr2=0x7f0f7c06aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:03.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.179+0000 7f0f7bfff640 1 -- 172.21.15.37:0/3643208736 shutdown_connections 2023-12-11T17:10:03.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.179+0000 7f0f7bfff640 1 -- 172.21.15.37:0/3643208736 wait complete. 2023-12-11T17:10:03.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.181+0000 7f0f7bfff640 1 Processor -- start 2023-12-11T17:10:03.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.182+0000 7f0f7bfff640 1 -- start start 2023-12-11T17:10:03.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.183+0000 7f0f7bfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f7c0ce150 0x7f0f7c09b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:03.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.183+0000 7f0f7bfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f7c0cf500 0x7f0f7c1404b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:03.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.183+0000 7f0f7bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f7c155400 0x7f0f7c142460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:03.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.183+0000 7f0f7bfff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c141fd0 con 0x7f0f7c155400 2023-12-11T17:10:03.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.183+0000 7f0f7bfff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c09b760 con 0x7f0f7c0cf500 2023-12-11T17:10:03.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.183+0000 7f0f7bfff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f7c1413c0 con 0x7f0f7c0ce150 2023-12-11T17:10:03.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.183+0000 7f0f7b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f7c155400 0x7f0f7c142460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:03.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.183+0000 7f0f7b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f7c155400 0x7f0f7c142460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44476/0 (socket says 172.21.15.37:44476) 2023-12-11T17:10:03.184 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.183+0000 7f0f7b7fe640 1 -- 172.21.15.37:0/1646300622 learned_addr learned my addr 172.21.15.37:0/1646300622 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:03.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.183+0000 7f0f7affd640 1 --2- 172.21.15.37:0/1646300622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f7c0ce150 0x7f0f7c09b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.183+0000 7f0f73fff640 1 --2- 172.21.15.37:0/1646300622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f7c0cf500 0x7f0f7c1404b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.183+0000 7f0f7b7fe640 1 -- 172.21.15.37:0/1646300622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f7c0ce150 msgr2=0x7f0f7c09b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.183+0000 7f0f7b7fe640 1 --2- 172.21.15.37:0/1646300622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f7c0ce150 0x7f0f7c09b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.183+0000 7f0f7b7fe640 1 -- 172.21.15.37:0/1646300622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f7c0cf500 msgr2=0x7f0f7c1404b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.183+0000 7f0f7b7fe640 1 --2- 172.21.15.37:0/1646300622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f7c0cf500 0x7f0f7c1404b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.183+0000 7f0f7b7fe640 1 -- 172.21.15.37:0/1646300622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f74009b30 con 0x7f0f7c155400 2023-12-11T17:10:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.183+0000 7f0f7affd640 1 --2- 172.21.15.37:0/1646300622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f7c0ce150 0x7f0f7c09b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.184+0000 7f0f7b7fe640 1 --2- 172.21.15.37:0/1646300622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f7c155400 0x7f0f7c142460 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009fa0 tx=0x7f0f74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.184+0000 7f0f737fe640 1 -- 172.21.15.37:0/1646300622 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7403e450 con 0x7f0f7c155400 2023-12-11T17:10:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.184+0000 7f0f737fe640 1 -- 172.21.15.37:0/1646300622 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7403e5b0 con 0x7f0f7c155400 2023-12-11T17:10:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.184+0000 7f0f737fe640 1 -- 172.21.15.37:0/1646300622 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7403e960 con 0x7f0f7c155400 2023-12-11T17:10:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.184+0000 7f0f7bfff640 1 -- 172.21.15.37:0/1646300622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7c1416a0 con 0x7f0f7c155400 2023-12-11T17:10:03.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.184+0000 7f0f7bfff640 1 -- 172.21.15.37:0/1646300622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7c141c60 con 0x7f0f7c155400 2023-12-11T17:10:03.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.186+0000 7f0f7bfff640 1 -- 172.21.15.37:0/1646300622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f7c142180 con 0x7f0f7c155400 2023-12-11T17:10:03.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.187+0000 7f0f737fe640 1 -- 172.21.15.37:0/1646300622 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f0f7403eac0 con 0x7f0f7c155400 2023-12-11T17:10:03.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.188+0000 7f0f737fe640 1 --2- 172.21.15.37:0/1646300622 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f0f5c06ae70 0x7f0f5c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:03.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.188+0000 7f0f737fe640 1 -- 172.21.15.37:0/1646300622 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0f740ac300 con 0x7f0f7c155400 2023-12-11T17:10:03.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.188+0000 7f0f7affd640 1 --2- 172.21.15.37:0/1646300622 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f0f5c06ae70 0x7f0f5c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:03.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.190+0000 7f0f7affd640 1 --2- 172.21.15.37:0/1646300622 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f0f5c06ae70 0x7f0f5c06d330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c006fd0 tx=0x7f0f6c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:03.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.192+0000 7f0f737fe640 1 -- 172.21.15.37:0/1646300622 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f0f7c142180 con 0x7f0f7c155400 2023-12-11T17:10:03.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.386+0000 7f0f7bfff640 1 -- 172.21.15.37:0/1646300622 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f7c074450 con 0x7f0f7c155400 2023-12-11T17:10:03.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.387+0000 7f0f737fe640 1 -- 172.21.15.37:0/1646300622 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f740770c0 con 0x7f0f7c155400 2023-12-11T17:10:03.388 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-11T17:10:03.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.390+0000 7f0f7bfff640 1 -- 172.21.15.37:0/1646300622 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f0f5c06ae70 msgr2=0x7f0f5c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:03.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.390+0000 7f0f7bfff640 1 --2- 172.21.15.37:0/1646300622 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f0f5c06ae70 0x7f0f5c06d330 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c006fd0 tx=0x7f0f6c008040 comp rx=0 tx=0).stop 2023-12-11T17:10:03.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.390+0000 7f0f7bfff640 1 -- 172.21.15.37:0/1646300622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f7c155400 msgr2=0x7f0f7c142460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:03.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.390+0000 7f0f7bfff640 1 --2- 172.21.15.37:0/1646300622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f7c155400 0x7f0f7c142460 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009fa0 tx=0x7f0f74004a40 comp rx=0 tx=0).stop 2023-12-11T17:10:03.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.390+0000 7f0f7bfff640 1 -- 172.21.15.37:0/1646300622 shutdown_connections 2023-12-11T17:10:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.390+0000 7f0f7bfff640 1 --2- 172.21.15.37:0/1646300622 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f0f5c06ae70 0x7f0f5c06d330 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.390+0000 7f0f7bfff640 1 --2- 172.21.15.37:0/1646300622 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0f7c0cf500 0x7f0f7c1404b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.390+0000 7f0f7bfff640 1 --2- 172.21.15.37:0/1646300622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0f7c155400 0x7f0f7c142460 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.390+0000 7f0f7bfff640 1 --2- 172.21.15.37:0/1646300622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f0f7c0ce150 0x7f0f7c09b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.390+0000 7f0f7bfff640 1 -- 172.21.15.37:0/1646300622 >> 172.21.15.37:0/1646300622 conn(0x7f0f7c06a640 msgr2=0x7f0f7c0b29b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.390+0000 7f0f7bfff640 1 -- 172.21.15.37:0/1646300622 shutdown_connections 2023-12-11T17:10:03.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.390+0000 7f0f7bfff640 1 -- 172.21.15.37:0/1646300622 wait complete. 2023-12-11T17:10:03.409 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-11T17:10:03.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.628+0000 7fad79754640 1 Processor -- start 2023-12-11T17:10:03.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.629+0000 7fad79754640 1 -- start start 2023-12-11T17:10:03.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.630+0000 7fad79754640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad74143a40 0x7fad740cb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:03.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.630+0000 7fad79754640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad740ce2b0 0x7fad740cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:03.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.630+0000 7fad79754640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad740cc0a0 con 0x7fad74143660 2023-12-11T17:10:03.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.630+0000 7fad79754640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad740cc310 con 0x7fad740ce2b0 2023-12-11T17:10:03.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.630+0000 7fad79754640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad740cc5f0 con 0x7fad74143a40 2023-12-11T17:10:03.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.630+0000 7fad78f53640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad740ce2b0 0x7fad740cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:03.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.630+0000 7fad78f53640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad740ce2b0 0x7fad740cbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44492/0 (socket says 172.21.15.37:44492) 2023-12-11T17:10:03.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.630+0000 7fad78f53640 1 -- 172.21.15.37:0/4255314795 learned_addr learned my addr 172.21.15.37:0/4255314795 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:03.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.631+0000 7fad737fe640 1 --2- 172.21.15.37:0/4255314795 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad74143a40 0x7fad740cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:03.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.631+0000 7fad78f53640 1 -- 172.21.15.37:0/4255314795 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad74143a40 msgr2=0x7fad740cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:03.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.631+0000 7fad78f53640 1 --2- 172.21.15.37:0/4255314795 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad74143a40 0x7fad740cb620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:03.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.631+0000 7fad78f53640 1 -- 172.21.15.37:0/4255314795 >> v1:172.21.15.151:6789/0 conn(0x7fad74143660 legacy=0x7fad740cdba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:03.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.631+0000 7fad78f53640 1 -- 172.21.15.37:0/4255314795 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad74070180 con 0x7fad740ce2b0 2023-12-11T17:10:03.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.632+0000 7fad78f53640 1 --2- 172.21.15.37:0/4255314795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad740ce2b0 0x7fad740cbb60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009e50 tx=0x7fad6c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e99c298f706c33be server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:03.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.632+0000 7fad72ffd640 1 -- 172.21.15.37:0/4255314795 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c02ca70 con 0x7fad740ce2b0 2023-12-11T17:10:03.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.632+0000 7fad72ffd640 1 -- 172.21.15.37:0/4255314795 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6c02cbd0 con 0x7fad740ce2b0 2023-12-11T17:10:03.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.632+0000 7fad72ffd640 1 -- 172.21.15.37:0/4255314795 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6c0343f0 con 0x7fad740ce2b0 2023-12-11T17:10:03.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.633+0000 7fad79754640 1 -- 172.21.15.37:0/4255314795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad740ce2b0 msgr2=0x7fad740cbb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:03.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.633+0000 7fad79754640 1 --2- 172.21.15.37:0/4255314795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad740ce2b0 0x7fad740cbb60 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fad6c009e50 tx=0x7fad6c02bed0 comp rx=0 tx=0).stop 2023-12-11T17:10:03.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.633+0000 7fad79754640 1 -- 172.21.15.37:0/4255314795 shutdown_connections 2023-12-11T17:10:03.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.633+0000 7fad79754640 1 --2- 172.21.15.37:0/4255314795 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad740ce2b0 0x7fad740cbb60 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:03.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.633+0000 7fad79754640 1 --2- 172.21.15.37:0/4255314795 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad74143a40 0x7fad740cb620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:03.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.633+0000 7fad79754640 1 -- 172.21.15.37:0/4255314795 >> 172.21.15.37:0/4255314795 conn(0x7fad740b0940 msgr2=0x7fad740b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:03.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.633+0000 7fad79754640 1 -- 172.21.15.37:0/4255314795 shutdown_connections 2023-12-11T17:10:03.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.633+0000 7fad79754640 1 -- 172.21.15.37:0/4255314795 wait complete. 2023-12-11T17:10:03.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.635+0000 7fad79754640 1 Processor -- start 2023-12-11T17:10:03.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.635+0000 7fad79754640 1 -- start start 2023-12-11T17:10:03.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.636+0000 7fad79754640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad740ce2b0 0x7fad7409a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:03.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.636+0000 7fad79754640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad74143660 0x7fad7409b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:03.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.636+0000 7fad79754640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad74143a40 0x7fad7413db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:03.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.636+0000 7fad79754640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad741ee9c0 con 0x7fad740ce2b0 2023-12-11T17:10:03.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.636+0000 7fad79754640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad741f2390 con 0x7fad74143660 2023-12-11T17:10:03.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.636+0000 7fad79754640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad741f2670 con 0x7fad74143a40 2023-12-11T17:10:03.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.636+0000 7fad73fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad740ce2b0 0x7fad7409a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:03.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.636+0000 7fad73fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad740ce2b0 0x7fad7409a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44500/0 (socket says 172.21.15.37:44500) 2023-12-11T17:10:03.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.636+0000 7fad73fff640 1 -- 172.21.15.37:0/3543354250 learned_addr learned my addr 172.21.15.37:0/3543354250 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:03.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.637+0000 7fad73fff640 1 -- 172.21.15.37:0/3543354250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad74143a40 msgr2=0x7fad7413db40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:03.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.637+0000 7fad78f53640 1 --2- 172.21.15.37:0/3543354250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad74143a40 0x7fad7413db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:03.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.637+0000 7fad73fff640 1 --2- 172.21.15.37:0/3543354250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad74143a40 0x7fad7413db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:03.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.637+0000 7fad73fff640 1 -- 172.21.15.37:0/3543354250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad74143660 msgr2=0x7fad7409b600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:03.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.637+0000 7fad73fff640 1 --2- 172.21.15.37:0/3543354250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad74143660 0x7fad7409b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:03.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.637+0000 7fad73fff640 1 -- 172.21.15.37:0/3543354250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c009b30 con 0x7fad740ce2b0 2023-12-11T17:10:03.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.637+0000 7fad73fff640 1 --2- 172.21.15.37:0/3543354250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad740ce2b0 0x7fad7409a8b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fad6400c430 tx=0x7fad6400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:03.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.638+0000 7fad70ff9640 1 -- 172.21.15.37:0/3543354250 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad64011790 con 0x7fad740ce2b0 2023-12-11T17:10:03.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.638+0000 7fad70ff9640 1 -- 172.21.15.37:0/3543354250 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad640118f0 con 0x7fad740ce2b0 2023-12-11T17:10:03.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.638+0000 7fad70ff9640 1 -- 172.21.15.37:0/3543354250 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad64011ce0 con 0x7fad740ce2b0 2023-12-11T17:10:03.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.638+0000 7fad79754640 1 -- 172.21.15.37:0/3543354250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad741f2950 con 0x7fad740ce2b0 2023-12-11T17:10:03.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.638+0000 7fad79754640 1 -- 172.21.15.37:0/3543354250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7409bb40 con 0x7fad740ce2b0 2023-12-11T17:10:03.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.639+0000 7fad79754640 1 -- 172.21.15.37:0/3543354250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad74067910 con 0x7fad740ce2b0 2023-12-11T17:10:03.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.640+0000 7fad70ff9640 1 -- 172.21.15.37:0/3543354250 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad6401c460 con 0x7fad740ce2b0 2023-12-11T17:10:03.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.641+0000 7fad70ff9640 1 --2- 172.21.15.37:0/3543354250 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fad6006ae40 0x7fad6006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:03.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.641+0000 7fad70ff9640 1 -- 172.21.15.37:0/3543354250 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fad64089830 con 0x7fad740ce2b0 2023-12-11T17:10:03.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.641+0000 7fad737fe640 1 --2- 172.21.15.37:0/3543354250 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fad6006ae40 0x7fad6006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:03.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.643+0000 7fad737fe640 1 --2- 172.21.15.37:0/3543354250 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fad6006ae40 0x7fad6006d300 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fad68006fd0 tx=0x7fad68008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:03.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.645+0000 7fad70ff9640 1 -- 172.21.15.37:0/3543354250 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fad64054680 con 0x7fad740ce2b0 2023-12-11T17:10:03.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.837+0000 7fad79754640 1 -- 172.21.15.37:0/3543354250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fad740b3260 con 0x7fad740ce2b0 2023-12-11T17:10:03.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.838+0000 7fad70ff9640 1 -- 172.21.15.37:0/3543354250 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fad64057ca0 con 0x7fad740ce2b0 2023-12-11T17:10:03.839 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:10:03.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.840+0000 7fad79754640 1 -- 172.21.15.37:0/3543354250 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fad6006ae40 msgr2=0x7fad6006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:03.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.840+0000 7fad79754640 1 --2- 172.21.15.37:0/3543354250 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fad6006ae40 0x7fad6006d300 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fad68006fd0 tx=0x7fad68008040 comp rx=0 tx=0).stop 2023-12-11T17:10:03.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.840+0000 7fad79754640 1 -- 172.21.15.37:0/3543354250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad740ce2b0 msgr2=0x7fad7409a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:03.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.840+0000 7fad79754640 1 --2- 172.21.15.37:0/3543354250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad740ce2b0 0x7fad7409a8b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fad6400c430 tx=0x7fad6400c8f0 comp rx=0 tx=0).stop 2023-12-11T17:10:03.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.841+0000 7fad79754640 1 -- 172.21.15.37:0/3543354250 shutdown_connections 2023-12-11T17:10:03.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.841+0000 7fad79754640 1 --2- 172.21.15.37:0/3543354250 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fad6006ae40 0x7fad6006d300 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:03.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.841+0000 7fad79754640 1 --2- 172.21.15.37:0/3543354250 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad74143660 0x7fad7409b600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:03.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.841+0000 7fad79754640 1 --2- 172.21.15.37:0/3543354250 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad74143a40 0x7fad7413db40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:03.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.841+0000 7fad79754640 1 --2- 172.21.15.37:0/3543354250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad740ce2b0 0x7fad7409a8b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:03.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.841+0000 7fad79754640 1 -- 172.21.15.37:0/3543354250 >> 172.21.15.37:0/3543354250 conn(0x7fad740b0940 msgr2=0x7fad7406c5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:03.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.841+0000 7fad79754640 1 -- 172.21.15.37:0/3543354250 shutdown_connections 2023-12-11T17:10:03.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:03.841+0000 7fad79754640 1 -- 172.21.15.37:0/3543354250 wait complete. 2023-12-11T17:10:03.863 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-11T17:10:04.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.087+0000 7fbbd6ee1640 1 Processor -- start 2023-12-11T17:10:04.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.087+0000 7fbbd6ee1640 1 -- start start 2023-12-11T17:10:04.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.089+0000 7fbbd6ee1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbbd015e5d0 0x7fbbd006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:04.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.089+0000 7fbbd6ee1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd0071f90 con 0x7fbbd00ae200 2023-12-11T17:10:04.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.089+0000 7fbbd6ee1640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd0072270 con 0x7fbbd0071260 2023-12-11T17:10:04.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.089+0000 7fbbd6ee1640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd0070070 con 0x7fbbd015e5d0 2023-12-11T17:10:04.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.089+0000 7fbbd5edf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbbd015e5d0 0x7fbbd006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:04.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.089+0000 7fbbd5edf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbbd015e5d0 0x7fbbd006bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44506/0 (socket says 172.21.15.37:44506) 2023-12-11T17:10:04.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.089+0000 7fbbd5edf640 1 -- 172.21.15.37:0/3318006028 learned_addr learned my addr 172.21.15.37:0/3318006028 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:04.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.090+0000 7fbbd5edf640 1 -- 172.21.15.37:0/3318006028 >> v1:172.21.15.151:6789/0 conn(0x7fbbd0071260 legacy=0x7fbbd00cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:04.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.090+0000 7fbbd5edf640 1 -- 172.21.15.37:0/3318006028 >> v1:172.21.15.37:6789/0 conn(0x7fbbd00ae200 legacy=0x7fbbd0070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:04.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.090+0000 7fbbd5edf640 1 -- 172.21.15.37:0/3318006028 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd0070350 con 0x7fbbd015e5d0 2023-12-11T17:10:04.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.091+0000 7fbbd5edf640 1 --2- 172.21.15.37:0/3318006028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd015e5d0 0x7fbbd006bdf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc009870 tx=0x7fbbcc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dda118f40059865b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:04.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.091+0000 7fbbd4edd640 1 -- 172.21.15.37:0/3318006028 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc031870 con 0x7fbbd015e5d0 2023-12-11T17:10:04.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.091+0000 7fbbd4edd640 1 -- 172.21.15.37:0/3318006028 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbcc0319d0 con 0x7fbbd015e5d0 2023-12-11T17:10:04.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.091+0000 7fbbd4edd640 1 -- 172.21.15.37:0/3318006028 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbcc031d60 con 0x7fbbd015e5d0 2023-12-11T17:10:04.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.092+0000 7fbbd6ee1640 1 -- 172.21.15.37:0/3318006028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd015e5d0 msgr2=0x7fbbd006bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:04.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.092+0000 7fbbd6ee1640 1 --2- 172.21.15.37:0/3318006028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd015e5d0 0x7fbbd006bdf0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc009870 tx=0x7fbbcc02b910 comp rx=0 tx=0).stop 2023-12-11T17:10:04.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.092+0000 7fbbd6ee1640 1 -- 172.21.15.37:0/3318006028 shutdown_connections 2023-12-11T17:10:04.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.092+0000 7fbbd6ee1640 1 --2- 172.21.15.37:0/3318006028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd015e5d0 0x7fbbd006bdf0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:04.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.092+0000 7fbbd6ee1640 1 -- 172.21.15.37:0/3318006028 >> 172.21.15.37:0/3318006028 conn(0x7fbbd00b0860 msgr2=0x7fbbd00b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:04.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.092+0000 7fbbd6ee1640 1 -- 172.21.15.37:0/3318006028 shutdown_connections 2023-12-11T17:10:04.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.092+0000 7fbbd6ee1640 1 -- 172.21.15.37:0/3318006028 wait complete. 2023-12-11T17:10:04.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.094+0000 7fbbd6ee1640 1 Processor -- start 2023-12-11T17:10:04.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.094+0000 7fbbd6ee1640 1 -- start start 2023-12-11T17:10:04.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.095+0000 7fbbd6ee1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0071260 0x7fbbd014c640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:04.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.095+0000 7fbbd6ee1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd00ae200 0x7fbbd013e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:04.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.095+0000 7fbbd6ee1640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbd015e5d0 0x7fbbd00b0c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:04.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.095+0000 7fbbd6ee1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd014db30 con 0x7fbbd00ae200 2023-12-11T17:10:04.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.095+0000 7fbbd6ee1640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd014cf20 con 0x7fbbd0071260 2023-12-11T17:10:04.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.095+0000 7fbbd6ee1640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd014d200 con 0x7fbbd015e5d0 2023-12-11T17:10:04.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.095+0000 7fbbd56de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd00ae200 0x7fbbd013e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:04.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.095+0000 7fbbd56de640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd00ae200 0x7fbbd013e410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44516/0 (socket says 172.21.15.37:44516) 2023-12-11T17:10:04.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.095+0000 7fbbd56de640 1 -- 172.21.15.37:0/3789747235 learned_addr learned my addr 172.21.15.37:0/3789747235 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:04.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.096+0000 7fbbd5edf640 1 --2- 172.21.15.37:0/3789747235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0071260 0x7fbbd014c640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:04.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.096+0000 7fbbd66e0640 1 --2- 172.21.15.37:0/3789747235 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbd015e5d0 0x7fbbd00b0c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:04.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.096+0000 7fbbd56de640 1 -- 172.21.15.37:0/3789747235 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbd015e5d0 msgr2=0x7fbbd00b0c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:04.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.096+0000 7fbbd56de640 1 --2- 172.21.15.37:0/3789747235 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbd015e5d0 0x7fbbd00b0c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:04.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.096+0000 7fbbd56de640 1 -- 172.21.15.37:0/3789747235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0071260 msgr2=0x7fbbd014c640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:04.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.096+0000 7fbbd56de640 1 --2- 172.21.15.37:0/3789747235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0071260 0x7fbbd014c640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:04.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.096+0000 7fbbd56de640 1 -- 172.21.15.37:0/3789747235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbcc0094d0 con 0x7fbbd00ae200 2023-12-11T17:10:04.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.096+0000 7fbbd56de640 1 --2- 172.21.15.37:0/3789747235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd00ae200 0x7fbbd013e410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000c450 tx=0x7fbbc000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:04.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.097+0000 7fbbc67fc640 1 -- 172.21.15.37:0/3789747235 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc00052d0 con 0x7fbbd00ae200 2023-12-11T17:10:04.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.097+0000 7fbbc67fc640 1 -- 172.21.15.37:0/3789747235 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc0005430 con 0x7fbbd00ae200 2023-12-11T17:10:04.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.097+0000 7fbbd6ee1640 1 -- 172.21.15.37:0/3789747235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbd014d4e0 con 0x7fbbd00ae200 2023-12-11T17:10:04.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.097+0000 7fbbc67fc640 1 -- 172.21.15.37:0/3789747235 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbc0012870 con 0x7fbbd00ae200 2023-12-11T17:10:04.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.097+0000 7fbbd6ee1640 1 -- 172.21.15.37:0/3789747235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd014cb80 con 0x7fbbd00ae200 2023-12-11T17:10:04.099 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.098+0000 7fbbd6ee1640 1 -- 172.21.15.37:0/3789747235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd014dce0 con 0x7fbbd00ae200 2023-12-11T17:10:04.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.100+0000 7fbbc67fc640 1 -- 172.21.15.37:0/3789747235 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbbc00129d0 con 0x7fbbd00ae200 2023-12-11T17:10:04.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.100+0000 7fbbc67fc640 1 --2- 172.21.15.37:0/3789747235 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbbb406ae40 0x7fbbb406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:04.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.101+0000 7fbbc67fc640 1 -- 172.21.15.37:0/3789747235 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbbc00894d0 con 0x7fbbd00ae200 2023-12-11T17:10:04.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.101+0000 7fbbd5edf640 1 --2- 172.21.15.37:0/3789747235 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbbb406ae40 0x7fbbb406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:04.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.102+0000 7fbbd5edf640 1 --2- 172.21.15.37:0/3789747235 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbbb406ae40 0x7fbbb406d300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc036000 tx=0x7fbbcc03c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:04.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.105+0000 7fbbc67fc640 1 -- 172.21.15.37:0/3789747235 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbbd014dce0 con 0x7fbbd00ae200 2023-12-11T17:10:04.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.313+0000 7fbbd6ee1640 1 -- 172.21.15.37:0/3789747235 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbbd0074450 con 0x7fbbd00ae200 2023-12-11T17:10:04.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.314+0000 7fbbc67fc640 1 -- 172.21.15.37:0/3789747235 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v25) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbbc00541f0 con 0x7fbbd00ae200 2023-12-11T17:10:04.315 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-12-11T17:10:04.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.316+0000 7fbbd6ee1640 1 -- 172.21.15.37:0/3789747235 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbbb406ae40 msgr2=0x7fbbb406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:04.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.316+0000 7fbbd6ee1640 1 --2- 172.21.15.37:0/3789747235 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbbb406ae40 0x7fbbb406d300 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fbbcc036000 tx=0x7fbbcc03c040 comp rx=0 tx=0).stop 2023-12-11T17:10:04.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.316+0000 7fbbd6ee1640 1 -- 172.21.15.37:0/3789747235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd00ae200 msgr2=0x7fbbd013e410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:04.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.316+0000 7fbbd6ee1640 1 --2- 172.21.15.37:0/3789747235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd00ae200 0x7fbbd013e410 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fbbc000c450 tx=0x7fbbc000c910 comp rx=0 tx=0).stop 2023-12-11T17:10:04.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.317+0000 7fbbd6ee1640 1 -- 172.21.15.37:0/3789747235 shutdown_connections 2023-12-11T17:10:04.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.317+0000 7fbbd6ee1640 1 --2- 172.21.15.37:0/3789747235 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbbb406ae40 0x7fbbb406d300 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:04.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.317+0000 7fbbd6ee1640 1 --2- 172.21.15.37:0/3789747235 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbbd015e5d0 0x7fbbd00b0c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:04.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.317+0000 7fbbd6ee1640 1 --2- 172.21.15.37:0/3789747235 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbbd00ae200 0x7fbbd013e410 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:04.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.317+0000 7fbbd6ee1640 1 --2- 172.21.15.37:0/3789747235 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbbd0071260 0x7fbbd014c640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:04.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.317+0000 7fbbd6ee1640 1 -- 172.21.15.37:0/3789747235 >> 172.21.15.37:0/3789747235 conn(0x7fbbd00b0860 msgr2=0x7fbbd006cb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:04.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.317+0000 7fbbd6ee1640 1 -- 172.21.15.37:0/3789747235 shutdown_connections 2023-12-11T17:10:04.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:04.317+0000 7fbbd6ee1640 1 -- 172.21.15.37:0/3789747235 wait complete. 2023-12-11T17:10:04.339 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi037.front.sepia.ceph.com... 2023-12-11T17:10:04.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:04.339 DEBUG:teuthology.orchestra.run.smithi037:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2023-12-11T17:10:04.435 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi037.stderr:ceph-fuse[94431]: fuse finished with error 0 and tester_r 0 2023-12-11T17:10:04.442 INFO:teuthology.orchestra.run:waiting for 300 2023-12-11T17:10:09.918 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:10:09.928 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:10:10.544 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-12-11T17:10:10.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:10.544 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2023-12-11T17:10:10.617 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:10:10.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.852+0000 7fbf34932640 1 Processor -- start 2023-12-11T17:10:10.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.852+0000 7fbf34932640 1 -- start start 2023-12-11T17:10:10.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.854+0000 7fbf34932640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbf3015e5d0 0x7fbf3006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:10.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.854+0000 7fbf34932640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf300ae200 0x7fbf30070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.854+0000 7fbf34932640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbf3006c330 0x7fbf30071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.854+0000 7fbf34932640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf30071f90 con 0x7fbf3006c330 2023-12-11T17:10:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.854+0000 7fbf34932640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf30072270 con 0x7fbf3015e5d0 2023-12-11T17:10:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.854+0000 7fbf34932640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf30070070 con 0x7fbf300ae200 2023-12-11T17:10:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.855+0000 7fbf2f59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbf3006c330 0x7fbf30071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.855+0000 7fbf2f59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbf3006c330 0x7fbf30071090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46410/0 (socket says 172.21.15.37:46410) 2023-12-11T17:10:10.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.855+0000 7fbf2f59e640 1 -- 172.21.15.37:0/2285414929 learned_addr learned my addr 172.21.15.37:0/2285414929 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:10.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.855+0000 7fbf27fff640 1 --2- 172.21.15.37:0/2285414929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf300ae200 0x7fbf30070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:10.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.855+0000 7fbf2ed9d640 1 --2- 172.21.15.37:0/2285414929 >> v2:172.21.15.151:3300/0 conn(0x7fbf3015e5d0 0x7fbf3006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:10.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.855+0000 7fbf2f59e640 1 -- 172.21.15.37:0/2285414929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf300ae200 msgr2=0x7fbf30070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:10.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.855+0000 7fbf2f59e640 1 --2- 172.21.15.37:0/2285414929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf300ae200 0x7fbf30070b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:10.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.855+0000 7fbf2f59e640 1 -- 172.21.15.37:0/2285414929 >> v2:172.21.15.151:3300/0 conn(0x7fbf3015e5d0 msgr2=0x7fbf3006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:10.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.855+0000 7fbf2f59e640 1 --2- 172.21.15.37:0/2285414929 >> v2:172.21.15.151:3300/0 conn(0x7fbf3015e5d0 0x7fbf3006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:10.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.855+0000 7fbf2f59e640 1 -- 172.21.15.37:0/2285414929 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf30070350 con 0x7fbf3006c330 2023-12-11T17:10:10.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.855+0000 7fbf27fff640 1 --2- 172.21.15.37:0/2285414929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf300ae200 0x7fbf30070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:10.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.855+0000 7fbf2ed9d640 1 --2- 172.21.15.37:0/2285414929 >> v2:172.21.15.151:3300/0 conn(0x7fbf3015e5d0 0x7fbf3006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:10.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.856+0000 7fbf2f59e640 1 --2- 172.21.15.37:0/2285414929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf3006c330 0x7fbf30071090 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbf3006bb50 tx=0x7fbf2802bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d04b7ea2d7a36a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:10.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.857+0000 7fbf2e59c640 1 -- 172.21.15.37:0/2285414929 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2802c960 con 0x7fbf3006c330 2023-12-11T17:10:10.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.857+0000 7fbf2e59c640 1 -- 172.21.15.37:0/2285414929 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2802cac0 con 0x7fbf3006c330 2023-12-11T17:10:10.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.857+0000 7fbf2e59c640 1 -- 172.21.15.37:0/2285414929 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2802ce50 con 0x7fbf3006c330 2023-12-11T17:10:10.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.857+0000 7fbf34932640 1 -- 172.21.15.37:0/2285414929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf3006c330 msgr2=0x7fbf30071090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:10.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.857+0000 7fbf34932640 1 --2- 172.21.15.37:0/2285414929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf3006c330 0x7fbf30071090 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fbf3006bb50 tx=0x7fbf2802bdc0 comp rx=0 tx=0).stop 2023-12-11T17:10:10.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.858+0000 7fbf34932640 1 -- 172.21.15.37:0/2285414929 shutdown_connections 2023-12-11T17:10:10.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.858+0000 7fbf34932640 1 --2- 172.21.15.37:0/2285414929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf3006c330 0x7fbf30071090 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:10.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.858+0000 7fbf34932640 1 --2- 172.21.15.37:0/2285414929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf300ae200 0x7fbf30070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:10.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.858+0000 7fbf34932640 1 --2- 172.21.15.37:0/2285414929 >> v2:172.21.15.151:3300/0 conn(0x7fbf3015e5d0 0x7fbf3006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:10.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.858+0000 7fbf34932640 1 -- 172.21.15.37:0/2285414929 >> 172.21.15.37:0/2285414929 conn(0x7fbf300b0860 msgr2=0x7fbf300b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:10.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.858+0000 7fbf34932640 1 -- 172.21.15.37:0/2285414929 shutdown_connections 2023-12-11T17:10:10.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.858+0000 7fbf34932640 1 -- 172.21.15.37:0/2285414929 wait complete. 2023-12-11T17:10:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.860+0000 7fbf34932640 1 Processor -- start 2023-12-11T17:10:10.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.860+0000 7fbf34932640 1 -- start start 2023-12-11T17:10:10.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.862+0000 7fbf34932640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf3006c330 0x7fbf300c9810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:10.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.862+0000 7fbf34932640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf300ae200 0x7fbf30159720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:10.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.862+0000 7fbf34932640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf3015e5d0 0x7fbf300b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:10.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.862+0000 7fbf34932640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf300cad60 con 0x7fbf3015e5d0 2023-12-11T17:10:10.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.862+0000 7fbf34932640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf300c9d50 con 0x7fbf300ae200 2023-12-11T17:10:10.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.862+0000 7fbf34932640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf30159c60 con 0x7fbf3006c330 2023-12-11T17:10:10.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.862+0000 7fbf2f59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf3015e5d0 0x7fbf300b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:10.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.862+0000 7fbf2f59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf3015e5d0 0x7fbf300b1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46422/0 (socket says 172.21.15.37:46422) 2023-12-11T17:10:10.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.862+0000 7fbf2f59e640 1 -- 172.21.15.37:0/2865791592 learned_addr learned my addr 172.21.15.37:0/2865791592 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:10.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.862+0000 7fbf2ed9d640 1 --2- 172.21.15.37:0/2865791592 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf3006c330 0x7fbf300c9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:10.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.862+0000 7fbf27fff640 1 --2- 172.21.15.37:0/2865791592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf300ae200 0x7fbf30159720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:10.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.863+0000 7fbf2f59e640 1 -- 172.21.15.37:0/2865791592 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf3006c330 msgr2=0x7fbf300c9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:10.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.863+0000 7fbf2f59e640 1 --2- 172.21.15.37:0/2865791592 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf3006c330 0x7fbf300c9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:10.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.863+0000 7fbf2f59e640 1 -- 172.21.15.37:0/2865791592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf300ae200 msgr2=0x7fbf30159720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:10.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.863+0000 7fbf2f59e640 1 --2- 172.21.15.37:0/2865791592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf300ae200 0x7fbf30159720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:10.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.863+0000 7fbf2f59e640 1 -- 172.21.15.37:0/2865791592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf28009b30 con 0x7fbf3015e5d0 2023-12-11T17:10:10.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.863+0000 7fbf2ed9d640 1 --2- 172.21.15.37:0/2865791592 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf3006c330 0x7fbf300c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:10:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.863+0000 7fbf2f59e640 1 --2- 172.21.15.37:0/2865791592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf3015e5d0 0x7fbf300b1c60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbf28036040 tx=0x7fbf28004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.863+0000 7fbf277fe640 1 -- 172.21.15.37:0/2865791592 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2803e450 con 0x7fbf3015e5d0 2023-12-11T17:10:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.863+0000 7fbf277fe640 1 -- 172.21.15.37:0/2865791592 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf2803e5d0 con 0x7fbf3015e5d0 2023-12-11T17:10:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.863+0000 7fbf277fe640 1 -- 172.21.15.37:0/2865791592 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf2803e980 con 0x7fbf3015e5d0 2023-12-11T17:10:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.863+0000 7fbf34932640 1 -- 172.21.15.37:0/2865791592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf301f7090 con 0x7fbf3015e5d0 2023-12-11T17:10:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.864+0000 7fbf34932640 1 -- 172.21.15.37:0/2865791592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf301f67f0 con 0x7fbf3015e5d0 2023-12-11T17:10:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.865+0000 7fbf34932640 1 -- 172.21.15.37:0/2865791592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf300c7f50 con 0x7fbf3015e5d0 2023-12-11T17:10:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.866+0000 7fbf277fe640 1 -- 172.21.15.37:0/2865791592 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbf2803eae0 con 0x7fbf3015e5d0 2023-12-11T17:10:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.867+0000 7fbf277fe640 1 --2- 172.21.15.37:0/2865791592 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbf1006ae40 0x7fbf1006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.867+0000 7fbf277fe640 1 -- 172.21.15.37:0/2865791592 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbf280ac880 con 0x7fbf3015e5d0 2023-12-11T17:10:10.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.867+0000 7fbf2ed9d640 1 --2- 172.21.15.37:0/2865791592 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbf1006ae40 0x7fbf1006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:10.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.868+0000 7fbf2ed9d640 1 --2- 172.21.15.37:0/2865791592 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbf1006ae40 0x7fbf1006d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000a910 tx=0x7fbf20008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:10.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:10.872+0000 7fbf277fe640 1 -- 172.21.15.37:0/2865791592 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbf300c7f50 con 0x7fbf3015e5d0 2023-12-11T17:10:11.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.070+0000 7fbf34932640 1 -- 172.21.15.37:0/2865791592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbf300c7f50 con 0x7fbf3015e5d0 2023-12-11T17:10:11.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.072+0000 7fbf277fe640 1 -- 172.21.15.37:0/2865791592 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fbf300c7f50 con 0x7fbf3015e5d0 2023-12-11T17:10:11.073 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:11.073 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:09:49.715938+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:10:11.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.076+0000 7fbf34932640 1 -- 172.21.15.37:0/2865791592 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbf1006ae40 msgr2=0x7fbf1006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:11.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.076+0000 7fbf34932640 1 --2- 172.21.15.37:0/2865791592 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbf1006ae40 0x7fbf1006d300 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbf2000a910 tx=0x7fbf20008040 comp rx=0 tx=0).stop 2023-12-11T17:10:11.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.076+0000 7fbf34932640 1 -- 172.21.15.37:0/2865791592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf3015e5d0 msgr2=0x7fbf300b1c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:11.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.076+0000 7fbf34932640 1 --2- 172.21.15.37:0/2865791592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf3015e5d0 0x7fbf300b1c60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fbf28036040 tx=0x7fbf28004a40 comp rx=0 tx=0).stop 2023-12-11T17:10:11.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.076+0000 7fbf34932640 1 -- 172.21.15.37:0/2865791592 shutdown_connections 2023-12-11T17:10:11.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.076+0000 7fbf34932640 1 --2- 172.21.15.37:0/2865791592 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbf1006ae40 0x7fbf1006d300 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:11.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.076+0000 7fbf34932640 1 --2- 172.21.15.37:0/2865791592 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf300ae200 0x7fbf30159720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:11.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.076+0000 7fbf34932640 1 --2- 172.21.15.37:0/2865791592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf3015e5d0 0x7fbf300b1c60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:11.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.076+0000 7fbf34932640 1 --2- 172.21.15.37:0/2865791592 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf3006c330 0x7fbf300c9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:11.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.076+0000 7fbf34932640 1 -- 172.21.15.37:0/2865791592 >> 172.21.15.37:0/2865791592 conn(0x7fbf300b0860 msgr2=0x7fbf3015d850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:11.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.077+0000 7fbf34932640 1 -- 172.21.15.37:0/2865791592 shutdown_connections 2023-12-11T17:10:11.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.077+0000 7fbf34932640 1 -- 172.21.15.37:0/2865791592 wait complete. 2023-12-11T17:10:11.096 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:10:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.320+0000 7f6c5f59e640 1 Processor -- start 2023-12-11T17:10:11.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.320+0000 7f6c5f59e640 1 -- start start 2023-12-11T17:10:11.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.322+0000 7f6c5f59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c600d13c0 0x7f6c600ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:11.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.322+0000 7f6c5f59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6c600d0d70 0x7f6c600d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:11.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.322+0000 7f6c5f59e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c600b2280 con 0x7f6c600cf6a0 2023-12-11T17:10:11.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.322+0000 7f6c5f59e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c600cee70 con 0x7f6c600d0d70 2023-12-11T17:10:11.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.322+0000 7f6c5f59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c600d1190 con 0x7f6c600d13c0 2023-12-11T17:10:11.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.322+0000 7f6c5dd9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6c600d0d70 0x7f6c600d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:11.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.322+0000 7f6c5dd9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6c600d0d70 0x7f6c600d17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46430/0 (socket says 172.21.15.37:46430) 2023-12-11T17:10:11.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.322+0000 7f6c5dd9b640 1 -- 172.21.15.37:0/185640420 learned_addr learned my addr 172.21.15.37:0/185640420 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:11.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.322+0000 7f6c5dd9b640 1 -- 172.21.15.37:0/185640420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c600d13c0 msgr2=0x7f6c600ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:11.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.322+0000 7f6c5dd9b640 1 --2- 172.21.15.37:0/185640420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c600d13c0 0x7f6c600ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:11.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.322+0000 7f6c5dd9b640 1 -- 172.21.15.37:0/185640420 >> v1:172.21.15.151:6789/0 conn(0x7f6c600cf6a0 legacy=0x7f6c600cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:11.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.322+0000 7f6c5dd9b640 1 -- 172.21.15.37:0/185640420 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c600d1ce0 con 0x7f6c600d0d70 2023-12-11T17:10:11.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.324+0000 7f6c5dd9b640 1 --2- 172.21.15.37:0/185640420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c600d0d70 0x7f6c600d17a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6c54009870 tx=0x7f6c5402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d6376f8c4a2e34f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.324+0000 7f6c5d59a640 1 -- 172.21.15.37:0/185640420 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c540317c0 con 0x7f6c600d0d70 2023-12-11T17:10:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.324+0000 7f6c5d59a640 1 -- 172.21.15.37:0/185640420 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c54031920 con 0x7f6c600d0d70 2023-12-11T17:10:11.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.324+0000 7f6c5d59a640 1 -- 172.21.15.37:0/185640420 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c54031cb0 con 0x7f6c600d0d70 2023-12-11T17:10:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.325+0000 7f6c5f59e640 1 -- 172.21.15.37:0/185640420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c600d0d70 msgr2=0x7f6c600d17a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.325+0000 7f6c5f59e640 1 --2- 172.21.15.37:0/185640420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c600d0d70 0x7f6c600d17a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6c54009870 tx=0x7f6c5402b860 comp rx=0 tx=0).stop 2023-12-11T17:10:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.325+0000 7f6c5f59e640 1 -- 172.21.15.37:0/185640420 shutdown_connections 2023-12-11T17:10:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.325+0000 7f6c5f59e640 1 --2- 172.21.15.37:0/185640420 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c600d0d70 0x7f6c600d17a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.325+0000 7f6c5f59e640 1 --2- 172.21.15.37:0/185640420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c600d13c0 0x7f6c600ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.325+0000 7f6c5f59e640 1 -- 172.21.15.37:0/185640420 >> 172.21.15.37:0/185640420 conn(0x7f6c6009c260 msgr2=0x7f6c600d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:11.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.325+0000 7f6c5f59e640 1 -- 172.21.15.37:0/185640420 shutdown_connections 2023-12-11T17:10:11.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.325+0000 7f6c5f59e640 1 -- 172.21.15.37:0/185640420 wait complete. 2023-12-11T17:10:11.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.327+0000 7f6c5f59e640 1 Processor -- start 2023-12-11T17:10:11.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.327+0000 7f6c5f59e640 1 -- start start 2023-12-11T17:10:11.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.328+0000 7f6c5f59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c600cf6a0 0x7f6c6009e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:11.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.328+0000 7f6c5f59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c600d0d70 0x7f6c60148d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:11.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.329+0000 7f6c5f59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c600d13c0 0x7f6c600c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:11.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.329+0000 7f6c5f59e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c600b5260 con 0x7f6c600d13c0 2023-12-11T17:10:11.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.329+0000 7f6c5f59e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c601494d0 con 0x7f6c600cf6a0 2023-12-11T17:10:11.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.329+0000 7f6c5f59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c60149250 con 0x7f6c600d0d70 2023-12-11T17:10:11.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.329+0000 7f6c5ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c600d13c0 0x7f6c600c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:11.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.329+0000 7f6c5ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c600d13c0 0x7f6c600c9350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46440/0 (socket says 172.21.15.37:46440) 2023-12-11T17:10:11.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.329+0000 7f6c5ed9d640 1 -- 172.21.15.37:0/3887950574 learned_addr learned my addr 172.21.15.37:0/3887950574 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:11.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.329+0000 7f6c5dd9b640 1 --2- 172.21.15.37:0/3887950574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c600d0d70 0x7f6c60148d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:11.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.329+0000 7f6c5e59c640 1 --2- 172.21.15.37:0/3887950574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c600cf6a0 0x7f6c6009e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:11.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.329+0000 7f6c5ed9d640 1 -- 172.21.15.37:0/3887950574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c600d0d70 msgr2=0x7f6c60148d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:11.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.329+0000 7f6c5ed9d640 1 --2- 172.21.15.37:0/3887950574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c600d0d70 0x7f6c60148d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:11.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.330+0000 7f6c5ed9d640 1 -- 172.21.15.37:0/3887950574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c600cf6a0 msgr2=0x7f6c6009e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:11.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.330+0000 7f6c5ed9d640 1 --2- 172.21.15.37:0/3887950574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c600cf6a0 0x7f6c6009e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:11.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.330+0000 7f6c5ed9d640 1 -- 172.21.15.37:0/3887950574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c540094d0 con 0x7f6c600d13c0 2023-12-11T17:10:11.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.330+0000 7f6c5ed9d640 1 --2- 172.21.15.37:0/3887950574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c600d13c0 0x7f6c600c9350 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800c440 tx=0x7f6c5800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:11.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.330+0000 7f6c4effd640 1 -- 172.21.15.37:0/3887950574 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c580035f0 con 0x7f6c600d13c0 2023-12-11T17:10:11.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.330+0000 7f6c4effd640 1 -- 172.21.15.37:0/3887950574 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c58003770 con 0x7f6c600d13c0 2023-12-11T17:10:11.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.330+0000 7f6c5f59e640 1 -- 172.21.15.37:0/3887950574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c6014a010 con 0x7f6c600d13c0 2023-12-11T17:10:11.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.330+0000 7f6c4effd640 1 -- 172.21.15.37:0/3887950574 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c58003b20 con 0x7f6c600d13c0 2023-12-11T17:10:11.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.330+0000 7f6c5f59e640 1 -- 172.21.15.37:0/3887950574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c601499c0 con 0x7f6c600d13c0 2023-12-11T17:10:11.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.332+0000 7f6c5f59e640 1 -- 172.21.15.37:0/3887950574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c6014a1a0 con 0x7f6c600d13c0 2023-12-11T17:10:11.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.333+0000 7f6c4effd640 1 -- 172.21.15.37:0/3887950574 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6c58003c80 con 0x7f6c600d13c0 2023-12-11T17:10:11.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.334+0000 7f6c4effd640 1 --2- 172.21.15.37:0/3887950574 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6c4006ae70 0x7f6c4006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:11.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.334+0000 7f6c4effd640 1 -- 172.21.15.37:0/3887950574 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6c58088910 con 0x7f6c600d13c0 2023-12-11T17:10:11.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.335+0000 7f6c5e59c640 1 --2- 172.21.15.37:0/3887950574 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6c4006ae70 0x7f6c4006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:11.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.336+0000 7f6c5e59c640 1 --2- 172.21.15.37:0/3887950574 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6c4006ae70 0x7f6c4006d330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6c50009f20 tx=0x7f6c500094f0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:11.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.339+0000 7f6c4effd640 1 -- 172.21.15.37:0/3887950574 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6c580536d0 con 0x7f6c600d13c0 2023-12-11T17:10:11.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.531+0000 7f6c5f59e640 1 -- 172.21.15.37:0/3887950574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6c60074450 con 0x7f6c600d13c0 2023-12-11T17:10:11.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.533+0000 7f6c4effd640 1 -- 172.21.15.37:0/3887950574 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f6c58056cf0 con 0x7f6c600d13c0 2023-12-11T17:10:11.535 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:11.535 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:09:49.715938+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:10:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.535+0000 7f6c5f59e640 1 -- 172.21.15.37:0/3887950574 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6c4006ae70 msgr2=0x7f6c4006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.535+0000 7f6c5f59e640 1 --2- 172.21.15.37:0/3887950574 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6c4006ae70 0x7f6c4006d330 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6c50009f20 tx=0x7f6c500094f0 comp rx=0 tx=0).stop 2023-12-11T17:10:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.535+0000 7f6c5f59e640 1 -- 172.21.15.37:0/3887950574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c600d13c0 msgr2=0x7f6c600c9350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.535+0000 7f6c5f59e640 1 --2- 172.21.15.37:0/3887950574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c600d13c0 0x7f6c600c9350 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800c440 tx=0x7f6c5800c900 comp rx=0 tx=0).stop 2023-12-11T17:10:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.536+0000 7f6c5f59e640 1 -- 172.21.15.37:0/3887950574 shutdown_connections 2023-12-11T17:10:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.536+0000 7f6c5f59e640 1 --2- 172.21.15.37:0/3887950574 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6c4006ae70 0x7f6c4006d330 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.536+0000 7f6c5f59e640 1 --2- 172.21.15.37:0/3887950574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6c600d13c0 0x7f6c600c9350 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.536+0000 7f6c5f59e640 1 --2- 172.21.15.37:0/3887950574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6c600d0d70 0x7f6c60148d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.536+0000 7f6c5f59e640 1 --2- 172.21.15.37:0/3887950574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6c600cf6a0 0x7f6c6009e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:11.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.536+0000 7f6c5f59e640 1 -- 172.21.15.37:0/3887950574 >> 172.21.15.37:0/3887950574 conn(0x7f6c6009c260 msgr2=0x7f6c600cc070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.536+0000 7f6c5f59e640 1 -- 172.21.15.37:0/3887950574 shutdown_connections 2023-12-11T17:10:11.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.536+0000 7f6c5f59e640 1 -- 172.21.15.37:0/3887950574 wait complete. 2023-12-11T17:10:11.558 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-11T17:10:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.790+0000 7f243929f640 1 Processor -- start 2023-12-11T17:10:11.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.790+0000 7f243929f640 1 -- start start 2023-12-11T17:10:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.792+0000 7f243929f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f243406d370 0x7f24340cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.792+0000 7f243929f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f24340cc120 0x7f2434161a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.792+0000 7f243929f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f243406d950 con 0x7f243415ba90 2023-12-11T17:10:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.792+0000 7f243929f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24340b3fe0 con 0x7f243406d370 2023-12-11T17:10:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.792+0000 7f243929f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f243406c0b0 con 0x7f24340cc120 2023-12-11T17:10:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.792+0000 7f242bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f243406d370 0x7f24340cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:11.793 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.792+0000 7f242bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f243406d370 0x7f24340cbbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46452/0 (socket says 172.21.15.37:46452) 2023-12-11T17:10:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.792+0000 7f242bfff640 1 -- 172.21.15.37:0/3350914289 learned_addr learned my addr 172.21.15.37:0/3350914289 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.793+0000 7f2438a9e640 1 --2- 172.21.15.37:0/3350914289 >> v2:172.21.15.151:3300/0 conn(0x7f24340cc120 0x7f2434161a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.793+0000 7f242bfff640 1 -- 172.21.15.37:0/3350914289 >> v2:172.21.15.151:3300/0 conn(0x7f24340cc120 msgr2=0x7f2434161a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.793+0000 7f242bfff640 1 --2- 172.21.15.37:0/3350914289 >> v2:172.21.15.151:3300/0 conn(0x7f24340cc120 0x7f2434161a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.793+0000 7f242bfff640 1 -- 172.21.15.37:0/3350914289 >> v1:172.21.15.151:6789/0 conn(0x7f243415ba90 legacy=0x7f24340b2aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:11.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.793+0000 7f242bfff640 1 -- 172.21.15.37:0/3350914289 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f243406c390 con 0x7f243406d370 2023-12-11T17:10:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.794+0000 7f242bfff640 1 --2- 172.21.15.37:0/3350914289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f243406d370 0x7f24340cbbe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f24340b25e0 tx=0x7f241c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92503ab7593f412b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.794+0000 7f24337fe640 1 -- 172.21.15.37:0/3350914289 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c0317e0 con 0x7f243406d370 2023-12-11T17:10:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.794+0000 7f24337fe640 1 -- 172.21.15.37:0/3350914289 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f241c031940 con 0x7f243406d370 2023-12-11T17:10:11.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.794+0000 7f24337fe640 1 -- 172.21.15.37:0/3350914289 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f241c031cd0 con 0x7f243406d370 2023-12-11T17:10:11.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.795+0000 7f243929f640 1 -- 172.21.15.37:0/3350914289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f243406d370 msgr2=0x7f24340cbbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:11.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.795+0000 7f243929f640 1 --2- 172.21.15.37:0/3350914289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f243406d370 0x7f24340cbbe0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f24340b25e0 tx=0x7f241c02b880 comp rx=0 tx=0).stop 2023-12-11T17:10:11.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.795+0000 7f243929f640 1 -- 172.21.15.37:0/3350914289 shutdown_connections 2023-12-11T17:10:11.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.795+0000 7f243929f640 1 --2- 172.21.15.37:0/3350914289 >> v2:172.21.15.151:3300/0 conn(0x7f24340cc120 0x7f2434161a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:11.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.795+0000 7f243929f640 1 --2- 172.21.15.37:0/3350914289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f243406d370 0x7f24340cbbe0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:11.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.795+0000 7f243929f640 1 -- 172.21.15.37:0/3350914289 >> 172.21.15.37:0/3350914289 conn(0x7f24340b0940 msgr2=0x7f24340b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:11.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.795+0000 7f243929f640 1 -- 172.21.15.37:0/3350914289 shutdown_connections 2023-12-11T17:10:11.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.795+0000 7f243929f640 1 -- 172.21.15.37:0/3350914289 wait complete. 2023-12-11T17:10:11.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.797+0000 7f243929f640 1 Processor -- start 2023-12-11T17:10:11.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.797+0000 7f243929f640 1 -- start start 2023-12-11T17:10:11.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.798+0000 7f243929f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24340cc120 0x7f24340cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:11.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.798+0000 7f243929f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f243415ba90 0x7f2434149970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:11.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.798+0000 7f243929f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2434099e30 0x7f243409a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:11.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.798+0000 7f243929f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243414a8c0 con 0x7f24340cc120 2023-12-11T17:10:11.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.798+0000 7f243929f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f243415c190 con 0x7f2434099e30 2023-12-11T17:10:11.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.798+0000 7f243929f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f243415c470 con 0x7f243415ba90 2023-12-11T17:10:11.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.799+0000 7f2433fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24340cc120 0x7f24340cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:11.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.799+0000 7f2433fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24340cc120 0x7f24340cf5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46454/0 (socket says 172.21.15.37:46454) 2023-12-11T17:10:11.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.799+0000 7f2433fff640 1 -- 172.21.15.37:0/1023437110 learned_addr learned my addr 172.21.15.37:0/1023437110 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:11.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.799+0000 7f2433fff640 1 -- 172.21.15.37:0/1023437110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f243415ba90 msgr2=0x7f2434149970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:11.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.799+0000 7f2433fff640 1 --2- 172.21.15.37:0/1023437110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f243415ba90 0x7f2434149970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:11.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.799+0000 7f2433fff640 1 -- 172.21.15.37:0/1023437110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2434099e30 msgr2=0x7f243409a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:11.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.799+0000 7f2433fff640 1 --2- 172.21.15.37:0/1023437110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2434099e30 0x7f243409a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:11.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.799+0000 7f2433fff640 1 -- 172.21.15.37:0/1023437110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f241c0094d0 con 0x7f24340cc120 2023-12-11T17:10:11.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.799+0000 7f2433fff640 1 --2- 172.21.15.37:0/1023437110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24340cc120 0x7f24340cf5d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f242400b3f0 tx=0x7f242400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:11.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.800+0000 7f24317fa640 1 -- 172.21.15.37:0/1023437110 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2424011830 con 0x7f24340cc120 2023-12-11T17:10:11.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.800+0000 7f24317fa640 1 -- 172.21.15.37:0/1023437110 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2424011990 con 0x7f24340cc120 2023-12-11T17:10:11.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.800+0000 7f243929f640 1 -- 172.21.15.37:0/1023437110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f243414a270 con 0x7f24340cc120 2023-12-11T17:10:11.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.800+0000 7f24317fa640 1 -- 172.21.15.37:0/1023437110 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2424011d40 con 0x7f24340cc120 2023-12-11T17:10:11.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.800+0000 7f243929f640 1 -- 172.21.15.37:0/1023437110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2434149eb0 con 0x7f24340cc120 2023-12-11T17:10:11.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.801+0000 7f243929f640 1 -- 172.21.15.37:0/1023437110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2434067910 con 0x7f24340cc120 2023-12-11T17:10:11.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.802+0000 7f24317fa640 1 -- 172.21.15.37:0/1023437110 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f242401a400 con 0x7f24340cc120 2023-12-11T17:10:11.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.803+0000 7f24317fa640 1 --2- 172.21.15.37:0/1023437110 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f241406ae40 0x7f241406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:11.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.803+0000 7f24317fa640 1 -- 172.21.15.37:0/1023437110 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2424089720 con 0x7f24340cc120 2023-12-11T17:10:11.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.803+0000 7f242bfff640 1 --2- 172.21.15.37:0/1023437110 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f241406ae40 0x7f241406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:11.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.804+0000 7f242bfff640 1 --2- 172.21.15.37:0/1023437110 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f241406ae40 0x7f241406d300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f241c036000 tx=0x7f241c030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:11.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:11.807+0000 7f24317fa640 1 -- 172.21.15.37:0/1023437110 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f24240544e0 con 0x7f24340cc120 2023-12-11T17:10:12.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.037+0000 7f243929f640 1 -- 172.21.15.37:0/1023437110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2434074450 con 0x7f24340cc120 2023-12-11T17:10:12.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.307+0000 7f24317fa640 1 -- 172.21.15.37:0/1023437110 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2424057b00 con 0x7f24340cc120 2023-12-11T17:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.310+0000 7f243929f640 1 -- 172.21.15.37:0/1023437110 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f241406ae40 msgr2=0x7f241406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.310+0000 7f243929f640 1 --2- 172.21.15.37:0/1023437110 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f241406ae40 0x7f241406d300 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f241c036000 tx=0x7f241c030000 comp rx=0 tx=0).stop 2023-12-11T17:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.310+0000 7f243929f640 1 -- 172.21.15.37:0/1023437110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24340cc120 msgr2=0x7f24340cf5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.310+0000 7f243929f640 1 --2- 172.21.15.37:0/1023437110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24340cc120 0x7f24340cf5d0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f242400b3f0 tx=0x7f242400b8b0 comp rx=0 tx=0).stop 2023-12-11T17:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.311+0000 7f243929f640 1 -- 172.21.15.37:0/1023437110 shutdown_connections 2023-12-11T17:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.311+0000 7f243929f640 1 --2- 172.21.15.37:0/1023437110 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f241406ae40 0x7f241406d300 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.311+0000 7f243929f640 1 --2- 172.21.15.37:0/1023437110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2434099e30 0x7f243409a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.311+0000 7f243929f640 1 --2- 172.21.15.37:0/1023437110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f243415ba90 0x7f2434149970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.311+0000 7f243929f640 1 --2- 172.21.15.37:0/1023437110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f24340cc120 0x7f24340cf5d0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.311+0000 7f243929f640 1 -- 172.21.15.37:0/1023437110 >> 172.21.15.37:0/1023437110 conn(0x7f24340b0940 msgr2=0x7f2434164410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.311+0000 7f243929f640 1 -- 172.21.15.37:0/1023437110 shutdown_connections 2023-12-11T17:10:12.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.311+0000 7f243929f640 1 -- 172.21.15.37:0/1023437110 wait complete. 2023-12-11T17:10:12.337 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd']} 2023-12-11T17:10:12.337 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-11T17:10:12.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.573+0000 7faa1530c640 1 Processor -- start 2023-12-11T17:10:12.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.573+0000 7faa1530c640 1 -- start start 2023-12-11T17:10:12.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.574+0000 7faa1530c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa100d1790 0x7faa1006ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:12.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.574+0000 7faa1530c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa100ccba0 con 0x7faa100cf610 2023-12-11T17:10:12.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.575+0000 7faa1530c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa1015b520 con 0x7faa1015b140 2023-12-11T17:10:12.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.575+0000 7faa1530c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa100cec00 con 0x7faa100d1790 2023-12-11T17:10:12.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.575+0000 7faa0f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faa100cf610 0x7faa1006e5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42852/0 (socket says 172.21.15.37:42852) 2023-12-11T17:10:12.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.575+0000 7faa0f7fe640 1 -- 172.21.15.37:0/1779218270 learned_addr learned my addr 172.21.15.37:0/1779218270 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:12.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.575+0000 7faa14b0b640 1 --2- 172.21.15.37:0/1779218270 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa100d1790 0x7faa1006ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:12.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.575+0000 7faa0effd640 1 -- 172.21.15.37:0/1779218270 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 25238079 0 0) 0x7faa100ccba0 con 0x7faa100cf610 2023-12-11T17:10:12.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.575+0000 7faa0effd640 1 -- 172.21.15.37:0/1779218270 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa9fc003520 con 0x7faa100cf610 2023-12-11T17:10:12.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.576+0000 7faa0effd640 1 -- 172.21.15.37:0/1779218270 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2943816221 0 0) 0x7fa9fc003520 con 0x7faa100cf610 2023-12-11T17:10:12.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.576+0000 7faa0effd640 1 -- 172.21.15.37:0/1779218270 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa100d1790 msgr2=0x7faa1006ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:12.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.576+0000 7faa0effd640 1 --2- 172.21.15.37:0/1779218270 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa100d1790 0x7faa1006ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:12.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.576+0000 7faa0effd640 1 -- 172.21.15.37:0/1779218270 >> v1:172.21.15.151:6789/0 conn(0x7faa1015b140 legacy=0x7faa100cef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:12.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.576+0000 7faa0effd640 1 -- 172.21.15.37:0/1779218270 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa100cc270 con 0x7faa100cf610 2023-12-11T17:10:12.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.576+0000 7faa0effd640 1 -- 172.21.15.37:0/1779218270 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7fa9f8001670 con 0x7faa100cf610 2023-12-11T17:10:12.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.576+0000 7faa0effd640 1 -- 172.21.15.37:0/1779218270 >> v1:172.21.15.37:6789/0 conn(0x7faa100cf610 legacy=0x7faa1006e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:12.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.576+0000 7faa0effd640 1 --2- 172.21.15.37:0/1779218270 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9fc0039a0 0x7fa9fc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:12.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.576+0000 7faa0effd640 1 --2- 172.21.15.37:0/1779218270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9fc0047c0 0x7fa9fc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:12.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.576+0000 7faa0effd640 1 --2- 172.21.15.37:0/1779218270 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa100d1790 0x7fa9fc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:12.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.576+0000 7faa0effd640 1 -- 172.21.15.37:0/1779218270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa100cec00 con 0x7fa9fc0047c0 2023-12-11T17:10:12.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.576+0000 7faa0effd640 1 -- 172.21.15.37:0/1779218270 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc00ba60 con 0x7fa9fc0039a0 2023-12-11T17:10:12.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.576+0000 7faa0effd640 1 -- 172.21.15.37:0/1779218270 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9fc00bc20 con 0x7faa100d1790 2023-12-11T17:10:12.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.576+0000 7faa0f7fe640 1 --2- 172.21.15.37:0/1779218270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9fc0047c0 0x7fa9fc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:12.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.577+0000 7faa0ffff640 1 --2- 172.21.15.37:0/1779218270 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9fc0039a0 0x7fa9fc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:12.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.577+0000 7faa14b0b640 1 --2- 172.21.15.37:0/1779218270 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa100d1790 0x7fa9fc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:12.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.577+0000 7faa0f7fe640 1 -- 172.21.15.37:0/1779218270 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa100d1790 msgr2=0x7fa9fc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:12.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.577+0000 7faa0f7fe640 1 --2- 172.21.15.37:0/1779218270 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa100d1790 0x7fa9fc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:12.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.577+0000 7faa0f7fe640 1 -- 172.21.15.37:0/1779218270 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9fc0039a0 msgr2=0x7fa9fc003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:12.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.577+0000 7faa0f7fe640 1 --2- 172.21.15.37:0/1779218270 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa9fc0039a0 0x7fa9fc003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:12.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.577+0000 7faa0f7fe640 1 -- 172.21.15.37:0/1779218270 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9fc003520 con 0x7fa9fc0047c0 2023-12-11T17:10:12.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.578+0000 7faa0f7fe640 1 --2- 172.21.15.37:0/1779218270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9fc0047c0 0x7fa9fc004c40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faa10070cd0 tx=0x7fa9fc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=593545480bdb40ea server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:12.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.578+0000 7faa0effd640 1 -- 172.21.15.37:0/1779218270 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f8005ad0 con 0x7fa9fc0047c0 2023-12-11T17:10:12.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.578+0000 7faa0effd640 1 -- 172.21.15.37:0/1779218270 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9f8005c50 con 0x7fa9fc0047c0 2023-12-11T17:10:12.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.578+0000 7faa0effd640 1 -- 172.21.15.37:0/1779218270 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9f802c830 con 0x7fa9fc0047c0 2023-12-11T17:10:12.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.579+0000 7faa1530c640 1 -- 172.21.15.37:0/1779218270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9fc0047c0 msgr2=0x7fa9fc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:12.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.579+0000 7faa1530c640 1 --2- 172.21.15.37:0/1779218270 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9fc0047c0 0x7fa9fc004c40 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7faa10070cd0 tx=0x7fa9fc0057f0 comp rx=0 tx=0).stop 2023-12-11T17:10:12.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.579+0000 7faa14b0b640 1 -- 172.21.15.37:0/1779218270 reap_dead start 2023-12-11T17:10:12.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.579+0000 7faa1530c640 1 -- 172.21.15.37:0/1779218270 shutdown_connections 2023-12-11T17:10:12.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.579+0000 7faa1530c640 1 -- 172.21.15.37:0/1779218270 >> 172.21.15.37:0/1779218270 conn(0x7faa100d0c70 msgr2=0x7faa100d1080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:12.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.579+0000 7faa1530c640 1 -- 172.21.15.37:0/1779218270 shutdown_connections 2023-12-11T17:10:12.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.579+0000 7faa1530c640 1 -- 172.21.15.37:0/1779218270 wait complete. 2023-12-11T17:10:12.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.581+0000 7faa1530c640 1 Processor -- start 2023-12-11T17:10:12.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.581+0000 7faa1530c640 1 -- start start 2023-12-11T17:10:12.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.582+0000 7faa1530c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9fc0047c0 0x7faa1015c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:12.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.582+0000 7faa1530c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa100b3600 0x7faa100b0510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:12.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.582+0000 7faa1530c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa10145770 0x7faa10145bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:12.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.582+0000 7faa1530c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa101f2fa0 con 0x7fa9fc0047c0 2023-12-11T17:10:12.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.582+0000 7faa1530c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa1015cc50 con 0x7faa10145770 2023-12-11T17:10:12.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.582+0000 7faa1530c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa1015cf30 con 0x7faa100b3600 2023-12-11T17:10:12.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.583+0000 7faa0ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9fc0047c0 0x7faa1015c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:12.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.583+0000 7faa0ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9fc0047c0 0x7faa1015c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46478/0 (socket says 172.21.15.37:46478) 2023-12-11T17:10:12.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.583+0000 7faa0ffff640 1 -- 172.21.15.37:0/849597207 learned_addr learned my addr 172.21.15.37:0/849597207 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:12.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.583+0000 7faa0f7fe640 1 --2- 172.21.15.37:0/849597207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa100b3600 0x7faa100b0510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:12.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.583+0000 7faa14b0b640 1 --2- 172.21.15.37:0/849597207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa10145770 0x7faa10145bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:12.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.583+0000 7faa0ffff640 1 -- 172.21.15.37:0/849597207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa100b3600 msgr2=0x7faa100b0510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:12.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.583+0000 7faa0ffff640 1 --2- 172.21.15.37:0/849597207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa100b3600 0x7faa100b0510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:12.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.583+0000 7faa0ffff640 1 -- 172.21.15.37:0/849597207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa10145770 msgr2=0x7faa10145bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:12.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.583+0000 7faa0ffff640 1 --2- 172.21.15.37:0/849597207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa10145770 0x7faa10145bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:12.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.583+0000 7faa0ffff640 1 -- 172.21.15.37:0/849597207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa1015d210 con 0x7fa9fc0047c0 2023-12-11T17:10:12.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.583+0000 7faa0ffff640 1 --2- 172.21.15.37:0/849597207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9fc0047c0 0x7faa1015c400 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faa0000e8c0 tx=0x7faa0000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:12.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.584+0000 7faa0cff9640 1 -- 172.21.15.37:0/849597207 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa00003b80 con 0x7fa9fc0047c0 2023-12-11T17:10:12.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.584+0000 7faa0cff9640 1 -- 172.21.15.37:0/849597207 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa00003ce0 con 0x7fa9fc0047c0 2023-12-11T17:10:12.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.584+0000 7faa0cff9640 1 -- 172.21.15.37:0/849597207 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa000052f0 con 0x7fa9fc0047c0 2023-12-11T17:10:12.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.584+0000 7faa1530c640 1 -- 172.21.15.37:0/849597207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa1015d4f0 con 0x7fa9fc0047c0 2023-12-11T17:10:12.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.584+0000 7faa1530c640 1 -- 172.21.15.37:0/849597207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1015c940 con 0x7fa9fc0047c0 2023-12-11T17:10:12.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.585+0000 7faa1530c640 1 -- 172.21.15.37:0/849597207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa100d0770 con 0x7fa9fc0047c0 2023-12-11T17:10:12.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.586+0000 7faa0cff9640 1 -- 172.21.15.37:0/849597207 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa00005450 con 0x7fa9fc0047c0 2023-12-11T17:10:12.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.588+0000 7faa0cff9640 1 --2- 172.21.15.37:0/849597207 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa9f006ae70 0x7fa9f006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:12.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.588+0000 7faa0cff9640 1 -- 172.21.15.37:0/849597207 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7faa00089b10 con 0x7fa9fc0047c0 2023-12-11T17:10:12.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.588+0000 7faa0f7fe640 1 --2- 172.21.15.37:0/849597207 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa9f006ae70 0x7fa9f006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:12.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.589+0000 7faa0f7fe640 1 --2- 172.21.15.37:0/849597207 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa9f006ae70 0x7fa9f006d330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8034000 tx=0x7fa9f8009030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:12.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.593+0000 7faa0cff9640 1 -- 172.21.15.37:0/849597207 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faa00054830 con 0x7fa9fc0047c0 2023-12-11T17:10:12.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:12.827+0000 7faa1530c640 1 -- 172.21.15.37:0/849597207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7faa100d0770 con 0x7fa9fc0047c0 2023-12-11T17:10:13.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.318+0000 7faa0cff9640 1 -- 172.21.15.37:0/849597207 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7faa0001a310 con 0x7fa9fc0047c0 2023-12-11T17:10:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.322+0000 7faa1530c640 1 -- 172.21.15.37:0/849597207 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa9f006ae70 msgr2=0x7fa9f006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.322+0000 7faa1530c640 1 --2- 172.21.15.37:0/849597207 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa9f006ae70 0x7fa9f006d330 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa9f8034000 tx=0x7fa9f8009030 comp rx=0 tx=0).stop 2023-12-11T17:10:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.322+0000 7faa1530c640 1 -- 172.21.15.37:0/849597207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9fc0047c0 msgr2=0x7faa1015c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.322+0000 7faa1530c640 1 --2- 172.21.15.37:0/849597207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9fc0047c0 0x7faa1015c400 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7faa0000e8c0 tx=0x7faa0000ed80 comp rx=0 tx=0).stop 2023-12-11T17:10:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.322+0000 7faa1530c640 1 -- 172.21.15.37:0/849597207 shutdown_connections 2023-12-11T17:10:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.322+0000 7faa1530c640 1 --2- 172.21.15.37:0/849597207 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa9f006ae70 0x7fa9f006d330 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.322+0000 7faa1530c640 1 --2- 172.21.15.37:0/849597207 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa10145770 0x7faa10145bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.322+0000 7faa1530c640 1 --2- 172.21.15.37:0/849597207 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa100b3600 0x7faa100b0510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.322+0000 7faa1530c640 1 --2- 172.21.15.37:0/849597207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa9fc0047c0 0x7faa1015c400 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.322+0000 7faa1530c640 1 -- 172.21.15.37:0/849597207 >> 172.21.15.37:0/849597207 conn(0x7faa100d0c70 msgr2=0x7faa100af770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.322+0000 7faa1530c640 1 -- 172.21.15.37:0/849597207 shutdown_connections 2023-12-11T17:10:13.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.322+0000 7faa1530c640 1 -- 172.21.15.37:0/849597207 wait complete. 2023-12-11T17:10:13.345 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-11T17:10:13.345 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T17:10:13.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.570+0000 7fce16be9640 1 Processor -- start 2023-12-11T17:10:13.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.570+0000 7fce16be9640 1 -- start start 2023-12-11T17:10:13.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.572+0000 7fce16be9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fce100713b0 0x7fce100ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:13.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.572+0000 7fce16be9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce10070070 con 0x7fce10159fd0 2023-12-11T17:10:13.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.572+0000 7fce16be9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce10070310 con 0x7fce10070750 2023-12-11T17:10:13.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.572+0000 7fce16be9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce100705f0 con 0x7fce100713b0 2023-12-11T17:10:13.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.572+0000 7fce15be7640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fce10159fd0 0x7fce10070ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42858/0 (socket says 172.21.15.37:42858) 2023-12-11T17:10:13.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.572+0000 7fce15be7640 1 -- 172.21.15.37:0/1489204422 learned_addr learned my addr 172.21.15.37:0/1489204422 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.573+0000 7fce153e6640 1 --2- 172.21.15.37:0/1489204422 >> v2:172.21.15.151:3300/0 conn(0x7fce100713b0 0x7fce100ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.573+0000 7fce14be5640 1 -- 172.21.15.37:0/1489204422 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1704935167 0 0) 0x7fce10070070 con 0x7fce10159fd0 2023-12-11T17:10:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.573+0000 7fce14be5640 1 -- 172.21.15.37:0/1489204422 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdfc003520 con 0x7fce10159fd0 2023-12-11T17:10:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.573+0000 7fce14be5640 1 -- 172.21.15.37:0/1489204422 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3084194343 0 0) 0x7fcdfc003520 con 0x7fce10159fd0 2023-12-11T17:10:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.573+0000 7fce14be5640 1 -- 172.21.15.37:0/1489204422 >> v2:172.21.15.151:3300/0 conn(0x7fce100713b0 msgr2=0x7fce100ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.573+0000 7fce14be5640 1 --2- 172.21.15.37:0/1489204422 >> v2:172.21.15.151:3300/0 conn(0x7fce100713b0 0x7fce100ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.573+0000 7fce14be5640 1 -- 172.21.15.37:0/1489204422 >> v1:172.21.15.151:6789/0 conn(0x7fce10070750 legacy=0x7fce100b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.573+0000 7fce14be5640 1 -- 172.21.15.37:0/1489204422 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce100b1d00 con 0x7fce10159fd0 2023-12-11T17:10:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.573+0000 7fce14be5640 1 -- 172.21.15.37:0/1489204422 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7fce0c001670 con 0x7fce10159fd0 2023-12-11T17:10:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.573+0000 7fce14be5640 1 -- 172.21.15.37:0/1489204422 >> v1:172.21.15.37:6789/0 conn(0x7fce10159fd0 legacy=0x7fce10070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:13.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.574+0000 7fce14be5640 1 --2- 172.21.15.37:0/1489204422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdfc003970 0x7fcdfc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.574+0000 7fce14be5640 1 --2- 172.21.15.37:0/1489204422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdfc0047c0 0x7fcdfc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.574+0000 7fce14be5640 1 --2- 172.21.15.37:0/1489204422 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdfc005180 0x7fcdfc00db90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.574+0000 7fce14be5640 1 -- 172.21.15.37:0/1489204422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce100705f0 con 0x7fcdfc0047c0 2023-12-11T17:10:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.574+0000 7fce14be5640 1 -- 172.21.15.37:0/1489204422 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc00e240 con 0x7fcdfc003970 2023-12-11T17:10:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.574+0000 7fce14be5640 1 -- 172.21.15.37:0/1489204422 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdfc00e400 con 0x7fcdfc005180 2023-12-11T17:10:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.574+0000 7fce153e6640 1 --2- 172.21.15.37:0/1489204422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdfc0047c0 0x7fcdfc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.574+0000 7fce15be7640 1 --2- 172.21.15.37:0/1489204422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdfc003970 0x7fcdfc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.574+0000 7fce163e8640 1 --2- 172.21.15.37:0/1489204422 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdfc005180 0x7fcdfc00db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.574+0000 7fce153e6640 1 -- 172.21.15.37:0/1489204422 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdfc005180 msgr2=0x7fcdfc00db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.574+0000 7fce153e6640 1 --2- 172.21.15.37:0/1489204422 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdfc005180 0x7fcdfc00db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.574+0000 7fce153e6640 1 -- 172.21.15.37:0/1489204422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdfc003970 msgr2=0x7fcdfc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.574+0000 7fce153e6640 1 --2- 172.21.15.37:0/1489204422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcdfc003970 0x7fcdfc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.574+0000 7fce153e6640 1 -- 172.21.15.37:0/1489204422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdfc003520 con 0x7fcdfc0047c0 2023-12-11T17:10:13.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.574+0000 7fce163e8640 1 --2- 172.21.15.37:0/1489204422 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdfc005180 0x7fcdfc00db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:13.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.574+0000 7fce163e8640 1 -- 172.21.15.37:0/1489204422 reap_dead start 2023-12-11T17:10:13.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.576+0000 7fce153e6640 1 --2- 172.21.15.37:0/1489204422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdfc0047c0 0x7fcdfc004c40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fce00009ac0 tx=0x7fcdfc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c8a09d442f0aefb server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:13.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.576+0000 7fce14be5640 1 -- 172.21.15.37:0/1489204422 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0002c6b0 con 0x7fcdfc0047c0 2023-12-11T17:10:13.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.576+0000 7fce14be5640 1 -- 172.21.15.37:0/1489204422 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce0002c810 con 0x7fcdfc0047c0 2023-12-11T17:10:13.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.576+0000 7fce14be5640 1 -- 172.21.15.37:0/1489204422 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce0002cba0 con 0x7fcdfc0047c0 2023-12-11T17:10:13.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.576+0000 7fce16be9640 1 -- 172.21.15.37:0/1489204422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdfc0047c0 msgr2=0x7fcdfc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:13.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.576+0000 7fce16be9640 1 --2- 172.21.15.37:0/1489204422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdfc0047c0 0x7fcdfc004c40 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fce00009ac0 tx=0x7fcdfc0057f0 comp rx=0 tx=0).stop 2023-12-11T17:10:13.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.577+0000 7fce16be9640 1 -- 172.21.15.37:0/1489204422 shutdown_connections 2023-12-11T17:10:13.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.577+0000 7fce16be9640 1 --2- 172.21.15.37:0/1489204422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcdfc0047c0 0x7fcdfc004c40 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:13.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.577+0000 7fce16be9640 1 -- 172.21.15.37:0/1489204422 >> 172.21.15.37:0/1489204422 conn(0x7fce100b0860 msgr2=0x7fce100b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:13.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.577+0000 7fce16be9640 1 -- 172.21.15.37:0/1489204422 shutdown_connections 2023-12-11T17:10:13.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.577+0000 7fce16be9640 1 -- 172.21.15.37:0/1489204422 wait complete. 2023-12-11T17:10:13.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.578+0000 7fce16be9640 1 Processor -- start 2023-12-11T17:10:13.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.579+0000 7fce16be9640 1 -- start start 2023-12-11T17:10:13.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.579+0000 7fce16be9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdfc0047c0 0x7fce101f3ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:13.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.579+0000 7fce16be9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce101f5b40 0x7fce101f60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:13.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.579+0000 7fce16be9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce101f6610 0x7fce1009c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:13.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.580+0000 7fce16be9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce101f41e0 con 0x7fce101f5b40 2023-12-11T17:10:13.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.580+0000 7fce16be9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce101f6a90 con 0x7fce101f6610 2023-12-11T17:10:13.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.580+0000 7fce16be9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce100ae560 con 0x7fcdfc0047c0 2023-12-11T17:10:13.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.580+0000 7fce153e6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce101f5b40 0x7fce101f60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:13.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.580+0000 7fce153e6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce101f5b40 0x7fce101f60d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46500/0 (socket says 172.21.15.37:46500) 2023-12-11T17:10:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.580+0000 7fce153e6640 1 -- 172.21.15.37:0/738676206 learned_addr learned my addr 172.21.15.37:0/738676206 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.580+0000 7fce15be7640 1 --2- 172.21.15.37:0/738676206 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdfc0047c0 0x7fce101f3ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.580+0000 7fce163e8640 1 --2- 172.21.15.37:0/738676206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce101f6610 0x7fce1009c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.580+0000 7fce153e6640 1 -- 172.21.15.37:0/738676206 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdfc0047c0 msgr2=0x7fce101f3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.580+0000 7fce153e6640 1 --2- 172.21.15.37:0/738676206 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdfc0047c0 0x7fce101f3ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.580+0000 7fce153e6640 1 -- 172.21.15.37:0/738676206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce101f6610 msgr2=0x7fce1009c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.580+0000 7fce153e6640 1 --2- 172.21.15.37:0/738676206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce101f6610 0x7fce1009c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.580+0000 7fce153e6640 1 -- 172.21.15.37:0/738676206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce100af0e0 con 0x7fce101f5b40 2023-12-11T17:10:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.580+0000 7fce163e8640 1 --2- 172.21.15.37:0/738676206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce101f6610 0x7fce1009c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.581+0000 7fce153e6640 1 --2- 172.21.15.37:0/738676206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce101f5b40 0x7fce101f60d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fce00009ac0 tx=0x7fce00004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.581+0000 7fce067fc640 1 -- 172.21.15.37:0/738676206 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce00003810 con 0x7fce101f5b40 2023-12-11T17:10:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.581+0000 7fce067fc640 1 -- 172.21.15.37:0/738676206 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce00003970 con 0x7fce101f5b40 2023-12-11T17:10:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.581+0000 7fce16be9640 1 -- 172.21.15.37:0/738676206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce100ae7b0 con 0x7fce101f5b40 2023-12-11T17:10:13.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.581+0000 7fce067fc640 1 -- 172.21.15.37:0/738676206 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce00003d20 con 0x7fce101f5b40 2023-12-11T17:10:13.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.581+0000 7fce16be9640 1 -- 172.21.15.37:0/738676206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce100aed70 con 0x7fce101f5b40 2023-12-11T17:10:13.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.582+0000 7fce16be9640 1 -- 172.21.15.37:0/738676206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce100af270 con 0x7fce101f5b40 2023-12-11T17:10:13.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.584+0000 7fce067fc640 1 -- 172.21.15.37:0/738676206 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fce0003b070 con 0x7fce101f5b40 2023-12-11T17:10:13.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.585+0000 7fce067fc640 1 --2- 172.21.15.37:0/738676206 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcdf406ae90 0x7fcdf406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:13.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.585+0000 7fce067fc640 1 -- 172.21.15.37:0/738676206 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fce000ab660 con 0x7fce101f5b40 2023-12-11T17:10:13.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.585+0000 7fce15be7640 1 --2- 172.21.15.37:0/738676206 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcdf406ae90 0x7fcdf406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:13.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.587+0000 7fce15be7640 1 --2- 172.21.15.37:0/738676206 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcdf406ae90 0x7fcdf406d350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fce0c000fb0 tx=0x7fce0c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:13.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.589+0000 7fce067fc640 1 -- 172.21.15.37:0/738676206 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fce000764b0 con 0x7fce101f5b40 2023-12-11T17:10:13.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.820+0000 7fce16be9640 1 -- 172.21.15.37:0/738676206 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fce10074450 con 0x7fce101f5b40 2023-12-11T17:10:13.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.822+0000 7fce067fc640 1 -- 172.21.15.37:0/738676206 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4915 (secure 0 0 0) 0x7fce00079ad0 con 0x7fce101f5b40 2023-12-11T17:10:13.823 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:13.823 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2395601865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2395601865},{"type":"v1","addr":"172.21.15.151:6835","nonce":2395601865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1535809271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1535809271},{"type":"v1","addr":"172.21.15.151:6837","nonce":1535809271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2590175074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2590175074},{"type":"v1","addr":"172.21.15.37:6833","nonce":2590175074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-11T17:09:44.643511+0000","modified":"2023-12-11T17:10:12.829357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/2348606057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2348606057},{"type":"v1","addr":"172.21.15.37:6835","nonce":2348606057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T17:10:13.823 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-12-11T17:10:13.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.824+0000 7fce16be9640 1 -- 172.21.15.37:0/738676206 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcdf406ae90 msgr2=0x7fcdf406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:13.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.824+0000 7fce16be9640 1 --2- 172.21.15.37:0/738676206 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcdf406ae90 0x7fcdf406d350 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fce0c000fb0 tx=0x7fce0c009040 comp rx=0 tx=0).stop 2023-12-11T17:10:13.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.824+0000 7fce16be9640 1 -- 172.21.15.37:0/738676206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce101f5b40 msgr2=0x7fce101f60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:13.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.824+0000 7fce16be9640 1 --2- 172.21.15.37:0/738676206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce101f5b40 0x7fce101f60d0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fce00009ac0 tx=0x7fce00004730 comp rx=0 tx=0).stop 2023-12-11T17:10:13.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.824+0000 7fce16be9640 1 -- 172.21.15.37:0/738676206 shutdown_connections 2023-12-11T17:10:13.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.824+0000 7fce16be9640 1 --2- 172.21.15.37:0/738676206 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcdf406ae90 0x7fcdf406d350 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:13.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.824+0000 7fce16be9640 1 --2- 172.21.15.37:0/738676206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce101f6610 0x7fce1009c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:13.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.824+0000 7fce16be9640 1 --2- 172.21.15.37:0/738676206 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fce101f5b40 0x7fce101f60d0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:13.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.824+0000 7fce16be9640 1 --2- 172.21.15.37:0/738676206 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcdfc0047c0 0x7fce101f3ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:13.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.824+0000 7fce16be9640 1 -- 172.21.15.37:0/738676206 >> 172.21.15.37:0/738676206 conn(0x7fce100b0860 msgr2=0x7fce100acea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:13.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.824+0000 7fce16be9640 1 -- 172.21.15.37:0/738676206 shutdown_connections 2023-12-11T17:10:13.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:13.824+0000 7fce16be9640 1 -- 172.21.15.37:0/738676206 wait complete. 2023-12-11T17:10:13.843 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:10:14.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.068+0000 7f9d98940640 1 Processor -- start 2023-12-11T17:10:14.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.068+0000 7f9d98940640 1 -- start start 2023-12-11T17:10:14.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.070+0000 7f9d98940640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9d94071260 0x7f9d940cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:14.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.070+0000 7f9d98940640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d94071f90 con 0x7f9d9415e5d0 2023-12-11T17:10:14.071 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.070+0000 7f9d98940640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d94072270 con 0x7f9d940ae200 2023-12-11T17:10:14.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.070+0000 7f9d98940640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d94070070 con 0x7f9d94071260 2023-12-11T17:10:14.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.071+0000 7f9d92d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9d9415e5d0 0x7f9d9406bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42864/0 (socket says 172.21.15.37:42864) 2023-12-11T17:10:14.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.071+0000 7f9d92d9d640 1 -- 172.21.15.37:0/1291456110 learned_addr learned my addr 172.21.15.37:0/1291456110 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:14.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.071+0000 7f9d9359e640 1 --2- 172.21.15.37:0/1291456110 >> v2:172.21.15.151:3300/0 conn(0x7f9d94071260 0x7f9d940cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:14.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.071+0000 7f9d9259c640 1 -- 172.21.15.37:0/1291456110 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1055546252 0 0) 0x7f9d94071f90 con 0x7f9d9415e5d0 2023-12-11T17:10:14.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.071+0000 7f9d9259c640 1 -- 172.21.15.37:0/1291456110 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d80003520 con 0x7f9d9415e5d0 2023-12-11T17:10:14.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.072+0000 7f9d9259c640 1 -- 172.21.15.37:0/1291456110 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3310670014 0 0) 0x7f9d80003520 con 0x7f9d9415e5d0 2023-12-11T17:10:14.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.072+0000 7f9d9259c640 1 -- 172.21.15.37:0/1291456110 >> v2:172.21.15.151:3300/0 conn(0x7f9d94071260 msgr2=0x7f9d940cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:14.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.072+0000 7f9d9259c640 1 --2- 172.21.15.37:0/1291456110 >> v2:172.21.15.151:3300/0 conn(0x7f9d94071260 0x7f9d940cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:14.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.072+0000 7f9d9259c640 1 -- 172.21.15.37:0/1291456110 >> v1:172.21.15.151:6789/0 conn(0x7f9d940ae200 legacy=0x7f9d94070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:14.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.072+0000 7f9d9259c640 1 -- 172.21.15.37:0/1291456110 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d94070350 con 0x7f9d9415e5d0 2023-12-11T17:10:14.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.072+0000 7f9d9259c640 1 -- 172.21.15.37:0/1291456110 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f9d84001670 con 0x7f9d9415e5d0 2023-12-11T17:10:14.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.072+0000 7f9d9259c640 1 -- 172.21.15.37:0/1291456110 >> v1:172.21.15.37:6789/0 conn(0x7f9d9415e5d0 legacy=0x7f9d9406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:14.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.072+0000 7f9d9259c640 1 --2- 172.21.15.37:0/1291456110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d800039c0 0x7f9d80003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:14.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.072+0000 7f9d9259c640 1 --2- 172.21.15.37:0/1291456110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d800047c0 0x7f9d80004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:14.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.072+0000 7f9d9259c640 1 --2- 172.21.15.37:0/1291456110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d800051d0 0x7f9d8000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:14.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.072+0000 7f9d9259c640 1 -- 172.21.15.37:0/1291456110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d94070070 con 0x7f9d800047c0 2023-12-11T17:10:14.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.072+0000 7f9d9259c640 1 -- 172.21.15.37:0/1291456110 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8000c120 con 0x7f9d800039c0 2023-12-11T17:10:14.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.072+0000 7f9d9259c640 1 -- 172.21.15.37:0/1291456110 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d8000c2e0 con 0x7f9d800051d0 2023-12-11T17:10:14.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.072+0000 7f9d8a59c640 1 --2- 172.21.15.37:0/1291456110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d800047c0 0x7f9d80004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:14.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.072+0000 7f9d92d9d640 1 --2- 172.21.15.37:0/1291456110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d800039c0 0x7f9d80003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:14.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.072+0000 7f9d9359e640 1 --2- 172.21.15.37:0/1291456110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d800051d0 0x7f9d8000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:14.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.072+0000 7f9d8a59c640 1 -- 172.21.15.37:0/1291456110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d800051d0 msgr2=0x7f9d8000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:14.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.072+0000 7f9d8a59c640 1 --2- 172.21.15.37:0/1291456110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d800051d0 0x7f9d8000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:14.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.072+0000 7f9d8a59c640 1 -- 172.21.15.37:0/1291456110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d800039c0 msgr2=0x7f9d80003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:14.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.072+0000 7f9d8a59c640 1 --2- 172.21.15.37:0/1291456110 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d800039c0 0x7f9d80003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:14.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.072+0000 7f9d8a59c640 1 -- 172.21.15.37:0/1291456110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d80003520 con 0x7f9d800047c0 2023-12-11T17:10:14.075 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.072+0000 7f9d9359e640 1 --2- 172.21.15.37:0/1291456110 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d800051d0 0x7f9d8000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:14.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.073+0000 7f9d9359e640 1 -- 172.21.15.37:0/1291456110 reap_dead start 2023-12-11T17:10:14.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.074+0000 7f9d8a59c640 1 --2- 172.21.15.37:0/1291456110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d800047c0 0x7f9d80004c40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c001720 tx=0x7f9d800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5059d0762fa3fd20 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:14.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.074+0000 7f9d9259c640 1 -- 172.21.15.37:0/1291456110 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c0052d0 con 0x7f9d800047c0 2023-12-11T17:10:14.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.074+0000 7f9d9259c640 1 -- 172.21.15.37:0/1291456110 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d7c02e050 con 0x7f9d800047c0 2023-12-11T17:10:14.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.074+0000 7f9d9259c640 1 -- 172.21.15.37:0/1291456110 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d7c003830 con 0x7f9d800047c0 2023-12-11T17:10:14.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.075+0000 7f9d98940640 1 -- 172.21.15.37:0/1291456110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d800047c0 msgr2=0x7f9d80004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:14.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.075+0000 7f9d98940640 1 --2- 172.21.15.37:0/1291456110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d800047c0 0x7f9d80004c40 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9d7c001720 tx=0x7f9d800057f0 comp rx=0 tx=0).stop 2023-12-11T17:10:14.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.075+0000 7f9d98940640 1 -- 172.21.15.37:0/1291456110 shutdown_connections 2023-12-11T17:10:14.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.075+0000 7f9d98940640 1 --2- 172.21.15.37:0/1291456110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d800047c0 0x7f9d80004c40 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:14.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.075+0000 7f9d98940640 1 -- 172.21.15.37:0/1291456110 >> 172.21.15.37:0/1291456110 conn(0x7f9d940b0860 msgr2=0x7f9d940b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:14.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.075+0000 7f9d98940640 1 -- 172.21.15.37:0/1291456110 shutdown_connections 2023-12-11T17:10:14.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.075+0000 7f9d98940640 1 -- 172.21.15.37:0/1291456110 wait complete. 2023-12-11T17:10:14.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.077+0000 7f9d98940640 1 Processor -- start 2023-12-11T17:10:14.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.077+0000 7f9d98940640 1 -- start start 2023-12-11T17:10:14.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.078+0000 7f9d98940640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d800047c0 0x7f9d9409ad70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:14.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.078+0000 7f9d98940640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d9413e540 0x7f9d9409bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:14.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.078+0000 7f9d98940640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d9409c0f0 0x7f9d9415d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:14.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.078+0000 7f9d98940640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d940999f0 con 0x7f9d9409c0f0 2023-12-11T17:10:14.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.078+0000 7f9d98940640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d94099cd0 con 0x7f9d800047c0 2023-12-11T17:10:14.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.078+0000 7f9d98940640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d94099fb0 con 0x7f9d9413e540 2023-12-11T17:10:14.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.078+0000 7f9d9359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d9409c0f0 0x7f9d9415d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:14.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.078+0000 7f9d9359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d9409c0f0 0x7f9d9415d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46528/0 (socket says 172.21.15.37:46528) 2023-12-11T17:10:14.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.078+0000 7f9d9359e640 1 -- 172.21.15.37:0/1210455660 learned_addr learned my addr 172.21.15.37:0/1210455660 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:14.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.078+0000 7f9d92d9d640 1 --2- 172.21.15.37:0/1210455660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d800047c0 0x7f9d9409ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:14.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.078+0000 7f9d8a59c640 1 --2- 172.21.15.37:0/1210455660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d9413e540 0x7f9d9409bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:14.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.079+0000 7f9d9359e640 1 -- 172.21.15.37:0/1210455660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d9413e540 msgr2=0x7f9d9409bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:14.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.079+0000 7f9d9359e640 1 --2- 172.21.15.37:0/1210455660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d9413e540 0x7f9d9409bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:14.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.079+0000 7f9d9359e640 1 -- 172.21.15.37:0/1210455660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d800047c0 msgr2=0x7f9d9409ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:14.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.079+0000 7f9d9359e640 1 --2- 172.21.15.37:0/1210455660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d800047c0 0x7f9d9409ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:14.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.079+0000 7f9d9359e640 1 -- 172.21.15.37:0/1210455660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d9409a290 con 0x7f9d9409c0f0 2023-12-11T17:10:14.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.079+0000 7f9d9359e640 1 --2- 172.21.15.37:0/1210455660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d9409c0f0 0x7f9d9415d090 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9d940cdc90 tx=0x7f9d8c00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:14.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.079+0000 7f9d8bfff640 1 -- 172.21.15.37:0/1210455660 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c016620 con 0x7f9d9409c0f0 2023-12-11T17:10:14.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.079+0000 7f9d8bfff640 1 -- 172.21.15.37:0/1210455660 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d8c016780 con 0x7f9d9409c0f0 2023-12-11T17:10:14.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.079+0000 7f9d8bfff640 1 -- 172.21.15.37:0/1210455660 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d8c016b10 con 0x7f9d9409c0f0 2023-12-11T17:10:14.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.079+0000 7f9d98940640 1 -- 172.21.15.37:0/1210455660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d9409a570 con 0x7f9d9409c0f0 2023-12-11T17:10:14.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.079+0000 7f9d98940640 1 -- 172.21.15.37:0/1210455660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d9413e9c0 con 0x7f9d9409c0f0 2023-12-11T17:10:14.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.081+0000 7f9d98940640 1 -- 172.21.15.37:0/1210455660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d9409a0f0 con 0x7f9d9409c0f0 2023-12-11T17:10:14.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.082+0000 7f9d8bfff640 1 -- 172.21.15.37:0/1210455660 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9d8c016c70 con 0x7f9d9409c0f0 2023-12-11T17:10:14.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.082+0000 7f9d8bfff640 1 --2- 172.21.15.37:0/1210455660 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9d7406ae40 0x7f9d7406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:14.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.083+0000 7f9d8bfff640 1 -- 172.21.15.37:0/1210455660 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9d8c08a8c0 con 0x7f9d9409c0f0 2023-12-11T17:10:14.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.083+0000 7f9d92d9d640 1 --2- 172.21.15.37:0/1210455660 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9d7406ae40 0x7f9d7406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:14.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.084+0000 7f9d92d9d640 1 --2- 172.21.15.37:0/1210455660 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9d7406ae40 0x7f9d7406d300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9d84001eb0 tx=0x7f9d84009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:14.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.087+0000 7f9d8bfff640 1 -- 172.21.15.37:0/1210455660 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9d9409a0f0 con 0x7f9d9409c0f0 2023-12-11T17:10:14.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.285+0000 7f9d98940640 1 -- 172.21.15.37:0/1210455660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d9409a0f0 con 0x7f9d9409c0f0 2023-12-11T17:10:14.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.288+0000 7f9d8bfff640 1 -- 172.21.15.37:0/1210455660 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f9d9409a0f0 con 0x7f9d9409c0f0 2023-12-11T17:10:14.289 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:14.290 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:09:49.715938+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:10:14.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.291+0000 7f9d98940640 1 -- 172.21.15.37:0/1210455660 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9d7406ae40 msgr2=0x7f9d7406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:14.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.291+0000 7f9d98940640 1 --2- 172.21.15.37:0/1210455660 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9d7406ae40 0x7f9d7406d300 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9d84001eb0 tx=0x7f9d84009040 comp rx=0 tx=0).stop 2023-12-11T17:10:14.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.291+0000 7f9d98940640 1 -- 172.21.15.37:0/1210455660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d9409c0f0 msgr2=0x7f9d9415d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:14.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.291+0000 7f9d98940640 1 --2- 172.21.15.37:0/1210455660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d9409c0f0 0x7f9d9415d090 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f9d940cdc90 tx=0x7f9d8c00f520 comp rx=0 tx=0).stop 2023-12-11T17:10:14.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.291+0000 7f9d98940640 1 -- 172.21.15.37:0/1210455660 shutdown_connections 2023-12-11T17:10:14.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.291+0000 7f9d98940640 1 --2- 172.21.15.37:0/1210455660 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9d7406ae40 0x7f9d7406d300 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:14.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.291+0000 7f9d98940640 1 --2- 172.21.15.37:0/1210455660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9d9409c0f0 0x7f9d9415d090 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:14.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.291+0000 7f9d98940640 1 --2- 172.21.15.37:0/1210455660 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9d9413e540 0x7f9d9409bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:14.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.291+0000 7f9d98940640 1 --2- 172.21.15.37:0/1210455660 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d800047c0 0x7f9d9409ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:14.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.291+0000 7f9d98940640 1 -- 172.21.15.37:0/1210455660 >> 172.21.15.37:0/1210455660 conn(0x7f9d940b0860 msgr2=0x7f9d94153340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:14.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.291+0000 7f9d98940640 1 -- 172.21.15.37:0/1210455660 shutdown_connections 2023-12-11T17:10:14.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.291+0000 7f9d98940640 1 -- 172.21.15.37:0/1210455660 wait complete. 2023-12-11T17:10:14.313 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-11T17:10:14.313 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-11T17:10:14.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.542+0000 7fc0e8d81640 1 Processor -- start 2023-12-11T17:10:14.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.542+0000 7fc0e8d81640 1 -- start start 2023-12-11T17:10:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.544+0000 7fc0e8d81640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc0e415e5d0 0x7fc0e406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.544+0000 7fc0e8d81640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0e40ae200 0x7fc0e4070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.544+0000 7fc0e8d81640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e4071f90 con 0x7fc0e406c330 2023-12-11T17:10:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.544+0000 7fc0e8d81640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e4072270 con 0x7fc0e415e5d0 2023-12-11T17:10:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.544+0000 7fc0e8d81640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e4070070 con 0x7fc0e40ae200 2023-12-11T17:10:14.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.544+0000 7fc0e37fe640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc0e415e5d0 0x7fc0e406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.544+0000 7fc0dbfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0e40ae200 0x7fc0e4070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.544+0000 7fc0e37fe640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc0e415e5d0 0x7fc0e406bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:51890/0 (socket says 172.21.15.37:51890) 2023-12-11T17:10:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.544+0000 7fc0e37fe640 1 -- 172.21.15.37:0/1448797758 learned_addr learned my addr 172.21.15.37:0/1448797758 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.545+0000 7fc0dbfff640 1 -- 172.21.15.37:0/1448797758 >> v2:172.21.15.151:3300/0 conn(0x7fc0e415e5d0 msgr2=0x7fc0e406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.545+0000 7fc0dbfff640 1 --2- 172.21.15.37:0/1448797758 >> v2:172.21.15.151:3300/0 conn(0x7fc0e415e5d0 0x7fc0e406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:14.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.545+0000 7fc0dbfff640 1 -- 172.21.15.37:0/1448797758 >> v1:172.21.15.151:6789/0 conn(0x7fc0e406c330 legacy=0x7fc0e40cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.545+0000 7fc0dbfff640 1 -- 172.21.15.37:0/1448797758 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e4070350 con 0x7fc0e40ae200 2023-12-11T17:10:14.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.547+0000 7fc0dbfff640 1 --2- 172.21.15.37:0/1448797758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0e40ae200 0x7fc0e4070b50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc0097a0 tx=0x7fc0cc02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fec72e0792253dca server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:14.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.547+0000 7fc0e2ffd640 1 -- 172.21.15.37:0/1448797758 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc02e070 con 0x7fc0e40ae200 2023-12-11T17:10:14.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.547+0000 7fc0e2ffd640 1 -- 172.21.15.37:0/1448797758 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0cc0315a0 con 0x7fc0e40ae200 2023-12-11T17:10:14.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.547+0000 7fc0e2ffd640 1 -- 172.21.15.37:0/1448797758 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0cc031930 con 0x7fc0e40ae200 2023-12-11T17:10:14.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.548+0000 7fc0e8d81640 1 -- 172.21.15.37:0/1448797758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0e40ae200 msgr2=0x7fc0e4070b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:14.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.548+0000 7fc0e8d81640 1 --2- 172.21.15.37:0/1448797758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0e40ae200 0x7fc0e4070b50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc0097a0 tx=0x7fc0cc02b840 comp rx=0 tx=0).stop 2023-12-11T17:10:14.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.548+0000 7fc0e8d81640 1 -- 172.21.15.37:0/1448797758 shutdown_connections 2023-12-11T17:10:14.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.548+0000 7fc0e8d81640 1 --2- 172.21.15.37:0/1448797758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0e40ae200 0x7fc0e4070b50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:14.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.548+0000 7fc0e8d81640 1 --2- 172.21.15.37:0/1448797758 >> v2:172.21.15.151:3300/0 conn(0x7fc0e415e5d0 0x7fc0e406bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:14.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.548+0000 7fc0e8d81640 1 -- 172.21.15.37:0/1448797758 >> 172.21.15.37:0/1448797758 conn(0x7fc0e40b0860 msgr2=0x7fc0e40b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:14.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.548+0000 7fc0e8d81640 1 -- 172.21.15.37:0/1448797758 shutdown_connections 2023-12-11T17:10:14.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.548+0000 7fc0e8d81640 1 -- 172.21.15.37:0/1448797758 wait complete. 2023-12-11T17:10:14.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.550+0000 7fc0e8d81640 1 Processor -- start 2023-12-11T17:10:14.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.551+0000 7fc0e8d81640 1 -- start start 2023-12-11T17:10:14.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.552+0000 7fc0e8d81640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0e406c330 0x7fc0e414d580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:14.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.552+0000 7fc0e8d81640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0e40ae200 0x7fc0e415ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:14.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.552+0000 7fc0e8d81640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0e415e5d0 0x7fc0e415b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:14.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.552+0000 7fc0e8d81640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e41f4db0 con 0x7fc0e406c330 2023-12-11T17:10:14.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.552+0000 7fc0e8d81640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e41f4130 con 0x7fc0e40ae200 2023-12-11T17:10:14.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.552+0000 7fc0e8d81640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e41f4410 con 0x7fc0e415e5d0 2023-12-11T17:10:14.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.552+0000 7fc0e37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0e406c330 0x7fc0e414d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:14.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.552+0000 7fc0e37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0e406c330 0x7fc0e414d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46536/0 (socket says 172.21.15.37:46536) 2023-12-11T17:10:14.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.552+0000 7fc0e37fe640 1 -- 172.21.15.37:0/944451561 learned_addr learned my addr 172.21.15.37:0/944451561 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:14.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.552+0000 7fc0dbfff640 1 --2- 172.21.15.37:0/944451561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0e40ae200 0x7fc0e415ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:14.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.552+0000 7fc0e3fff640 1 --2- 172.21.15.37:0/944451561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0e415e5d0 0x7fc0e415b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:14.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.553+0000 7fc0e37fe640 1 -- 172.21.15.37:0/944451561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0e415e5d0 msgr2=0x7fc0e415b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:14.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.553+0000 7fc0e37fe640 1 --2- 172.21.15.37:0/944451561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0e415e5d0 0x7fc0e415b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:14.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.553+0000 7fc0e37fe640 1 -- 172.21.15.37:0/944451561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0e40ae200 msgr2=0x7fc0e415ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:14.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.553+0000 7fc0e37fe640 1 --2- 172.21.15.37:0/944451561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0e40ae200 0x7fc0e415ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:14.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.553+0000 7fc0e37fe640 1 -- 172.21.15.37:0/944451561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0cc009400 con 0x7fc0e406c330 2023-12-11T17:10:14.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.553+0000 7fc0e37fe640 1 --2- 172.21.15.37:0/944451561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0e406c330 0x7fc0e414d580 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc0d400e840 tx=0x7fc0d400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:14.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.553+0000 7fc0e0ff9640 1 -- 172.21.15.37:0/944451561 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d400c8e0 con 0x7fc0e406c330 2023-12-11T17:10:14.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.553+0000 7fc0e0ff9640 1 -- 172.21.15.37:0/944451561 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d400ca40 con 0x7fc0e406c330 2023-12-11T17:10:14.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.553+0000 7fc0e8d81640 1 -- 172.21.15.37:0/944451561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e41f46f0 con 0x7fc0e406c330 2023-12-11T17:10:14.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.553+0000 7fc0e0ff9640 1 -- 172.21.15.37:0/944451561 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d400cdf0 con 0x7fc0e406c330 2023-12-11T17:10:14.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.554+0000 7fc0e8d81640 1 -- 172.21.15.37:0/944451561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e415bbb0 con 0x7fc0e406c330 2023-12-11T17:10:14.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.555+0000 7fc0e8d81640 1 -- 172.21.15.37:0/944451561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e41f5020 con 0x7fc0e406c330 2023-12-11T17:10:14.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.556+0000 7fc0e0ff9640 1 -- 172.21.15.37:0/944451561 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc0d4013470 con 0x7fc0e406c330 2023-12-11T17:10:14.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.558+0000 7fc0e0ff9640 1 --2- 172.21.15.37:0/944451561 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc0c406ae40 0x7fc0c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:14.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.558+0000 7fc0e0ff9640 1 -- 172.21.15.37:0/944451561 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fc0d4089d70 con 0x7fc0e406c330 2023-12-11T17:10:14.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.558+0000 7fc0dbfff640 1 --2- 172.21.15.37:0/944451561 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc0c406ae40 0x7fc0c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:14.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.559+0000 7fc0dbfff640 1 --2- 172.21.15.37:0/944451561 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc0c406ae40 0x7fc0c406d300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc036000 tx=0x7fc0cc03d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:14.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.563+0000 7fc0e0ff9640 1 -- 172.21.15.37:0/944451561 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc0d4054b40 con 0x7fc0e406c330 2023-12-11T17:10:14.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.751+0000 7fc0e8d81640 1 -- 172.21.15.37:0/944451561 --> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc0e4071c20 con 0x7fc0c406ae40 2023-12-11T17:10:14.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.785+0000 7fc0e0ff9640 1 -- 172.21.15.37:0/944451561 <== mgr.4111 v2:172.21.15.151:6832/3081040918 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345033 (secure 0 0 0) 0x7fc0cc031a10 con 0x7fc0c406ae40 2023-12-11T17:10:14.791 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:14.793 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-12-11T17:10:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.790+0000 7fc0e8d81640 1 -- 172.21.15.37:0/944451561 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc0c406ae40 msgr2=0x7fc0c406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.790+0000 7fc0e8d81640 1 --2- 172.21.15.37:0/944451561 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc0c406ae40 0x7fc0c406d300 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc0cc036000 tx=0x7fc0cc03d040 comp rx=0 tx=0).stop 2023-12-11T17:10:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.790+0000 7fc0e8d81640 1 -- 172.21.15.37:0/944451561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0e406c330 msgr2=0x7fc0e414d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.790+0000 7fc0e8d81640 1 --2- 172.21.15.37:0/944451561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0e406c330 0x7fc0e414d580 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc0d400e840 tx=0x7fc0d400ed00 comp rx=0 tx=0).stop 2023-12-11T17:10:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.790+0000 7fc0e8d81640 1 -- 172.21.15.37:0/944451561 shutdown_connections 2023-12-11T17:10:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.790+0000 7fc0e8d81640 1 --2- 172.21.15.37:0/944451561 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc0c406ae40 0x7fc0c406d300 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.790+0000 7fc0e8d81640 1 --2- 172.21.15.37:0/944451561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc0e40ae200 0x7fc0e415ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.790+0000 7fc0e8d81640 1 --2- 172.21.15.37:0/944451561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc0e415e5d0 0x7fc0e415b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.790+0000 7fc0e8d81640 1 --2- 172.21.15.37:0/944451561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc0e406c330 0x7fc0e414d580 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.790+0000 7fc0e8d81640 1 -- 172.21.15.37:0/944451561 >> 172.21.15.37:0/944451561 conn(0x7fc0e40b0860 msgr2=0x7fc0e4072ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.791+0000 7fc0e8d81640 1 -- 172.21.15.37:0/944451561 shutdown_connections 2023-12-11T17:10:14.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:14.791+0000 7fc0e8d81640 1 -- 172.21.15.37:0/944451561 wait complete. 2023-12-11T17:10:14.815 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-12-11T17:10:14.348813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595006,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219428,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755292,"statfs":{"total":773094113280,"available":772869419008,"internally_reserved":0,"allocated":3350528,"data_stored":2014708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005008"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.264778+0000","last_change":"2023-12-11T17:09:44.205494+0000","last_active":"2023-12-11T17:09:49.264778+0000","last_peered":"2023-12-11T17:09:49.264778+0000","last_clean":"2023-12-11T17:09:49.264778+0000","last_became_active":"2023-12-11T17:09:44.205155+0000","last_became_peered":"2023-12-11T17:09:44.205155+0000","last_unstale":"2023-12-11T17:09:49.264778+0000","last_undegraded":"2023-12-11T17:09:49.264778+0000","last_fullsized":"2023-12-11T17:09:49.264778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:13:55.603067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242077+0000","last_change":"2023-12-11T17:09:45.206887+0000","last_active":"2023-12-11T17:09:49.242077+0000","last_peered":"2023-12-11T17:09:49.242077+0000","last_clean":"2023-12-11T17:09:49.242077+0000","last_became_active":"2023-12-11T17:09:45.206696+0000","last_became_peered":"2023-12-11T17:09:45.206696+0000","last_unstale":"2023-12-11T17:09:49.242077+0000","last_undegraded":"2023-12-11T17:09:49.242077+0000","last_fullsized":"2023-12-11T17:09:49.242077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:13:50.995140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.248574+0000","last_change":"2023-12-11T17:09:49.282316+0000","last_active":"2023-12-11T17:09:50.248574+0000","last_peered":"2023-12-11T17:09:50.248574+0000","last_clean":"2023-12-11T17:09:50.248574+0000","last_became_active":"2023-12-11T17:09:49.281935+0000","last_became_peered":"2023-12-11T17:09:49.281935+0000","last_unstale":"2023-12-11T17:09:50.248574+0000","last_undegraded":"2023-12-11T17:09:50.248574+0000","last_fullsized":"2023-12-11T17:09:50.248574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:09:37.168887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242245+0000","last_change":"2023-12-11T17:09:44.197711+0000","last_active":"2023-12-11T17:09:49.242245+0000","last_peered":"2023-12-11T17:09:49.242245+0000","last_clean":"2023-12-11T17:09:49.242245+0000","last_became_active":"2023-12-11T17:09:44.197229+0000","last_became_peered":"2023-12-11T17:09:44.197229+0000","last_unstale":"2023-12-11T17:09:49.242245+0000","last_undegraded":"2023-12-11T17:09:49.242245+0000","last_fullsized":"2023-12-11T17:09:49.242245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:56:33.686127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.264591+0000","last_change":"2023-12-11T17:09:45.215263+0000","last_active":"2023-12-11T17:09:49.264591+0000","last_peered":"2023-12-11T17:09:49.264591+0000","last_clean":"2023-12-11T17:09:49.264591+0000","last_became_active":"2023-12-11T17:09:45.214989+0000","last_became_peered":"2023-12-11T17:09:45.214989+0000","last_unstale":"2023-12-11T17:09:49.264591+0000","last_undegraded":"2023-12-11T17:09:49.264591+0000","last_fullsized":"2023-12-11T17:09:49.264591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:05.364711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669349+0000","last_change":"2023-12-11T17:09:49.281985+0000","last_active":"2023-12-11T17:09:51.669349+0000","last_peered":"2023-12-11T17:09:51.669349+0000","last_clean":"2023-12-11T17:09:51.669349+0000","last_became_active":"2023-12-11T17:09:49.280479+0000","last_became_peered":"2023-12-11T17:09:49.280479+0000","last_unstale":"2023-12-11T17:09:51.669349+0000","last_undegraded":"2023-12-11T17:09:51.669349+0000","last_fullsized":"2023-12-11T17:09:51.669349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:13:55.059808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274621+0000","last_change":"2023-12-11T17:09:44.209993+0000","last_active":"2023-12-11T17:09:49.274621+0000","last_peered":"2023-12-11T17:09:49.274621+0000","last_clean":"2023-12-11T17:09:49.274621+0000","last_became_active":"2023-12-11T17:09:44.209695+0000","last_became_peered":"2023-12-11T17:09:44.209695+0000","last_unstale":"2023-12-11T17:09:49.274621+0000","last_undegraded":"2023-12-11T17:09:49.274621+0000","last_fullsized":"2023-12-11T17:09:49.274621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:08:15.250298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267955+0000","last_change":"2023-12-11T17:09:45.222374+0000","last_active":"2023-12-11T17:09:49.267955+0000","last_peered":"2023-12-11T17:09:49.267955+0000","last_clean":"2023-12-11T17:09:49.267955+0000","last_became_active":"2023-12-11T17:09:45.222069+0000","last_became_peered":"2023-12-11T17:09:45.222069+0000","last_unstale":"2023-12-11T17:09:49.267955+0000","last_undegraded":"2023-12-11T17:09:49.267955+0000","last_fullsized":"2023-12-11T17:09:49.267955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:33:36.618495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669784+0000","last_change":"2023-12-11T17:09:49.277595+0000","last_active":"2023-12-11T17:09:51.669784+0000","last_peered":"2023-12-11T17:09:51.669784+0000","last_clean":"2023-12-11T17:09:51.669784+0000","last_became_active":"2023-12-11T17:09:49.276806+0000","last_became_peered":"2023-12-11T17:09:49.276806+0000","last_unstale":"2023-12-11T17:09:51.669784+0000","last_undegraded":"2023-12-11T17:09:51.669784+0000","last_fullsized":"2023-12-11T17:09:51.669784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:08.141530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274475+0000","last_change":"2023-12-11T17:09:44.213170+0000","last_active":"2023-12-11T17:09:49.274475+0000","last_peered":"2023-12-11T17:09:49.274475+0000","last_clean":"2023-12-11T17:09:49.274475+0000","last_became_active":"2023-12-11T17:09:44.212695+0000","last_became_peered":"2023-12-11T17:09:44.212695+0000","last_unstale":"2023-12-11T17:09:49.274475+0000","last_undegraded":"2023-12-11T17:09:49.274475+0000","last_fullsized":"2023-12-11T17:09:49.274475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:38:29.306893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267473+0000","last_change":"2023-12-11T17:09:45.222217+0000","last_active":"2023-12-11T17:09:49.267473+0000","last_peered":"2023-12-11T17:09:49.267473+0000","last_clean":"2023-12-11T17:09:49.267473+0000","last_became_active":"2023-12-11T17:09:45.221985+0000","last_became_peered":"2023-12-11T17:09:45.221985+0000","last_unstale":"2023-12-11T17:09:49.267473+0000","last_undegraded":"2023-12-11T17:09:49.267473+0000","last_fullsized":"2023-12-11T17:09:49.267473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:02:04.180131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.668985+0000","last_change":"2023-12-11T17:09:49.271236+0000","last_active":"2023-12-11T17:09:51.668985+0000","last_peered":"2023-12-11T17:09:51.668985+0000","last_clean":"2023-12-11T17:09:51.668985+0000","last_became_active":"2023-12-11T17:09:49.268635+0000","last_became_peered":"2023-12-11T17:09:49.268635+0000","last_unstale":"2023-12-11T17:09:51.668985+0000","last_undegraded":"2023-12-11T17:09:51.668985+0000","last_fullsized":"2023-12-11T17:09:51.668985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:36:14.458597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244251+0000","last_change":"2023-12-11T17:09:45.215612+0000","last_active":"2023-12-11T17:09:49.244251+0000","last_peered":"2023-12-11T17:09:49.244251+0000","last_clean":"2023-12-11T17:09:49.244251+0000","last_became_active":"2023-12-11T17:09:45.215222+0000","last_became_peered":"2023-12-11T17:09:45.215222+0000","last_unstale":"2023-12-11T17:09:49.244251+0000","last_undegraded":"2023-12-11T17:09:49.244251+0000","last_fullsized":"2023-12-11T17:09:49.244251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:39:10.691125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275270+0000","last_change":"2023-12-11T17:09:44.208572+0000","last_active":"2023-12-11T17:09:49.275270+0000","last_peered":"2023-12-11T17:09:49.275270+0000","last_clean":"2023-12-11T17:09:49.275270+0000","last_became_active":"2023-12-11T17:09:44.208062+0000","last_became_peered":"2023-12-11T17:09:44.208062+0000","last_unstale":"2023-12-11T17:09:49.275270+0000","last_undegraded":"2023-12-11T17:09:49.275270+0000","last_fullsized":"2023-12-11T17:09:49.275270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:22:33.669469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669908+0000","last_change":"2023-12-11T17:09:49.280949+0000","last_active":"2023-12-11T17:09:51.669908+0000","last_peered":"2023-12-11T17:09:51.669908+0000","last_clean":"2023-12-11T17:09:51.669908+0000","last_became_active":"2023-12-11T17:09:49.280486+0000","last_became_peered":"2023-12-11T17:09:49.280486+0000","last_unstale":"2023-12-11T17:09:51.669908+0000","last_undegraded":"2023-12-11T17:09:51.669908+0000","last_fullsized":"2023-12-11T17:09:51.669908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:28:35.459824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242397+0000","last_change":"2023-12-11T17:09:45.200951+0000","last_active":"2023-12-11T17:09:49.242397+0000","last_peered":"2023-12-11T17:09:49.242397+0000","last_clean":"2023-12-11T17:09:49.242397+0000","last_became_active":"2023-12-11T17:09:45.199504+0000","last_became_peered":"2023-12-11T17:09:45.199504+0000","last_unstale":"2023-12-11T17:09:49.242397+0000","last_undegraded":"2023-12-11T17:09:49.242397+0000","last_fullsized":"2023-12-11T17:09:49.242397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:51:29.300195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.247683+0000","last_change":"2023-12-11T17:09:44.195059+0000","last_active":"2023-12-11T17:09:49.247683+0000","last_peered":"2023-12-11T17:09:49.247683+0000","last_clean":"2023-12-11T17:09:49.247683+0000","last_became_active":"2023-12-11T17:09:44.194799+0000","last_became_peered":"2023-12-11T17:09:44.194799+0000","last_unstale":"2023-12-11T17:09:49.247683+0000","last_undegraded":"2023-12-11T17:09:49.247683+0000","last_fullsized":"2023-12-11T17:09:49.247683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:43:26.684582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669518+0000","last_change":"2023-12-11T17:09:49.279664+0000","last_active":"2023-12-11T17:09:51.669518+0000","last_peered":"2023-12-11T17:09:51.669518+0000","last_clean":"2023-12-11T17:09:51.669518+0000","last_became_active":"2023-12-11T17:09:49.279207+0000","last_became_peered":"2023-12-11T17:09:49.279207+0000","last_unstale":"2023-12-11T17:09:51.669518+0000","last_undegraded":"2023-12-11T17:09:51.669518+0000","last_fullsized":"2023-12-11T17:09:51.669518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:02:08.244798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242731+0000","last_change":"2023-12-11T17:09:45.209162+0000","last_active":"2023-12-11T17:09:49.242731+0000","last_peered":"2023-12-11T17:09:49.242731+0000","last_clean":"2023-12-11T17:09:49.242731+0000","last_became_active":"2023-12-11T17:09:45.204781+0000","last_became_peered":"2023-12-11T17:09:45.204781+0000","last_unstale":"2023-12-11T17:09:49.242731+0000","last_undegraded":"2023-12-11T17:09:49.242731+0000","last_fullsized":"2023-12-11T17:09:49.242731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:27:18.925357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.241243+0000","last_change":"2023-12-11T17:09:44.196375+0000","last_active":"2023-12-11T17:09:49.241243+0000","last_peered":"2023-12-11T17:09:49.241243+0000","last_clean":"2023-12-11T17:09:49.241243+0000","last_became_active":"2023-12-11T17:09:44.196046+0000","last_became_peered":"2023-12-11T17:09:44.196046+0000","last_unstale":"2023-12-11T17:09:49.241243+0000","last_undegraded":"2023-12-11T17:09:49.241243+0000","last_fullsized":"2023-12-11T17:09:49.241243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:42:30.903444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.673124+0000","last_change":"2023-12-11T17:09:49.280698+0000","last_active":"2023-12-11T17:09:51.673124+0000","last_peered":"2023-12-11T17:09:51.673124+0000","last_clean":"2023-12-11T17:09:51.673124+0000","last_became_active":"2023-12-11T17:09:49.280309+0000","last_became_peered":"2023-12-11T17:09:49.280309+0000","last_unstale":"2023-12-11T17:09:51.673124+0000","last_undegraded":"2023-12-11T17:09:51.673124+0000","last_fullsized":"2023-12-11T17:09:51.673124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:24:45.184380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.270508+0000","last_change":"2023-12-11T17:09:45.210450+0000","last_active":"2023-12-11T17:09:49.270508+0000","last_peered":"2023-12-11T17:09:49.270508+0000","last_clean":"2023-12-11T17:09:49.270508+0000","last_became_active":"2023-12-11T17:09:45.202201+0000","last_became_peered":"2023-12-11T17:09:45.202201+0000","last_unstale":"2023-12-11T17:09:49.270508+0000","last_undegraded":"2023-12-11T17:09:49.270508+0000","last_fullsized":"2023-12-11T17:09:49.270508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:43:19.164503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.271955+0000","last_change":"2023-12-11T17:09:44.209283+0000","last_active":"2023-12-11T17:09:49.271955+0000","last_peered":"2023-12-11T17:09:49.271955+0000","last_clean":"2023-12-11T17:09:49.271955+0000","last_became_active":"2023-12-11T17:09:44.208995+0000","last_became_peered":"2023-12-11T17:09:44.208995+0000","last_unstale":"2023-12-11T17:09:49.271955+0000","last_undegraded":"2023-12-11T17:09:49.271955+0000","last_fullsized":"2023-12-11T17:09:49.271955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:43:26.684582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669445+0000","last_change":"2023-12-11T17:09:49.278872+0000","last_active":"2023-12-11T17:09:51.669445+0000","last_peered":"2023-12-11T17:09:51.669445+0000","last_clean":"2023-12-11T17:09:51.669445+0000","last_became_active":"2023-12-11T17:09:49.276738+0000","last_became_peered":"2023-12-11T17:09:49.276738+0000","last_unstale":"2023-12-11T17:09:51.669445+0000","last_undegraded":"2023-12-11T17:09:51.669445+0000","last_fullsized":"2023-12-11T17:09:51.669445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:17:51.127675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.261226+0000","last_change":"2023-12-11T17:09:45.211027+0000","last_active":"2023-12-11T17:09:49.261226+0000","last_peered":"2023-12-11T17:09:49.261226+0000","last_clean":"2023-12-11T17:09:49.261226+0000","last_became_active":"2023-12-11T17:09:45.210763+0000","last_became_peered":"2023-12-11T17:09:45.210763+0000","last_unstale":"2023-12-11T17:09:49.261226+0000","last_undegraded":"2023-12-11T17:09:49.261226+0000","last_fullsized":"2023-12-11T17:09:49.261226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:08:16.262435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.247483+0000","last_change":"2023-12-11T17:09:44.203386+0000","last_active":"2023-12-11T17:09:49.247483+0000","last_peered":"2023-12-11T17:09:49.247483+0000","last_clean":"2023-12-11T17:09:49.247483+0000","last_became_active":"2023-12-11T17:09:44.203053+0000","last_became_peered":"2023-12-11T17:09:44.203053+0000","last_unstale":"2023-12-11T17:09:49.247483+0000","last_undegraded":"2023-12-11T17:09:49.247483+0000","last_fullsized":"2023-12-11T17:09:49.247483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:44.213311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.668973+0000","last_change":"2023-12-11T17:09:49.282875+0000","last_active":"2023-12-11T17:09:51.668973+0000","last_peered":"2023-12-11T17:09:51.668973+0000","last_clean":"2023-12-11T17:09:51.668973+0000","last_became_active":"2023-12-11T17:09:49.282315+0000","last_became_peered":"2023-12-11T17:09:49.282315+0000","last_unstale":"2023-12-11T17:09:51.668973+0000","last_undegraded":"2023-12-11T17:09:51.668973+0000","last_fullsized":"2023-12-11T17:09:51.668973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:51:33.364863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.243142+0000","last_change":"2023-12-11T17:09:45.195150+0000","last_active":"2023-12-11T17:09:49.243142+0000","last_peered":"2023-12-11T17:09:49.243142+0000","last_clean":"2023-12-11T17:09:49.243142+0000","last_became_active":"2023-12-11T17:09:45.194871+0000","last_became_peered":"2023-12-11T17:09:45.194871+0000","last_unstale":"2023-12-11T17:09:49.243142+0000","last_undegraded":"2023-12-11T17:09:49.243142+0000","last_fullsized":"2023-12-11T17:09:49.243142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:36:10.393929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.247741+0000","last_change":"2023-12-11T17:09:44.194695+0000","last_active":"2023-12-11T17:09:49.247741+0000","last_peered":"2023-12-11T17:09:49.247741+0000","last_clean":"2023-12-11T17:09:49.247741+0000","last_became_active":"2023-12-11T17:09:44.193709+0000","last_became_peered":"2023-12-11T17:09:44.193709+0000","last_unstale":"2023-12-11T17:09:49.247741+0000","last_undegraded":"2023-12-11T17:09:49.247741+0000","last_fullsized":"2023-12-11T17:09:49.247741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:47:06.501355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.245990+0000","last_change":"2023-12-11T17:09:49.278389+0000","last_active":"2023-12-11T17:09:50.245990+0000","last_peered":"2023-12-11T17:09:50.245990+0000","last_clean":"2023-12-11T17:09:50.245990+0000","last_became_active":"2023-12-11T17:09:49.277824+0000","last_became_peered":"2023-12-11T17:09:49.277824+0000","last_unstale":"2023-12-11T17:09:50.245990+0000","last_undegraded":"2023-12-11T17:09:50.245990+0000","last_fullsized":"2023-12-11T17:09:50.245990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:35:53.618553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244690+0000","last_change":"2023-12-11T17:09:45.201703+0000","last_active":"2023-12-11T17:09:49.244690+0000","last_peered":"2023-12-11T17:09:49.244690+0000","last_clean":"2023-12-11T17:09:49.244690+0000","last_became_active":"2023-12-11T17:09:45.200824+0000","last_became_peered":"2023-12-11T17:09:45.200824+0000","last_unstale":"2023-12-11T17:09:49.244690+0000","last_undegraded":"2023-12-11T17:09:49.244690+0000","last_fullsized":"2023-12-11T17:09:49.244690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:39:10.691125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274750+0000","last_change":"2023-12-11T17:09:44.208756+0000","last_active":"2023-12-11T17:09:49.274750+0000","last_peered":"2023-12-11T17:09:49.274750+0000","last_clean":"2023-12-11T17:09:49.274750+0000","last_became_active":"2023-12-11T17:09:44.208390+0000","last_became_peered":"2023-12-11T17:09:44.208390+0000","last_unstale":"2023-12-11T17:09:49.274750+0000","last_undegraded":"2023-12-11T17:09:49.274750+0000","last_fullsized":"2023-12-11T17:09:49.274750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:04.352574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.671162+0000","last_change":"2023-12-11T17:09:49.283760+0000","last_active":"2023-12-11T17:09:51.671162+0000","last_peered":"2023-12-11T17:09:51.671162+0000","last_clean":"2023-12-11T17:09:51.671162+0000","last_became_active":"2023-12-11T17:09:49.281062+0000","last_became_peered":"2023-12-11T17:09:49.281062+0000","last_unstale":"2023-12-11T17:09:51.671162+0000","last_undegraded":"2023-12-11T17:09:51.671162+0000","last_fullsized":"2023-12-11T17:09:51.671162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:01:12.186325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267581+0000","last_change":"2023-12-11T17:09:45.214708+0000","last_active":"2023-12-11T17:09:49.267581+0000","last_peered":"2023-12-11T17:09:49.267581+0000","last_clean":"2023-12-11T17:09:49.267581+0000","last_became_active":"2023-12-11T17:09:45.214453+0000","last_became_peered":"2023-12-11T17:09:45.214453+0000","last_unstale":"2023-12-11T17:09:49.267581+0000","last_undegraded":"2023-12-11T17:09:49.267581+0000","last_fullsized":"2023-12-11T17:09:49.267581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:04.076862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244838+0000","last_change":"2023-12-11T17:09:44.192839+0000","last_active":"2023-12-11T17:09:49.244838+0000","last_peered":"2023-12-11T17:09:49.244838+0000","last_clean":"2023-12-11T17:09:49.244838+0000","last_became_active":"2023-12-11T17:09:44.192441+0000","last_became_peered":"2023-12-11T17:09:44.192441+0000","last_unstale":"2023-12-11T17:09:49.244838+0000","last_undegraded":"2023-12-11T17:09:49.244838+0000","last_fullsized":"2023-12-11T17:09:49.244838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:52:53.972126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.670689+0000","last_change":"2023-12-11T17:09:49.270432+0000","last_active":"2023-12-11T17:09:51.670689+0000","last_peered":"2023-12-11T17:09:51.670689+0000","last_clean":"2023-12-11T17:09:51.670689+0000","last_became_active":"2023-12-11T17:09:49.269987+0000","last_became_peered":"2023-12-11T17:09:49.269987+0000","last_unstale":"2023-12-11T17:09:51.670689+0000","last_undegraded":"2023-12-11T17:09:51.670689+0000","last_fullsized":"2023-12-11T17:09:51.670689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:08.141530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.271570+0000","last_change":"2023-12-11T17:09:45.222655+0000","last_active":"2023-12-11T17:09:49.271570+0000","last_peered":"2023-12-11T17:09:49.271570+0000","last_clean":"2023-12-11T17:09:49.271570+0000","last_became_active":"2023-12-11T17:09:45.222198+0000","last_became_peered":"2023-12-11T17:09:45.222198+0000","last_unstale":"2023-12-11T17:09:49.271570+0000","last_undegraded":"2023-12-11T17:09:49.271570+0000","last_fullsized":"2023-12-11T17:09:49.271570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:28:10.075039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.263830+0000","last_change":"2023-12-11T17:09:44.207657+0000","last_active":"2023-12-11T17:09:49.263830+0000","last_peered":"2023-12-11T17:09:49.263830+0000","last_clean":"2023-12-11T17:09:49.263830+0000","last_became_active":"2023-12-11T17:09:44.205012+0000","last_became_peered":"2023-12-11T17:09:44.205012+0000","last_unstale":"2023-12-11T17:09:49.263830+0000","last_undegraded":"2023-12-11T17:09:49.263830+0000","last_fullsized":"2023-12-11T17:09:49.263830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:17:03.000720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.672166+0000","last_change":"2023-12-11T17:09:49.270417+0000","last_active":"2023-12-11T17:09:51.672166+0000","last_peered":"2023-12-11T17:09:51.672166+0000","last_clean":"2023-12-11T17:09:51.672166+0000","last_became_active":"2023-12-11T17:09:49.270052+0000","last_became_peered":"2023-12-11T17:09:49.270052+0000","last_unstale":"2023-12-11T17:09:51.672166+0000","last_undegraded":"2023-12-11T17:09:51.672166+0000","last_fullsized":"2023-12-11T17:09:51.672166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:03:14.942737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.240098+0000","last_change":"2023-12-11T17:09:45.205128+0000","last_active":"2023-12-11T17:09:49.240098+0000","last_peered":"2023-12-11T17:09:49.240098+0000","last_clean":"2023-12-11T17:09:49.240098+0000","last_became_active":"2023-12-11T17:09:45.204869+0000","last_became_peered":"2023-12-11T17:09:45.204869+0000","last_unstale":"2023-12-11T17:09:49.240098+0000","last_undegraded":"2023-12-11T17:09:49.240098+0000","last_fullsized":"2023-12-11T17:09:49.240098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:17:04.012857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.250848+0000","last_change":"2023-12-11T17:09:44.198305+0000","last_active":"2023-12-11T17:09:49.250848+0000","last_peered":"2023-12-11T17:09:49.250848+0000","last_clean":"2023-12-11T17:09:49.250848+0000","last_became_active":"2023-12-11T17:09:44.196890+0000","last_became_peered":"2023-12-11T17:09:44.196890+0000","last_unstale":"2023-12-11T17:09:49.250848+0000","last_undegraded":"2023-12-11T17:09:49.250848+0000","last_fullsized":"2023-12-11T17:09:49.250848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:59:22.990940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.673145+0000","last_change":"2023-12-11T17:09:49.272669+0000","last_active":"2023-12-11T17:09:51.673145+0000","last_peered":"2023-12-11T17:09:51.673145+0000","last_clean":"2023-12-11T17:09:51.673145+0000","last_became_active":"2023-12-11T17:09:49.269739+0000","last_became_peered":"2023-12-11T17:09:49.269739+0000","last_unstale":"2023-12-11T17:09:51.673145+0000","last_undegraded":"2023-12-11T17:09:51.673145+0000","last_fullsized":"2023-12-11T17:09:51.673145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:01:12.186325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259188+0000","last_change":"2023-12-11T17:09:45.215855+0000","last_active":"2023-12-11T17:09:49.259188+0000","last_peered":"2023-12-11T17:09:49.259188+0000","last_clean":"2023-12-11T17:09:49.259188+0000","last_became_active":"2023-12-11T17:09:45.214930+0000","last_became_peered":"2023-12-11T17:09:45.214930+0000","last_unstale":"2023-12-11T17:09:49.259188+0000","last_undegraded":"2023-12-11T17:09:49.259188+0000","last_fullsized":"2023-12-11T17:09:49.259188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:38:30.319030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.272045+0000","last_change":"2023-12-11T17:09:44.206866+0000","last_active":"2023-12-11T17:09:49.272045+0000","last_peered":"2023-12-11T17:09:49.272045+0000","last_clean":"2023-12-11T17:09:49.272045+0000","last_became_active":"2023-12-11T17:09:44.205821+0000","last_became_peered":"2023-12-11T17:09:44.205821+0000","last_unstale":"2023-12-11T17:09:49.272045+0000","last_undegraded":"2023-12-11T17:09:49.272045+0000","last_fullsized":"2023-12-11T17:09:49.272045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:44.213311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.670848+0000","last_change":"2023-12-11T17:09:49.285904+0000","last_active":"2023-12-11T17:09:51.670848+0000","last_peered":"2023-12-11T17:09:51.670848+0000","last_clean":"2023-12-11T17:09:51.670848+0000","last_became_active":"2023-12-11T17:09:49.282906+0000","last_became_peered":"2023-12-11T17:09:49.282906+0000","last_unstale":"2023-12-11T17:09:51.670848+0000","last_undegraded":"2023-12-11T17:09:51.670848+0000","last_fullsized":"2023-12-11T17:09:51.670848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:03:14.942737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242151+0000","last_change":"2023-12-11T17:09:45.213664+0000","last_active":"2023-12-11T17:09:49.242151+0000","last_peered":"2023-12-11T17:09:49.242151+0000","last_clean":"2023-12-11T17:09:49.242151+0000","last_became_active":"2023-12-11T17:09:45.213356+0000","last_became_peered":"2023-12-11T17:09:45.213356+0000","last_unstale":"2023-12-11T17:09:49.242151+0000","last_undegraded":"2023-12-11T17:09:49.242151+0000","last_fullsized":"2023-12-11T17:09:49.242151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:17:04.012857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.266436+0000","last_change":"2023-12-11T17:09:44.196934+0000","last_active":"2023-12-11T17:09:49.266436+0000","last_peered":"2023-12-11T17:09:49.266436+0000","last_clean":"2023-12-11T17:09:49.266436+0000","last_became_active":"2023-12-11T17:09:44.192526+0000","last_became_peered":"2023-12-11T17:09:44.192526+0000","last_unstale":"2023-12-11T17:09:49.266436+0000","last_undegraded":"2023-12-11T17:09:49.266436+0000","last_fullsized":"2023-12-11T17:09:49.266436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:08:15.250298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.272132+0000","last_change":"2023-12-11T17:09:40.320298+0000","last_active":"2023-12-11T17:09:49.272132+0000","last_peered":"2023-12-11T17:09:49.272132+0000","last_clean":"2023-12-11T17:09:49.272132+0000","last_became_active":"2023-12-11T17:09:40.318118+0000","last_became_peered":"2023-12-11T17:09:40.318118+0000","last_unstale":"2023-12-11T17:09:49.272132+0000","last_undegraded":"2023-12-11T17:09:49.272132+0000","last_fullsized":"2023-12-11T17:09:49.272132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:38.641841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:38.641841+0000","last_clean_scrub_stamp":"2023-12-11T17:09:38.641841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:36:05.856847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.246854+0000","last_change":"2023-12-11T17:09:49.284105+0000","last_active":"2023-12-11T17:09:50.246854+0000","last_peered":"2023-12-11T17:09:50.246854+0000","last_clean":"2023-12-11T17:09:50.246854+0000","last_became_active":"2023-12-11T17:09:49.282365+0000","last_became_peered":"2023-12-11T17:09:49.282365+0000","last_unstale":"2023-12-11T17:09:50.246854+0000","last_undegraded":"2023-12-11T17:09:50.246854+0000","last_fullsized":"2023-12-11T17:09:50.246854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:33:40.683163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274490+0000","last_change":"2023-12-11T17:09:45.227132+0000","last_active":"2023-12-11T17:09:49.274490+0000","last_peered":"2023-12-11T17:09:49.274490+0000","last_clean":"2023-12-11T17:09:49.274490+0000","last_became_active":"2023-12-11T17:09:45.224674+0000","last_became_peered":"2023-12-11T17:09:45.224674+0000","last_unstale":"2023-12-11T17:09:49.274490+0000","last_undegraded":"2023-12-11T17:09:49.274490+0000","last_fullsized":"2023-12-11T17:09:49.274490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:02:04.180131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.251498+0000","last_change":"2023-12-11T17:09:44.207068+0000","last_active":"2023-12-11T17:09:49.251498+0000","last_peered":"2023-12-11T17:09:49.251498+0000","last_clean":"2023-12-11T17:09:49.251498+0000","last_became_active":"2023-12-11T17:09:44.206365+0000","last_became_peered":"2023-12-11T17:09:44.206365+0000","last_unstale":"2023-12-11T17:09:49.251498+0000","last_undegraded":"2023-12-11T17:09:49.251498+0000","last_fullsized":"2023-12-11T17:09:49.251498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:53:23.727946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.245537+0000","last_change":"2023-12-11T17:09:49.282432+0000","last_active":"2023-12-11T17:09:50.245537+0000","last_peered":"2023-12-11T17:09:50.245537+0000","last_clean":"2023-12-11T17:09:50.245537+0000","last_became_active":"2023-12-11T17:09:49.281688+0000","last_became_peered":"2023-12-11T17:09:49.281688+0000","last_unstale":"2023-12-11T17:09:50.245537+0000","last_undegraded":"2023-12-11T17:09:50.245537+0000","last_fullsized":"2023-12-11T17:09:50.245537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:02:08.244798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.268082+0000","last_change":"2023-12-11T17:09:45.212177+0000","last_active":"2023-12-11T17:09:49.268082+0000","last_peered":"2023-12-11T17:09:49.268082+0000","last_clean":"2023-12-11T17:09:49.268082+0000","last_became_active":"2023-12-11T17:09:45.211897+0000","last_became_peered":"2023-12-11T17:09:45.211897+0000","last_unstale":"2023-12-11T17:09:49.268082+0000","last_undegraded":"2023-12-11T17:09:49.268082+0000","last_fullsized":"2023-12-11T17:09:49.268082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:28:31.395156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244887+0000","last_change":"2023-12-11T17:09:44.200317+0000","last_active":"2023-12-11T17:09:49.244887+0000","last_peered":"2023-12-11T17:09:49.244887+0000","last_clean":"2023-12-11T17:09:49.244887+0000","last_became_active":"2023-12-11T17:09:44.199797+0000","last_became_peered":"2023-12-11T17:09:44.199797+0000","last_unstale":"2023-12-11T17:09:49.244887+0000","last_undegraded":"2023-12-11T17:09:49.244887+0000","last_fullsized":"2023-12-11T17:09:49.244887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:56:33.686127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.670045+0000","last_change":"2023-12-11T17:09:49.267135+0000","last_active":"2023-12-11T17:09:51.670045+0000","last_peered":"2023-12-11T17:09:51.670045+0000","last_clean":"2023-12-11T17:09:51.670045+0000","last_became_active":"2023-12-11T17:09:49.266709+0000","last_became_peered":"2023-12-11T17:09:49.266709+0000","last_unstale":"2023-12-11T17:09:51.670045+0000","last_undegraded":"2023-12-11T17:09:51.670045+0000","last_fullsized":"2023-12-11T17:09:51.670045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:08.141530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275410+0000","last_change":"2023-12-11T17:09:45.227783+0000","last_active":"2023-12-11T17:09:49.275410+0000","last_peered":"2023-12-11T17:09:49.275410+0000","last_clean":"2023-12-11T17:09:49.275410+0000","last_became_active":"2023-12-11T17:09:45.225563+0000","last_became_peered":"2023-12-11T17:09:45.225563+0000","last_unstale":"2023-12-11T17:09:49.275410+0000","last_undegraded":"2023-12-11T17:09:49.275410+0000","last_fullsized":"2023-12-11T17:09:49.275410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:35:49.553886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.252708+0000","last_change":"2023-12-11T17:09:44.197835+0000","last_active":"2023-12-11T17:09:49.252708+0000","last_peered":"2023-12-11T17:09:49.252708+0000","last_clean":"2023-12-11T17:09:49.252708+0000","last_became_active":"2023-12-11T17:09:44.197550+0000","last_became_peered":"2023-12-11T17:09:44.197550+0000","last_unstale":"2023-12-11T17:09:49.252708+0000","last_undegraded":"2023-12-11T17:09:49.252708+0000","last_fullsized":"2023-12-11T17:09:49.252708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:48:05.507260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.734122+0000","last_change":"2023-12-11T17:09:49.277218+0000","last_active":"2023-12-11T17:09:50.734122+0000","last_peered":"2023-12-11T17:09:50.734122+0000","last_clean":"2023-12-11T17:09:50.734122+0000","last_became_active":"2023-12-11T17:09:49.276790+0000","last_became_peered":"2023-12-11T17:09:49.276790+0000","last_unstale":"2023-12-11T17:09:50.734122+0000","last_undegraded":"2023-12-11T17:09:50.734122+0000","last_fullsized":"2023-12-11T17:09:50.734122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:09:37.168887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274765+0000","last_change":"2023-12-11T17:09:45.228047+0000","last_active":"2023-12-11T17:09:49.274765+0000","last_peered":"2023-12-11T17:09:49.274765+0000","last_clean":"2023-12-11T17:09:49.274765+0000","last_became_active":"2023-12-11T17:09:45.225286+0000","last_became_peered":"2023-12-11T17:09:45.225286+0000","last_unstale":"2023-12-11T17:09:49.274765+0000","last_undegraded":"2023-12-11T17:09:49.274765+0000","last_fullsized":"2023-12-11T17:09:49.274765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:28:31.395156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.270765+0000","last_change":"2023-12-11T17:09:44.203193+0000","last_active":"2023-12-11T17:09:49.270765+0000","last_peered":"2023-12-11T17:09:49.270765+0000","last_clean":"2023-12-11T17:09:49.270765+0000","last_became_active":"2023-12-11T17:09:44.202663+0000","last_became_peered":"2023-12-11T17:09:44.202663+0000","last_unstale":"2023-12-11T17:09:49.270765+0000","last_undegraded":"2023-12-11T17:09:49.270765+0000","last_fullsized":"2023-12-11T17:09:49.270765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:17:24.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.668651+0000","last_change":"2023-12-11T17:09:49.274246+0000","last_active":"2023-12-11T17:09:51.668651+0000","last_peered":"2023-12-11T17:09:51.668651+0000","last_clean":"2023-12-11T17:09:51.668651+0000","last_became_active":"2023-12-11T17:09:49.273634+0000","last_became_peered":"2023-12-11T17:09:49.273634+0000","last_unstale":"2023-12-11T17:09:51.668651+0000","last_undegraded":"2023-12-11T17:09:51.668651+0000","last_fullsized":"2023-12-11T17:09:51.668651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:56.216955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.276177+0000","last_change":"2023-12-11T17:09:45.227483+0000","last_active":"2023-12-11T17:09:49.276177+0000","last_peered":"2023-12-11T17:09:49.276177+0000","last_clean":"2023-12-11T17:09:49.276177+0000","last_became_active":"2023-12-11T17:09:45.227150+0000","last_became_peered":"2023-12-11T17:09:45.227150+0000","last_unstale":"2023-12-11T17:09:49.276177+0000","last_undegraded":"2023-12-11T17:09:49.276177+0000","last_fullsized":"2023-12-11T17:09:49.276177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:36:10.393929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.249199+0000","last_change":"2023-12-11T17:09:44.185666+0000","last_active":"2023-12-11T17:09:49.249199+0000","last_peered":"2023-12-11T17:09:49.249199+0000","last_clean":"2023-12-11T17:09:49.249199+0000","last_became_active":"2023-12-11T17:09:44.185302+0000","last_became_peered":"2023-12-11T17:09:44.185302+0000","last_unstale":"2023-12-11T17:09:49.249199+0000","last_undegraded":"2023-12-11T17:09:49.249199+0000","last_fullsized":"2023-12-11T17:09:49.249199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:17:35.452188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.670426+0000","last_change":"2023-12-11T17:09:49.268722+0000","last_active":"2023-12-11T17:09:51.670426+0000","last_peered":"2023-12-11T17:09:51.670426+0000","last_clean":"2023-12-11T17:09:51.670426+0000","last_became_active":"2023-12-11T17:09:49.268340+0000","last_became_peered":"2023-12-11T17:09:49.268340+0000","last_unstale":"2023-12-11T17:09:51.670426+0000","last_undegraded":"2023-12-11T17:09:51.670426+0000","last_fullsized":"2023-12-11T17:09:51.670426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:28:35.459824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242938+0000","last_change":"2023-12-11T17:09:45.215129+0000","last_active":"2023-12-11T17:09:49.242938+0000","last_peered":"2023-12-11T17:09:49.242938+0000","last_clean":"2023-12-11T17:09:49.242938+0000","last_became_active":"2023-12-11T17:09:45.214556+0000","last_became_peered":"2023-12-11T17:09:45.214556+0000","last_unstale":"2023-12-11T17:09:49.242938+0000","last_undegraded":"2023-12-11T17:09:49.242938+0000","last_fullsized":"2023-12-11T17:09:49.242938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:27:18.925357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.243243+0000","last_change":"2023-12-11T17:09:44.195851+0000","last_active":"2023-12-11T17:09:49.243243+0000","last_peered":"2023-12-11T17:09:49.243243+0000","last_clean":"2023-12-11T17:09:49.243243+0000","last_became_active":"2023-12-11T17:09:44.195539+0000","last_became_peered":"2023-12-11T17:09:44.195539+0000","last_unstale":"2023-12-11T17:09:49.243243+0000","last_undegraded":"2023-12-11T17:09:49.243243+0000","last_fullsized":"2023-12-11T17:09:49.243243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:52:53.972126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.250040+0000","last_change":"2023-12-11T17:09:49.288681+0000","last_active":"2023-12-11T17:09:50.250040+0000","last_peered":"2023-12-11T17:09:50.250040+0000","last_clean":"2023-12-11T17:09:50.250040+0000","last_became_active":"2023-12-11T17:09:49.280484+0000","last_became_peered":"2023-12-11T17:09:49.280484+0000","last_unstale":"2023-12-11T17:09:50.250040+0000","last_undegraded":"2023-12-11T17:09:50.250040+0000","last_fullsized":"2023-12-11T17:09:50.250040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:28:03.097522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275178+0000","last_change":"2023-12-11T17:09:45.228655+0000","last_active":"2023-12-11T17:09:49.275178+0000","last_peered":"2023-12-11T17:09:49.275178+0000","last_clean":"2023-12-11T17:09:49.275178+0000","last_became_active":"2023-12-11T17:09:45.225530+0000","last_became_peered":"2023-12-11T17:09:45.225530+0000","last_unstale":"2023-12-11T17:09:49.275178+0000","last_undegraded":"2023-12-11T17:09:49.275178+0000","last_fullsized":"2023-12-11T17:09:49.275178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:04.076862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.263735+0000","last_change":"2023-12-11T17:09:44.197598+0000","last_active":"2023-12-11T17:09:49.263735+0000","last_peered":"2023-12-11T17:09:49.263735+0000","last_clean":"2023-12-11T17:09:49.263735+0000","last_became_active":"2023-12-11T17:09:44.197143+0000","last_became_peered":"2023-12-11T17:09:44.197143+0000","last_unstale":"2023-12-11T17:09:49.263735+0000","last_undegraded":"2023-12-11T17:09:49.263735+0000","last_fullsized":"2023-12-11T17:09:49.263735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:11:14.773136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.249485+0000","last_change":"2023-12-11T17:09:49.281263+0000","last_active":"2023-12-11T17:09:50.249485+0000","last_peered":"2023-12-11T17:09:50.249485+0000","last_clean":"2023-12-11T17:09:50.249485+0000","last_became_active":"2023-12-11T17:09:49.280311+0000","last_became_peered":"2023-12-11T17:09:49.280311+0000","last_unstale":"2023-12-11T17:09:50.249485+0000","last_undegraded":"2023-12-11T17:09:50.249485+0000","last_fullsized":"2023-12-11T17:09:50.249485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:14:54.962202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259318+0000","last_change":"2023-12-11T17:09:45.222607+0000","last_active":"2023-12-11T17:09:49.259318+0000","last_peered":"2023-12-11T17:09:49.259318+0000","last_clean":"2023-12-11T17:09:49.259318+0000","last_became_active":"2023-12-11T17:09:45.221704+0000","last_became_peered":"2023-12-11T17:09:45.221704+0000","last_unstale":"2023-12-11T17:09:49.259318+0000","last_undegraded":"2023-12-11T17:09:49.259318+0000","last_fullsized":"2023-12-11T17:09:49.259318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:27:18.925357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259851+0000","last_change":"2023-12-11T17:09:44.201116+0000","last_active":"2023-12-11T17:09:49.259851+0000","last_peered":"2023-12-11T17:09:49.259851+0000","last_clean":"2023-12-11T17:09:49.259851+0000","last_became_active":"2023-12-11T17:09:44.200316+0000","last_became_peered":"2023-12-11T17:09:44.200316+0000","last_unstale":"2023-12-11T17:09:49.259851+0000","last_undegraded":"2023-12-11T17:09:49.259851+0000","last_fullsized":"2023-12-11T17:09:49.259851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:22:33.669469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.735500+0000","last_change":"2023-12-11T17:09:49.284856+0000","last_active":"2023-12-11T17:09:50.735500+0000","last_peered":"2023-12-11T17:09:50.735500+0000","last_clean":"2023-12-11T17:09:50.735500+0000","last_became_active":"2023-12-11T17:09:49.284294+0000","last_became_peered":"2023-12-11T17:09:49.284294+0000","last_unstale":"2023-12-11T17:09:50.735500+0000","last_undegraded":"2023-12-11T17:09:50.735500+0000","last_fullsized":"2023-12-11T17:09:50.735500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:14:54.962202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274536+0000","last_change":"2023-12-11T17:09:45.220222+0000","last_active":"2023-12-11T17:09:49.274536+0000","last_peered":"2023-12-11T17:09:49.274536+0000","last_clean":"2023-12-11T17:09:49.274536+0000","last_became_active":"2023-12-11T17:09:45.218938+0000","last_became_peered":"2023-12-11T17:09:45.218938+0000","last_unstale":"2023-12-11T17:09:49.274536+0000","last_undegraded":"2023-12-11T17:09:49.274536+0000","last_fullsized":"2023-12-11T17:09:49.274536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:33:36.618495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:10:04.440884+0000","last_change":"2023-12-11T17:09:44.198146+0000","last_active":"2023-12-11T17:10:04.440884+0000","last_peered":"2023-12-11T17:10:04.440884+0000","last_clean":"2023-12-11T17:10:04.440884+0000","last_became_active":"2023-12-11T17:09:44.197814+0000","last_became_peered":"2023-12-11T17:09:44.197814+0000","last_unstale":"2023-12-11T17:10:04.440884+0000","last_undegraded":"2023-12-11T17:10:04.440884+0000","last_fullsized":"2023-12-11T17:10:04.440884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:43:18.152366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3840,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.671230+0000","last_change":"2023-12-11T17:09:49.267215+0000","last_active":"2023-12-11T17:09:51.671230+0000","last_peered":"2023-12-11T17:09:51.671230+0000","last_clean":"2023-12-11T17:09:51.671230+0000","last_became_active":"2023-12-11T17:09:49.266813+0000","last_became_peered":"2023-12-11T17:09:49.266813+0000","last_unstale":"2023-12-11T17:09:51.671230+0000","last_undegraded":"2023-12-11T17:09:51.671230+0000","last_fullsized":"2023-12-11T17:09:51.671230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:28:35.459824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.270634+0000","last_change":"2023-12-11T17:09:45.207339+0000","last_active":"2023-12-11T17:09:49.270634+0000","last_peered":"2023-12-11T17:09:49.270634+0000","last_clean":"2023-12-11T17:09:49.270634+0000","last_became_active":"2023-12-11T17:09:45.206332+0000","last_became_peered":"2023-12-11T17:09:45.206332+0000","last_unstale":"2023-12-11T17:09:49.270634+0000","last_undegraded":"2023-12-11T17:09:49.270634+0000","last_fullsized":"2023-12-11T17:09:49.270634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:13:56.615204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.241546+0000","last_change":"2023-12-11T17:09:44.204047+0000","last_active":"2023-12-11T17:09:49.241546+0000","last_peered":"2023-12-11T17:09:49.241546+0000","last_clean":"2023-12-11T17:09:49.241546+0000","last_became_active":"2023-12-11T17:09:44.203606+0000","last_became_peered":"2023-12-11T17:09:44.203606+0000","last_unstale":"2023-12-11T17:09:49.241546+0000","last_undegraded":"2023-12-11T17:09:49.241546+0000","last_fullsized":"2023-12-11T17:09:49.241546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:38:29.306893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669605+0000","last_change":"2023-12-11T17:09:49.277690+0000","last_active":"2023-12-11T17:09:51.669605+0000","last_peered":"2023-12-11T17:09:51.669605+0000","last_clean":"2023-12-11T17:09:51.669605+0000","last_became_active":"2023-12-11T17:09:49.277278+0000","last_became_peered":"2023-12-11T17:09:49.277278+0000","last_unstale":"2023-12-11T17:09:51.669605+0000","last_undegraded":"2023-12-11T17:09:51.669605+0000","last_fullsized":"2023-12-11T17:09:51.669605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:33:40.683163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.264691+0000","last_change":"2023-12-11T17:09:45.223576+0000","last_active":"2023-12-11T17:09:49.264691+0000","last_peered":"2023-12-11T17:09:49.264691+0000","last_clean":"2023-12-11T17:09:49.264691+0000","last_became_active":"2023-12-11T17:09:45.216938+0000","last_became_peered":"2023-12-11T17:09:45.216938+0000","last_unstale":"2023-12-11T17:09:49.264691+0000","last_undegraded":"2023-12-11T17:09:49.264691+0000","last_fullsized":"2023-12-11T17:09:49.264691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:52.152287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267786+0000","last_change":"2023-12-11T17:09:44.203731+0000","last_active":"2023-12-11T17:09:49.267786+0000","last_peered":"2023-12-11T17:09:49.267786+0000","last_clean":"2023-12-11T17:09:49.267786+0000","last_became_active":"2023-12-11T17:09:44.202145+0000","last_became_peered":"2023-12-11T17:09:44.202145+0000","last_unstale":"2023-12-11T17:09:49.267786+0000","last_undegraded":"2023-12-11T17:09:49.267786+0000","last_fullsized":"2023-12-11T17:09:49.267786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:27:17.913220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.247224+0000","last_change":"2023-12-11T17:09:49.268109+0000","last_active":"2023-12-11T17:09:50.247224+0000","last_peered":"2023-12-11T17:09:50.247224+0000","last_clean":"2023-12-11T17:09:50.247224+0000","last_became_active":"2023-12-11T17:09:49.264048+0000","last_became_peered":"2023-12-11T17:09:49.264048+0000","last_unstale":"2023-12-11T17:09:50.247224+0000","last_undegraded":"2023-12-11T17:09:50.247224+0000","last_fullsized":"2023-12-11T17:09:50.247224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:08:53.883159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267673+0000","last_change":"2023-12-11T17:09:45.225214+0000","last_active":"2023-12-11T17:09:49.267673+0000","last_peered":"2023-12-11T17:09:49.267673+0000","last_clean":"2023-12-11T17:09:49.267673+0000","last_became_active":"2023-12-11T17:09:45.224870+0000","last_became_peered":"2023-12-11T17:09:45.224870+0000","last_unstale":"2023-12-11T17:09:49.267673+0000","last_undegraded":"2023-12-11T17:09:49.267673+0000","last_fullsized":"2023-12-11T17:09:49.267673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:01:08.121657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.247231+0000","last_change":"2023-12-11T17:09:44.205313+0000","last_active":"2023-12-11T17:09:49.247231+0000","last_peered":"2023-12-11T17:09:49.247231+0000","last_clean":"2023-12-11T17:09:49.247231+0000","last_became_active":"2023-12-11T17:09:44.205016+0000","last_became_peered":"2023-12-11T17:09:44.205016+0000","last_unstale":"2023-12-11T17:09:49.247231+0000","last_undegraded":"2023-12-11T17:09:49.247231+0000","last_fullsized":"2023-12-11T17:09:49.247231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:43:26.684582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.247679+0000","last_change":"2023-12-11T17:09:49.282289+0000","last_active":"2023-12-11T17:09:50.247679+0000","last_peered":"2023-12-11T17:09:50.247679+0000","last_clean":"2023-12-11T17:09:50.247679+0000","last_became_active":"2023-12-11T17:09:49.281891+0000","last_became_peered":"2023-12-11T17:09:49.281891+0000","last_unstale":"2023-12-11T17:09:50.247679+0000","last_undegraded":"2023-12-11T17:09:50.247679+0000","last_fullsized":"2023-12-11T17:09:50.247679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:07:56.022278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.671580+0000","last_change":"2023-12-11T17:09:49.280847+0000","last_active":"2023-12-11T17:09:51.671580+0000","last_peered":"2023-12-11T17:09:51.671580+0000","last_clean":"2023-12-11T17:09:51.671580+0000","last_became_active":"2023-12-11T17:09:49.280442+0000","last_became_peered":"2023-12-11T17:09:49.280442+0000","last_unstale":"2023-12-11T17:09:51.671580+0000","last_undegraded":"2023-12-11T17:09:51.671580+0000","last_fullsized":"2023-12-11T17:09:51.671580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:24:45.184380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.240253+0000","last_change":"2023-12-11T17:09:45.198219+0000","last_active":"2023-12-11T17:09:49.240253+0000","last_peered":"2023-12-11T17:09:49.240253+0000","last_clean":"2023-12-11T17:09:49.240253+0000","last_became_active":"2023-12-11T17:09:45.196218+0000","last_became_peered":"2023-12-11T17:09:45.196218+0000","last_unstale":"2023-12-11T17:09:49.240253+0000","last_undegraded":"2023-12-11T17:09:49.240253+0000","last_fullsized":"2023-12-11T17:09:49.240253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:27:18.925357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.261218+0000","last_change":"2023-12-11T17:09:44.208638+0000","last_active":"2023-12-11T17:09:49.261218+0000","last_peered":"2023-12-11T17:09:49.261218+0000","last_clean":"2023-12-11T17:09:49.261218+0000","last_became_active":"2023-12-11T17:09:44.208143+0000","last_became_peered":"2023-12-11T17:09:44.208143+0000","last_unstale":"2023-12-11T17:09:49.261218+0000","last_undegraded":"2023-12-11T17:09:49.261218+0000","last_fullsized":"2023-12-11T17:09:49.261218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:39:09.678988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.247175+0000","last_change":"2023-12-11T17:09:49.270558+0000","last_active":"2023-12-11T17:09:50.247175+0000","last_peered":"2023-12-11T17:09:50.247175+0000","last_clean":"2023-12-11T17:09:50.247175+0000","last_became_active":"2023-12-11T17:09:49.270065+0000","last_became_peered":"2023-12-11T17:09:49.270065+0000","last_unstale":"2023-12-11T17:09:50.247175+0000","last_undegraded":"2023-12-11T17:09:50.247175+0000","last_fullsized":"2023-12-11T17:09:50.247175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:08.141530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242639+0000","last_change":"2023-12-11T17:09:45.209539+0000","last_active":"2023-12-11T17:09:49.242639+0000","last_peered":"2023-12-11T17:09:49.242639+0000","last_clean":"2023-12-11T17:09:49.242639+0000","last_became_active":"2023-12-11T17:09:45.209135+0000","last_became_peered":"2023-12-11T17:09:45.209135+0000","last_unstale":"2023-12-11T17:09:49.242639+0000","last_undegraded":"2023-12-11T17:09:49.242639+0000","last_fullsized":"2023-12-11T17:09:49.242639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:08:16.262435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.243583+0000","last_change":"2023-12-11T17:09:44.203078+0000","last_active":"2023-12-11T17:09:49.243583+0000","last_peered":"2023-12-11T17:09:49.243583+0000","last_clean":"2023-12-11T17:09:49.243583+0000","last_became_active":"2023-12-11T17:09:44.202856+0000","last_became_peered":"2023-12-11T17:09:44.202856+0000","last_unstale":"2023-12-11T17:09:49.243583+0000","last_undegraded":"2023-12-11T17:09:49.243583+0000","last_fullsized":"2023-12-11T17:09:49.243583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:13:55.603067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244507+0000","last_change":"2023-12-11T17:09:44.200256+0000","last_active":"2023-12-11T17:09:49.244507+0000","last_peered":"2023-12-11T17:09:49.244507+0000","last_clean":"2023-12-11T17:09:49.244507+0000","last_became_active":"2023-12-11T17:09:44.199854+0000","last_became_peered":"2023-12-11T17:09:44.199854+0000","last_unstale":"2023-12-11T17:09:49.244507+0000","last_undegraded":"2023-12-11T17:09:49.244507+0000","last_fullsized":"2023-12-11T17:09:49.244507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:22:33.669469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259758+0000","last_change":"2023-12-11T17:09:45.223465+0000","last_active":"2023-12-11T17:09:49.259758+0000","last_peered":"2023-12-11T17:09:49.259758+0000","last_clean":"2023-12-11T17:09:49.259758+0000","last_became_active":"2023-12-11T17:09:45.223204+0000","last_became_peered":"2023-12-11T17:09:45.223204+0000","last_unstale":"2023-12-11T17:09:49.259758+0000","last_undegraded":"2023-12-11T17:09:49.259758+0000","last_fullsized":"2023-12-11T17:09:49.259758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:39:10.691125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.245254+0000","last_change":"2023-12-11T17:09:49.264568+0000","last_active":"2023-12-11T17:09:50.245254+0000","last_peered":"2023-12-11T17:09:50.245254+0000","last_clean":"2023-12-11T17:09:50.245254+0000","last_became_active":"2023-12-11T17:09:49.263931+0000","last_became_peered":"2023-12-11T17:09:49.263931+0000","last_unstale":"2023-12-11T17:09:50.245254+0000","last_undegraded":"2023-12-11T17:09:50.245254+0000","last_fullsized":"2023-12-11T17:09:50.245254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T17:20:54.594805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242524+0000","last_change":"2023-12-11T17:09:44.205097+0000","last_active":"2023-12-11T17:09:49.242524+0000","last_peered":"2023-12-11T17:09:49.242524+0000","last_clean":"2023-12-11T17:09:49.242524+0000","last_became_active":"2023-12-11T17:09:44.204802+0000","last_became_peered":"2023-12-11T17:09:44.204802+0000","last_unstale":"2023-12-11T17:09:49.242524+0000","last_undegraded":"2023-12-11T17:09:49.242524+0000","last_fullsized":"2023-12-11T17:09:49.242524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:38:29.306893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.270946+0000","last_change":"2023-12-11T17:09:45.213754+0000","last_active":"2023-12-11T17:09:49.270946+0000","last_peered":"2023-12-11T17:09:49.270946+0000","last_clean":"2023-12-11T17:09:49.270946+0000","last_became_active":"2023-12-11T17:09:45.213235+0000","last_became_peered":"2023-12-11T17:09:45.213235+0000","last_unstale":"2023-12-11T17:09:49.270946+0000","last_undegraded":"2023-12-11T17:09:49.270946+0000","last_fullsized":"2023-12-11T17:09:49.270946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:45.225448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.249535+0000","last_change":"2023-12-11T17:09:49.275093+0000","last_active":"2023-12-11T17:09:50.249535+0000","last_peered":"2023-12-11T17:09:50.249535+0000","last_clean":"2023-12-11T17:09:50.249535+0000","last_became_active":"2023-12-11T17:09:49.274728+0000","last_became_peered":"2023-12-11T17:09:49.274728+0000","last_unstale":"2023-12-11T17:09:50.249535+0000","last_undegraded":"2023-12-11T17:09:50.249535+0000","last_fullsized":"2023-12-11T17:09:50.249535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:41:31.040376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242805+0000","last_change":"2023-12-11T17:09:45.214934+0000","last_active":"2023-12-11T17:09:49.242805+0000","last_peered":"2023-12-11T17:09:49.242805+0000","last_clean":"2023-12-11T17:09:49.242805+0000","last_became_active":"2023-12-11T17:09:45.214572+0000","last_became_peered":"2023-12-11T17:09:45.214572+0000","last_unstale":"2023-12-11T17:09:49.242805+0000","last_undegraded":"2023-12-11T17:09:49.242805+0000","last_fullsized":"2023-12-11T17:09:49.242805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:08:16.262435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.250749+0000","last_change":"2023-12-11T17:09:45.211423+0000","last_active":"2023-12-11T17:09:49.250749+0000","last_peered":"2023-12-11T17:09:49.250749+0000","last_clean":"2023-12-11T17:09:49.250749+0000","last_became_active":"2023-12-11T17:09:45.211056+0000","last_became_peered":"2023-12-11T17:09:45.211056+0000","last_unstale":"2023-12-11T17:09:49.250749+0000","last_undegraded":"2023-12-11T17:09:49.250749+0000","last_fullsized":"2023-12-11T17:09:49.250749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:46:02.502338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.263639+0000","last_change":"2023-12-11T17:09:45.197421+0000","last_active":"2023-12-11T17:09:49.263639+0000","last_peered":"2023-12-11T17:09:49.263639+0000","last_clean":"2023-12-11T17:09:49.263639+0000","last_became_active":"2023-12-11T17:09:45.197128+0000","last_became_peered":"2023-12-11T17:09:45.197128+0000","last_unstale":"2023-12-11T17:09:49.263639+0000","last_undegraded":"2023-12-11T17:09:49.263639+0000","last_fullsized":"2023-12-11T17:09:49.263639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:13:50.995140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259671+0000","last_change":"2023-12-11T17:09:45.208645+0000","last_active":"2023-12-11T17:09:49.259671+0000","last_peered":"2023-12-11T17:09:49.259671+0000","last_clean":"2023-12-11T17:09:49.259671+0000","last_became_active":"2023-12-11T17:09:45.203739+0000","last_became_peered":"2023-12-11T17:09:45.203739+0000","last_unstale":"2023-12-11T17:09:49.259671+0000","last_undegraded":"2023-12-11T17:09:49.259671+0000","last_fullsized":"2023-12-11T17:09:49.259671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:17:04.012857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242521+0000","last_change":"2023-12-11T17:09:45.220379+0000","last_active":"2023-12-11T17:09:49.242521+0000","last_peered":"2023-12-11T17:09:49.242521+0000","last_clean":"2023-12-11T17:09:49.242521+0000","last_became_active":"2023-12-11T17:09:45.220153+0000","last_became_peered":"2023-12-11T17:09:45.220153+0000","last_unstale":"2023-12-11T17:09:49.242521+0000","last_undegraded":"2023-12-11T17:09:49.242521+0000","last_fullsized":"2023-12-11T17:09:49.242521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:52.152287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.241402+0000","last_change":"2023-12-11T17:09:45.194086+0000","last_active":"2023-12-11T17:09:49.241402+0000","last_peered":"2023-12-11T17:09:49.241402+0000","last_clean":"2023-12-11T17:09:49.241402+0000","last_became_active":"2023-12-11T17:09:45.193835+0000","last_became_peered":"2023-12-11T17:09:45.193835+0000","last_unstale":"2023-12-11T17:09:49.241402+0000","last_undegraded":"2023-12-11T17:09:49.241402+0000","last_fullsized":"2023-12-11T17:09:49.241402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:05.364711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244539+0000","last_change":"2023-12-11T17:09:45.219697+0000","last_active":"2023-12-11T17:09:49.244539+0000","last_peered":"2023-12-11T17:09:49.244539+0000","last_clean":"2023-12-11T17:09:49.244539+0000","last_became_active":"2023-12-11T17:09:45.219406+0000","last_became_peered":"2023-12-11T17:09:45.219406+0000","last_unstale":"2023-12-11T17:09:49.244539+0000","last_undegraded":"2023-12-11T17:09:49.244539+0000","last_fullsized":"2023-12-11T17:09:49.244539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:52.152287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.243089+0000","last_change":"2023-12-11T17:09:45.220707+0000","last_active":"2023-12-11T17:09:49.243089+0000","last_peered":"2023-12-11T17:09:49.243089+0000","last_clean":"2023-12-11T17:09:49.243089+0000","last_became_active":"2023-12-11T17:09:45.220357+0000","last_became_peered":"2023-12-11T17:09:45.220357+0000","last_unstale":"2023-12-11T17:09:49.243089+0000","last_undegraded":"2023-12-11T17:09:49.243089+0000","last_fullsized":"2023-12-11T17:09:49.243089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:39:10.691125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.261207+0000","last_change":"2023-12-11T17:09:45.196150+0000","last_active":"2023-12-11T17:09:49.261207+0000","last_peered":"2023-12-11T17:09:49.261207+0000","last_clean":"2023-12-11T17:09:49.261207+0000","last_became_active":"2023-12-11T17:09:45.195878+0000","last_became_peered":"2023-12-11T17:09:45.195878+0000","last_unstale":"2023-12-11T17:09:49.261207+0000","last_undegraded":"2023-12-11T17:09:49.261207+0000","last_fullsized":"2023-12-11T17:09:49.261207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:51:29.300195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.243497+0000","last_change":"2023-12-11T17:09:45.220663+0000","last_active":"2023-12-11T17:09:49.243497+0000","last_peered":"2023-12-11T17:09:49.243497+0000","last_clean":"2023-12-11T17:09:49.243497+0000","last_became_active":"2023-12-11T17:09:45.220349+0000","last_became_peered":"2023-12-11T17:09:45.220349+0000","last_unstale":"2023-12-11T17:09:49.243497+0000","last_undegraded":"2023-12-11T17:09:49.243497+0000","last_fullsized":"2023-12-11T17:09:49.243497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:11:15.785273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.263544+0000","last_change":"2023-12-11T17:09:45.213788+0000","last_active":"2023-12-11T17:09:49.263544+0000","last_peered":"2023-12-11T17:09:49.263544+0000","last_clean":"2023-12-11T17:09:49.263544+0000","last_became_active":"2023-12-11T17:09:45.213454+0000","last_became_peered":"2023-12-11T17:09:45.213454+0000","last_unstale":"2023-12-11T17:09:49.263544+0000","last_undegraded":"2023-12-11T17:09:49.263544+0000","last_fullsized":"2023-12-11T17:09:49.263544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:36:10.393929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259552+0000","last_change":"2023-12-11T17:09:45.219309+0000","last_active":"2023-12-11T17:09:49.259552+0000","last_peered":"2023-12-11T17:09:49.259552+0000","last_clean":"2023-12-11T17:09:49.259552+0000","last_became_active":"2023-12-11T17:09:45.218538+0000","last_became_peered":"2023-12-11T17:09:45.218538+0000","last_unstale":"2023-12-11T17:09:49.259552+0000","last_undegraded":"2023-12-11T17:09:49.259552+0000","last_fullsized":"2023-12-11T17:09:49.259552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:11:15.785273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.246802+0000","last_change":"2023-12-11T17:09:45.217105+0000","last_active":"2023-12-11T17:09:49.246802+0000","last_peered":"2023-12-11T17:09:49.246802+0000","last_clean":"2023-12-11T17:09:49.246802+0000","last_became_active":"2023-12-11T17:09:45.215966+0000","last_became_peered":"2023-12-11T17:09:45.215966+0000","last_unstale":"2023-12-11T17:09:49.246802+0000","last_undegraded":"2023-12-11T17:09:49.246802+0000","last_fullsized":"2023-12-11T17:09:49.246802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:17:04.012857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274639+0000","last_change":"2023-12-11T17:09:45.225041+0000","last_active":"2023-12-11T17:09:49.274639+0000","last_peered":"2023-12-11T17:09:49.274639+0000","last_clean":"2023-12-11T17:09:49.274639+0000","last_became_active":"2023-12-11T17:09:45.224696+0000","last_became_peered":"2023-12-11T17:09:45.224696+0000","last_unstale":"2023-12-11T17:09:49.274639+0000","last_undegraded":"2023-12-11T17:09:49.274639+0000","last_fullsized":"2023-12-11T17:09:49.274639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:03:10.878069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.252605+0000","last_change":"2023-12-11T17:09:45.207821+0000","last_active":"2023-12-11T17:09:49.252605+0000","last_peered":"2023-12-11T17:09:49.252605+0000","last_clean":"2023-12-11T17:09:49.252605+0000","last_became_active":"2023-12-11T17:09:45.207541+0000","last_became_peered":"2023-12-11T17:09:45.207541+0000","last_unstale":"2023-12-11T17:09:49.252605+0000","last_undegraded":"2023-12-11T17:09:49.252605+0000","last_fullsized":"2023-12-11T17:09:49.252605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:51:44.769227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267963+0000","last_change":"2023-12-11T17:09:45.212081+0000","last_active":"2023-12-11T17:09:49.267963+0000","last_peered":"2023-12-11T17:09:49.267963+0000","last_clean":"2023-12-11T17:09:49.267963+0000","last_became_active":"2023-12-11T17:09:45.211781+0000","last_became_peered":"2023-12-11T17:09:45.211781+0000","last_unstale":"2023-12-11T17:09:49.267963+0000","last_undegraded":"2023-12-11T17:09:49.267963+0000","last_fullsized":"2023-12-11T17:09:49.267963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:03:10.878069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.260999+0000","last_change":"2023-12-11T17:09:45.218896+0000","last_active":"2023-12-11T17:09:49.260999+0000","last_peered":"2023-12-11T17:09:49.260999+0000","last_clean":"2023-12-11T17:09:49.260999+0000","last_became_active":"2023-12-11T17:09:45.218071+0000","last_became_peered":"2023-12-11T17:09:45.218071+0000","last_unstale":"2023-12-11T17:09:49.260999+0000","last_undegraded":"2023-12-11T17:09:49.260999+0000","last_fullsized":"2023-12-11T17:09:49.260999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:05.364711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.240603+0000","last_change":"2023-12-11T17:09:45.208633+0000","last_active":"2023-12-11T17:09:49.240603+0000","last_peered":"2023-12-11T17:09:49.240603+0000","last_clean":"2023-12-11T17:09:49.240603+0000","last_became_active":"2023-12-11T17:09:45.208337+0000","last_became_peered":"2023-12-11T17:09:45.208337+0000","last_unstale":"2023-12-11T17:09:49.240603+0000","last_undegraded":"2023-12-11T17:09:49.240603+0000","last_fullsized":"2023-12-11T17:09:49.240603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:11:15.785273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259315+0000","last_change":"2023-12-11T17:09:45.216391+0000","last_active":"2023-12-11T17:09:49.259315+0000","last_peered":"2023-12-11T17:09:49.259315+0000","last_clean":"2023-12-11T17:09:49.259315+0000","last_became_active":"2023-12-11T17:09:45.215314+0000","last_became_peered":"2023-12-11T17:09:45.215314+0000","last_unstale":"2023-12-11T17:09:49.259315+0000","last_undegraded":"2023-12-11T17:09:49.259315+0000","last_fullsized":"2023-12-11T17:09:49.259315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:42:31.915581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242252+0000","last_change":"2023-12-11T17:09:45.206222+0000","last_active":"2023-12-11T17:09:49.242252+0000","last_peered":"2023-12-11T17:09:49.242252+0000","last_clean":"2023-12-11T17:09:49.242252+0000","last_became_active":"2023-12-11T17:09:45.206027+0000","last_became_peered":"2023-12-11T17:09:45.206027+0000","last_unstale":"2023-12-11T17:09:49.242252+0000","last_undegraded":"2023-12-11T17:09:49.242252+0000","last_fullsized":"2023-12-11T17:09:49.242252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:05.364711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.270530+0000","last_change":"2023-12-11T17:09:45.209961+0000","last_active":"2023-12-11T17:09:49.270530+0000","last_peered":"2023-12-11T17:09:49.270530+0000","last_clean":"2023-12-11T17:09:49.270530+0000","last_became_active":"2023-12-11T17:09:45.207836+0000","last_became_peered":"2023-12-11T17:09:45.207836+0000","last_unstale":"2023-12-11T17:09:49.270530+0000","last_undegraded":"2023-12-11T17:09:49.270530+0000","last_fullsized":"2023-12-11T17:09:49.270530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:47:07.513492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.245215+0000","last_change":"2023-12-11T17:09:45.218319+0000","last_active":"2023-12-11T17:09:49.245215+0000","last_peered":"2023-12-11T17:09:49.245215+0000","last_clean":"2023-12-11T17:09:49.245215+0000","last_became_active":"2023-12-11T17:09:45.217465+0000","last_became_peered":"2023-12-11T17:09:45.217465+0000","last_unstale":"2023-12-11T17:09:49.245215+0000","last_undegraded":"2023-12-11T17:09:49.245215+0000","last_fullsized":"2023-12-11T17:09:49.245215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:11:15.785273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244369+0000","last_change":"2023-12-11T17:09:45.219120+0000","last_active":"2023-12-11T17:09:49.244369+0000","last_peered":"2023-12-11T17:09:49.244369+0000","last_clean":"2023-12-11T17:09:49.244369+0000","last_became_active":"2023-12-11T17:09:45.216692+0000","last_became_peered":"2023-12-11T17:09:45.216692+0000","last_unstale":"2023-12-11T17:09:49.244369+0000","last_undegraded":"2023-12-11T17:09:49.244369+0000","last_fullsized":"2023-12-11T17:09:49.244369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:05.364711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275330+0000","last_change":"2023-12-11T17:09:45.227610+0000","last_active":"2023-12-11T17:09:49.275330+0000","last_peered":"2023-12-11T17:09:49.275330+0000","last_clean":"2023-12-11T17:09:49.275330+0000","last_became_active":"2023-12-11T17:09:45.220917+0000","last_became_peered":"2023-12-11T17:09:45.220917+0000","last_unstale":"2023-12-11T17:09:49.275330+0000","last_undegraded":"2023-12-11T17:09:49.275330+0000","last_fullsized":"2023-12-11T17:09:49.275330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:24:41.119712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.241871+0000","last_change":"2023-12-11T17:09:45.213329+0000","last_active":"2023-12-11T17:09:49.241871+0000","last_peered":"2023-12-11T17:09:49.241871+0000","last_clean":"2023-12-11T17:09:49.241871+0000","last_became_active":"2023-12-11T17:09:45.211552+0000","last_became_peered":"2023-12-11T17:09:45.211552+0000","last_unstale":"2023-12-11T17:09:49.241871+0000","last_undegraded":"2023-12-11T17:09:49.241871+0000","last_fullsized":"2023-12-11T17:09:49.241871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:42:31.915581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274314+0000","last_change":"2023-12-11T17:09:45.219662+0000","last_active":"2023-12-11T17:09:49.274314+0000","last_peered":"2023-12-11T17:09:49.274314+0000","last_clean":"2023-12-11T17:09:49.274314+0000","last_became_active":"2023-12-11T17:09:45.219315+0000","last_became_peered":"2023-12-11T17:09:45.219315+0000","last_unstale":"2023-12-11T17:09:49.274314+0000","last_undegraded":"2023-12-11T17:09:49.274314+0000","last_fullsized":"2023-12-11T17:09:49.274314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:17:47.063007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.263442+0000","last_change":"2023-12-11T17:09:45.214165+0000","last_active":"2023-12-11T17:09:49.263442+0000","last_peered":"2023-12-11T17:09:49.263442+0000","last_clean":"2023-12-11T17:09:49.263442+0000","last_became_active":"2023-12-11T17:09:45.211191+0000","last_became_peered":"2023-12-11T17:09:45.211191+0000","last_unstale":"2023-12-11T17:09:49.263442+0000","last_undegraded":"2023-12-11T17:09:49.263442+0000","last_fullsized":"2023-12-11T17:09:49.263442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:52.152287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275091+0000","last_change":"2023-12-11T17:09:45.210404+0000","last_active":"2023-12-11T17:09:49.275091+0000","last_peered":"2023-12-11T17:09:49.275091+0000","last_clean":"2023-12-11T17:09:49.275091+0000","last_became_active":"2023-12-11T17:09:45.210084+0000","last_became_peered":"2023-12-11T17:09:45.210084+0000","last_unstale":"2023-12-11T17:09:49.275091+0000","last_undegraded":"2023-12-11T17:09:49.275091+0000","last_fullsized":"2023-12-11T17:09:49.275091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:13:50.995140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267850+0000","last_change":"2023-12-11T17:09:45.213977+0000","last_active":"2023-12-11T17:09:49.267850+0000","last_peered":"2023-12-11T17:09:49.267850+0000","last_clean":"2023-12-11T17:09:49.267850+0000","last_became_active":"2023-12-11T17:09:45.212551+0000","last_became_peered":"2023-12-11T17:09:45.212551+0000","last_unstale":"2023-12-11T17:09:49.267850+0000","last_undegraded":"2023-12-11T17:09:49.267850+0000","last_fullsized":"2023-12-11T17:09:49.267850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:17:47.063007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259640+0000","last_change":"2023-12-11T17:09:45.216618+0000","last_active":"2023-12-11T17:09:49.259640+0000","last_peered":"2023-12-11T17:09:49.259640+0000","last_clean":"2023-12-11T17:09:49.259640+0000","last_became_active":"2023-12-11T17:09:45.209865+0000","last_became_peered":"2023-12-11T17:09:45.209865+0000","last_unstale":"2023-12-11T17:09:49.259640+0000","last_undegraded":"2023-12-11T17:09:49.259640+0000","last_fullsized":"2023-12-11T17:09:49.259640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:56:34.698264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.241316+0000","last_change":"2023-12-11T17:09:45.208109+0000","last_active":"2023-12-11T17:09:49.241316+0000","last_peered":"2023-12-11T17:09:49.241316+0000","last_clean":"2023-12-11T17:09:49.241316+0000","last_became_active":"2023-12-11T17:09:45.204247+0000","last_became_peered":"2023-12-11T17:09:45.204247+0000","last_unstale":"2023-12-11T17:09:49.241316+0000","last_undegraded":"2023-12-11T17:09:49.241316+0000","last_fullsized":"2023-12-11T17:09:49.241316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:52.152287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275224+0000","last_change":"2023-12-11T17:09:45.225873+0000","last_active":"2023-12-11T17:09:49.275224+0000","last_peered":"2023-12-11T17:09:49.275224+0000","last_clean":"2023-12-11T17:09:49.275224+0000","last_became_active":"2023-12-11T17:09:45.225223+0000","last_became_peered":"2023-12-11T17:09:45.225223+0000","last_unstale":"2023-12-11T17:09:49.275224+0000","last_undegraded":"2023-12-11T17:09:49.275224+0000","last_fullsized":"2023-12-11T17:09:49.275224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:01:08.121657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4638,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":694037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6359999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4159999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":103177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":103213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5169999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1759999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]}]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4530000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0049999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":103087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6339999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5680000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.671}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":103247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.671}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]}]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":694093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.649}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6990000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-11T17:10:14.822 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-11T17:10:15.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.084+0000 7f0021ee7640 1 Processor -- start 2023-12-11T17:10:15.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.085+0000 7f0021ee7640 1 -- start start 2023-12-11T17:10:15.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.086+0000 7f0021ee7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f001c1467c0 0x7f001c0cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:15.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.086+0000 7f0021ee7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f001c146ba0 0x7f001c0cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:15.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.086+0000 7f0021ee7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f001c06c7e0 0x7f001c06cc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:15.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.086+0000 7f0021ee7640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f001c0ac860 con 0x7f001c146ba0 2023-12-11T17:10:15.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.086+0000 7f0021ee7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f001c06d510 con 0x7f001c06c7e0 2023-12-11T17:10:15.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.086+0000 7f0021ee7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001c06d7f0 con 0x7f001c1467c0 2023-12-11T17:10:15.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.087+0000 7f001affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f001c146ba0 0x7f001c0cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:15.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.087+0000 7f001affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f001c146ba0 0x7f001c0cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46544/0 (socket says 172.21.15.37:46544) 2023-12-11T17:10:15.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.087+0000 7f001affd640 1 -- 172.21.15.37:0/68919828 learned_addr learned my addr 172.21.15.37:0/68919828 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:15.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.087+0000 7f001bfff640 1 --2- 172.21.15.37:0/68919828 >> v2:172.21.15.151:3300/0 conn(0x7f001c06c7e0 0x7f001c06cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:15.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.087+0000 7f001b7fe640 1 --2- 172.21.15.37:0/68919828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f001c1467c0 0x7f001c0cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:15.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.087+0000 7f001affd640 1 -- 172.21.15.37:0/68919828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f001c1467c0 msgr2=0x7f001c0cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:15.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.087+0000 7f001affd640 1 --2- 172.21.15.37:0/68919828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f001c1467c0 0x7f001c0cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:15.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.087+0000 7f001affd640 1 -- 172.21.15.37:0/68919828 >> v2:172.21.15.151:3300/0 conn(0x7f001c06c7e0 msgr2=0x7f001c06cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:15.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.087+0000 7f001affd640 1 --2- 172.21.15.37:0/68919828 >> v2:172.21.15.151:3300/0 conn(0x7f001c06c7e0 0x7f001c06cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:15.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.087+0000 7f001affd640 1 -- 172.21.15.37:0/68919828 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f001c06dad0 con 0x7f001c146ba0 2023-12-11T17:10:15.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.087+0000 7f001bfff640 1 --2- 172.21.15.37:0/68919828 >> v2:172.21.15.151:3300/0 conn(0x7f001c06c7e0 0x7f001c06cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:15.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.087+0000 7f001b7fe640 1 --2- 172.21.15.37:0/68919828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f001c1467c0 0x7f001c0cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:15.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.088+0000 7f001affd640 1 --2- 172.21.15.37:0/68919828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f001c146ba0 0x7f001c0cce30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f001c0cb7b0 tx=0x7f000402b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e89848f32b1d30 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:15.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.089+0000 7f001a7fc640 1 -- 172.21.15.37:0/68919828 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0004031860 con 0x7f001c146ba0 2023-12-11T17:10:15.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.089+0000 7f001a7fc640 1 -- 172.21.15.37:0/68919828 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00040319c0 con 0x7f001c146ba0 2023-12-11T17:10:15.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.089+0000 7f001a7fc640 1 -- 172.21.15.37:0/68919828 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0004031d50 con 0x7f001c146ba0 2023-12-11T17:10:15.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.089+0000 7f0021ee7640 1 -- 172.21.15.37:0/68919828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f001c146ba0 msgr2=0x7f001c0cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:15.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.089+0000 7f0021ee7640 1 --2- 172.21.15.37:0/68919828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f001c146ba0 0x7f001c0cce30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f001c0cb7b0 tx=0x7f000402b900 comp rx=0 tx=0).stop 2023-12-11T17:10:15.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.090+0000 7f0021ee7640 1 -- 172.21.15.37:0/68919828 shutdown_connections 2023-12-11T17:10:15.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.090+0000 7f0021ee7640 1 --2- 172.21.15.37:0/68919828 >> v2:172.21.15.151:3300/0 conn(0x7f001c06c7e0 0x7f001c06cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:15.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.090+0000 7f0021ee7640 1 --2- 172.21.15.37:0/68919828 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f001c146ba0 0x7f001c0cce30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:15.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.090+0000 7f0021ee7640 1 --2- 172.21.15.37:0/68919828 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f001c1467c0 0x7f001c0cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:15.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.090+0000 7f0021ee7640 1 -- 172.21.15.37:0/68919828 >> 172.21.15.37:0/68919828 conn(0x7f001c0b0a90 msgr2=0x7f001c0b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:15.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.090+0000 7f0021ee7640 1 -- 172.21.15.37:0/68919828 shutdown_connections 2023-12-11T17:10:15.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.090+0000 7f0021ee7640 1 -- 172.21.15.37:0/68919828 wait complete. 2023-12-11T17:10:15.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.092+0000 7f0021ee7640 1 Processor -- start 2023-12-11T17:10:15.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.092+0000 7f0021ee7640 1 -- start start 2023-12-11T17:10:15.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.093+0000 7f0021ee7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f001c06c7e0 0x7f001c1f3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:15.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.093+0000 7f0021ee7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f001c1467c0 0x7f001c135410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:15.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.094+0000 7f0021ee7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f001c146ba0 0x7f001c1587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:15.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.094+0000 7f0021ee7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c159470 con 0x7f001c146ba0 2023-12-11T17:10:15.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.094+0000 7f0021ee7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f001c159190 con 0x7f001c06c7e0 2023-12-11T17:10:15.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.094+0000 7f0021ee7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f001c0b1cb0 con 0x7f001c1467c0 2023-12-11T17:10:15.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.094+0000 7f001bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f001c146ba0 0x7f001c1587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:15.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.094+0000 7f001bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f001c146ba0 0x7f001c1587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46554/0 (socket says 172.21.15.37:46554) 2023-12-11T17:10:15.095 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.094+0000 7f001bfff640 1 -- 172.21.15.37:0/2808767612 learned_addr learned my addr 172.21.15.37:0/2808767612 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:15.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.094+0000 7f001affd640 1 --2- 172.21.15.37:0/2808767612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f001c1467c0 0x7f001c135410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:15.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.094+0000 7f001b7fe640 1 --2- 172.21.15.37:0/2808767612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f001c06c7e0 0x7f001c1f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:15.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.094+0000 7f001bfff640 1 -- 172.21.15.37:0/2808767612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f001c1467c0 msgr2=0x7f001c135410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:15.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.094+0000 7f001bfff640 1 --2- 172.21.15.37:0/2808767612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f001c1467c0 0x7f001c135410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:15.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.094+0000 7f001bfff640 1 -- 172.21.15.37:0/2808767612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f001c06c7e0 msgr2=0x7f001c1f3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:15.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.094+0000 7f001bfff640 1 --2- 172.21.15.37:0/2808767612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f001c06c7e0 0x7f001c1f3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:15.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.094+0000 7f001bfff640 1 -- 172.21.15.37:0/2808767612 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00040094d0 con 0x7f001c146ba0 2023-12-11T17:10:15.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.095+0000 7f001bfff640 1 --2- 172.21.15.37:0/2808767612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f001c146ba0 0x7f001c1587d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f001400c7f0 tx=0x7f001400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:15.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.095+0000 7f0013fff640 1 -- 172.21.15.37:0/2808767612 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0014007820 con 0x7f001c146ba0 2023-12-11T17:10:15.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.095+0000 7f0013fff640 1 -- 172.21.15.37:0/2808767612 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0014007980 con 0x7f001c146ba0 2023-12-11T17:10:15.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.095+0000 7f0013fff640 1 -- 172.21.15.37:0/2808767612 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0014007d70 con 0x7f001c146ba0 2023-12-11T17:10:15.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.095+0000 7f0021ee7640 1 -- 172.21.15.37:0/2808767612 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f001c0b1f90 con 0x7f001c146ba0 2023-12-11T17:10:15.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.095+0000 7f0021ee7640 1 -- 172.21.15.37:0/2808767612 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f001c135950 con 0x7f001c146ba0 2023-12-11T17:10:15.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.096+0000 7f0021ee7640 1 -- 172.21.15.37:0/2808767612 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f001c0745d0 con 0x7f001c146ba0 2023-12-11T17:10:15.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.098+0000 7f0013fff640 1 -- 172.21.15.37:0/2808767612 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f00140113f0 con 0x7f001c146ba0 2023-12-11T17:10:15.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.099+0000 7f0013fff640 1 --2- 172.21.15.37:0/2808767612 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efffc06ae40 0x7efffc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:15.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.099+0000 7f0013fff640 1 -- 172.21.15.37:0/2808767612 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f0014089c50 con 0x7f001c146ba0 2023-12-11T17:10:15.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.099+0000 7f001b7fe640 1 --2- 172.21.15.37:0/2808767612 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efffc06ae40 0x7efffc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:15.101 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.100+0000 7f001b7fe640 1 --2- 172.21.15.37:0/2808767612 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efffc06ae40 0x7efffc06d300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f000c007fb0 tx=0x7f000c007990 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:15.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.103+0000 7f0013fff640 1 -- 172.21.15.37:0/2808767612 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f001408f020 con 0x7f001c146ba0 2023-12-11T17:10:15.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.294+0000 7f0021ee7640 1 -- 172.21.15.37:0/2808767612 --> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f001c06e560 con 0x7efffc06ae40 2023-12-11T17:10:15.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.320+0000 7f0013fff640 1 -- 172.21.15.37:0/2808767612 <== mgr.4111 v2:172.21.15.151:6832/3081040918 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345033 (secure 0 0 0) 0x7f001c06e560 con 0x7efffc06ae40 2023-12-11T17:10:15.325 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:15.328 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-12-11T17:10:15.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.328+0000 7f0021ee7640 1 -- 172.21.15.37:0/2808767612 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efffc06ae40 msgr2=0x7efffc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:15.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.328+0000 7f0021ee7640 1 --2- 172.21.15.37:0/2808767612 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efffc06ae40 0x7efffc06d300 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f000c007fb0 tx=0x7f000c007990 comp rx=0 tx=0).stop 2023-12-11T17:10:15.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.328+0000 7f0021ee7640 1 -- 172.21.15.37:0/2808767612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f001c146ba0 msgr2=0x7f001c1587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:15.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.328+0000 7f0021ee7640 1 --2- 172.21.15.37:0/2808767612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f001c146ba0 0x7f001c1587d0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f001400c7f0 tx=0x7f001400ccb0 comp rx=0 tx=0).stop 2023-12-11T17:10:15.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.328+0000 7f0021ee7640 1 -- 172.21.15.37:0/2808767612 shutdown_connections 2023-12-11T17:10:15.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.328+0000 7f0021ee7640 1 --2- 172.21.15.37:0/2808767612 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efffc06ae40 0x7efffc06d300 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:15.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.328+0000 7f0021ee7640 1 --2- 172.21.15.37:0/2808767612 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f001c146ba0 0x7f001c1587d0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:15.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.328+0000 7f0021ee7640 1 --2- 172.21.15.37:0/2808767612 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f001c1467c0 0x7f001c135410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:15.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.328+0000 7f0021ee7640 1 --2- 172.21.15.37:0/2808767612 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f001c06c7e0 0x7f001c1f3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:15.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.328+0000 7f0021ee7640 1 -- 172.21.15.37:0/2808767612 >> 172.21.15.37:0/2808767612 conn(0x7f001c0b0a90 msgr2=0x7f001c15dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:15.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.329+0000 7f0021ee7640 1 -- 172.21.15.37:0/2808767612 shutdown_connections 2023-12-11T17:10:15.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.329+0000 7f0021ee7640 1 -- 172.21.15.37:0/2808767612 wait complete. 2023-12-11T17:10:15.352 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2023-12-11T17:10:14.348813+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595006,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219428,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755292,"statfs":{"total":773094113280,"available":772869419008,"internally_reserved":0,"allocated":3350528,"data_stored":2014708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1781,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005008"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.264778+0000","last_change":"2023-12-11T17:09:44.205494+0000","last_active":"2023-12-11T17:09:49.264778+0000","last_peered":"2023-12-11T17:09:49.264778+0000","last_clean":"2023-12-11T17:09:49.264778+0000","last_became_active":"2023-12-11T17:09:44.205155+0000","last_became_peered":"2023-12-11T17:09:44.205155+0000","last_unstale":"2023-12-11T17:09:49.264778+0000","last_undegraded":"2023-12-11T17:09:49.264778+0000","last_fullsized":"2023-12-11T17:09:49.264778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:13:55.603067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242077+0000","last_change":"2023-12-11T17:09:45.206887+0000","last_active":"2023-12-11T17:09:49.242077+0000","last_peered":"2023-12-11T17:09:49.242077+0000","last_clean":"2023-12-11T17:09:49.242077+0000","last_became_active":"2023-12-11T17:09:45.206696+0000","last_became_peered":"2023-12-11T17:09:45.206696+0000","last_unstale":"2023-12-11T17:09:49.242077+0000","last_undegraded":"2023-12-11T17:09:49.242077+0000","last_fullsized":"2023-12-11T17:09:49.242077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:13:50.995140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.248574+0000","last_change":"2023-12-11T17:09:49.282316+0000","last_active":"2023-12-11T17:09:50.248574+0000","last_peered":"2023-12-11T17:09:50.248574+0000","last_clean":"2023-12-11T17:09:50.248574+0000","last_became_active":"2023-12-11T17:09:49.281935+0000","last_became_peered":"2023-12-11T17:09:49.281935+0000","last_unstale":"2023-12-11T17:09:50.248574+0000","last_undegraded":"2023-12-11T17:09:50.248574+0000","last_fullsized":"2023-12-11T17:09:50.248574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:09:37.168887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242245+0000","last_change":"2023-12-11T17:09:44.197711+0000","last_active":"2023-12-11T17:09:49.242245+0000","last_peered":"2023-12-11T17:09:49.242245+0000","last_clean":"2023-12-11T17:09:49.242245+0000","last_became_active":"2023-12-11T17:09:44.197229+0000","last_became_peered":"2023-12-11T17:09:44.197229+0000","last_unstale":"2023-12-11T17:09:49.242245+0000","last_undegraded":"2023-12-11T17:09:49.242245+0000","last_fullsized":"2023-12-11T17:09:49.242245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:56:33.686127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.264591+0000","last_change":"2023-12-11T17:09:45.215263+0000","last_active":"2023-12-11T17:09:49.264591+0000","last_peered":"2023-12-11T17:09:49.264591+0000","last_clean":"2023-12-11T17:09:49.264591+0000","last_became_active":"2023-12-11T17:09:45.214989+0000","last_became_peered":"2023-12-11T17:09:45.214989+0000","last_unstale":"2023-12-11T17:09:49.264591+0000","last_undegraded":"2023-12-11T17:09:49.264591+0000","last_fullsized":"2023-12-11T17:09:49.264591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:05.364711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669349+0000","last_change":"2023-12-11T17:09:49.281985+0000","last_active":"2023-12-11T17:09:51.669349+0000","last_peered":"2023-12-11T17:09:51.669349+0000","last_clean":"2023-12-11T17:09:51.669349+0000","last_became_active":"2023-12-11T17:09:49.280479+0000","last_became_peered":"2023-12-11T17:09:49.280479+0000","last_unstale":"2023-12-11T17:09:51.669349+0000","last_undegraded":"2023-12-11T17:09:51.669349+0000","last_fullsized":"2023-12-11T17:09:51.669349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:13:55.059808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274621+0000","last_change":"2023-12-11T17:09:44.209993+0000","last_active":"2023-12-11T17:09:49.274621+0000","last_peered":"2023-12-11T17:09:49.274621+0000","last_clean":"2023-12-11T17:09:49.274621+0000","last_became_active":"2023-12-11T17:09:44.209695+0000","last_became_peered":"2023-12-11T17:09:44.209695+0000","last_unstale":"2023-12-11T17:09:49.274621+0000","last_undegraded":"2023-12-11T17:09:49.274621+0000","last_fullsized":"2023-12-11T17:09:49.274621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:08:15.250298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267955+0000","last_change":"2023-12-11T17:09:45.222374+0000","last_active":"2023-12-11T17:09:49.267955+0000","last_peered":"2023-12-11T17:09:49.267955+0000","last_clean":"2023-12-11T17:09:49.267955+0000","last_became_active":"2023-12-11T17:09:45.222069+0000","last_became_peered":"2023-12-11T17:09:45.222069+0000","last_unstale":"2023-12-11T17:09:49.267955+0000","last_undegraded":"2023-12-11T17:09:49.267955+0000","last_fullsized":"2023-12-11T17:09:49.267955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:33:36.618495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669784+0000","last_change":"2023-12-11T17:09:49.277595+0000","last_active":"2023-12-11T17:09:51.669784+0000","last_peered":"2023-12-11T17:09:51.669784+0000","last_clean":"2023-12-11T17:09:51.669784+0000","last_became_active":"2023-12-11T17:09:49.276806+0000","last_became_peered":"2023-12-11T17:09:49.276806+0000","last_unstale":"2023-12-11T17:09:51.669784+0000","last_undegraded":"2023-12-11T17:09:51.669784+0000","last_fullsized":"2023-12-11T17:09:51.669784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:08.141530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274475+0000","last_change":"2023-12-11T17:09:44.213170+0000","last_active":"2023-12-11T17:09:49.274475+0000","last_peered":"2023-12-11T17:09:49.274475+0000","last_clean":"2023-12-11T17:09:49.274475+0000","last_became_active":"2023-12-11T17:09:44.212695+0000","last_became_peered":"2023-12-11T17:09:44.212695+0000","last_unstale":"2023-12-11T17:09:49.274475+0000","last_undegraded":"2023-12-11T17:09:49.274475+0000","last_fullsized":"2023-12-11T17:09:49.274475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:38:29.306893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267473+0000","last_change":"2023-12-11T17:09:45.222217+0000","last_active":"2023-12-11T17:09:49.267473+0000","last_peered":"2023-12-11T17:09:49.267473+0000","last_clean":"2023-12-11T17:09:49.267473+0000","last_became_active":"2023-12-11T17:09:45.221985+0000","last_became_peered":"2023-12-11T17:09:45.221985+0000","last_unstale":"2023-12-11T17:09:49.267473+0000","last_undegraded":"2023-12-11T17:09:49.267473+0000","last_fullsized":"2023-12-11T17:09:49.267473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:02:04.180131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.668985+0000","last_change":"2023-12-11T17:09:49.271236+0000","last_active":"2023-12-11T17:09:51.668985+0000","last_peered":"2023-12-11T17:09:51.668985+0000","last_clean":"2023-12-11T17:09:51.668985+0000","last_became_active":"2023-12-11T17:09:49.268635+0000","last_became_peered":"2023-12-11T17:09:49.268635+0000","last_unstale":"2023-12-11T17:09:51.668985+0000","last_undegraded":"2023-12-11T17:09:51.668985+0000","last_fullsized":"2023-12-11T17:09:51.668985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:36:14.458597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244251+0000","last_change":"2023-12-11T17:09:45.215612+0000","last_active":"2023-12-11T17:09:49.244251+0000","last_peered":"2023-12-11T17:09:49.244251+0000","last_clean":"2023-12-11T17:09:49.244251+0000","last_became_active":"2023-12-11T17:09:45.215222+0000","last_became_peered":"2023-12-11T17:09:45.215222+0000","last_unstale":"2023-12-11T17:09:49.244251+0000","last_undegraded":"2023-12-11T17:09:49.244251+0000","last_fullsized":"2023-12-11T17:09:49.244251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:39:10.691125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275270+0000","last_change":"2023-12-11T17:09:44.208572+0000","last_active":"2023-12-11T17:09:49.275270+0000","last_peered":"2023-12-11T17:09:49.275270+0000","last_clean":"2023-12-11T17:09:49.275270+0000","last_became_active":"2023-12-11T17:09:44.208062+0000","last_became_peered":"2023-12-11T17:09:44.208062+0000","last_unstale":"2023-12-11T17:09:49.275270+0000","last_undegraded":"2023-12-11T17:09:49.275270+0000","last_fullsized":"2023-12-11T17:09:49.275270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:22:33.669469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669908+0000","last_change":"2023-12-11T17:09:49.280949+0000","last_active":"2023-12-11T17:09:51.669908+0000","last_peered":"2023-12-11T17:09:51.669908+0000","last_clean":"2023-12-11T17:09:51.669908+0000","last_became_active":"2023-12-11T17:09:49.280486+0000","last_became_peered":"2023-12-11T17:09:49.280486+0000","last_unstale":"2023-12-11T17:09:51.669908+0000","last_undegraded":"2023-12-11T17:09:51.669908+0000","last_fullsized":"2023-12-11T17:09:51.669908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:28:35.459824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242397+0000","last_change":"2023-12-11T17:09:45.200951+0000","last_active":"2023-12-11T17:09:49.242397+0000","last_peered":"2023-12-11T17:09:49.242397+0000","last_clean":"2023-12-11T17:09:49.242397+0000","last_became_active":"2023-12-11T17:09:45.199504+0000","last_became_peered":"2023-12-11T17:09:45.199504+0000","last_unstale":"2023-12-11T17:09:49.242397+0000","last_undegraded":"2023-12-11T17:09:49.242397+0000","last_fullsized":"2023-12-11T17:09:49.242397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:51:29.300195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.247683+0000","last_change":"2023-12-11T17:09:44.195059+0000","last_active":"2023-12-11T17:09:49.247683+0000","last_peered":"2023-12-11T17:09:49.247683+0000","last_clean":"2023-12-11T17:09:49.247683+0000","last_became_active":"2023-12-11T17:09:44.194799+0000","last_became_peered":"2023-12-11T17:09:44.194799+0000","last_unstale":"2023-12-11T17:09:49.247683+0000","last_undegraded":"2023-12-11T17:09:49.247683+0000","last_fullsized":"2023-12-11T17:09:49.247683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:43:26.684582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669518+0000","last_change":"2023-12-11T17:09:49.279664+0000","last_active":"2023-12-11T17:09:51.669518+0000","last_peered":"2023-12-11T17:09:51.669518+0000","last_clean":"2023-12-11T17:09:51.669518+0000","last_became_active":"2023-12-11T17:09:49.279207+0000","last_became_peered":"2023-12-11T17:09:49.279207+0000","last_unstale":"2023-12-11T17:09:51.669518+0000","last_undegraded":"2023-12-11T17:09:51.669518+0000","last_fullsized":"2023-12-11T17:09:51.669518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:02:08.244798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242731+0000","last_change":"2023-12-11T17:09:45.209162+0000","last_active":"2023-12-11T17:09:49.242731+0000","last_peered":"2023-12-11T17:09:49.242731+0000","last_clean":"2023-12-11T17:09:49.242731+0000","last_became_active":"2023-12-11T17:09:45.204781+0000","last_became_peered":"2023-12-11T17:09:45.204781+0000","last_unstale":"2023-12-11T17:09:49.242731+0000","last_undegraded":"2023-12-11T17:09:49.242731+0000","last_fullsized":"2023-12-11T17:09:49.242731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:27:18.925357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.241243+0000","last_change":"2023-12-11T17:09:44.196375+0000","last_active":"2023-12-11T17:09:49.241243+0000","last_peered":"2023-12-11T17:09:49.241243+0000","last_clean":"2023-12-11T17:09:49.241243+0000","last_became_active":"2023-12-11T17:09:44.196046+0000","last_became_peered":"2023-12-11T17:09:44.196046+0000","last_unstale":"2023-12-11T17:09:49.241243+0000","last_undegraded":"2023-12-11T17:09:49.241243+0000","last_fullsized":"2023-12-11T17:09:49.241243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:42:30.903444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.673124+0000","last_change":"2023-12-11T17:09:49.280698+0000","last_active":"2023-12-11T17:09:51.673124+0000","last_peered":"2023-12-11T17:09:51.673124+0000","last_clean":"2023-12-11T17:09:51.673124+0000","last_became_active":"2023-12-11T17:09:49.280309+0000","last_became_peered":"2023-12-11T17:09:49.280309+0000","last_unstale":"2023-12-11T17:09:51.673124+0000","last_undegraded":"2023-12-11T17:09:51.673124+0000","last_fullsized":"2023-12-11T17:09:51.673124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:24:45.184380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.270508+0000","last_change":"2023-12-11T17:09:45.210450+0000","last_active":"2023-12-11T17:09:49.270508+0000","last_peered":"2023-12-11T17:09:49.270508+0000","last_clean":"2023-12-11T17:09:49.270508+0000","last_became_active":"2023-12-11T17:09:45.202201+0000","last_became_peered":"2023-12-11T17:09:45.202201+0000","last_unstale":"2023-12-11T17:09:49.270508+0000","last_undegraded":"2023-12-11T17:09:49.270508+0000","last_fullsized":"2023-12-11T17:09:49.270508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:43:19.164503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.271955+0000","last_change":"2023-12-11T17:09:44.209283+0000","last_active":"2023-12-11T17:09:49.271955+0000","last_peered":"2023-12-11T17:09:49.271955+0000","last_clean":"2023-12-11T17:09:49.271955+0000","last_became_active":"2023-12-11T17:09:44.208995+0000","last_became_peered":"2023-12-11T17:09:44.208995+0000","last_unstale":"2023-12-11T17:09:49.271955+0000","last_undegraded":"2023-12-11T17:09:49.271955+0000","last_fullsized":"2023-12-11T17:09:49.271955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:43:26.684582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669445+0000","last_change":"2023-12-11T17:09:49.278872+0000","last_active":"2023-12-11T17:09:51.669445+0000","last_peered":"2023-12-11T17:09:51.669445+0000","last_clean":"2023-12-11T17:09:51.669445+0000","last_became_active":"2023-12-11T17:09:49.276738+0000","last_became_peered":"2023-12-11T17:09:49.276738+0000","last_unstale":"2023-12-11T17:09:51.669445+0000","last_undegraded":"2023-12-11T17:09:51.669445+0000","last_fullsized":"2023-12-11T17:09:51.669445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:17:51.127675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.261226+0000","last_change":"2023-12-11T17:09:45.211027+0000","last_active":"2023-12-11T17:09:49.261226+0000","last_peered":"2023-12-11T17:09:49.261226+0000","last_clean":"2023-12-11T17:09:49.261226+0000","last_became_active":"2023-12-11T17:09:45.210763+0000","last_became_peered":"2023-12-11T17:09:45.210763+0000","last_unstale":"2023-12-11T17:09:49.261226+0000","last_undegraded":"2023-12-11T17:09:49.261226+0000","last_fullsized":"2023-12-11T17:09:49.261226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:08:16.262435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.247483+0000","last_change":"2023-12-11T17:09:44.203386+0000","last_active":"2023-12-11T17:09:49.247483+0000","last_peered":"2023-12-11T17:09:49.247483+0000","last_clean":"2023-12-11T17:09:49.247483+0000","last_became_active":"2023-12-11T17:09:44.203053+0000","last_became_peered":"2023-12-11T17:09:44.203053+0000","last_unstale":"2023-12-11T17:09:49.247483+0000","last_undegraded":"2023-12-11T17:09:49.247483+0000","last_fullsized":"2023-12-11T17:09:49.247483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:44.213311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.668973+0000","last_change":"2023-12-11T17:09:49.282875+0000","last_active":"2023-12-11T17:09:51.668973+0000","last_peered":"2023-12-11T17:09:51.668973+0000","last_clean":"2023-12-11T17:09:51.668973+0000","last_became_active":"2023-12-11T17:09:49.282315+0000","last_became_peered":"2023-12-11T17:09:49.282315+0000","last_unstale":"2023-12-11T17:09:51.668973+0000","last_undegraded":"2023-12-11T17:09:51.668973+0000","last_fullsized":"2023-12-11T17:09:51.668973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:51:33.364863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.243142+0000","last_change":"2023-12-11T17:09:45.195150+0000","last_active":"2023-12-11T17:09:49.243142+0000","last_peered":"2023-12-11T17:09:49.243142+0000","last_clean":"2023-12-11T17:09:49.243142+0000","last_became_active":"2023-12-11T17:09:45.194871+0000","last_became_peered":"2023-12-11T17:09:45.194871+0000","last_unstale":"2023-12-11T17:09:49.243142+0000","last_undegraded":"2023-12-11T17:09:49.243142+0000","last_fullsized":"2023-12-11T17:09:49.243142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:36:10.393929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.247741+0000","last_change":"2023-12-11T17:09:44.194695+0000","last_active":"2023-12-11T17:09:49.247741+0000","last_peered":"2023-12-11T17:09:49.247741+0000","last_clean":"2023-12-11T17:09:49.247741+0000","last_became_active":"2023-12-11T17:09:44.193709+0000","last_became_peered":"2023-12-11T17:09:44.193709+0000","last_unstale":"2023-12-11T17:09:49.247741+0000","last_undegraded":"2023-12-11T17:09:49.247741+0000","last_fullsized":"2023-12-11T17:09:49.247741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:47:06.501355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.245990+0000","last_change":"2023-12-11T17:09:49.278389+0000","last_active":"2023-12-11T17:09:50.245990+0000","last_peered":"2023-12-11T17:09:50.245990+0000","last_clean":"2023-12-11T17:09:50.245990+0000","last_became_active":"2023-12-11T17:09:49.277824+0000","last_became_peered":"2023-12-11T17:09:49.277824+0000","last_unstale":"2023-12-11T17:09:50.245990+0000","last_undegraded":"2023-12-11T17:09:50.245990+0000","last_fullsized":"2023-12-11T17:09:50.245990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:35:53.618553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244690+0000","last_change":"2023-12-11T17:09:45.201703+0000","last_active":"2023-12-11T17:09:49.244690+0000","last_peered":"2023-12-11T17:09:49.244690+0000","last_clean":"2023-12-11T17:09:49.244690+0000","last_became_active":"2023-12-11T17:09:45.200824+0000","last_became_peered":"2023-12-11T17:09:45.200824+0000","last_unstale":"2023-12-11T17:09:49.244690+0000","last_undegraded":"2023-12-11T17:09:49.244690+0000","last_fullsized":"2023-12-11T17:09:49.244690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:39:10.691125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274750+0000","last_change":"2023-12-11T17:09:44.208756+0000","last_active":"2023-12-11T17:09:49.274750+0000","last_peered":"2023-12-11T17:09:49.274750+0000","last_clean":"2023-12-11T17:09:49.274750+0000","last_became_active":"2023-12-11T17:09:44.208390+0000","last_became_peered":"2023-12-11T17:09:44.208390+0000","last_unstale":"2023-12-11T17:09:49.274750+0000","last_undegraded":"2023-12-11T17:09:49.274750+0000","last_fullsized":"2023-12-11T17:09:49.274750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:04.352574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.671162+0000","last_change":"2023-12-11T17:09:49.283760+0000","last_active":"2023-12-11T17:09:51.671162+0000","last_peered":"2023-12-11T17:09:51.671162+0000","last_clean":"2023-12-11T17:09:51.671162+0000","last_became_active":"2023-12-11T17:09:49.281062+0000","last_became_peered":"2023-12-11T17:09:49.281062+0000","last_unstale":"2023-12-11T17:09:51.671162+0000","last_undegraded":"2023-12-11T17:09:51.671162+0000","last_fullsized":"2023-12-11T17:09:51.671162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:01:12.186325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267581+0000","last_change":"2023-12-11T17:09:45.214708+0000","last_active":"2023-12-11T17:09:49.267581+0000","last_peered":"2023-12-11T17:09:49.267581+0000","last_clean":"2023-12-11T17:09:49.267581+0000","last_became_active":"2023-12-11T17:09:45.214453+0000","last_became_peered":"2023-12-11T17:09:45.214453+0000","last_unstale":"2023-12-11T17:09:49.267581+0000","last_undegraded":"2023-12-11T17:09:49.267581+0000","last_fullsized":"2023-12-11T17:09:49.267581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:04.076862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244838+0000","last_change":"2023-12-11T17:09:44.192839+0000","last_active":"2023-12-11T17:09:49.244838+0000","last_peered":"2023-12-11T17:09:49.244838+0000","last_clean":"2023-12-11T17:09:49.244838+0000","last_became_active":"2023-12-11T17:09:44.192441+0000","last_became_peered":"2023-12-11T17:09:44.192441+0000","last_unstale":"2023-12-11T17:09:49.244838+0000","last_undegraded":"2023-12-11T17:09:49.244838+0000","last_fullsized":"2023-12-11T17:09:49.244838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:52:53.972126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.670689+0000","last_change":"2023-12-11T17:09:49.270432+0000","last_active":"2023-12-11T17:09:51.670689+0000","last_peered":"2023-12-11T17:09:51.670689+0000","last_clean":"2023-12-11T17:09:51.670689+0000","last_became_active":"2023-12-11T17:09:49.269987+0000","last_became_peered":"2023-12-11T17:09:49.269987+0000","last_unstale":"2023-12-11T17:09:51.670689+0000","last_undegraded":"2023-12-11T17:09:51.670689+0000","last_fullsized":"2023-12-11T17:09:51.670689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:08.141530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.271570+0000","last_change":"2023-12-11T17:09:45.222655+0000","last_active":"2023-12-11T17:09:49.271570+0000","last_peered":"2023-12-11T17:09:49.271570+0000","last_clean":"2023-12-11T17:09:49.271570+0000","last_became_active":"2023-12-11T17:09:45.222198+0000","last_became_peered":"2023-12-11T17:09:45.222198+0000","last_unstale":"2023-12-11T17:09:49.271570+0000","last_undegraded":"2023-12-11T17:09:49.271570+0000","last_fullsized":"2023-12-11T17:09:49.271570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:28:10.075039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.263830+0000","last_change":"2023-12-11T17:09:44.207657+0000","last_active":"2023-12-11T17:09:49.263830+0000","last_peered":"2023-12-11T17:09:49.263830+0000","last_clean":"2023-12-11T17:09:49.263830+0000","last_became_active":"2023-12-11T17:09:44.205012+0000","last_became_peered":"2023-12-11T17:09:44.205012+0000","last_unstale":"2023-12-11T17:09:49.263830+0000","last_undegraded":"2023-12-11T17:09:49.263830+0000","last_fullsized":"2023-12-11T17:09:49.263830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:17:03.000720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.672166+0000","last_change":"2023-12-11T17:09:49.270417+0000","last_active":"2023-12-11T17:09:51.672166+0000","last_peered":"2023-12-11T17:09:51.672166+0000","last_clean":"2023-12-11T17:09:51.672166+0000","last_became_active":"2023-12-11T17:09:49.270052+0000","last_became_peered":"2023-12-11T17:09:49.270052+0000","last_unstale":"2023-12-11T17:09:51.672166+0000","last_undegraded":"2023-12-11T17:09:51.672166+0000","last_fullsized":"2023-12-11T17:09:51.672166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:03:14.942737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.240098+0000","last_change":"2023-12-11T17:09:45.205128+0000","last_active":"2023-12-11T17:09:49.240098+0000","last_peered":"2023-12-11T17:09:49.240098+0000","last_clean":"2023-12-11T17:09:49.240098+0000","last_became_active":"2023-12-11T17:09:45.204869+0000","last_became_peered":"2023-12-11T17:09:45.204869+0000","last_unstale":"2023-12-11T17:09:49.240098+0000","last_undegraded":"2023-12-11T17:09:49.240098+0000","last_fullsized":"2023-12-11T17:09:49.240098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:17:04.012857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.250848+0000","last_change":"2023-12-11T17:09:44.198305+0000","last_active":"2023-12-11T17:09:49.250848+0000","last_peered":"2023-12-11T17:09:49.250848+0000","last_clean":"2023-12-11T17:09:49.250848+0000","last_became_active":"2023-12-11T17:09:44.196890+0000","last_became_peered":"2023-12-11T17:09:44.196890+0000","last_unstale":"2023-12-11T17:09:49.250848+0000","last_undegraded":"2023-12-11T17:09:49.250848+0000","last_fullsized":"2023-12-11T17:09:49.250848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:59:22.990940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.673145+0000","last_change":"2023-12-11T17:09:49.272669+0000","last_active":"2023-12-11T17:09:51.673145+0000","last_peered":"2023-12-11T17:09:51.673145+0000","last_clean":"2023-12-11T17:09:51.673145+0000","last_became_active":"2023-12-11T17:09:49.269739+0000","last_became_peered":"2023-12-11T17:09:49.269739+0000","last_unstale":"2023-12-11T17:09:51.673145+0000","last_undegraded":"2023-12-11T17:09:51.673145+0000","last_fullsized":"2023-12-11T17:09:51.673145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:01:12.186325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259188+0000","last_change":"2023-12-11T17:09:45.215855+0000","last_active":"2023-12-11T17:09:49.259188+0000","last_peered":"2023-12-11T17:09:49.259188+0000","last_clean":"2023-12-11T17:09:49.259188+0000","last_became_active":"2023-12-11T17:09:45.214930+0000","last_became_peered":"2023-12-11T17:09:45.214930+0000","last_unstale":"2023-12-11T17:09:49.259188+0000","last_undegraded":"2023-12-11T17:09:49.259188+0000","last_fullsized":"2023-12-11T17:09:49.259188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:38:30.319030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.272045+0000","last_change":"2023-12-11T17:09:44.206866+0000","last_active":"2023-12-11T17:09:49.272045+0000","last_peered":"2023-12-11T17:09:49.272045+0000","last_clean":"2023-12-11T17:09:49.272045+0000","last_became_active":"2023-12-11T17:09:44.205821+0000","last_became_peered":"2023-12-11T17:09:44.205821+0000","last_unstale":"2023-12-11T17:09:49.272045+0000","last_undegraded":"2023-12-11T17:09:49.272045+0000","last_fullsized":"2023-12-11T17:09:49.272045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:44.213311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.670848+0000","last_change":"2023-12-11T17:09:49.285904+0000","last_active":"2023-12-11T17:09:51.670848+0000","last_peered":"2023-12-11T17:09:51.670848+0000","last_clean":"2023-12-11T17:09:51.670848+0000","last_became_active":"2023-12-11T17:09:49.282906+0000","last_became_peered":"2023-12-11T17:09:49.282906+0000","last_unstale":"2023-12-11T17:09:51.670848+0000","last_undegraded":"2023-12-11T17:09:51.670848+0000","last_fullsized":"2023-12-11T17:09:51.670848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:03:14.942737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242151+0000","last_change":"2023-12-11T17:09:45.213664+0000","last_active":"2023-12-11T17:09:49.242151+0000","last_peered":"2023-12-11T17:09:49.242151+0000","last_clean":"2023-12-11T17:09:49.242151+0000","last_became_active":"2023-12-11T17:09:45.213356+0000","last_became_peered":"2023-12-11T17:09:45.213356+0000","last_unstale":"2023-12-11T17:09:49.242151+0000","last_undegraded":"2023-12-11T17:09:49.242151+0000","last_fullsized":"2023-12-11T17:09:49.242151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:17:04.012857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.266436+0000","last_change":"2023-12-11T17:09:44.196934+0000","last_active":"2023-12-11T17:09:49.266436+0000","last_peered":"2023-12-11T17:09:49.266436+0000","last_clean":"2023-12-11T17:09:49.266436+0000","last_became_active":"2023-12-11T17:09:44.192526+0000","last_became_peered":"2023-12-11T17:09:44.192526+0000","last_unstale":"2023-12-11T17:09:49.266436+0000","last_undegraded":"2023-12-11T17:09:49.266436+0000","last_fullsized":"2023-12-11T17:09:49.266436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:08:15.250298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.272132+0000","last_change":"2023-12-11T17:09:40.320298+0000","last_active":"2023-12-11T17:09:49.272132+0000","last_peered":"2023-12-11T17:09:49.272132+0000","last_clean":"2023-12-11T17:09:49.272132+0000","last_became_active":"2023-12-11T17:09:40.318118+0000","last_became_peered":"2023-12-11T17:09:40.318118+0000","last_unstale":"2023-12-11T17:09:49.272132+0000","last_undegraded":"2023-12-11T17:09:49.272132+0000","last_fullsized":"2023-12-11T17:09:49.272132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:38.641841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:38.641841+0000","last_clean_scrub_stamp":"2023-12-11T17:09:38.641841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:36:05.856847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.246854+0000","last_change":"2023-12-11T17:09:49.284105+0000","last_active":"2023-12-11T17:09:50.246854+0000","last_peered":"2023-12-11T17:09:50.246854+0000","last_clean":"2023-12-11T17:09:50.246854+0000","last_became_active":"2023-12-11T17:09:49.282365+0000","last_became_peered":"2023-12-11T17:09:49.282365+0000","last_unstale":"2023-12-11T17:09:50.246854+0000","last_undegraded":"2023-12-11T17:09:50.246854+0000","last_fullsized":"2023-12-11T17:09:50.246854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:33:40.683163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274490+0000","last_change":"2023-12-11T17:09:45.227132+0000","last_active":"2023-12-11T17:09:49.274490+0000","last_peered":"2023-12-11T17:09:49.274490+0000","last_clean":"2023-12-11T17:09:49.274490+0000","last_became_active":"2023-12-11T17:09:45.224674+0000","last_became_peered":"2023-12-11T17:09:45.224674+0000","last_unstale":"2023-12-11T17:09:49.274490+0000","last_undegraded":"2023-12-11T17:09:49.274490+0000","last_fullsized":"2023-12-11T17:09:49.274490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:02:04.180131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.251498+0000","last_change":"2023-12-11T17:09:44.207068+0000","last_active":"2023-12-11T17:09:49.251498+0000","last_peered":"2023-12-11T17:09:49.251498+0000","last_clean":"2023-12-11T17:09:49.251498+0000","last_became_active":"2023-12-11T17:09:44.206365+0000","last_became_peered":"2023-12-11T17:09:44.206365+0000","last_unstale":"2023-12-11T17:09:49.251498+0000","last_undegraded":"2023-12-11T17:09:49.251498+0000","last_fullsized":"2023-12-11T17:09:49.251498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:53:23.727946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.245537+0000","last_change":"2023-12-11T17:09:49.282432+0000","last_active":"2023-12-11T17:09:50.245537+0000","last_peered":"2023-12-11T17:09:50.245537+0000","last_clean":"2023-12-11T17:09:50.245537+0000","last_became_active":"2023-12-11T17:09:49.281688+0000","last_became_peered":"2023-12-11T17:09:49.281688+0000","last_unstale":"2023-12-11T17:09:50.245537+0000","last_undegraded":"2023-12-11T17:09:50.245537+0000","last_fullsized":"2023-12-11T17:09:50.245537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:02:08.244798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.268082+0000","last_change":"2023-12-11T17:09:45.212177+0000","last_active":"2023-12-11T17:09:49.268082+0000","last_peered":"2023-12-11T17:09:49.268082+0000","last_clean":"2023-12-11T17:09:49.268082+0000","last_became_active":"2023-12-11T17:09:45.211897+0000","last_became_peered":"2023-12-11T17:09:45.211897+0000","last_unstale":"2023-12-11T17:09:49.268082+0000","last_undegraded":"2023-12-11T17:09:49.268082+0000","last_fullsized":"2023-12-11T17:09:49.268082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:28:31.395156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244887+0000","last_change":"2023-12-11T17:09:44.200317+0000","last_active":"2023-12-11T17:09:49.244887+0000","last_peered":"2023-12-11T17:09:49.244887+0000","last_clean":"2023-12-11T17:09:49.244887+0000","last_became_active":"2023-12-11T17:09:44.199797+0000","last_became_peered":"2023-12-11T17:09:44.199797+0000","last_unstale":"2023-12-11T17:09:49.244887+0000","last_undegraded":"2023-12-11T17:09:49.244887+0000","last_fullsized":"2023-12-11T17:09:49.244887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:56:33.686127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.670045+0000","last_change":"2023-12-11T17:09:49.267135+0000","last_active":"2023-12-11T17:09:51.670045+0000","last_peered":"2023-12-11T17:09:51.670045+0000","last_clean":"2023-12-11T17:09:51.670045+0000","last_became_active":"2023-12-11T17:09:49.266709+0000","last_became_peered":"2023-12-11T17:09:49.266709+0000","last_unstale":"2023-12-11T17:09:51.670045+0000","last_undegraded":"2023-12-11T17:09:51.670045+0000","last_fullsized":"2023-12-11T17:09:51.670045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:08.141530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275410+0000","last_change":"2023-12-11T17:09:45.227783+0000","last_active":"2023-12-11T17:09:49.275410+0000","last_peered":"2023-12-11T17:09:49.275410+0000","last_clean":"2023-12-11T17:09:49.275410+0000","last_became_active":"2023-12-11T17:09:45.225563+0000","last_became_peered":"2023-12-11T17:09:45.225563+0000","last_unstale":"2023-12-11T17:09:49.275410+0000","last_undegraded":"2023-12-11T17:09:49.275410+0000","last_fullsized":"2023-12-11T17:09:49.275410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:35:49.553886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.252708+0000","last_change":"2023-12-11T17:09:44.197835+0000","last_active":"2023-12-11T17:09:49.252708+0000","last_peered":"2023-12-11T17:09:49.252708+0000","last_clean":"2023-12-11T17:09:49.252708+0000","last_became_active":"2023-12-11T17:09:44.197550+0000","last_became_peered":"2023-12-11T17:09:44.197550+0000","last_unstale":"2023-12-11T17:09:49.252708+0000","last_undegraded":"2023-12-11T17:09:49.252708+0000","last_fullsized":"2023-12-11T17:09:49.252708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:48:05.507260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.734122+0000","last_change":"2023-12-11T17:09:49.277218+0000","last_active":"2023-12-11T17:09:50.734122+0000","last_peered":"2023-12-11T17:09:50.734122+0000","last_clean":"2023-12-11T17:09:50.734122+0000","last_became_active":"2023-12-11T17:09:49.276790+0000","last_became_peered":"2023-12-11T17:09:49.276790+0000","last_unstale":"2023-12-11T17:09:50.734122+0000","last_undegraded":"2023-12-11T17:09:50.734122+0000","last_fullsized":"2023-12-11T17:09:50.734122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:09:37.168887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274765+0000","last_change":"2023-12-11T17:09:45.228047+0000","last_active":"2023-12-11T17:09:49.274765+0000","last_peered":"2023-12-11T17:09:49.274765+0000","last_clean":"2023-12-11T17:09:49.274765+0000","last_became_active":"2023-12-11T17:09:45.225286+0000","last_became_peered":"2023-12-11T17:09:45.225286+0000","last_unstale":"2023-12-11T17:09:49.274765+0000","last_undegraded":"2023-12-11T17:09:49.274765+0000","last_fullsized":"2023-12-11T17:09:49.274765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:28:31.395156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.270765+0000","last_change":"2023-12-11T17:09:44.203193+0000","last_active":"2023-12-11T17:09:49.270765+0000","last_peered":"2023-12-11T17:09:49.270765+0000","last_clean":"2023-12-11T17:09:49.270765+0000","last_became_active":"2023-12-11T17:09:44.202663+0000","last_became_peered":"2023-12-11T17:09:44.202663+0000","last_unstale":"2023-12-11T17:09:49.270765+0000","last_undegraded":"2023-12-11T17:09:49.270765+0000","last_fullsized":"2023-12-11T17:09:49.270765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:17:24.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.668651+0000","last_change":"2023-12-11T17:09:49.274246+0000","last_active":"2023-12-11T17:09:51.668651+0000","last_peered":"2023-12-11T17:09:51.668651+0000","last_clean":"2023-12-11T17:09:51.668651+0000","last_became_active":"2023-12-11T17:09:49.273634+0000","last_became_peered":"2023-12-11T17:09:49.273634+0000","last_unstale":"2023-12-11T17:09:51.668651+0000","last_undegraded":"2023-12-11T17:09:51.668651+0000","last_fullsized":"2023-12-11T17:09:51.668651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:56.216955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.276177+0000","last_change":"2023-12-11T17:09:45.227483+0000","last_active":"2023-12-11T17:09:49.276177+0000","last_peered":"2023-12-11T17:09:49.276177+0000","last_clean":"2023-12-11T17:09:49.276177+0000","last_became_active":"2023-12-11T17:09:45.227150+0000","last_became_peered":"2023-12-11T17:09:45.227150+0000","last_unstale":"2023-12-11T17:09:49.276177+0000","last_undegraded":"2023-12-11T17:09:49.276177+0000","last_fullsized":"2023-12-11T17:09:49.276177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:36:10.393929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.249199+0000","last_change":"2023-12-11T17:09:44.185666+0000","last_active":"2023-12-11T17:09:49.249199+0000","last_peered":"2023-12-11T17:09:49.249199+0000","last_clean":"2023-12-11T17:09:49.249199+0000","last_became_active":"2023-12-11T17:09:44.185302+0000","last_became_peered":"2023-12-11T17:09:44.185302+0000","last_unstale":"2023-12-11T17:09:49.249199+0000","last_undegraded":"2023-12-11T17:09:49.249199+0000","last_fullsized":"2023-12-11T17:09:49.249199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:17:35.452188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.670426+0000","last_change":"2023-12-11T17:09:49.268722+0000","last_active":"2023-12-11T17:09:51.670426+0000","last_peered":"2023-12-11T17:09:51.670426+0000","last_clean":"2023-12-11T17:09:51.670426+0000","last_became_active":"2023-12-11T17:09:49.268340+0000","last_became_peered":"2023-12-11T17:09:49.268340+0000","last_unstale":"2023-12-11T17:09:51.670426+0000","last_undegraded":"2023-12-11T17:09:51.670426+0000","last_fullsized":"2023-12-11T17:09:51.670426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:28:35.459824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242938+0000","last_change":"2023-12-11T17:09:45.215129+0000","last_active":"2023-12-11T17:09:49.242938+0000","last_peered":"2023-12-11T17:09:49.242938+0000","last_clean":"2023-12-11T17:09:49.242938+0000","last_became_active":"2023-12-11T17:09:45.214556+0000","last_became_peered":"2023-12-11T17:09:45.214556+0000","last_unstale":"2023-12-11T17:09:49.242938+0000","last_undegraded":"2023-12-11T17:09:49.242938+0000","last_fullsized":"2023-12-11T17:09:49.242938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:27:18.925357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.243243+0000","last_change":"2023-12-11T17:09:44.195851+0000","last_active":"2023-12-11T17:09:49.243243+0000","last_peered":"2023-12-11T17:09:49.243243+0000","last_clean":"2023-12-11T17:09:49.243243+0000","last_became_active":"2023-12-11T17:09:44.195539+0000","last_became_peered":"2023-12-11T17:09:44.195539+0000","last_unstale":"2023-12-11T17:09:49.243243+0000","last_undegraded":"2023-12-11T17:09:49.243243+0000","last_fullsized":"2023-12-11T17:09:49.243243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:52:53.972126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.250040+0000","last_change":"2023-12-11T17:09:49.288681+0000","last_active":"2023-12-11T17:09:50.250040+0000","last_peered":"2023-12-11T17:09:50.250040+0000","last_clean":"2023-12-11T17:09:50.250040+0000","last_became_active":"2023-12-11T17:09:49.280484+0000","last_became_peered":"2023-12-11T17:09:49.280484+0000","last_unstale":"2023-12-11T17:09:50.250040+0000","last_undegraded":"2023-12-11T17:09:50.250040+0000","last_fullsized":"2023-12-11T17:09:50.250040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:28:03.097522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275178+0000","last_change":"2023-12-11T17:09:45.228655+0000","last_active":"2023-12-11T17:09:49.275178+0000","last_peered":"2023-12-11T17:09:49.275178+0000","last_clean":"2023-12-11T17:09:49.275178+0000","last_became_active":"2023-12-11T17:09:45.225530+0000","last_became_peered":"2023-12-11T17:09:45.225530+0000","last_unstale":"2023-12-11T17:09:49.275178+0000","last_undegraded":"2023-12-11T17:09:49.275178+0000","last_fullsized":"2023-12-11T17:09:49.275178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:04.076862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.263735+0000","last_change":"2023-12-11T17:09:44.197598+0000","last_active":"2023-12-11T17:09:49.263735+0000","last_peered":"2023-12-11T17:09:49.263735+0000","last_clean":"2023-12-11T17:09:49.263735+0000","last_became_active":"2023-12-11T17:09:44.197143+0000","last_became_peered":"2023-12-11T17:09:44.197143+0000","last_unstale":"2023-12-11T17:09:49.263735+0000","last_undegraded":"2023-12-11T17:09:49.263735+0000","last_fullsized":"2023-12-11T17:09:49.263735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:11:14.773136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.249485+0000","last_change":"2023-12-11T17:09:49.281263+0000","last_active":"2023-12-11T17:09:50.249485+0000","last_peered":"2023-12-11T17:09:50.249485+0000","last_clean":"2023-12-11T17:09:50.249485+0000","last_became_active":"2023-12-11T17:09:49.280311+0000","last_became_peered":"2023-12-11T17:09:49.280311+0000","last_unstale":"2023-12-11T17:09:50.249485+0000","last_undegraded":"2023-12-11T17:09:50.249485+0000","last_fullsized":"2023-12-11T17:09:50.249485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:14:54.962202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259318+0000","last_change":"2023-12-11T17:09:45.222607+0000","last_active":"2023-12-11T17:09:49.259318+0000","last_peered":"2023-12-11T17:09:49.259318+0000","last_clean":"2023-12-11T17:09:49.259318+0000","last_became_active":"2023-12-11T17:09:45.221704+0000","last_became_peered":"2023-12-11T17:09:45.221704+0000","last_unstale":"2023-12-11T17:09:49.259318+0000","last_undegraded":"2023-12-11T17:09:49.259318+0000","last_fullsized":"2023-12-11T17:09:49.259318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:27:18.925357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259851+0000","last_change":"2023-12-11T17:09:44.201116+0000","last_active":"2023-12-11T17:09:49.259851+0000","last_peered":"2023-12-11T17:09:49.259851+0000","last_clean":"2023-12-11T17:09:49.259851+0000","last_became_active":"2023-12-11T17:09:44.200316+0000","last_became_peered":"2023-12-11T17:09:44.200316+0000","last_unstale":"2023-12-11T17:09:49.259851+0000","last_undegraded":"2023-12-11T17:09:49.259851+0000","last_fullsized":"2023-12-11T17:09:49.259851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:22:33.669469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.735500+0000","last_change":"2023-12-11T17:09:49.284856+0000","last_active":"2023-12-11T17:09:50.735500+0000","last_peered":"2023-12-11T17:09:50.735500+0000","last_clean":"2023-12-11T17:09:50.735500+0000","last_became_active":"2023-12-11T17:09:49.284294+0000","last_became_peered":"2023-12-11T17:09:49.284294+0000","last_unstale":"2023-12-11T17:09:50.735500+0000","last_undegraded":"2023-12-11T17:09:50.735500+0000","last_fullsized":"2023-12-11T17:09:50.735500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:14:54.962202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274536+0000","last_change":"2023-12-11T17:09:45.220222+0000","last_active":"2023-12-11T17:09:49.274536+0000","last_peered":"2023-12-11T17:09:49.274536+0000","last_clean":"2023-12-11T17:09:49.274536+0000","last_became_active":"2023-12-11T17:09:45.218938+0000","last_became_peered":"2023-12-11T17:09:45.218938+0000","last_unstale":"2023-12-11T17:09:49.274536+0000","last_undegraded":"2023-12-11T17:09:49.274536+0000","last_fullsized":"2023-12-11T17:09:49.274536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:33:36.618495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:10:04.440884+0000","last_change":"2023-12-11T17:09:44.198146+0000","last_active":"2023-12-11T17:10:04.440884+0000","last_peered":"2023-12-11T17:10:04.440884+0000","last_clean":"2023-12-11T17:10:04.440884+0000","last_became_active":"2023-12-11T17:09:44.197814+0000","last_became_peered":"2023-12-11T17:09:44.197814+0000","last_unstale":"2023-12-11T17:10:04.440884+0000","last_undegraded":"2023-12-11T17:10:04.440884+0000","last_fullsized":"2023-12-11T17:10:04.440884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:43:18.152366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3840,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.671230+0000","last_change":"2023-12-11T17:09:49.267215+0000","last_active":"2023-12-11T17:09:51.671230+0000","last_peered":"2023-12-11T17:09:51.671230+0000","last_clean":"2023-12-11T17:09:51.671230+0000","last_became_active":"2023-12-11T17:09:49.266813+0000","last_became_peered":"2023-12-11T17:09:49.266813+0000","last_unstale":"2023-12-11T17:09:51.671230+0000","last_undegraded":"2023-12-11T17:09:51.671230+0000","last_fullsized":"2023-12-11T17:09:51.671230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:28:35.459824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.270634+0000","last_change":"2023-12-11T17:09:45.207339+0000","last_active":"2023-12-11T17:09:49.270634+0000","last_peered":"2023-12-11T17:09:49.270634+0000","last_clean":"2023-12-11T17:09:49.270634+0000","last_became_active":"2023-12-11T17:09:45.206332+0000","last_became_peered":"2023-12-11T17:09:45.206332+0000","last_unstale":"2023-12-11T17:09:49.270634+0000","last_undegraded":"2023-12-11T17:09:49.270634+0000","last_fullsized":"2023-12-11T17:09:49.270634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:13:56.615204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.241546+0000","last_change":"2023-12-11T17:09:44.204047+0000","last_active":"2023-12-11T17:09:49.241546+0000","last_peered":"2023-12-11T17:09:49.241546+0000","last_clean":"2023-12-11T17:09:49.241546+0000","last_became_active":"2023-12-11T17:09:44.203606+0000","last_became_peered":"2023-12-11T17:09:44.203606+0000","last_unstale":"2023-12-11T17:09:49.241546+0000","last_undegraded":"2023-12-11T17:09:49.241546+0000","last_fullsized":"2023-12-11T17:09:49.241546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:38:29.306893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669605+0000","last_change":"2023-12-11T17:09:49.277690+0000","last_active":"2023-12-11T17:09:51.669605+0000","last_peered":"2023-12-11T17:09:51.669605+0000","last_clean":"2023-12-11T17:09:51.669605+0000","last_became_active":"2023-12-11T17:09:49.277278+0000","last_became_peered":"2023-12-11T17:09:49.277278+0000","last_unstale":"2023-12-11T17:09:51.669605+0000","last_undegraded":"2023-12-11T17:09:51.669605+0000","last_fullsized":"2023-12-11T17:09:51.669605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:33:40.683163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.264691+0000","last_change":"2023-12-11T17:09:45.223576+0000","last_active":"2023-12-11T17:09:49.264691+0000","last_peered":"2023-12-11T17:09:49.264691+0000","last_clean":"2023-12-11T17:09:49.264691+0000","last_became_active":"2023-12-11T17:09:45.216938+0000","last_became_peered":"2023-12-11T17:09:45.216938+0000","last_unstale":"2023-12-11T17:09:49.264691+0000","last_undegraded":"2023-12-11T17:09:49.264691+0000","last_fullsized":"2023-12-11T17:09:49.264691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:52.152287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267786+0000","last_change":"2023-12-11T17:09:44.203731+0000","last_active":"2023-12-11T17:09:49.267786+0000","last_peered":"2023-12-11T17:09:49.267786+0000","last_clean":"2023-12-11T17:09:49.267786+0000","last_became_active":"2023-12-11T17:09:44.202145+0000","last_became_peered":"2023-12-11T17:09:44.202145+0000","last_unstale":"2023-12-11T17:09:49.267786+0000","last_undegraded":"2023-12-11T17:09:49.267786+0000","last_fullsized":"2023-12-11T17:09:49.267786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:27:17.913220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.247224+0000","last_change":"2023-12-11T17:09:49.268109+0000","last_active":"2023-12-11T17:09:50.247224+0000","last_peered":"2023-12-11T17:09:50.247224+0000","last_clean":"2023-12-11T17:09:50.247224+0000","last_became_active":"2023-12-11T17:09:49.264048+0000","last_became_peered":"2023-12-11T17:09:49.264048+0000","last_unstale":"2023-12-11T17:09:50.247224+0000","last_undegraded":"2023-12-11T17:09:50.247224+0000","last_fullsized":"2023-12-11T17:09:50.247224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:08:53.883159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267673+0000","last_change":"2023-12-11T17:09:45.225214+0000","last_active":"2023-12-11T17:09:49.267673+0000","last_peered":"2023-12-11T17:09:49.267673+0000","last_clean":"2023-12-11T17:09:49.267673+0000","last_became_active":"2023-12-11T17:09:45.224870+0000","last_became_peered":"2023-12-11T17:09:45.224870+0000","last_unstale":"2023-12-11T17:09:49.267673+0000","last_undegraded":"2023-12-11T17:09:49.267673+0000","last_fullsized":"2023-12-11T17:09:49.267673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:01:08.121657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.247231+0000","last_change":"2023-12-11T17:09:44.205313+0000","last_active":"2023-12-11T17:09:49.247231+0000","last_peered":"2023-12-11T17:09:49.247231+0000","last_clean":"2023-12-11T17:09:49.247231+0000","last_became_active":"2023-12-11T17:09:44.205016+0000","last_became_peered":"2023-12-11T17:09:44.205016+0000","last_unstale":"2023-12-11T17:09:49.247231+0000","last_undegraded":"2023-12-11T17:09:49.247231+0000","last_fullsized":"2023-12-11T17:09:49.247231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:43:26.684582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.247679+0000","last_change":"2023-12-11T17:09:49.282289+0000","last_active":"2023-12-11T17:09:50.247679+0000","last_peered":"2023-12-11T17:09:50.247679+0000","last_clean":"2023-12-11T17:09:50.247679+0000","last_became_active":"2023-12-11T17:09:49.281891+0000","last_became_peered":"2023-12-11T17:09:49.281891+0000","last_unstale":"2023-12-11T17:09:50.247679+0000","last_undegraded":"2023-12-11T17:09:50.247679+0000","last_fullsized":"2023-12-11T17:09:50.247679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:07:56.022278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.671580+0000","last_change":"2023-12-11T17:09:49.280847+0000","last_active":"2023-12-11T17:09:51.671580+0000","last_peered":"2023-12-11T17:09:51.671580+0000","last_clean":"2023-12-11T17:09:51.671580+0000","last_became_active":"2023-12-11T17:09:49.280442+0000","last_became_peered":"2023-12-11T17:09:49.280442+0000","last_unstale":"2023-12-11T17:09:51.671580+0000","last_undegraded":"2023-12-11T17:09:51.671580+0000","last_fullsized":"2023-12-11T17:09:51.671580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:24:45.184380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.240253+0000","last_change":"2023-12-11T17:09:45.198219+0000","last_active":"2023-12-11T17:09:49.240253+0000","last_peered":"2023-12-11T17:09:49.240253+0000","last_clean":"2023-12-11T17:09:49.240253+0000","last_became_active":"2023-12-11T17:09:45.196218+0000","last_became_peered":"2023-12-11T17:09:45.196218+0000","last_unstale":"2023-12-11T17:09:49.240253+0000","last_undegraded":"2023-12-11T17:09:49.240253+0000","last_fullsized":"2023-12-11T17:09:49.240253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:27:18.925357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.261218+0000","last_change":"2023-12-11T17:09:44.208638+0000","last_active":"2023-12-11T17:09:49.261218+0000","last_peered":"2023-12-11T17:09:49.261218+0000","last_clean":"2023-12-11T17:09:49.261218+0000","last_became_active":"2023-12-11T17:09:44.208143+0000","last_became_peered":"2023-12-11T17:09:44.208143+0000","last_unstale":"2023-12-11T17:09:49.261218+0000","last_undegraded":"2023-12-11T17:09:49.261218+0000","last_fullsized":"2023-12-11T17:09:49.261218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:39:09.678988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.247175+0000","last_change":"2023-12-11T17:09:49.270558+0000","last_active":"2023-12-11T17:09:50.247175+0000","last_peered":"2023-12-11T17:09:50.247175+0000","last_clean":"2023-12-11T17:09:50.247175+0000","last_became_active":"2023-12-11T17:09:49.270065+0000","last_became_peered":"2023-12-11T17:09:49.270065+0000","last_unstale":"2023-12-11T17:09:50.247175+0000","last_undegraded":"2023-12-11T17:09:50.247175+0000","last_fullsized":"2023-12-11T17:09:50.247175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:08.141530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242639+0000","last_change":"2023-12-11T17:09:45.209539+0000","last_active":"2023-12-11T17:09:49.242639+0000","last_peered":"2023-12-11T17:09:49.242639+0000","last_clean":"2023-12-11T17:09:49.242639+0000","last_became_active":"2023-12-11T17:09:45.209135+0000","last_became_peered":"2023-12-11T17:09:45.209135+0000","last_unstale":"2023-12-11T17:09:49.242639+0000","last_undegraded":"2023-12-11T17:09:49.242639+0000","last_fullsized":"2023-12-11T17:09:49.242639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:08:16.262435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.243583+0000","last_change":"2023-12-11T17:09:44.203078+0000","last_active":"2023-12-11T17:09:49.243583+0000","last_peered":"2023-12-11T17:09:49.243583+0000","last_clean":"2023-12-11T17:09:49.243583+0000","last_became_active":"2023-12-11T17:09:44.202856+0000","last_became_peered":"2023-12-11T17:09:44.202856+0000","last_unstale":"2023-12-11T17:09:49.243583+0000","last_undegraded":"2023-12-11T17:09:49.243583+0000","last_fullsized":"2023-12-11T17:09:49.243583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:13:55.603067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244507+0000","last_change":"2023-12-11T17:09:44.200256+0000","last_active":"2023-12-11T17:09:49.244507+0000","last_peered":"2023-12-11T17:09:49.244507+0000","last_clean":"2023-12-11T17:09:49.244507+0000","last_became_active":"2023-12-11T17:09:44.199854+0000","last_became_peered":"2023-12-11T17:09:44.199854+0000","last_unstale":"2023-12-11T17:09:49.244507+0000","last_undegraded":"2023-12-11T17:09:49.244507+0000","last_fullsized":"2023-12-11T17:09:49.244507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:22:33.669469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259758+0000","last_change":"2023-12-11T17:09:45.223465+0000","last_active":"2023-12-11T17:09:49.259758+0000","last_peered":"2023-12-11T17:09:49.259758+0000","last_clean":"2023-12-11T17:09:49.259758+0000","last_became_active":"2023-12-11T17:09:45.223204+0000","last_became_peered":"2023-12-11T17:09:45.223204+0000","last_unstale":"2023-12-11T17:09:49.259758+0000","last_undegraded":"2023-12-11T17:09:49.259758+0000","last_fullsized":"2023-12-11T17:09:49.259758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:39:10.691125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.245254+0000","last_change":"2023-12-11T17:09:49.264568+0000","last_active":"2023-12-11T17:09:50.245254+0000","last_peered":"2023-12-11T17:09:50.245254+0000","last_clean":"2023-12-11T17:09:50.245254+0000","last_became_active":"2023-12-11T17:09:49.263931+0000","last_became_peered":"2023-12-11T17:09:49.263931+0000","last_unstale":"2023-12-11T17:09:50.245254+0000","last_undegraded":"2023-12-11T17:09:50.245254+0000","last_fullsized":"2023-12-11T17:09:50.245254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T17:20:54.594805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242524+0000","last_change":"2023-12-11T17:09:44.205097+0000","last_active":"2023-12-11T17:09:49.242524+0000","last_peered":"2023-12-11T17:09:49.242524+0000","last_clean":"2023-12-11T17:09:49.242524+0000","last_became_active":"2023-12-11T17:09:44.204802+0000","last_became_peered":"2023-12-11T17:09:44.204802+0000","last_unstale":"2023-12-11T17:09:49.242524+0000","last_undegraded":"2023-12-11T17:09:49.242524+0000","last_fullsized":"2023-12-11T17:09:49.242524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:38:29.306893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.270946+0000","last_change":"2023-12-11T17:09:45.213754+0000","last_active":"2023-12-11T17:09:49.270946+0000","last_peered":"2023-12-11T17:09:49.270946+0000","last_clean":"2023-12-11T17:09:49.270946+0000","last_became_active":"2023-12-11T17:09:45.213235+0000","last_became_peered":"2023-12-11T17:09:45.213235+0000","last_unstale":"2023-12-11T17:09:49.270946+0000","last_undegraded":"2023-12-11T17:09:49.270946+0000","last_fullsized":"2023-12-11T17:09:49.270946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:45.225448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.249535+0000","last_change":"2023-12-11T17:09:49.275093+0000","last_active":"2023-12-11T17:09:50.249535+0000","last_peered":"2023-12-11T17:09:50.249535+0000","last_clean":"2023-12-11T17:09:50.249535+0000","last_became_active":"2023-12-11T17:09:49.274728+0000","last_became_peered":"2023-12-11T17:09:49.274728+0000","last_unstale":"2023-12-11T17:09:50.249535+0000","last_undegraded":"2023-12-11T17:09:50.249535+0000","last_fullsized":"2023-12-11T17:09:50.249535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:41:31.040376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242805+0000","last_change":"2023-12-11T17:09:45.214934+0000","last_active":"2023-12-11T17:09:49.242805+0000","last_peered":"2023-12-11T17:09:49.242805+0000","last_clean":"2023-12-11T17:09:49.242805+0000","last_became_active":"2023-12-11T17:09:45.214572+0000","last_became_peered":"2023-12-11T17:09:45.214572+0000","last_unstale":"2023-12-11T17:09:49.242805+0000","last_undegraded":"2023-12-11T17:09:49.242805+0000","last_fullsized":"2023-12-11T17:09:49.242805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:08:16.262435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.250749+0000","last_change":"2023-12-11T17:09:45.211423+0000","last_active":"2023-12-11T17:09:49.250749+0000","last_peered":"2023-12-11T17:09:49.250749+0000","last_clean":"2023-12-11T17:09:49.250749+0000","last_became_active":"2023-12-11T17:09:45.211056+0000","last_became_peered":"2023-12-11T17:09:45.211056+0000","last_unstale":"2023-12-11T17:09:49.250749+0000","last_undegraded":"2023-12-11T17:09:49.250749+0000","last_fullsized":"2023-12-11T17:09:49.250749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:46:02.502338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.263639+0000","last_change":"2023-12-11T17:09:45.197421+0000","last_active":"2023-12-11T17:09:49.263639+0000","last_peered":"2023-12-11T17:09:49.263639+0000","last_clean":"2023-12-11T17:09:49.263639+0000","last_became_active":"2023-12-11T17:09:45.197128+0000","last_became_peered":"2023-12-11T17:09:45.197128+0000","last_unstale":"2023-12-11T17:09:49.263639+0000","last_undegraded":"2023-12-11T17:09:49.263639+0000","last_fullsized":"2023-12-11T17:09:49.263639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:13:50.995140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259671+0000","last_change":"2023-12-11T17:09:45.208645+0000","last_active":"2023-12-11T17:09:49.259671+0000","last_peered":"2023-12-11T17:09:49.259671+0000","last_clean":"2023-12-11T17:09:49.259671+0000","last_became_active":"2023-12-11T17:09:45.203739+0000","last_became_peered":"2023-12-11T17:09:45.203739+0000","last_unstale":"2023-12-11T17:09:49.259671+0000","last_undegraded":"2023-12-11T17:09:49.259671+0000","last_fullsized":"2023-12-11T17:09:49.259671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:17:04.012857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242521+0000","last_change":"2023-12-11T17:09:45.220379+0000","last_active":"2023-12-11T17:09:49.242521+0000","last_peered":"2023-12-11T17:09:49.242521+0000","last_clean":"2023-12-11T17:09:49.242521+0000","last_became_active":"2023-12-11T17:09:45.220153+0000","last_became_peered":"2023-12-11T17:09:45.220153+0000","last_unstale":"2023-12-11T17:09:49.242521+0000","last_undegraded":"2023-12-11T17:09:49.242521+0000","last_fullsized":"2023-12-11T17:09:49.242521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:52.152287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.241402+0000","last_change":"2023-12-11T17:09:45.194086+0000","last_active":"2023-12-11T17:09:49.241402+0000","last_peered":"2023-12-11T17:09:49.241402+0000","last_clean":"2023-12-11T17:09:49.241402+0000","last_became_active":"2023-12-11T17:09:45.193835+0000","last_became_peered":"2023-12-11T17:09:45.193835+0000","last_unstale":"2023-12-11T17:09:49.241402+0000","last_undegraded":"2023-12-11T17:09:49.241402+0000","last_fullsized":"2023-12-11T17:09:49.241402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:05.364711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244539+0000","last_change":"2023-12-11T17:09:45.219697+0000","last_active":"2023-12-11T17:09:49.244539+0000","last_peered":"2023-12-11T17:09:49.244539+0000","last_clean":"2023-12-11T17:09:49.244539+0000","last_became_active":"2023-12-11T17:09:45.219406+0000","last_became_peered":"2023-12-11T17:09:45.219406+0000","last_unstale":"2023-12-11T17:09:49.244539+0000","last_undegraded":"2023-12-11T17:09:49.244539+0000","last_fullsized":"2023-12-11T17:09:49.244539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:52.152287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.243089+0000","last_change":"2023-12-11T17:09:45.220707+0000","last_active":"2023-12-11T17:09:49.243089+0000","last_peered":"2023-12-11T17:09:49.243089+0000","last_clean":"2023-12-11T17:09:49.243089+0000","last_became_active":"2023-12-11T17:09:45.220357+0000","last_became_peered":"2023-12-11T17:09:45.220357+0000","last_unstale":"2023-12-11T17:09:49.243089+0000","last_undegraded":"2023-12-11T17:09:49.243089+0000","last_fullsized":"2023-12-11T17:09:49.243089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:39:10.691125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.261207+0000","last_change":"2023-12-11T17:09:45.196150+0000","last_active":"2023-12-11T17:09:49.261207+0000","last_peered":"2023-12-11T17:09:49.261207+0000","last_clean":"2023-12-11T17:09:49.261207+0000","last_became_active":"2023-12-11T17:09:45.195878+0000","last_became_peered":"2023-12-11T17:09:45.195878+0000","last_unstale":"2023-12-11T17:09:49.261207+0000","last_undegraded":"2023-12-11T17:09:49.261207+0000","last_fullsized":"2023-12-11T17:09:49.261207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:51:29.300195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.243497+0000","last_change":"2023-12-11T17:09:45.220663+0000","last_active":"2023-12-11T17:09:49.243497+0000","last_peered":"2023-12-11T17:09:49.243497+0000","last_clean":"2023-12-11T17:09:49.243497+0000","last_became_active":"2023-12-11T17:09:45.220349+0000","last_became_peered":"2023-12-11T17:09:45.220349+0000","last_unstale":"2023-12-11T17:09:49.243497+0000","last_undegraded":"2023-12-11T17:09:49.243497+0000","last_fullsized":"2023-12-11T17:09:49.243497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:11:15.785273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.263544+0000","last_change":"2023-12-11T17:09:45.213788+0000","last_active":"2023-12-11T17:09:49.263544+0000","last_peered":"2023-12-11T17:09:49.263544+0000","last_clean":"2023-12-11T17:09:49.263544+0000","last_became_active":"2023-12-11T17:09:45.213454+0000","last_became_peered":"2023-12-11T17:09:45.213454+0000","last_unstale":"2023-12-11T17:09:49.263544+0000","last_undegraded":"2023-12-11T17:09:49.263544+0000","last_fullsized":"2023-12-11T17:09:49.263544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:36:10.393929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259552+0000","last_change":"2023-12-11T17:09:45.219309+0000","last_active":"2023-12-11T17:09:49.259552+0000","last_peered":"2023-12-11T17:09:49.259552+0000","last_clean":"2023-12-11T17:09:49.259552+0000","last_became_active":"2023-12-11T17:09:45.218538+0000","last_became_peered":"2023-12-11T17:09:45.218538+0000","last_unstale":"2023-12-11T17:09:49.259552+0000","last_undegraded":"2023-12-11T17:09:49.259552+0000","last_fullsized":"2023-12-11T17:09:49.259552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:11:15.785273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.246802+0000","last_change":"2023-12-11T17:09:45.217105+0000","last_active":"2023-12-11T17:09:49.246802+0000","last_peered":"2023-12-11T17:09:49.246802+0000","last_clean":"2023-12-11T17:09:49.246802+0000","last_became_active":"2023-12-11T17:09:45.215966+0000","last_became_peered":"2023-12-11T17:09:45.215966+0000","last_unstale":"2023-12-11T17:09:49.246802+0000","last_undegraded":"2023-12-11T17:09:49.246802+0000","last_fullsized":"2023-12-11T17:09:49.246802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:17:04.012857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274639+0000","last_change":"2023-12-11T17:09:45.225041+0000","last_active":"2023-12-11T17:09:49.274639+0000","last_peered":"2023-12-11T17:09:49.274639+0000","last_clean":"2023-12-11T17:09:49.274639+0000","last_became_active":"2023-12-11T17:09:45.224696+0000","last_became_peered":"2023-12-11T17:09:45.224696+0000","last_unstale":"2023-12-11T17:09:49.274639+0000","last_undegraded":"2023-12-11T17:09:49.274639+0000","last_fullsized":"2023-12-11T17:09:49.274639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:03:10.878069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.252605+0000","last_change":"2023-12-11T17:09:45.207821+0000","last_active":"2023-12-11T17:09:49.252605+0000","last_peered":"2023-12-11T17:09:49.252605+0000","last_clean":"2023-12-11T17:09:49.252605+0000","last_became_active":"2023-12-11T17:09:45.207541+0000","last_became_peered":"2023-12-11T17:09:45.207541+0000","last_unstale":"2023-12-11T17:09:49.252605+0000","last_undegraded":"2023-12-11T17:09:49.252605+0000","last_fullsized":"2023-12-11T17:09:49.252605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:51:44.769227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267963+0000","last_change":"2023-12-11T17:09:45.212081+0000","last_active":"2023-12-11T17:09:49.267963+0000","last_peered":"2023-12-11T17:09:49.267963+0000","last_clean":"2023-12-11T17:09:49.267963+0000","last_became_active":"2023-12-11T17:09:45.211781+0000","last_became_peered":"2023-12-11T17:09:45.211781+0000","last_unstale":"2023-12-11T17:09:49.267963+0000","last_undegraded":"2023-12-11T17:09:49.267963+0000","last_fullsized":"2023-12-11T17:09:49.267963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:03:10.878069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.260999+0000","last_change":"2023-12-11T17:09:45.218896+0000","last_active":"2023-12-11T17:09:49.260999+0000","last_peered":"2023-12-11T17:09:49.260999+0000","last_clean":"2023-12-11T17:09:49.260999+0000","last_became_active":"2023-12-11T17:09:45.218071+0000","last_became_peered":"2023-12-11T17:09:45.218071+0000","last_unstale":"2023-12-11T17:09:49.260999+0000","last_undegraded":"2023-12-11T17:09:49.260999+0000","last_fullsized":"2023-12-11T17:09:49.260999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:05.364711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.240603+0000","last_change":"2023-12-11T17:09:45.208633+0000","last_active":"2023-12-11T17:09:49.240603+0000","last_peered":"2023-12-11T17:09:49.240603+0000","last_clean":"2023-12-11T17:09:49.240603+0000","last_became_active":"2023-12-11T17:09:45.208337+0000","last_became_peered":"2023-12-11T17:09:45.208337+0000","last_unstale":"2023-12-11T17:09:49.240603+0000","last_undegraded":"2023-12-11T17:09:49.240603+0000","last_fullsized":"2023-12-11T17:09:49.240603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:11:15.785273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259315+0000","last_change":"2023-12-11T17:09:45.216391+0000","last_active":"2023-12-11T17:09:49.259315+0000","last_peered":"2023-12-11T17:09:49.259315+0000","last_clean":"2023-12-11T17:09:49.259315+0000","last_became_active":"2023-12-11T17:09:45.215314+0000","last_became_peered":"2023-12-11T17:09:45.215314+0000","last_unstale":"2023-12-11T17:09:49.259315+0000","last_undegraded":"2023-12-11T17:09:49.259315+0000","last_fullsized":"2023-12-11T17:09:49.259315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:42:31.915581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242252+0000","last_change":"2023-12-11T17:09:45.206222+0000","last_active":"2023-12-11T17:09:49.242252+0000","last_peered":"2023-12-11T17:09:49.242252+0000","last_clean":"2023-12-11T17:09:49.242252+0000","last_became_active":"2023-12-11T17:09:45.206027+0000","last_became_peered":"2023-12-11T17:09:45.206027+0000","last_unstale":"2023-12-11T17:09:49.242252+0000","last_undegraded":"2023-12-11T17:09:49.242252+0000","last_fullsized":"2023-12-11T17:09:49.242252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:05.364711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.270530+0000","last_change":"2023-12-11T17:09:45.209961+0000","last_active":"2023-12-11T17:09:49.270530+0000","last_peered":"2023-12-11T17:09:49.270530+0000","last_clean":"2023-12-11T17:09:49.270530+0000","last_became_active":"2023-12-11T17:09:45.207836+0000","last_became_peered":"2023-12-11T17:09:45.207836+0000","last_unstale":"2023-12-11T17:09:49.270530+0000","last_undegraded":"2023-12-11T17:09:49.270530+0000","last_fullsized":"2023-12-11T17:09:49.270530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:47:07.513492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.245215+0000","last_change":"2023-12-11T17:09:45.218319+0000","last_active":"2023-12-11T17:09:49.245215+0000","last_peered":"2023-12-11T17:09:49.245215+0000","last_clean":"2023-12-11T17:09:49.245215+0000","last_became_active":"2023-12-11T17:09:45.217465+0000","last_became_peered":"2023-12-11T17:09:45.217465+0000","last_unstale":"2023-12-11T17:09:49.245215+0000","last_undegraded":"2023-12-11T17:09:49.245215+0000","last_fullsized":"2023-12-11T17:09:49.245215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:11:15.785273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244369+0000","last_change":"2023-12-11T17:09:45.219120+0000","last_active":"2023-12-11T17:09:49.244369+0000","last_peered":"2023-12-11T17:09:49.244369+0000","last_clean":"2023-12-11T17:09:49.244369+0000","last_became_active":"2023-12-11T17:09:45.216692+0000","last_became_peered":"2023-12-11T17:09:45.216692+0000","last_unstale":"2023-12-11T17:09:49.244369+0000","last_undegraded":"2023-12-11T17:09:49.244369+0000","last_fullsized":"2023-12-11T17:09:49.244369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:05.364711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275330+0000","last_change":"2023-12-11T17:09:45.227610+0000","last_active":"2023-12-11T17:09:49.275330+0000","last_peered":"2023-12-11T17:09:49.275330+0000","last_clean":"2023-12-11T17:09:49.275330+0000","last_became_active":"2023-12-11T17:09:45.220917+0000","last_became_peered":"2023-12-11T17:09:45.220917+0000","last_unstale":"2023-12-11T17:09:49.275330+0000","last_undegraded":"2023-12-11T17:09:49.275330+0000","last_fullsized":"2023-12-11T17:09:49.275330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:24:41.119712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.241871+0000","last_change":"2023-12-11T17:09:45.213329+0000","last_active":"2023-12-11T17:09:49.241871+0000","last_peered":"2023-12-11T17:09:49.241871+0000","last_clean":"2023-12-11T17:09:49.241871+0000","last_became_active":"2023-12-11T17:09:45.211552+0000","last_became_peered":"2023-12-11T17:09:45.211552+0000","last_unstale":"2023-12-11T17:09:49.241871+0000","last_undegraded":"2023-12-11T17:09:49.241871+0000","last_fullsized":"2023-12-11T17:09:49.241871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:42:31.915581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274314+0000","last_change":"2023-12-11T17:09:45.219662+0000","last_active":"2023-12-11T17:09:49.274314+0000","last_peered":"2023-12-11T17:09:49.274314+0000","last_clean":"2023-12-11T17:09:49.274314+0000","last_became_active":"2023-12-11T17:09:45.219315+0000","last_became_peered":"2023-12-11T17:09:45.219315+0000","last_unstale":"2023-12-11T17:09:49.274314+0000","last_undegraded":"2023-12-11T17:09:49.274314+0000","last_fullsized":"2023-12-11T17:09:49.274314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:17:47.063007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.263442+0000","last_change":"2023-12-11T17:09:45.214165+0000","last_active":"2023-12-11T17:09:49.263442+0000","last_peered":"2023-12-11T17:09:49.263442+0000","last_clean":"2023-12-11T17:09:49.263442+0000","last_became_active":"2023-12-11T17:09:45.211191+0000","last_became_peered":"2023-12-11T17:09:45.211191+0000","last_unstale":"2023-12-11T17:09:49.263442+0000","last_undegraded":"2023-12-11T17:09:49.263442+0000","last_fullsized":"2023-12-11T17:09:49.263442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:52.152287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275091+0000","last_change":"2023-12-11T17:09:45.210404+0000","last_active":"2023-12-11T17:09:49.275091+0000","last_peered":"2023-12-11T17:09:49.275091+0000","last_clean":"2023-12-11T17:09:49.275091+0000","last_became_active":"2023-12-11T17:09:45.210084+0000","last_became_peered":"2023-12-11T17:09:45.210084+0000","last_unstale":"2023-12-11T17:09:49.275091+0000","last_undegraded":"2023-12-11T17:09:49.275091+0000","last_fullsized":"2023-12-11T17:09:49.275091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:13:50.995140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267850+0000","last_change":"2023-12-11T17:09:45.213977+0000","last_active":"2023-12-11T17:09:49.267850+0000","last_peered":"2023-12-11T17:09:49.267850+0000","last_clean":"2023-12-11T17:09:49.267850+0000","last_became_active":"2023-12-11T17:09:45.212551+0000","last_became_peered":"2023-12-11T17:09:45.212551+0000","last_unstale":"2023-12-11T17:09:49.267850+0000","last_undegraded":"2023-12-11T17:09:49.267850+0000","last_fullsized":"2023-12-11T17:09:49.267850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:17:47.063007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259640+0000","last_change":"2023-12-11T17:09:45.216618+0000","last_active":"2023-12-11T17:09:49.259640+0000","last_peered":"2023-12-11T17:09:49.259640+0000","last_clean":"2023-12-11T17:09:49.259640+0000","last_became_active":"2023-12-11T17:09:45.209865+0000","last_became_peered":"2023-12-11T17:09:45.209865+0000","last_unstale":"2023-12-11T17:09:49.259640+0000","last_undegraded":"2023-12-11T17:09:49.259640+0000","last_fullsized":"2023-12-11T17:09:49.259640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:56:34.698264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.241316+0000","last_change":"2023-12-11T17:09:45.208109+0000","last_active":"2023-12-11T17:09:49.241316+0000","last_peered":"2023-12-11T17:09:49.241316+0000","last_clean":"2023-12-11T17:09:49.241316+0000","last_became_active":"2023-12-11T17:09:45.204247+0000","last_became_peered":"2023-12-11T17:09:45.204247+0000","last_unstale":"2023-12-11T17:09:49.241316+0000","last_undegraded":"2023-12-11T17:09:49.241316+0000","last_fullsized":"2023-12-11T17:09:49.241316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:52.152287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275224+0000","last_change":"2023-12-11T17:09:45.225873+0000","last_active":"2023-12-11T17:09:49.275224+0000","last_peered":"2023-12-11T17:09:49.275224+0000","last_clean":"2023-12-11T17:09:49.275224+0000","last_became_active":"2023-12-11T17:09:45.225223+0000","last_became_peered":"2023-12-11T17:09:45.225223+0000","last_unstale":"2023-12-11T17:09:49.275224+0000","last_undegraded":"2023-12-11T17:09:49.275224+0000","last_fullsized":"2023-12-11T17:09:49.275224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:01:08.121657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4638,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542152,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":694037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93100000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6359999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.304}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0669999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.196}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.411}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5860000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542153,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4159999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.97199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93300000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0289999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3300000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.173}]}]},{"osd":5,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":103177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2270000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.075}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5069999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.351}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5640000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2989999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542153,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":103213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.413}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95099999999999996}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5169999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4570000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1759999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.298}]}]},{"osd":3,"up_from":14,"seq":60129542154,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.82099999999999995}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.91700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.496}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4530000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.0049999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542152,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":103087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96599999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.113}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.052}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6339999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.254}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5680000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.671}]}]},{"osd":1,"up_from":14,"seq":60129542153,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":103247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.95299999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.218}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.431}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.355}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.671}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.403}]}]},{"osd":0,"up_from":14,"seq":60129542153,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":694093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.165}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89600000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5009999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.202}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.649}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.6990000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-11T17:10:15.358 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-11T17:10:15.358 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-11T17:10:15.359 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-11T17:10:15.359 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-11T17:10:15.359 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-11T17:10:15.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.625+0000 7f6db74bb640 1 Processor -- start 2023-12-11T17:10:15.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.625+0000 7f6db74bb640 1 -- start start 2023-12-11T17:10:15.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.627+0000 7f6db74bb640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6db0143e00 0x7f6db00b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:15.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.627+0000 7f6db74bb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6db006c410 0x7f6db015ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:15.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.627+0000 7f6db74bb640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db00b3bb0 con 0x7f6db0072180 2023-12-11T17:10:15.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.627+0000 7f6db74bb640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6db01441e0 con 0x7f6db0143e00 2023-12-11T17:10:15.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.627+0000 7f6db74bb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db0072680 con 0x7f6db006c410 2023-12-11T17:10:15.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.628+0000 7f6db5a58640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6db006c410 0x7f6db015ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:15.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.628+0000 7f6db5257640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6db0143e00 0x7f6db00b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:15.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.628+0000 7f6db5a58640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6db006c410 0x7f6db015ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.37:42462/0 (socket says 172.21.15.37:42462) 2023-12-11T17:10:15.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.628+0000 7f6db5257640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6db0143e00 0x7f6db00b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:51914/0 (socket says 172.21.15.37:51914) 2023-12-11T17:10:15.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.628+0000 7f6db5a58640 1 -- 172.21.15.37:0/4090941248 learned_addr learned my addr 172.21.15.37:0/4090941248 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:15.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.628+0000 7f6db5257640 1 -- 172.21.15.37:0/4090941248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6db006c410 msgr2=0x7f6db015ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:15.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.629+0000 7f6db5257640 1 --2- 172.21.15.37:0/4090941248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6db006c410 0x7f6db015ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:15.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.629+0000 7f6db5257640 1 -- 172.21.15.37:0/4090941248 >> v1:172.21.15.151:6789/0 conn(0x7f6db0072180 legacy=0x7f6db00b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:15.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.629+0000 7f6db5257640 1 -- 172.21.15.37:0/4090941248 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db00b1e30 con 0x7f6db0143e00 2023-12-11T17:10:15.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.629+0000 7f6db5a58640 1 --2- 172.21.15.37:0/4090941248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6db006c410 0x7f6db015ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:10:15.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.630+0000 7f6db5257640 1 --2- 172.21.15.37:0/4090941248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db0143e00 0x7f6db00b4040 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0097a0 tx=0x7f6dac02b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7fb0e7cc6fc271d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:15.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.631+0000 7f6da7fff640 1 -- 172.21.15.37:0/4090941248 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac02d040 con 0x7f6db0143e00 2023-12-11T17:10:15.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.631+0000 7f6da7fff640 1 -- 172.21.15.37:0/4090941248 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dac031810 con 0x7f6db0143e00 2023-12-11T17:10:15.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.631+0000 7f6da7fff640 1 -- 172.21.15.37:0/4090941248 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dac031ba0 con 0x7f6db0143e00 2023-12-11T17:10:15.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.631+0000 7f6db74bb640 1 -- 172.21.15.37:0/4090941248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db0143e00 msgr2=0x7f6db00b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:15.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.631+0000 7f6db74bb640 1 --2- 172.21.15.37:0/4090941248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db0143e00 0x7f6db00b4040 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f6dac0097a0 tx=0x7f6dac02b8b0 comp rx=0 tx=0).stop 2023-12-11T17:10:15.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.632+0000 7f6db74bb640 1 -- 172.21.15.37:0/4090941248 shutdown_connections 2023-12-11T17:10:15.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.632+0000 7f6db74bb640 1 --2- 172.21.15.37:0/4090941248 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6db006c410 0x7f6db015ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:15.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.632+0000 7f6db74bb640 1 --2- 172.21.15.37:0/4090941248 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db0143e00 0x7f6db00b4040 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:15.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.632+0000 7f6db74bb640 1 -- 172.21.15.37:0/4090941248 >> 172.21.15.37:0/4090941248 conn(0x7f6db00b0a90 msgr2=0x7f6db00b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:15.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.632+0000 7f6db74bb640 1 -- 172.21.15.37:0/4090941248 shutdown_connections 2023-12-11T17:10:15.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.632+0000 7f6db74bb640 1 -- 172.21.15.37:0/4090941248 wait complete. 2023-12-11T17:10:15.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.634+0000 7f6db74bb640 1 Processor -- start 2023-12-11T17:10:15.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.634+0000 7f6db74bb640 1 -- start start 2023-12-11T17:10:15.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.635+0000 7f6db74bb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db006c410 0x7f6db01591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:15.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.635+0000 7f6db74bb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6db0072180 0x7f6db0133d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:15.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.635+0000 7f6db74bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6db0143e00 0x7f6db00cc890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:15.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.635+0000 7f6db74bb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db01351a0 con 0x7f6db0143e00 2023-12-11T17:10:15.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.635+0000 7f6db74bb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db01596f0 con 0x7f6db006c410 2023-12-11T17:10:15.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.635+0000 7f6db74bb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db01342c0 con 0x7f6db0072180 2023-12-11T17:10:15.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.636+0000 7f6db5a58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6db0143e00 0x7f6db00cc890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:15.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.636+0000 7f6db5a58640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6db0143e00 0x7f6db00cc890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46568/0 (socket says 172.21.15.37:46568) 2023-12-11T17:10:15.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.636+0000 7f6db5a58640 1 -- 172.21.15.37:0/520462843 learned_addr learned my addr 172.21.15.37:0/520462843 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:15.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.636+0000 7f6db4a56640 1 --2- 172.21.15.37:0/520462843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6db0072180 0x7f6db0133d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:15.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.636+0000 7f6db5257640 1 --2- 172.21.15.37:0/520462843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db006c410 0x7f6db01591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:15.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.636+0000 7f6db5a58640 1 -- 172.21.15.37:0/520462843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6db0072180 msgr2=0x7f6db0133d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:15.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.636+0000 7f6db5a58640 1 --2- 172.21.15.37:0/520462843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6db0072180 0x7f6db0133d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:15.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.636+0000 7f6db5a58640 1 -- 172.21.15.37:0/520462843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db006c410 msgr2=0x7f6db01591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:15.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.636+0000 7f6db5a58640 1 --2- 172.21.15.37:0/520462843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db006c410 0x7f6db01591b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:15.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.636+0000 7f6db5a58640 1 -- 172.21.15.37:0/520462843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da8009b30 con 0x7f6db0143e00 2023-12-11T17:10:15.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.636+0000 7f6db5257640 1 --2- 172.21.15.37:0/520462843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db006c410 0x7f6db01591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:10:15.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.637+0000 7f6db5a58640 1 --2- 172.21.15.37:0/520462843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6db0143e00 0x7f6db00cc890 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6da800efc0 tx=0x7f6da800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:15.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.637+0000 7f6da5ffb640 1 -- 172.21.15.37:0/520462843 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da8018070 con 0x7f6db0143e00 2023-12-11T17:10:15.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.637+0000 7f6da5ffb640 1 -- 172.21.15.37:0/520462843 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6da800f040 con 0x7f6db0143e00 2023-12-11T17:10:15.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.637+0000 7f6da5ffb640 1 -- 172.21.15.37:0/520462843 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6da800ce00 con 0x7f6db0143e00 2023-12-11T17:10:15.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.637+0000 7f6db74bb640 1 -- 172.21.15.37:0/520462843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dac009400 con 0x7f6db0143e00 2023-12-11T17:10:15.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.637+0000 7f6db74bb640 1 -- 172.21.15.37:0/520462843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db0134870 con 0x7f6db0143e00 2023-12-11T17:10:15.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.638+0000 7f6db74bb640 1 -- 172.21.15.37:0/520462843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db00745d0 con 0x7f6db0143e00 2023-12-11T17:10:15.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.639+0000 7f6da5ffb640 1 -- 172.21.15.37:0/520462843 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6da8014480 con 0x7f6db0143e00 2023-12-11T17:10:15.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.640+0000 7f6da5ffb640 1 --2- 172.21.15.37:0/520462843 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6d9406ae40 0x7f6d9406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:15.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.640+0000 7f6da5ffb640 1 -- 172.21.15.37:0/520462843 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6da8089cd0 con 0x7f6db0143e00 2023-12-11T17:10:15.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.641+0000 7f6db5257640 1 --2- 172.21.15.37:0/520462843 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6d9406ae40 0x7f6d9406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:15.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.642+0000 7f6db5257640 1 --2- 172.21.15.37:0/520462843 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6d9406ae40 0x7f6d9406d300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6dac036000 tx=0x7f6dac03c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:15.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.645+0000 7f6da5ffb640 1 -- 172.21.15.37:0/520462843 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6da8054a80 con 0x7f6db0143e00 2023-12-11T17:10:15.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.891+0000 7f6db74bb640 1 -- 172.21.15.37:0/520462843 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f6db006e020 con 0x7f6db0143e00 2023-12-11T17:10:15.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.896+0000 7f6da5ffb640 1 -- 172.21.15.37:0/520462843 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+171038 (secure 0 0 0) 0x7f6da80580a0 con 0x7f6db0143e00 2023-12-11T17:10:15.899 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:15.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.900+0000 7f6db74bb640 1 -- 172.21.15.37:0/520462843 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6d9406ae40 msgr2=0x7f6d9406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:15.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.900+0000 7f6db74bb640 1 --2- 172.21.15.37:0/520462843 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6d9406ae40 0x7f6d9406d300 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6dac036000 tx=0x7f6dac03c040 comp rx=0 tx=0).stop 2023-12-11T17:10:15.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.900+0000 7f6db74bb640 1 -- 172.21.15.37:0/520462843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6db0143e00 msgr2=0x7f6db00cc890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:15.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.900+0000 7f6db74bb640 1 --2- 172.21.15.37:0/520462843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6db0143e00 0x7f6db00cc890 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6da800efc0 tx=0x7f6da800c490 comp rx=0 tx=0).stop 2023-12-11T17:10:15.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.901+0000 7f6db74bb640 1 -- 172.21.15.37:0/520462843 shutdown_connections 2023-12-11T17:10:15.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.901+0000 7f6db74bb640 1 --2- 172.21.15.37:0/520462843 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6d9406ae40 0x7f6d9406d300 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:15.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.901+0000 7f6db74bb640 1 --2- 172.21.15.37:0/520462843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6db0143e00 0x7f6db00cc890 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:15.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.901+0000 7f6db74bb640 1 --2- 172.21.15.37:0/520462843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6db0072180 0x7f6db0133d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:15.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.901+0000 7f6db74bb640 1 --2- 172.21.15.37:0/520462843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db006c410 0x7f6db01591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:15.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.901+0000 7f6db74bb640 1 -- 172.21.15.37:0/520462843 >> 172.21.15.37:0/520462843 conn(0x7f6db00b0a90 msgr2=0x7f6db00aff70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:15.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.901+0000 7f6db74bb640 1 -- 172.21.15.37:0/520462843 shutdown_connections 2023-12-11T17:10:15.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:15.901+0000 7f6db74bb640 1 -- 172.21.15.37:0/520462843 wait complete. 2023-12-11T17:10:15.922 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"active_gid":4111,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":3081040918},{"type":"v1","addr":"172.21.15.151:6833","nonce":3081040918}]},"active_addr":"172.21.15.151:6833/3081040918","active_change":"2023-12-11T17:09:30.308536+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4104,"name":"y","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:latest","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":3265225503}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":2126574939}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":239325527}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.151:0","nonce":1275675758}]}]} 2023-12-11T17:10:15.925 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-11T17:10:15.925 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-11T17:10:15.925 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:10:16.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.143+0000 7f7c80e90640 1 Processor -- start 2023-12-11T17:10:16.144 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.143+0000 7f7c80e90640 1 -- start start 2023-12-11T17:10:16.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.145+0000 7f7c80e90640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7c7c143e00 0x7f7c7c0b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:16.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.145+0000 7f7c80e90640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7c7c06c410 0x7f7c7c15ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:16.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.145+0000 7f7c80e90640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7c0b3bb0 con 0x7f7c7c072180 2023-12-11T17:10:16.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.145+0000 7f7c80e90640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7c1441e0 con 0x7f7c7c06c410 2023-12-11T17:10:16.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.145+0000 7f7c80e90640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7c072680 con 0x7f7c7c143e00 2023-12-11T17:10:16.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.146+0000 7f7c7ad9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7c7c06c410 0x7f7c7c15ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:16.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.146+0000 7f7c7ad9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7c7c06c410 0x7f7c7c15ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46582/0 (socket says 172.21.15.37:46582) 2023-12-11T17:10:16.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.146+0000 7f7c7ad9d640 1 -- 172.21.15.37:0/3386258537 learned_addr learned my addr 172.21.15.37:0/3386258537 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:16.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.146+0000 7f7c7a59c640 1 --2- 172.21.15.37:0/3386258537 >> v2:172.21.15.151:3300/0 conn(0x7f7c7c143e00 0x7f7c7c0b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:16.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.146+0000 7f7c7ad9d640 1 -- 172.21.15.37:0/3386258537 >> v2:172.21.15.151:3300/0 conn(0x7f7c7c143e00 msgr2=0x7f7c7c0b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:16.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.146+0000 7f7c7ad9d640 1 --2- 172.21.15.37:0/3386258537 >> v2:172.21.15.151:3300/0 conn(0x7f7c7c143e00 0x7f7c7c0b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:16.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.146+0000 7f7c7ad9d640 1 -- 172.21.15.37:0/3386258537 >> v1:172.21.15.151:6789/0 conn(0x7f7c7c072180 legacy=0x7f7c7c0b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:16.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.146+0000 7f7c7ad9d640 1 -- 172.21.15.37:0/3386258537 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c0b1e30 con 0x7f7c7c06c410 2023-12-11T17:10:16.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.147+0000 7f7c7ad9d640 1 --2- 172.21.15.37:0/3386258537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c7c06c410 0x7f7c7c15ecb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c06b760 tx=0x7f7c7402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5be5d9972ecad128 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:16.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.147+0000 7f7c79d9b640 1 -- 172.21.15.37:0/3386258537 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74031870 con 0x7f7c7c06c410 2023-12-11T17:10:16.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.148+0000 7f7c79d9b640 1 -- 172.21.15.37:0/3386258537 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c740319d0 con 0x7f7c7c06c410 2023-12-11T17:10:16.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.148+0000 7f7c79d9b640 1 -- 172.21.15.37:0/3386258537 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74031d60 con 0x7f7c7c06c410 2023-12-11T17:10:16.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.148+0000 7f7c80e90640 1 -- 172.21.15.37:0/3386258537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c7c06c410 msgr2=0x7f7c7c15ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:16.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.148+0000 7f7c80e90640 1 --2- 172.21.15.37:0/3386258537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c7c06c410 0x7f7c7c15ecb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c06b760 tx=0x7f7c7402b910 comp rx=0 tx=0).stop 2023-12-11T17:10:16.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.148+0000 7f7c80e90640 1 -- 172.21.15.37:0/3386258537 shutdown_connections 2023-12-11T17:10:16.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.148+0000 7f7c80e90640 1 --2- 172.21.15.37:0/3386258537 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c7c06c410 0x7f7c7c15ecb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:16.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.148+0000 7f7c80e90640 1 --2- 172.21.15.37:0/3386258537 >> v2:172.21.15.151:3300/0 conn(0x7f7c7c143e00 0x7f7c7c0b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:16.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.148+0000 7f7c80e90640 1 -- 172.21.15.37:0/3386258537 >> 172.21.15.37:0/3386258537 conn(0x7f7c7c0b0a90 msgr2=0x7f7c7c0b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:16.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.148+0000 7f7c80e90640 1 -- 172.21.15.37:0/3386258537 shutdown_connections 2023-12-11T17:10:16.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.148+0000 7f7c80e90640 1 -- 172.21.15.37:0/3386258537 wait complete. 2023-12-11T17:10:16.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.150+0000 7f7c80e90640 1 Processor -- start 2023-12-11T17:10:16.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.150+0000 7f7c80e90640 1 -- start start 2023-12-11T17:10:16.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.151+0000 7f7c80e90640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c7c06c410 0x7f7c7c13ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:16.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.151+0000 7f7c80e90640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c7c072180 0x7f7c7c13dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:16.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.151+0000 7f7c80e90640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c7c143e00 0x7f7c7c15a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:16.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.151+0000 7f7c80e90640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c13be20 con 0x7f7c7c072180 2023-12-11T17:10:16.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.151+0000 7f7c80e90640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c13e320 con 0x7f7c7c143e00 2023-12-11T17:10:16.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.151+0000 7f7c80e90640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c15adb0 con 0x7f7c7c06c410 2023-12-11T17:10:16.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.152+0000 7f7c71d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c7c072180 0x7f7c7c13dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:16.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.152+0000 7f7c71d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c7c072180 0x7f7c7c13dde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46594/0 (socket says 172.21.15.37:46594) 2023-12-11T17:10:16.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.152+0000 7f7c71d9b640 1 -- 172.21.15.37:0/1184309345 learned_addr learned my addr 172.21.15.37:0/1184309345 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:16.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.152+0000 7f7c7a59c640 1 --2- 172.21.15.37:0/1184309345 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c7c06c410 0x7f7c7c13ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:16.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.152+0000 7f7c7ad9d640 1 --2- 172.21.15.37:0/1184309345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c7c143e00 0x7f7c7c15a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:16.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.152+0000 7f7c71d9b640 1 -- 172.21.15.37:0/1184309345 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c7c06c410 msgr2=0x7f7c7c13ab80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:16.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.152+0000 7f7c71d9b640 1 --2- 172.21.15.37:0/1184309345 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c7c06c410 0x7f7c7c13ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:16.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.152+0000 7f7c71d9b640 1 -- 172.21.15.37:0/1184309345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c7c143e00 msgr2=0x7f7c7c15a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:16.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.152+0000 7f7c71d9b640 1 --2- 172.21.15.37:0/1184309345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c7c143e00 0x7f7c7c15a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:16.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.152+0000 7f7c71d9b640 1 -- 172.21.15.37:0/1184309345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c740094d0 con 0x7f7c7c072180 2023-12-11T17:10:16.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.152+0000 7f7c71d9b640 1 --2- 172.21.15.37:0/1184309345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c7c072180 0x7f7c7c13dde0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400c780 tx=0x7f7c6400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:16.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.153+0000 7f7c737fe640 1 -- 172.21.15.37:0/1184309345 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6400aa50 con 0x7f7c7c072180 2023-12-11T17:10:16.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.153+0000 7f7c737fe640 1 -- 172.21.15.37:0/1184309345 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6400ce90 con 0x7f7c7c072180 2023-12-11T17:10:16.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.153+0000 7f7c737fe640 1 -- 172.21.15.37:0/1184309345 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6400ae30 con 0x7f7c7c072180 2023-12-11T17:10:16.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.153+0000 7f7c80e90640 1 -- 172.21.15.37:0/1184309345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c7c13b210 con 0x7f7c7c072180 2023-12-11T17:10:16.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.153+0000 7f7c80e90640 1 -- 172.21.15.37:0/1184309345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7c13b7d0 con 0x7f7c7c072180 2023-12-11T17:10:16.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.154+0000 7f7c80e90640 1 -- 172.21.15.37:0/1184309345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c7c13bf90 con 0x7f7c7c072180 2023-12-11T17:10:16.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.155+0000 7f7c737fe640 1 -- 172.21.15.37:0/1184309345 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7c64012420 con 0x7f7c7c072180 2023-12-11T17:10:16.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.156+0000 7f7c737fe640 1 --2- 172.21.15.37:0/1184309345 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7c5c06ae40 0x7f7c5c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:16.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.157+0000 7f7c737fe640 1 -- 172.21.15.37:0/1184309345 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7c64089c40 con 0x7f7c7c072180 2023-12-11T17:10:16.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.157+0000 7f7c7a59c640 1 --2- 172.21.15.37:0/1184309345 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7c5c06ae40 0x7f7c5c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:16.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.158+0000 7f7c7a59c640 1 --2- 172.21.15.37:0/1184309345 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7c5c06ae40 0x7f7c5c06d300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c006fd0 tx=0x7f7c6c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:16.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.161+0000 7f7c737fe640 1 -- 172.21.15.37:0/1184309345 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7c64054960 con 0x7f7c7c072180 2023-12-11T17:10:16.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.372+0000 7f7c80e90640 1 -- 172.21.15.37:0/1184309345 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7c7c0745d0 con 0x7f7c7c072180 2023-12-11T17:10:16.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.376+0000 7f7c737fe640 1 -- 172.21.15.37:0/1184309345 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f7c64016020 con 0x7f7c7c072180 2023-12-11T17:10:16.377 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:16.377 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:09:49.715938+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:10:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.379+0000 7f7c80e90640 1 -- 172.21.15.37:0/1184309345 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7c5c06ae40 msgr2=0x7f7c5c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.379+0000 7f7c80e90640 1 --2- 172.21.15.37:0/1184309345 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7c5c06ae40 0x7f7c5c06d300 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c006fd0 tx=0x7f7c6c008040 comp rx=0 tx=0).stop 2023-12-11T17:10:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.379+0000 7f7c80e90640 1 -- 172.21.15.37:0/1184309345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c7c072180 msgr2=0x7f7c7c13dde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.379+0000 7f7c80e90640 1 --2- 172.21.15.37:0/1184309345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c7c072180 0x7f7c7c13dde0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f7c6400c780 tx=0x7f7c6400cc40 comp rx=0 tx=0).stop 2023-12-11T17:10:16.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.379+0000 7f7c80e90640 1 -- 172.21.15.37:0/1184309345 shutdown_connections 2023-12-11T17:10:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.379+0000 7f7c80e90640 1 --2- 172.21.15.37:0/1184309345 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7c5c06ae40 0x7f7c5c06d300 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.379+0000 7f7c80e90640 1 --2- 172.21.15.37:0/1184309345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7c7c143e00 0x7f7c7c15a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.379+0000 7f7c80e90640 1 --2- 172.21.15.37:0/1184309345 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7c7c072180 0x7f7c7c13dde0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.379+0000 7f7c80e90640 1 --2- 172.21.15.37:0/1184309345 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7c7c06c410 0x7f7c7c13ab80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.379+0000 7f7c80e90640 1 -- 172.21.15.37:0/1184309345 >> 172.21.15.37:0/1184309345 conn(0x7f7c7c0b0a90 msgr2=0x7f7c7c0aea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.379+0000 7f7c80e90640 1 -- 172.21.15.37:0/1184309345 shutdown_connections 2023-12-11T17:10:16.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.379+0000 7f7c80e90640 1 -- 172.21.15.37:0/1184309345 wait complete. 2023-12-11T17:10:16.401 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-11T17:10:16.401 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:10:16.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.620+0000 7f5fc7fff640 1 Processor -- start 2023-12-11T17:10:16.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.620+0000 7f5fc7fff640 1 -- start start 2023-12-11T17:10:16.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.622+0000 7f5fc7fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5fc815e5d0 0x7f5fc806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:16.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.622+0000 7f5fc7fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc80ae200 0x7f5fc8070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:16.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.622+0000 7f5fc7fff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fc8071f90 con 0x7f5fc806c330 2023-12-11T17:10:16.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.622+0000 7f5fc7fff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fc8072270 con 0x7f5fc815e5d0 2023-12-11T17:10:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.622+0000 7f5fc7fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc8070070 con 0x7f5fc80ae200 2023-12-11T17:10:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.622+0000 7f5fc77fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5fc806c330 0x7f5fc80cded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42868/0 (socket says 172.21.15.37:42868) 2023-12-11T17:10:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.622+0000 7f5fc77fe640 1 -- 172.21.15.37:0/2237980897 learned_addr learned my addr 172.21.15.37:0/2237980897 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.622+0000 7f5fbffff640 1 --2- 172.21.15.37:0/2237980897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc80ae200 0x7f5fc8070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.622+0000 7f5fc6ffd640 1 --2- 172.21.15.37:0/2237980897 >> v2:172.21.15.151:3300/0 conn(0x7f5fc815e5d0 0x7f5fc806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.623+0000 7f5fc67fc640 1 -- 172.21.15.37:0/2237980897 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 836417515 0 0) 0x7f5fc8071f90 con 0x7f5fc806c330 2023-12-11T17:10:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.623+0000 7f5fc67fc640 1 -- 172.21.15.37:0/2237980897 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5fb4003520 con 0x7f5fc806c330 2023-12-11T17:10:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.623+0000 7f5fc67fc640 1 -- 172.21.15.37:0/2237980897 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2393000169 0 0) 0x7f5fb4003520 con 0x7f5fc806c330 2023-12-11T17:10:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.623+0000 7f5fc67fc640 1 -- 172.21.15.37:0/2237980897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc80ae200 msgr2=0x7f5fc8070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.623+0000 7f5fc67fc640 1 --2- 172.21.15.37:0/2237980897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc80ae200 0x7f5fc8070b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.623+0000 7f5fc67fc640 1 -- 172.21.15.37:0/2237980897 >> v2:172.21.15.151:3300/0 conn(0x7f5fc815e5d0 msgr2=0x7f5fc806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.623+0000 7f5fc67fc640 1 --2- 172.21.15.37:0/2237980897 >> v2:172.21.15.151:3300/0 conn(0x7f5fc815e5d0 0x7f5fc806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.623+0000 7f5fc67fc640 1 -- 172.21.15.37:0/2237980897 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc8070350 con 0x7f5fc806c330 2023-12-11T17:10:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.623+0000 7f5fc67fc640 1 -- 172.21.15.37:0/2237980897 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f5fc00019f0 con 0x7f5fc806c330 2023-12-11T17:10:16.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.623+0000 7f5fc67fc640 1 -- 172.21.15.37:0/2237980897 >> v1:172.21.15.37:6789/0 conn(0x7f5fc806c330 legacy=0x7f5fc80cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:16.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.623+0000 7f5fc67fc640 1 --2- 172.21.15.37:0/2237980897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fb4003970 0x7f5fb4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:16.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.623+0000 7f5fc67fc640 1 --2- 172.21.15.37:0/2237980897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc80ae200 0x7f5fb40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:16.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.623+0000 7f5fc67fc640 1 --2- 172.21.15.37:0/2237980897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fb4004d00 0x7f5fb4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:16.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.623+0000 7f5fc67fc640 1 -- 172.21.15.37:0/2237980897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc8072270 con 0x7f5fb4004d00 2023-12-11T17:10:16.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.623+0000 7f5fc67fc640 1 -- 172.21.15.37:0/2237980897 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc8070070 con 0x7f5fb4003970 2023-12-11T17:10:16.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.623+0000 7f5fc67fc640 1 -- 172.21.15.37:0/2237980897 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fb400ba00 con 0x7f5fc80ae200 2023-12-11T17:10:16.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.624+0000 7f5fc77fe640 1 --2- 172.21.15.37:0/2237980897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fb4004d00 0x7f5fb4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:16.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.624+0000 7f5fc6ffd640 1 --2- 172.21.15.37:0/2237980897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fb4003970 0x7f5fb4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:16.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.624+0000 7f5fbffff640 1 --2- 172.21.15.37:0/2237980897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc80ae200 0x7f5fb40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:16.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.624+0000 7f5fc77fe640 1 -- 172.21.15.37:0/2237980897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc80ae200 msgr2=0x7f5fb40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:16.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.624+0000 7f5fc77fe640 1 --2- 172.21.15.37:0/2237980897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc80ae200 0x7f5fb40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:16.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.624+0000 7f5fc77fe640 1 -- 172.21.15.37:0/2237980897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fb4003970 msgr2=0x7f5fb4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:16.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.624+0000 7f5fc77fe640 1 --2- 172.21.15.37:0/2237980897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fb4003970 0x7f5fb4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:16.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.624+0000 7f5fc77fe640 1 -- 172.21.15.37:0/2237980897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fb4003520 con 0x7f5fb4004d00 2023-12-11T17:10:16.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.625+0000 7f5fc77fe640 1 --2- 172.21.15.37:0/2237980897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fb4004d00 0x7f5fb4005180 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000a790 tx=0x7f5fb40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81f0df4fd212176 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:16.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.626+0000 7f5fc67fc640 1 -- 172.21.15.37:0/2237980897 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc0034630 con 0x7f5fb4004d00 2023-12-11T17:10:16.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.626+0000 7f5fc67fc640 1 -- 172.21.15.37:0/2237980897 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fc002f070 con 0x7f5fb4004d00 2023-12-11T17:10:16.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.626+0000 7f5fc67fc640 1 -- 172.21.15.37:0/2237980897 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fc00349f0 con 0x7f5fb4004d00 2023-12-11T17:10:16.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.626+0000 7f5fc7fff640 1 -- 172.21.15.37:0/2237980897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fb4004d00 msgr2=0x7f5fb4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:16.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.626+0000 7f5fc7fff640 1 --2- 172.21.15.37:0/2237980897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fb4004d00 0x7f5fb4005180 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f5fc000a790 tx=0x7f5fb40057f0 comp rx=0 tx=0).stop 2023-12-11T17:10:16.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.626+0000 7f5fc77fe640 1 -- 172.21.15.37:0/2237980897 reap_dead start 2023-12-11T17:10:16.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.626+0000 7f5fc7fff640 1 -- 172.21.15.37:0/2237980897 shutdown_connections 2023-12-11T17:10:16.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.626+0000 7f5fc7fff640 1 -- 172.21.15.37:0/2237980897 >> 172.21.15.37:0/2237980897 conn(0x7f5fc80b0860 msgr2=0x7f5fc80b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:16.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.627+0000 7f5fc7fff640 1 -- 172.21.15.37:0/2237980897 shutdown_connections 2023-12-11T17:10:16.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.627+0000 7f5fc7fff640 1 -- 172.21.15.37:0/2237980897 wait complete. 2023-12-11T17:10:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.628+0000 7f5fc7fff640 1 Processor -- start 2023-12-11T17:10:16.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.629+0000 7f5fc7fff640 1 -- start start 2023-12-11T17:10:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.630+0000 7f5fc7fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fb4004d00 0x7f5fc81f3940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.630+0000 7f5fc7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc8099e00 0x7f5fc809a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.630+0000 7f5fc7fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc809a8c0 0x7f5fc8151df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.630+0000 7f5fc7fff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc809b880 con 0x7f5fc8099e00 2023-12-11T17:10:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.630+0000 7f5fc7fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc81f1910 con 0x7f5fb4004d00 2023-12-11T17:10:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.630+0000 7f5fc7fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fc81f0c90 con 0x7f5fc809a8c0 2023-12-11T17:10:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.630+0000 7f5fbffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc8099e00 0x7f5fc809a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.630+0000 7f5fbffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc8099e00 0x7f5fc809a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46624/0 (socket says 172.21.15.37:46624) 2023-12-11T17:10:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.630+0000 7f5fbffff640 1 -- 172.21.15.37:0/3887726998 learned_addr learned my addr 172.21.15.37:0/3887726998 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.630+0000 7f5fc6ffd640 1 --2- 172.21.15.37:0/3887726998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fb4004d00 0x7f5fc81f3940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.630+0000 7f5fbffff640 1 -- 172.21.15.37:0/3887726998 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc809a8c0 msgr2=0x7f5fc8151df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.630+0000 7f5fbffff640 1 --2- 172.21.15.37:0/3887726998 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc809a8c0 0x7f5fc8151df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.630+0000 7f5fbffff640 1 -- 172.21.15.37:0/3887726998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fb4004d00 msgr2=0x7f5fc81f3940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:16.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.630+0000 7f5fbffff640 1 --2- 172.21.15.37:0/3887726998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fb4004d00 0x7f5fc81f3940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:16.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.630+0000 7f5fbffff640 1 -- 172.21.15.37:0/3887726998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fc81f0f70 con 0x7f5fc8099e00 2023-12-11T17:10:16.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.631+0000 7f5fbffff640 1 --2- 172.21.15.37:0/3887726998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc8099e00 0x7f5fc809a380 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0011600 tx=0x7f5fb0011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:16.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.631+0000 7f5fbf7fe640 1 -- 172.21.15.37:0/3887726998 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0015870 con 0x7f5fc8099e00 2023-12-11T17:10:16.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.631+0000 7f5fbf7fe640 1 -- 172.21.15.37:0/3887726998 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fb00159d0 con 0x7f5fc8099e00 2023-12-11T17:10:16.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.631+0000 7f5fbf7fe640 1 -- 172.21.15.37:0/3887726998 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fb0015d40 con 0x7f5fc8099e00 2023-12-11T17:10:16.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.631+0000 7f5fc7fff640 1 -- 172.21.15.37:0/3887726998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fc81f1250 con 0x7f5fc8099e00 2023-12-11T17:10:16.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.631+0000 7f5fc7fff640 1 -- 172.21.15.37:0/3887726998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fc81f3e80 con 0x7f5fc8099e00 2023-12-11T17:10:16.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.632+0000 7f5fc7fff640 1 -- 172.21.15.37:0/3887726998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fc8074450 con 0x7f5fc8099e00 2023-12-11T17:10:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.633+0000 7f5fbf7fe640 1 -- 172.21.15.37:0/3887726998 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5fb000f490 con 0x7f5fc8099e00 2023-12-11T17:10:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.634+0000 7f5fbf7fe640 1 --2- 172.21.15.37:0/3887726998 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5fa806ae40 0x7f5fa806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.634+0000 7f5fbf7fe640 1 -- 172.21.15.37:0/3887726998 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5fb0089da0 con 0x7f5fc8099e00 2023-12-11T17:10:16.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.635+0000 7f5fc6ffd640 1 --2- 172.21.15.37:0/3887726998 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5fa806ae40 0x7f5fa806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:16.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.636+0000 7f5fc6ffd640 1 --2- 172.21.15.37:0/3887726998 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5fa806ae40 0x7f5fa806d300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5fc80af2e0 tx=0x7f5fb8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:16.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.639+0000 7f5fbf7fe640 1 -- 172.21.15.37:0/3887726998 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5fb0054b50 con 0x7f5fc8099e00 2023-12-11T17:10:16.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.832+0000 7f5fc7fff640 1 -- 172.21.15.37:0/3887726998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5fc80adfe0 con 0x7f5fc8099e00 2023-12-11T17:10:16.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.835+0000 7f5fbf7fe640 1 -- 172.21.15.37:0/3887726998 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f5fb0022090 con 0x7f5fc8099e00 2023-12-11T17:10:16.836 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:16.836 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:09:49.715938+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:10:16.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.838+0000 7f5fc7fff640 1 -- 172.21.15.37:0/3887726998 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5fa806ae40 msgr2=0x7f5fa806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:16.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.838+0000 7f5fc7fff640 1 --2- 172.21.15.37:0/3887726998 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5fa806ae40 0x7f5fa806d300 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f5fc80af2e0 tx=0x7f5fb8008040 comp rx=0 tx=0).stop 2023-12-11T17:10:16.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.838+0000 7f5fc7fff640 1 -- 172.21.15.37:0/3887726998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc8099e00 msgr2=0x7f5fc809a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:16.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.838+0000 7f5fc7fff640 1 --2- 172.21.15.37:0/3887726998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc8099e00 0x7f5fc809a380 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5fb0011600 tx=0x7f5fb0011ac0 comp rx=0 tx=0).stop 2023-12-11T17:10:16.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.838+0000 7f5fc7fff640 1 -- 172.21.15.37:0/3887726998 shutdown_connections 2023-12-11T17:10:16.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.838+0000 7f5fc7fff640 1 --2- 172.21.15.37:0/3887726998 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5fa806ae40 0x7f5fa806d300 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:16.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.838+0000 7f5fc7fff640 1 --2- 172.21.15.37:0/3887726998 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fc809a8c0 0x7f5fc8151df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:16.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.838+0000 7f5fc7fff640 1 --2- 172.21.15.37:0/3887726998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fc8099e00 0x7f5fc809a380 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:16.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.838+0000 7f5fc7fff640 1 --2- 172.21.15.37:0/3887726998 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fb4004d00 0x7f5fc81f3940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:16.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.838+0000 7f5fc7fff640 1 -- 172.21.15.37:0/3887726998 >> 172.21.15.37:0/3887726998 conn(0x7f5fc80b0860 msgr2=0x7f5fc8158d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:16.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.838+0000 7f5fc7fff640 1 -- 172.21.15.37:0/3887726998 shutdown_connections 2023-12-11T17:10:16.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:16.838+0000 7f5fc7fff640 1 -- 172.21.15.37:0/3887726998 wait complete. 2023-12-11T17:10:16.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-11T17:10:16.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-11T17:10:16.859 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-11T17:10:16.859 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-11T17:10:16.859 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-11T17:10:16.860 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-11T17:10:16.860 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-11T17:10:16.861 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-11T17:10:17.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.172+0000 7ff633a32640 1 Processor -- start 2023-12-11T17:10:17.173 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.172+0000 7ff633a32640 1 -- start start 2023-12-11T17:10:17.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.174+0000 7ff633a32640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff624005e60 0x7ff6240062a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.174+0000 7ff633a32640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff6240067e0 0x7ff624006c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.174+0000 7ff633a32640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff624054300 con 0x7ff6240eacd0 2023-12-11T17:10:17.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.174+0000 7ff633a32640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6240536f0 con 0x7ff6240067e0 2023-12-11T17:10:17.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.174+0000 7ff633a32640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6240539d0 con 0x7ff624005e60 2023-12-11T17:10:17.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.175+0000 7ff6317ce640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7ff6240eacd0 0x7ff62404fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.37:56406/0 (socket says 172.21.15.37:56406) 2023-12-11T17:10:17.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.175+0000 7ff6317ce640 1 -- 172.21.15.37:0/2139825839 learned_addr learned my addr 172.21.15.37:0/2139825839 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:17.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.175+0000 7ff630fcd640 1 --2- 172.21.15.37:0/2139825839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff624005e60 0x7ff6240062a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.175+0000 7ff631fcf640 1 --2- 172.21.15.37:0/2139825839 >> v2:172.21.15.37:3300/0 conn(0x7ff6240067e0 0x7ff624006c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.176+0000 7f8da93a9640 1 Processor -- start 2023-12-11T17:10:17.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.176+0000 7ff623fff640 1 -- 172.21.15.37:0/2139825839 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2082446292 0 0) 0x7ff624054300 con 0x7ff6240eacd0 2023-12-11T17:10:17.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.176+0000 7ff623fff640 1 -- 172.21.15.37:0/2139825839 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff618003520 con 0x7ff6240eacd0 2023-12-11T17:10:17.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.176+0000 7ff630fcd640 1 -- 172.21.15.37:0/2139825839 >> v2:172.21.15.37:3300/0 conn(0x7ff6240067e0 msgr2=0x7ff624006c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:17.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.176+0000 7ff630fcd640 1 --2- 172.21.15.37:0/2139825839 >> v2:172.21.15.37:3300/0 conn(0x7ff6240067e0 0x7ff624006c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.176+0000 7f8da93a9640 1 -- start start 2023-12-11T17:10:17.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.177+0000 7ff630fcd640 1 -- 172.21.15.37:0/2139825839 >> v1:172.21.15.151:6789/0 conn(0x7ff6240eacd0 legacy=0x7ff62404fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.177+0000 7ff630fcd640 1 -- 172.21.15.37:0/2139825839 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff624053cb0 con 0x7ff624005e60 2023-12-11T17:10:17.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.179+0000 7f8da93a9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d9c050da0 0x7f8d9c038600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.179+0000 7f8da93a9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d9c04f510 con 0x7f8d9c03a5a0 2023-12-11T17:10:17.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.179+0000 7f8da93a9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d9c04f7f0 con 0x7f8d9c0e1060 2023-12-11T17:10:17.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.179+0000 7f8da93a9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c04fad0 con 0x7f8d9c050da0 2023-12-11T17:10:17.180 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.179+0000 7ff630fcd640 1 --2- 172.21.15.37:0/2139825839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff624005e60 0x7ff6240062a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0097a0 tx=0x7ff61c02b600 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e3380645d96b1bcb server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.180+0000 7f8da2ffd640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f8d9c0e1060 0x7f8d9c039e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.37:56418/0 (socket says 172.21.15.37:56418) 2023-12-11T17:10:17.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.180+0000 7f8da2ffd640 1 -- 172.21.15.37:0/2861494041 learned_addr learned my addr 172.21.15.37:0/2861494041 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:17.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.180+0000 7f8da27fc640 1 --2- 172.21.15.37:0/2861494041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d9c050da0 0x7f8d9c038600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.180+0000 7ff623fff640 1 -- 172.21.15.37:0/2139825839 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff628001670 con 0x7ff624005e60 2023-12-11T17:10:17.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.180+0000 7ff623fff640 1 -- 172.21.15.37:0/2139825839 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61c02e050 con 0x7ff624005e60 2023-12-11T17:10:17.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.181+0000 7ff623fff640 1 -- 172.21.15.37:0/2139825839 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61c030510 con 0x7ff624005e60 2023-12-11T17:10:17.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.181+0000 7f18a8333640 1 Processor -- start 2023-12-11T17:10:17.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.181+0000 7ff633a32640 1 -- 172.21.15.37:0/2139825839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff624005e60 msgr2=0x7ff6240062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.181+0000 7f8da1ffb640 1 -- 172.21.15.37:0/2861494041 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3275204303 0 0) 0x7f8d9c04f7f0 con 0x7f8d9c0e1060 2023-12-11T17:10:17.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.181+0000 7f8da1ffb640 1 -- 172.21.15.37:0/2861494041 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d8c003520 con 0x7f8d9c0e1060 2023-12-11T17:10:17.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.182+0000 7f8da1ffb640 1 -- 172.21.15.37:0/2861494041 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2276639762 0 0) 0x7f8d9c04f510 con 0x7f8d9c03a5a0 2023-12-11T17:10:17.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.182+0000 7f8da1ffb640 1 -- 172.21.15.37:0/2861494041 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d9c04f7f0 con 0x7f8d9c03a5a0 2023-12-11T17:10:17.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.181+0000 7ff633a32640 1 --2- 172.21.15.37:0/2139825839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff624005e60 0x7ff6240062a0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff61c0097a0 tx=0x7ff61c02b600 comp rx=0 tx=0).stop 2023-12-11T17:10:17.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.182+0000 7ff633a32640 1 -- 172.21.15.37:0/2139825839 shutdown_connections 2023-12-11T17:10:17.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.182+0000 7ff633a32640 1 --2- 172.21.15.37:0/2139825839 >> v2:172.21.15.37:3300/0 conn(0x7ff6240067e0 0x7ff624006c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.182+0000 7ff633a32640 1 --2- 172.21.15.37:0/2139825839 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff624005e60 0x7ff6240062a0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.182+0000 7ff633a32640 1 -- 172.21.15.37:0/2139825839 >> 172.21.15.37:0/2139825839 conn(0x7ff624009f80 msgr2=0x7ff62400a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.182+0000 7f18a8333640 1 -- start start 2023-12-11T17:10:17.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.182+0000 7f8da1ffb640 1 -- 172.21.15.37:0/2861494041 <== mon.1 v1:172.21.15.151:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2183864944 0 0) 0x7f8d8c003520 con 0x7f8d9c0e1060 2023-12-11T17:10:17.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.182+0000 7f8da1ffb640 1 -- 172.21.15.37:0/2861494041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d9c050da0 msgr2=0x7f8d9c038600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:17.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.183+0000 7f8da1ffb640 1 --2- 172.21.15.37:0/2861494041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d9c050da0 0x7f8d9c038600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.183+0000 7f8da1ffb640 1 -- 172.21.15.37:0/2861494041 >> v1:172.21.15.37:6789/0 conn(0x7f8d9c03a5a0 legacy=0x7f8d9c005f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.183+0000 7f8da1ffb640 1 -- 172.21.15.37:0/2861494041 --> v1:172.21.15.151:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c04fdb0 con 0x7f8d9c0e1060 2023-12-11T17:10:17.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.183+0000 7f8da1ffb640 1 -- 172.21.15.37:0/2861494041 <== mon.1 v1:172.21.15.151:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f8d94001670 con 0x7f8d9c0e1060 2023-12-11T17:10:17.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.183+0000 7f8da1ffb640 1 -- 172.21.15.37:0/2861494041 >> v1:172.21.15.151:6789/0 conn(0x7f8d9c0e1060 legacy=0x7f8d9c039e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.183+0000 7f8da1ffb640 1 --2- 172.21.15.37:0/2861494041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d8c003b30 0x7f8d8c003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.183+0000 7f8da1ffb640 1 --2- 172.21.15.37:0/2861494041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d8c0047c0 0x7f8d8c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.183+0000 7f8da1ffb640 1 --2- 172.21.15.37:0/2861494041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8c009970 0x7f8d8c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.183+0000 7f8da1ffb640 1 -- 172.21.15.37:0/2861494041 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8da404ed60 con 0x7f8d8c009970 2023-12-11T17:10:17.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.183+0000 7f8da1ffb640 1 -- 172.21.15.37:0/2861494041 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c04fad0 con 0x7f8d8c003b30 2023-12-11T17:10:17.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.183+0000 7f8da1ffb640 1 -- 172.21.15.37:0/2861494041 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8c0146e0 con 0x7f8d8c0047c0 2023-12-11T17:10:17.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.183+0000 7f8da37fe640 1 --2- 172.21.15.37:0/2861494041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8c009970 0x7f8d8c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.184+0000 7f18a8333640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f18a00b1580 0x7f18a0070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.184+0000 7f18a8333640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a006d650 con 0x7f18a006cc90 2023-12-11T17:10:17.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.184+0000 7f18a8333640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a00ccd70 con 0x7f18a015a580 2023-12-11T17:10:17.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.184+0000 7f18a8333640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a00cd050 con 0x7f18a00b1580 2023-12-11T17:10:17.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.184+0000 7f8da27fc640 1 --2- 172.21.15.37:0/2861494041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d9c050da0 0x7f8d9c038600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:10:17.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.185+0000 7f18a60cf640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f18a015a580 0x7f18a0153690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.37:56424/0 (socket says 172.21.15.37:56424) 2023-12-11T17:10:17.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.185+0000 7f18a60cf640 1 -- 172.21.15.37:0/3762984035 learned_addr learned my addr 172.21.15.37:0/3762984035 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:17.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.183+0000 7ff633a32640 1 -- 172.21.15.37:0/2139825839 shutdown_connections 2023-12-11T17:10:17.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.183+0000 7ff633a32640 1 -- 172.21.15.37:0/2139825839 wait complete. 2023-12-11T17:10:17.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.185+0000 7f8da27fc640 1 --2- 172.21.15.37:0/2861494041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d8c0047c0 0x7f8d8c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.185+0000 7f18a58ce640 1 --2- 172.21.15.37:0/3762984035 >> v2:172.21.15.151:3300/0 conn(0x7f18a00b1580 0x7f18a0070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.185+0000 7f8da37fe640 1 -- 172.21.15.37:0/2861494041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d8c0047c0 msgr2=0x7f8d8c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:17.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.186+0000 7ff633a32640 1 Processor -- start 2023-12-11T17:10:17.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.186+0000 7ff633a32640 1 -- start start 2023-12-11T17:10:17.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.186+0000 7f18a58ce640 1 -- 172.21.15.37:0/3762984035 >> v1:172.21.15.151:6789/0 conn(0x7f18a015a580 legacy=0x7f18a0153690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.186+0000 7f18a58ce640 1 -- 172.21.15.37:0/3762984035 >> v1:172.21.15.37:6789/0 conn(0x7f18a006cc90 legacy=0x7f18a00b43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.186+0000 7f18a58ce640 1 -- 172.21.15.37:0/3762984035 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a00cd330 con 0x7f18a00b1580 2023-12-11T17:10:17.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.187+0000 7fbef6b25640 1 Processor -- start 2023-12-11T17:10:17.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.187+0000 7fbef6b25640 1 -- start start 2023-12-11T17:10:17.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.187+0000 7f5daa1a9640 1 Processor -- start 2023-12-11T17:10:17.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.187+0000 7f5daa1a9640 1 -- start start 2023-12-11T17:10:17.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.185+0000 7f8da2ffd640 1 --2- 172.21.15.37:0/2861494041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d8c003b30 0x7f8d8c003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.188+0000 7f8da37fe640 1 --2- 172.21.15.37:0/2861494041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d8c0047c0 0x7f8d8c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.188+0000 7f8da37fe640 1 -- 172.21.15.37:0/2861494041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d8c003b30 msgr2=0x7f8d8c003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:17.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.188+0000 7f8da37fe640 1 --2- 172.21.15.37:0/2861494041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d8c003b30 0x7f8d8c003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.188+0000 7f8da37fe640 1 -- 172.21.15.37:0/2861494041 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c04fdb0 con 0x7f8d8c009970 2023-12-11T17:10:17.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.188+0000 7f8da27fc640 1 --2- 172.21.15.37:0/2861494041 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d8c0047c0 0x7f8d8c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:17.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.188+0000 7f69013ce640 1 Processor -- start 2023-12-11T17:10:17.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.188+0000 7f8da2ffd640 1 --2- 172.21.15.37:0/2861494041 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d8c003b30 0x7f8d8c003f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:17.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.188+0000 7f69013ce640 1 -- start start 2023-12-11T17:10:17.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.188+0000 7f18a58ce640 1 --2- 172.21.15.37:0/3762984035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18a00b1580 0x7f18a0070a80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f18900097a0 tx=0x7f189002b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2c4415082271dd04 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.189+0000 7f18a50cd640 1 -- 172.21.15.37:0/3762984035 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189002f810 con 0x7f18a00b1580 2023-12-11T17:10:17.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.189+0000 7fbef6b25640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fbef00cfb20 0x7fbef00cff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.189+0000 7f8da37fe640 1 --2- 172.21.15.37:0/2861494041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8c009970 0x7f8d8c005180 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8da4064180 tx=0x7f8d8c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e51b0a61102a462 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.190+0000 7f8da1ffb640 1 -- 172.21.15.37:0/2861494041 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da40bf440 con 0x7f8d8c009970 2023-12-11T17:10:17.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.190+0000 7f8da1ffb640 1 -- 172.21.15.37:0/2861494041 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da40bf5a0 con 0x7f8d8c009970 2023-12-11T17:10:17.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.191+0000 7f8da1ffb640 1 -- 172.21.15.37:0/2861494041 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da40bf9d0 con 0x7f8d8c009970 2023-12-11T17:10:17.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.192+0000 7f8da93a9640 1 -- 172.21.15.37:0/2861494041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8c009970 msgr2=0x7f8d8c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.192+0000 7f8da93a9640 1 --2- 172.21.15.37:0/2861494041 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d8c009970 0x7f8d8c005180 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f8da4064180 tx=0x7f8d8c0057f0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.192+0000 7f8da37fe640 1 -- 172.21.15.37:0/2861494041 reap_dead start 2023-12-11T17:10:17.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.189+0000 7ff633a32640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff624005e60 0x7ff62404a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.189+0000 7ff633a32640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6240067e0 0x7ff624037080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.189+0000 7ff633a32640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6240eacd0 0x7ff62417d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.189+0000 7ff633a32640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62417dad0 con 0x7ff6240067e0 2023-12-11T17:10:17.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.189+0000 7ff633a32640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6240d0820 con 0x7ff6240eacd0 2023-12-11T17:10:17.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.189+0000 7ff633a32640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff62404aa20 con 0x7ff624005e60 2023-12-11T17:10:17.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.189+0000 7ff630fcd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6240067e0 0x7ff624037080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.190+0000 7ff630fcd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6240067e0 0x7ff624037080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46644/0 (socket says 172.21.15.37:46644) 2023-12-11T17:10:17.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.190+0000 7ff630fcd640 1 -- 172.21.15.37:0/3376864999 learned_addr learned my addr 172.21.15.37:0/3376864999 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:17.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.190+0000 7ff6317ce640 1 --2- 172.21.15.37:0/3376864999 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff624005e60 0x7ff62404a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.190+0000 7ff631fcf640 1 --2- 172.21.15.37:0/3376864999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6240eacd0 0x7ff62417d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.192+0000 7ff631fcf640 1 -- 172.21.15.37:0/3376864999 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff624005e60 msgr2=0x7ff62404a390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.192+0000 7ff631fcf640 1 --2- 172.21.15.37:0/3376864999 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff624005e60 0x7ff62404a390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.192+0000 7ff631fcf640 1 -- 172.21.15.37:0/3376864999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6240067e0 msgr2=0x7ff624037080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.192+0000 7ff631fcf640 1 --2- 172.21.15.37:0/3376864999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6240067e0 0x7ff624037080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.192+0000 7ff631fcf640 1 -- 172.21.15.37:0/3376864999 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff61c009400 con 0x7ff6240eacd0 2023-12-11T17:10:17.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.192+0000 7ff630fcd640 1 --2- 172.21.15.37:0/3376864999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6240067e0 0x7ff624037080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:10:17.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.192+0000 7ff631fcf640 1 --2- 172.21.15.37:0/3376864999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6240eacd0 0x7ff62417d590 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff62c063e60 tx=0x7ff62c067ed0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.190+0000 7f69013ce640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f68fc1609b0 0x7f68fc0d0ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.190+0000 7f69013ce640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68fc0d0230 0x7f68fc15cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.190+0000 7f69013ce640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68fc15dd60 con 0x7f68fc0d1220 2023-12-11T17:10:17.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.190+0000 7f69013ce640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68fc160d90 con 0x7f68fc1609b0 2023-12-11T17:10:17.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.190+0000 7f69013ce640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc15e040 con 0x7f68fc0d0230 2023-12-11T17:10:17.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.191+0000 7f68fa7fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f68fc0d1220 0x7f68fc0cfb20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42914/0 (socket says 172.21.15.37:42914) 2023-12-11T17:10:17.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.191+0000 7f68fa7fc640 1 -- 172.21.15.37:0/3464128203 learned_addr learned my addr 172.21.15.37:0/3464128203 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:17.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.191+0000 7f68faffd640 1 --2- 172.21.15.37:0/3464128203 >> v2:172.21.15.37:3300/0 conn(0x7f68fc1609b0 0x7f68fc0d0ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.189+0000 7f5daa1a9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5da4157a60 0x7f5da406c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.190+0000 7f5daa1a9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da406ca40 con 0x7f5da406de20 2023-12-11T17:10:17.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.190+0000 7f5daa1a9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5da4071cd0 con 0x7f5da415e2b0 2023-12-11T17:10:17.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.190+0000 7f5daa1a9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5da4070f10 con 0x7f5da4157a60 2023-12-11T17:10:17.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.191+0000 7f5da37fe640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5da4157a60 0x7f5da406c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.191+0000 7f5da37fe640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5da4157a60 0x7f5da406c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:52024/0 (socket says 172.21.15.37:52024) 2023-12-11T17:10:17.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.191+0000 7f5d9bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5da406de20 0x7f5da415dba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42900/0 (socket says 172.21.15.37:42900) 2023-12-11T17:10:17.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.191+0000 7f5da37fe640 1 -- 172.21.15.37:0/644216728 learned_addr learned my addr 172.21.15.37:0/644216728 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:17.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.191+0000 7f5da3fff640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f5da415e2b0 0x7f5da40cc8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.37:56438/0 (socket says 172.21.15.37:56438) 2023-12-11T17:10:17.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.189+0000 7f18a50cd640 1 -- 172.21.15.37:0/3762984035 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189002f970 con 0x7f18a00b1580 2023-12-11T17:10:17.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.189+0000 7f18a50cd640 1 -- 172.21.15.37:0/3762984035 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189002f810 con 0x7f18a00b1580 2023-12-11T17:10:17.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.190+0000 7f18a8333640 1 -- 172.21.15.37:0/3762984035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18a00b1580 msgr2=0x7f18a0070a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.190+0000 7f18a8333640 1 --2- 172.21.15.37:0/3762984035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18a00b1580 0x7f18a0070a80 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f18900097a0 tx=0x7f189002b9f0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.191+0000 7f18a8333640 1 -- 172.21.15.37:0/3762984035 shutdown_connections 2023-12-11T17:10:17.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.191+0000 7f18a8333640 1 --2- 172.21.15.37:0/3762984035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18a00b1580 0x7f18a0070a80 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.191+0000 7f18a8333640 1 -- 172.21.15.37:0/3762984035 >> 172.21.15.37:0/3762984035 conn(0x7f18a00b0a90 msgr2=0x7f18a00b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.191+0000 7f18a8333640 1 -- 172.21.15.37:0/3762984035 shutdown_connections 2023-12-11T17:10:17.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.191+0000 7f18a8333640 1 -- 172.21.15.37:0/3762984035 wait complete. 2023-12-11T17:10:17.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.189+0000 7fbef6b25640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbef015cd60 0x7fbef015d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.189+0000 7fbef6b25640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbef00d04a0 con 0x7fbef01609b0 2023-12-11T17:10:17.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.189+0000 7fbef6b25640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef0160d90 con 0x7fbef015cd60 2023-12-11T17:10:17.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.189+0000 7fbef6b25640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbef015dd60 con 0x7fbef00cfb20 2023-12-11T17:10:17.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.190+0000 7fbef48c1640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fbef01609b0 0x7fbef00d0ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.37:56436/0 (socket says 172.21.15.37:56436) 2023-12-11T17:10:17.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.190+0000 7fbef48c1640 1 -- 172.21.15.37:0/1982455544 learned_addr learned my addr 172.21.15.37:0/1982455544 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:17.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.190+0000 7fbeeffff640 1 --2- 172.21.15.37:0/1982455544 >> v2:172.21.15.151:3300/0 conn(0x7fbef00cfb20 0x7fbef00cff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.190+0000 7fbef50c2640 1 --2- 172.21.15.37:0/1982455544 >> v2:172.21.15.37:3300/0 conn(0x7fbef015cd60 0x7fbef015d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.191+0000 7fbeef7fe640 1 -- 172.21.15.37:0/1982455544 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1275995852 0 0) 0x7fbef00d04a0 con 0x7fbef01609b0 2023-12-11T17:10:17.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.191+0000 7fbeef7fe640 1 -- 172.21.15.37:0/1982455544 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbed8003520 con 0x7fbef01609b0 2023-12-11T17:10:17.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.191+0000 7fbeeffff640 1 -- 172.21.15.37:0/1982455544 >> v2:172.21.15.37:3300/0 conn(0x7fbef015cd60 msgr2=0x7fbef015d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:17.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.191+0000 7fbeeffff640 1 --2- 172.21.15.37:0/1982455544 >> v2:172.21.15.37:3300/0 conn(0x7fbef015cd60 0x7fbef015d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.191+0000 7fbeeffff640 1 -- 172.21.15.37:0/1982455544 >> v1:172.21.15.151:6789/0 conn(0x7fbef01609b0 legacy=0x7fbef00d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.191+0000 7fbeeffff640 1 -- 172.21.15.37:0/1982455544 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbef015e040 con 0x7fbef00cfb20 2023-12-11T17:10:17.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.193+0000 7f68faffd640 1 -- 172.21.15.37:0/3464128203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68fc0d0230 msgr2=0x7f68fc15cd60 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-11T17:10:17.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.193+0000 7f68faffd640 1 --2- 172.21.15.37:0/3464128203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68fc0d0230 0x7f68fc15cd60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.193+0000 7f68faffd640 1 -- 172.21.15.37:0/3464128203 >> v1:172.21.15.37:6789/0 conn(0x7f68fc0d1220 legacy=0x7f68fc0cfb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.193+0000 7f68faffd640 1 -- 172.21.15.37:0/3464128203 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68fc15e320 con 0x7f68fc1609b0 2023-12-11T17:10:17.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.193+0000 7ff621ffb640 1 -- 172.21.15.37:0/3376864999 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c08f070 con 0x7ff6240eacd0 2023-12-11T17:10:17.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.193+0000 7f8da93a9640 1 -- 172.21.15.37:0/2861494041 shutdown_connections 2023-12-11T17:10:17.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.193+0000 7f8da93a9640 1 -- 172.21.15.37:0/2861494041 >> 172.21.15.37:0/2861494041 conn(0x7f8d9c009f80 msgr2=0x7f8d9c00a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.193+0000 7ff633a32640 1 -- 172.21.15.37:0/3376864999 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff62404ad00 con 0x7ff6240eacd0 2023-12-11T17:10:17.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.193+0000 7ff633a32640 1 -- 172.21.15.37:0/3376864999 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff62404b2c0 con 0x7ff6240eacd0 2023-12-11T17:10:17.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.193+0000 7fbeeffff640 1 --2- 172.21.15.37:0/1982455544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbef00cfb20 0x7fbef00cff60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbef008d680 tx=0x7fbee402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b8cf1bac670a101f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.194+0000 7ff621ffb640 1 -- 172.21.15.37:0/3376864999 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff62c074030 con 0x7ff6240eacd0 2023-12-11T17:10:17.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.194+0000 7ff621ffb640 1 -- 172.21.15.37:0/3376864999 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff62c073100 con 0x7ff6240eacd0 2023-12-11T17:10:17.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.194+0000 7f8da93a9640 1 -- 172.21.15.37:0/2861494041 shutdown_connections 2023-12-11T17:10:17.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.194+0000 7f8da93a9640 1 -- 172.21.15.37:0/2861494041 wait complete. 2023-12-11T17:10:17.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.193+0000 7f5da2ffd640 1 -- 172.21.15.37:0/644216728 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1163276751 0 0) 0x7f5da406ca40 con 0x7f5da406de20 2023-12-11T17:10:17.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.193+0000 7f5da37fe640 1 -- 172.21.15.37:0/644216728 >> v1:172.21.15.151:6789/0 conn(0x7f5da415e2b0 legacy=0x7f5da40cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.193+0000 7f5da37fe640 1 -- 172.21.15.37:0/644216728 >> v1:172.21.15.37:6789/0 conn(0x7f5da406de20 legacy=0x7f5da415dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.193+0000 7f5da37fe640 1 -- 172.21.15.37:0/644216728 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5da40711f0 con 0x7f5da4157a60 2023-12-11T17:10:17.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.194+0000 7fbeef7fe640 1 -- 172.21.15.37:0/1982455544 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee4031830 con 0x7fbef00cfb20 2023-12-11T17:10:17.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.194+0000 7fbeef7fe640 1 -- 172.21.15.37:0/1982455544 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee4031990 con 0x7fbef00cfb20 2023-12-11T17:10:17.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.194+0000 7fbeef7fe640 1 -- 172.21.15.37:0/1982455544 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee4031d20 con 0x7fbef00cfb20 2023-12-11T17:10:17.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.195+0000 7ff633a32640 1 -- 172.21.15.37:0/3376864999 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7ff60c000fc0 con 0x7ff6240eacd0 2023-12-11T17:10:17.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.195+0000 7f68faffd640 1 --2- 172.21.15.37:0/3464128203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68fc1609b0 0x7f68fc0d0ce0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0097a0 tx=0x7f68ec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14ae9d77d50e438e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.195+0000 7f5da37fe640 1 --2- 172.21.15.37:0/644216728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5da4157a60 0x7f5da406c410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009870 tx=0x7f5d9402b9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=513a67915de2be7a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.195+0000 7f68f9ffb640 1 -- 172.21.15.37:0/3464128203 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec031830 con 0x7f68fc1609b0 2023-12-11T17:10:17.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.196+0000 7f5da2ffd640 1 -- 172.21.15.37:0/644216728 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d94030880 con 0x7f5da4157a60 2023-12-11T17:10:17.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.196+0000 7f5da2ffd640 1 -- 172.21.15.37:0/644216728 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d940309e0 con 0x7f5da4157a60 2023-12-11T17:10:17.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.196+0000 7fbef6b25640 1 -- 172.21.15.37:0/1982455544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbef00cfb20 msgr2=0x7fbef00cff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.196+0000 7fbef6b25640 1 --2- 172.21.15.37:0/1982455544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbef00cfb20 0x7fbef00cff60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbef008d680 tx=0x7fbee402b8d0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.196+0000 7f5da2ffd640 1 -- 172.21.15.37:0/644216728 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d94030db0 con 0x7f5da4157a60 2023-12-11T17:10:17.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.195+0000 7f18a8333640 1 Processor -- start 2023-12-11T17:10:17.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.196+0000 7f18a8333640 1 -- start start 2023-12-11T17:10:17.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.196+0000 7fbef6b25640 1 -- 172.21.15.37:0/1982455544 shutdown_connections 2023-12-11T17:10:17.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.196+0000 7fbef6b25640 1 --2- 172.21.15.37:0/1982455544 >> v2:172.21.15.37:3300/0 conn(0x7fbef015cd60 0x7fbef015d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.196+0000 7fbef6b25640 1 --2- 172.21.15.37:0/1982455544 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbef00cfb20 0x7fbef00cff60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.196+0000 7fbef6b25640 1 -- 172.21.15.37:0/1982455544 >> 172.21.15.37:0/1982455544 conn(0x7fbef009c450 msgr2=0x7fbef00d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.196+0000 7f68f9ffb640 1 -- 172.21.15.37:0/3464128203 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ec031990 con 0x7f68fc1609b0 2023-12-11T17:10:17.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.196+0000 7f68f9ffb640 1 -- 172.21.15.37:0/3464128203 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec031d20 con 0x7f68fc1609b0 2023-12-11T17:10:17.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.197+0000 7fbef6b25640 1 -- 172.21.15.37:0/1982455544 shutdown_connections 2023-12-11T17:10:17.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.197+0000 7f69013ce640 1 -- 172.21.15.37:0/3464128203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68fc1609b0 msgr2=0x7f68fc0d0ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.197+0000 7f69013ce640 1 --2- 172.21.15.37:0/3464128203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68fc1609b0 0x7f68fc0d0ce0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0097a0 tx=0x7f68ec02b8d0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.197+0000 7f5daa1a9640 1 -- 172.21.15.37:0/644216728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5da4157a60 msgr2=0x7f5da406c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.197+0000 7f5daa1a9640 1 --2- 172.21.15.37:0/644216728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5da4157a60 0x7f5da406c410 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009870 tx=0x7f5d9402b9c0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.198+0000 7f8da93a9640 1 Processor -- start 2023-12-11T17:10:17.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.198+0000 7f69013ce640 1 -- 172.21.15.37:0/3464128203 shutdown_connections 2023-12-11T17:10:17.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.198+0000 7f69013ce640 1 --2- 172.21.15.37:0/3464128203 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68fc0d0230 0x7f68fc15cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.198+0000 7f69013ce640 1 --2- 172.21.15.37:0/3464128203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68fc1609b0 0x7f68fc0d0ce0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.198+0000 7f69013ce640 1 -- 172.21.15.37:0/3464128203 >> 172.21.15.37:0/3464128203 conn(0x7f68fc09c450 msgr2=0x7f68fc0d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.197+0000 7fbef6b25640 1 -- 172.21.15.37:0/1982455544 wait complete. 2023-12-11T17:10:17.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.197+0000 7f18a8333640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18a006cc90 0x7f18a0155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.197+0000 7f18a8333640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a00b1580 0x7f18a014b9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.197+0000 7f18a8333640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18a015a580 0x7f18a0166300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.197+0000 7f18a8333640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a0155e70 con 0x7f18a00b1580 2023-12-11T17:10:17.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.197+0000 7f18a8333640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a0156150 con 0x7f18a006cc90 2023-12-11T17:10:17.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.197+0000 7f18a8333640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a0156430 con 0x7f18a015a580 2023-12-11T17:10:17.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.198+0000 7ff621ffb640 1 -- 172.21.15.37:0/3376864999 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff62c073260 con 0x7ff6240eacd0 2023-12-11T17:10:17.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.198+0000 7f5daa1a9640 1 -- 172.21.15.37:0/644216728 shutdown_connections 2023-12-11T17:10:17.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.198+0000 7f5daa1a9640 1 --2- 172.21.15.37:0/644216728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5da4157a60 0x7f5da406c410 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.198+0000 7f5daa1a9640 1 -- 172.21.15.37:0/644216728 >> 172.21.15.37:0/644216728 conn(0x7f5da40b0a90 msgr2=0x7f5da40b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.199+0000 7f69013ce640 1 -- 172.21.15.37:0/3464128203 shutdown_connections 2023-12-11T17:10:17.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.199+0000 7fa2e430f640 1 Processor -- start 2023-12-11T17:10:17.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.199+0000 7f8da93a9640 1 -- start start 2023-12-11T17:10:17.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.199+0000 7ff621ffb640 1 --2- 172.21.15.37:0/3376864999 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff61006ae70 0x7ff61006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.199+0000 7ff621ffb640 1 -- 172.21.15.37:0/3376864999 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff62c103440 con 0x7ff6240eacd0 2023-12-11T17:10:17.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.200+0000 7ff621ffb640 1 --2- 172.21.15.37:0/3376864999 >> [v2:172.21.15.37:6813/1457860485,v1:172.21.15.37:6815/1457860485] conn(0x7ff6100744b0 0x7ff6100768f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.200+0000 7ff621ffb640 1 -- 172.21.15.37:0/3376864999 --> [v2:172.21.15.37:6813/1457860485,v1:172.21.15.37:6815/1457860485] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7ff610076fc0 con 0x7ff6100744b0 2023-12-11T17:10:17.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.200+0000 7ff621ffb640 1 -- 172.21.15.37:0/3376864999 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff62c1037f0 con 0x7ff6240eacd0 2023-12-11T17:10:17.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.200+0000 7ff6317ce640 1 --2- 172.21.15.37:0/3376864999 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff61006ae70 0x7ff61006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.200+0000 7fbef6b25640 1 Processor -- start 2023-12-11T17:10:17.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.200+0000 7f8da93a9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d9c047d50 0x7f8d9c0e1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.200+0000 7f8da93a9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d9c04d5a0 0x7f8d9c04da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.200+0000 7f8da93a9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d9c052c70 0x7f8d9c0530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.200+0000 7f8da93a9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c052850 con 0x7f8d9c052c70 2023-12-11T17:10:17.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.200+0000 7f8da93a9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c0e3e30 con 0x7f8d9c047d50 2023-12-11T17:10:17.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.200+0000 7f8da93a9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d9c0e1b50 con 0x7f8d9c04d5a0 2023-12-11T17:10:17.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.201+0000 7ff630fcd640 1 --2- 172.21.15.37:0/3376864999 >> [v2:172.21.15.37:6813/1457860485,v1:172.21.15.37:6815/1457860485] conn(0x7ff6100744b0 0x7ff6100768f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.201+0000 7fbef6b25640 1 -- start start 2023-12-11T17:10:17.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.199+0000 7f5daa1a9640 1 -- 172.21.15.37:0/644216728 shutdown_connections 2023-12-11T17:10:17.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.199+0000 7f5daa1a9640 1 -- 172.21.15.37:0/644216728 wait complete. 2023-12-11T17:10:17.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.198+0000 7f18a58ce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a00b1580 0x7f18a014b9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.199+0000 7f18a60cf640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18a006cc90 0x7f18a0155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.199+0000 7f18a60cf640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18a006cc90 0x7f18a0155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:52032/0 (socket says 172.21.15.37:52032) 2023-12-11T17:10:17.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.199+0000 7f18a60cf640 1 -- 172.21.15.37:0/2391603843 learned_addr learned my addr 172.21.15.37:0/2391603843 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:17.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.199+0000 7f18a68d0640 1 --2- 172.21.15.37:0/2391603843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18a015a580 0x7f18a0166300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.201+0000 7f18a68d0640 1 -- 172.21.15.37:0/2391603843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18a006cc90 msgr2=0x7f18a0155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.201+0000 7f18a68d0640 1 --2- 172.21.15.37:0/2391603843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18a006cc90 0x7f18a0155890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.201+0000 7f18a68d0640 1 -- 172.21.15.37:0/2391603843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a00b1580 msgr2=0x7f18a014b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.201+0000 7f18a68d0640 1 --2- 172.21.15.37:0/2391603843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a00b1580 0x7f18a014b9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.201+0000 7f18a68d0640 1 -- 172.21.15.37:0/2391603843 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1890009400 con 0x7f18a015a580 2023-12-11T17:10:17.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.201+0000 7f8da37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d9c052c70 0x7f8d9c0530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.201+0000 7f8da37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d9c052c70 0x7f8d9c0530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46684/0 (socket says 172.21.15.37:46684) 2023-12-11T17:10:17.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.201+0000 7f8da37fe640 1 -- 172.21.15.37:0/3167308147 learned_addr learned my addr 172.21.15.37:0/3167308147 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:17.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.202+0000 7f8da2ffd640 1 --2- 172.21.15.37:0/3167308147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d9c047d50 0x7f8d9c0e1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.202+0000 7f8da37fe640 1 -- 172.21.15.37:0/3167308147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d9c04d5a0 msgr2=0x7f8d9c04da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.202+0000 7f8da37fe640 1 --2- 172.21.15.37:0/3167308147 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8d9c04d5a0 0x7f8d9c04da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.202+0000 7f8da37fe640 1 -- 172.21.15.37:0/3167308147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d9c047d50 msgr2=0x7f8d9c0e1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.201+0000 7ff6317ce640 1 --2- 172.21.15.37:0/3376864999 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff61006ae70 0x7ff61006d330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff628001d50 tx=0x7ff628001ce0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.202+0000 7ff630fcd640 1 --2- 172.21.15.37:0/3376864999 >> [v2:172.21.15.37:6813/1457860485,v1:172.21.15.37:6815/1457860485] conn(0x7ff6100744b0 0x7ff6100768f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.199+0000 7f69013ce640 1 -- 172.21.15.37:0/3464128203 wait complete. 2023-12-11T17:10:17.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.201+0000 7f69013ce640 1 Processor -- start 2023-12-11T17:10:17.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.202+0000 7f69013ce640 1 -- start start 2023-12-11T17:10:17.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.202+0000 7f18a58ce640 1 --2- 172.21.15.37:0/2391603843 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f18a00b1580 0x7f18a014b9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:17.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.202+0000 7f18a60cf640 1 --2- 172.21.15.37:0/2391603843 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18a006cc90 0x7f18a0155890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:10:17.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.202+0000 7f18a68d0640 1 --2- 172.21.15.37:0/2391603843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18a015a580 0x7f18a0166300 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f189800c310 tx=0x7f189800c7d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.200+0000 7fa2e430f640 1 -- start start 2023-12-11T17:10:17.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.201+0000 7fcb6b090640 1 Processor -- start 2023-12-11T17:10:17.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.202+0000 7fcb6b090640 1 -- start start 2023-12-11T17:10:17.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.202+0000 7f8da37fe640 1 --2- 172.21.15.37:0/3167308147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d9c047d50 0x7f8d9c0e1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.202+0000 7f8da37fe640 1 -- 172.21.15.37:0/3167308147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d9c04ee10 con 0x7f8d9c052c70 2023-12-11T17:10:17.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.202+0000 7f8da2ffd640 1 --2- 172.21.15.37:0/3167308147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8d9c047d50 0x7f8d9c0e1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:17.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.202+0000 7fbef6b25640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbef00cfb20 0x7fbef00b5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.202+0000 7fbef6b25640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbef015cd60 0x7fbef00cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.202+0000 7fa2e430f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa2dc15f260 0x7fa2dc0ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.203+0000 7fbef6b25640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbef01609b0 0x7fbef014c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.203+0000 7fa2e430f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa2dc0708d0 0x7fa2dc16b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.202+0000 7f5daa1a9640 1 Processor -- start 2023-12-11T17:10:17.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.203+0000 7fbef6b25640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef00b7150 con 0x7fbef015cd60 2023-12-11T17:10:17.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.203+0000 7fbef6b25640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbef00b6270 con 0x7fbef00cfb20 2023-12-11T17:10:17.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.203+0000 7fbef6b25640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbef00b6540 con 0x7fbef01609b0 2023-12-11T17:10:17.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.203+0000 7fbef48c1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbef00cfb20 0x7fbef00b5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.203+0000 7f5daa1a9640 1 -- start start 2023-12-11T17:10:17.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.203+0000 7fa2e430f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2dc0cde40 con 0x7fa2dc1626b0 2023-12-11T17:10:17.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.203+0000 7fa2e430f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2dc0cd040 con 0x7fa2dc0708d0 2023-12-11T17:10:17.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.203+0000 7fbef50c2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbef01609b0 0x7fbef014c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.203+0000 7fbef50c2640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbef01609b0 0x7fbef014c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.37:42580/0 (socket says 172.21.15.37:42580) 2023-12-11T17:10:17.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.203+0000 7fbef50c2640 1 -- 172.21.15.37:0/1706463320 learned_addr learned my addr 172.21.15.37:0/1706463320 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:17.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.203+0000 7fa2e20ab640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa2dc15f260 0x7fa2dc0ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.204+0000 7fa2e20ab640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa2dc15f260 0x7fa2dc0ccb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:52044/0 (socket says 172.21.15.37:52044) 2023-12-11T17:10:17.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.204+0000 7fa2e20ab640 1 -- 172.21.15.37:0/1378538812 learned_addr learned my addr 172.21.15.37:0/1378538812 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:17.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.204+0000 7fa2e430f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2dc15f640 con 0x7fa2dc15f260 2023-12-11T17:10:17.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.204+0000 7fa2e28ac640 1 --2- 172.21.15.37:0/1378538812 >> v2:172.21.15.37:3300/0 conn(0x7fa2dc0708d0 0x7fa2dc16b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.203+0000 7f8da37fe640 1 --2- 172.21.15.37:0/3167308147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d9c052c70 0x7f8d9c0530f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8da4068ea0 tx=0x7f8da4066000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.204+0000 7f8d8b7fe640 1 -- 172.21.15.37:0/3167308147 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da4074230 con 0x7f8d9c052c70 2023-12-11T17:10:17.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.205+0000 7f8d8b7fe640 1 -- 172.21.15.37:0/3167308147 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8da404f730 con 0x7f8d9c052c70 2023-12-11T17:10:17.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.205+0000 7f8d8b7fe640 1 -- 172.21.15.37:0/3167308147 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8da40be820 con 0x7f8d9c052c70 2023-12-11T17:10:17.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.205+0000 7ff621ffb640 1 -- 172.21.15.37:0/3376864999 <== osd.1 v2:172.21.15.37:6813/1457860485 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7ff610076fc0 con 0x7ff6100744b0 2023-12-11T17:10:17.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.205+0000 7fcb6b090640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcb64143e00 0x7fcb640b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.204+0000 7f1896ffd640 1 -- 172.21.15.37:0/2391603843 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18980052d0 con 0x7f18a015a580 2023-12-11T17:10:17.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.204+0000 7f1896ffd640 1 -- 172.21.15.37:0/2391603843 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1898005430 con 0x7f18a015a580 2023-12-11T17:10:17.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.204+0000 7f1896ffd640 1 -- 172.21.15.37:0/2391603843 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898003830 con 0x7f18a015a580 2023-12-11T17:10:17.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.205+0000 7fcb6b090640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcb6406c410 0x7fcb6415ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.205+0000 7fa2e20ab640 1 -- 172.21.15.37:0/1378538812 >> v2:172.21.15.37:3300/0 conn(0x7fa2dc0708d0 msgr2=0x7fa2dc16b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:17.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.205+0000 7fcb6b090640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb640b3bb0 con 0x7fcb64072180 2023-12-11T17:10:17.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.205+0000 7fcb6b090640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb641441e0 con 0x7fcb64143e00 2023-12-11T17:10:17.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.205+0000 7fcb6b090640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb64072680 con 0x7fcb6406c410 2023-12-11T17:10:17.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.204+0000 7fbeeffff640 1 --2- 172.21.15.37:0/1706463320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbef015cd60 0x7fbef00cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.204+0000 7fbef50c2640 1 -- 172.21.15.37:0/1706463320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbef00cfb20 msgr2=0x7fbef00b5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.204+0000 7fbef50c2640 1 --2- 172.21.15.37:0/1706463320 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbef00cfb20 0x7fbef00b5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.204+0000 7fbef50c2640 1 -- 172.21.15.37:0/1706463320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbef015cd60 msgr2=0x7fbef00cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.205+0000 7fbef50c2640 1 --2- 172.21.15.37:0/1706463320 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbef015cd60 0x7fbef00cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.205+0000 7fbef50c2640 1 -- 172.21.15.37:0/1706463320 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbee4009400 con 0x7fbef01609b0 2023-12-11T17:10:17.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.205+0000 7f5daa1a9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5da406de20 0x7f5da41674c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.205+0000 7f5daa1a9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5da4157a60 0x7f5da415cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.205+0000 7fa2e10a9640 1 -- 172.21.15.37:0/1378538812 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2384347816 0 0) 0x7fa2dc0cde40 con 0x7fa2dc1626b0 2023-12-11T17:10:17.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.205+0000 7fcb6962d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcb6406c410 0x7fcb6415ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.206+0000 7fcb6962d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcb6406c410 0x7fcb6415ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:52052/0 (socket says 172.21.15.37:52052) 2023-12-11T17:10:17.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.205+0000 7f18a8333640 1 -- 172.21.15.37:0/2391603843 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a0156710 con 0x7f18a015a580 2023-12-11T17:10:17.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.206+0000 7f18a8333640 1 -- 172.21.15.37:0/2391603843 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a0166840 con 0x7f18a015a580 2023-12-11T17:10:17.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.206+0000 7fcb6962d640 1 -- 172.21.15.37:0/3029546900 learned_addr learned my addr 172.21.15.37:0/3029546900 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:17.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.206+0000 7fcb68e2c640 1 --2- 172.21.15.37:0/3029546900 >> v2:172.21.15.37:3300/0 conn(0x7fcb64143e00 0x7fcb640b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.206+0000 7f5da37fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5da406de20 0x7f5da41674c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.206+0000 7fa2e20ab640 1 --2- 172.21.15.37:0/1378538812 >> v2:172.21.15.37:3300/0 conn(0x7fa2dc0708d0 0x7fa2dc16b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.206+0000 7fa2e20ab640 1 -- 172.21.15.37:0/1378538812 >> v1:172.21.15.37:6789/0 conn(0x7fa2dc1626b0 legacy=0x7fa2dc0701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.206+0000 7fa2e20ab640 1 -- 172.21.15.37:0/1378538812 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc162b40 con 0x7fa2dc15f260 2023-12-11T17:10:17.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.206+0000 7fa2e28ac640 1 --2- 172.21.15.37:0/1378538812 >> v2:172.21.15.37:3300/0 conn(0x7fa2dc0708d0 0x7fa2dc16b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:10:17.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.206+0000 7f69013ce640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68fc0d0230 0x7f68fc200880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.206+0000 7f69013ce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68fc0d1220 0x7f68fc1fd2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.206+0000 7f69013ce640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68fc1609b0 0x7f68fc0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.206+0000 7f69013ce640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc0b5d30 con 0x7f68fc0d1220 2023-12-11T17:10:17.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.206+0000 7f69013ce640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc1fd800 con 0x7f68fc0d0230 2023-12-11T17:10:17.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.206+0000 7f69013ce640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68fc0b5f80 con 0x7f68fc1609b0 2023-12-11T17:10:17.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.207+0000 7f5da37fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5da406de20 0x7f5da41674c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.37:42590/0 (socket says 172.21.15.37:42590) 2023-12-11T17:10:17.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.207+0000 7fcb6962d640 1 -- 172.21.15.37:0/3029546900 >> v2:172.21.15.37:3300/0 conn(0x7fcb64143e00 msgr2=0x7fcb640b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:17.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.207+0000 7f5da37fe640 1 -- 172.21.15.37:0/1745172863 learned_addr learned my addr 172.21.15.37:0/1745172863 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:17.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.207+0000 7f5daa1a9640 1 --2- 172.21.15.37:0/1745172863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5da415e2b0 0x7f5da414a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.207+0000 7f5d9bfff640 1 --2- 172.21.15.37:0/1745172863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5da4157a60 0x7f5da415cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.207+0000 7f8da93a9640 1 -- 172.21.15.37:0/3167308147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d9c0e3590 con 0x7f8d9c052c70 2023-12-11T17:10:17.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.207+0000 7f8da93a9640 1 -- 172.21.15.37:0/3167308147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d9c0e3b50 con 0x7f8d9c052c70 2023-12-11T17:10:17.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.207+0000 7f5daa1a9640 1 -- 172.21.15.37:0/1745172863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da415d530 con 0x7f5da4157a60 2023-12-11T17:10:17.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.207+0000 7fbef50c2640 1 --2- 172.21.15.37:0/1706463320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbef01609b0 0x7fbef014c080 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbee800efc0 tx=0x7fbee800c490 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.208+0000 7f5daa1a9640 1 -- 172.21.15.37:0/1745172863 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5da41592c0 con 0x7f5da415e2b0 2023-12-11T17:10:17.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.208+0000 7f5daa1a9640 1 -- 172.21.15.37:0/1745172863 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5da41595a0 con 0x7f5da406de20 2023-12-11T17:10:17.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.208+0000 7f68faffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68fc0d0230 0x7f68fc200880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.208+0000 7f5da3fff640 1 --2- 172.21.15.37:0/1745172863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5da415e2b0 0x7f5da414a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.207+0000 7fcb6962d640 1 --2- 172.21.15.37:0/3029546900 >> v2:172.21.15.37:3300/0 conn(0x7fcb64143e00 0x7fcb640b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.207+0000 7fcb6962d640 1 -- 172.21.15.37:0/3029546900 >> v1:172.21.15.37:6789/0 conn(0x7fcb64072180 legacy=0x7fcb640b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:17.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.207+0000 7fcb6962d640 1 -- 172.21.15.37:0/3029546900 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb640b1e30 con 0x7fcb6406c410 2023-12-11T17:10:17.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.207+0000 7fcb68e2c640 1 --2- 172.21.15.37:0/3029546900 >> v2:172.21.15.37:3300/0 conn(0x7fcb64143e00 0x7fcb640b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:10:17.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.209+0000 7f18a8333640 1 -- 172.21.15.37:0/2391603843 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f18a0156f90 con 0x7f18a015a580 2023-12-11T17:10:17.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.209+0000 7fa2e20ab640 1 --2- 172.21.15.37:0/1378538812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2dc15f260 0x7fa2dc0ccb00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc0b1710 tx=0x7fa2d802b9a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3522e02834cd948 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.209+0000 7f68faffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68fc0d0230 0x7f68fc200880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:52062/0 (socket says 172.21.15.37:52062) 2023-12-11T17:10:17.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.209+0000 7f68faffd640 1 -- 172.21.15.37:0/4145277341 learned_addr learned my addr 172.21.15.37:0/4145277341 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:17.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.209+0000 7fcb6962d640 1 --2- 172.21.15.37:0/3029546900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb6406c410 0x7fcb6415ecb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcb64072b60 tx=0x7fcb5c02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e37579a6dd391914 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.209+0000 7f5d9bfff640 1 -- 172.21.15.37:0/1745172863 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5da406de20 msgr2=0x7f5da41674c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.209+0000 7fbeed7fa640 1 -- 172.21.15.37:0/1706463320 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee8014480 con 0x7fbef01609b0 2023-12-11T17:10:17.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.209+0000 7fbef6b25640 1 -- 172.21.15.37:0/1706463320 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbef00b6820 con 0x7fbef01609b0 2023-12-11T17:10:17.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.209+0000 7f5d9bfff640 1 --2- 172.21.15.37:0/1745172863 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5da406de20 0x7f5da41674c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.209+0000 7f5d9bfff640 1 -- 172.21.15.37:0/1745172863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5da415e2b0 msgr2=0x7f5da414a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.209+0000 7f5d9bfff640 1 --2- 172.21.15.37:0/1745172863 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5da415e2b0 0x7f5da414a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.209+0000 7f5d9bfff640 1 -- 172.21.15.37:0/1745172863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d940094d0 con 0x7f5da4157a60 2023-12-11T17:10:17.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.209+0000 7fa2e10a9640 1 -- 172.21.15.37:0/1378538812 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8030860 con 0x7fa2dc15f260 2023-12-11T17:10:17.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.209+0000 7f8da93a9640 1 -- 172.21.15.37:0/3167308147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8d9c0525d0 con 0x7f8d9c052c70 2023-12-11T17:10:17.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.209+0000 7fbef6b25640 1 -- 172.21.15.37:0/1706463320 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbef00b6de0 con 0x7fbef01609b0 2023-12-11T17:10:17.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.209+0000 7fbeed7fa640 1 -- 172.21.15.37:0/1706463320 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbee800f040 con 0x7fbef01609b0 2023-12-11T17:10:17.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.209+0000 7fbeed7fa640 1 -- 172.21.15.37:0/1706463320 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbee8014480 con 0x7fbef01609b0 2023-12-11T17:10:17.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.209+0000 7fa2e10a9640 1 -- 172.21.15.37:0/1378538812 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d80309c0 con 0x7fa2dc15f260 2023-12-11T17:10:17.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.210+0000 7f5da37fe640 1 --2- 172.21.15.37:0/1745172863 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5da406de20 0x7f5da41674c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:10:17.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.210+0000 7f5d9bfff640 1 --2- 172.21.15.37:0/1745172863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5da4157a60 0x7f5da415cff0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c00c3e0 tx=0x7f5d8c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.210+0000 7fa2e10a9640 1 -- 172.21.15.37:0/1378538812 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8030860 con 0x7fa2dc15f260 2023-12-11T17:10:17.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.211+0000 7f5da0ff9640 1 -- 172.21.15.37:0/1745172863 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c0074e0 con 0x7f5da4157a60 2023-12-11T17:10:17.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.211+0000 7fa2e430f640 1 -- 172.21.15.37:0/1378538812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2dc15f260 msgr2=0x7fa2dc0ccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.211+0000 7fa2e430f640 1 --2- 172.21.15.37:0/1378538812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2dc15f260 0x7fa2dc0ccb00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa2dc0b1710 tx=0x7fa2d802b9a0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.210+0000 7fcb5b7fe640 1 -- 172.21.15.37:0/3029546900 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c02ca80 con 0x7fcb6406c410 2023-12-11T17:10:17.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.210+0000 7fcb5b7fe640 1 -- 172.21.15.37:0/3029546900 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c02cbe0 con 0x7fcb6406c410 2023-12-11T17:10:17.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.211+0000 7fa2e430f640 1 -- 172.21.15.37:0/1378538812 shutdown_connections 2023-12-11T17:10:17.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.211+0000 7fa2e430f640 1 --2- 172.21.15.37:0/1378538812 >> v2:172.21.15.37:3300/0 conn(0x7fa2dc0708d0 0x7fa2dc16b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.211+0000 7fbef6b25640 1 -- 172.21.15.37:0/1706463320 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbed0000fc0 con 0x7fbef01609b0 2023-12-11T17:10:17.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.211+0000 7fa2e430f640 1 --2- 172.21.15.37:0/1378538812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2dc15f260 0x7fa2dc0ccb00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.211+0000 7f5daa1a9640 1 -- 172.21.15.37:0/1745172863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5da4159880 con 0x7f5da4157a60 2023-12-11T17:10:17.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.211+0000 7f5daa1a9640 1 -- 172.21.15.37:0/1745172863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5da4155330 con 0x7f5da4157a60 2023-12-11T17:10:17.239 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.211+0000 7fa2e430f640 1 -- 172.21.15.37:0/1378538812 >> 172.21.15.37:0/1378538812 conn(0x7fa2dc0b0a90 msgr2=0x7fa2dc0b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.210+0000 7fcb5b7fe640 1 -- 172.21.15.37:0/3029546900 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c02ca80 con 0x7fcb6406c410 2023-12-11T17:10:17.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.211+0000 7f5da0ff9640 1 -- 172.21.15.37:0/1745172863 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d8c007640 con 0x7f5da4157a60 2023-12-11T17:10:17.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.211+0000 7f5da0ff9640 1 -- 172.21.15.37:0/1745172863 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d8c004a00 con 0x7f5da4157a60 2023-12-11T17:10:17.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.212+0000 7fcb6b090640 1 -- 172.21.15.37:0/3029546900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb6406c410 msgr2=0x7fcb6415ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.212+0000 7fcb6b090640 1 --2- 172.21.15.37:0/3029546900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb6406c410 0x7fcb6415ecb0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fcb64072b60 tx=0x7fcb5c02bee0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.212+0000 7f5daa1a9640 1 -- 172.21.15.37:0/1745172863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5d88000fc0 con 0x7f5da4157a60 2023-12-11T17:10:17.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.212+0000 7fcb6b090640 1 -- 172.21.15.37:0/3029546900 shutdown_connections 2023-12-11T17:10:17.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.212+0000 7fcb6b090640 1 --2- 172.21.15.37:0/3029546900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb6406c410 0x7fcb6415ecb0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.212+0000 7fcb6b090640 1 --2- 172.21.15.37:0/3029546900 >> v2:172.21.15.37:3300/0 conn(0x7fcb64143e00 0x7fcb640b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.212+0000 7fcb6b090640 1 -- 172.21.15.37:0/3029546900 >> 172.21.15.37:0/3029546900 conn(0x7fcb640b0a90 msgr2=0x7fcb640b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.212+0000 7fcb6b090640 1 -- 172.21.15.37:0/3029546900 shutdown_connections 2023-12-11T17:10:17.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.213+0000 7fcb6b090640 1 -- 172.21.15.37:0/3029546900 wait complete. 2023-12-11T17:10:17.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.213+0000 7fa2e430f640 1 -- 172.21.15.37:0/1378538812 shutdown_connections 2023-12-11T17:10:17.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.214+0000 7fa2e430f640 1 -- 172.21.15.37:0/1378538812 wait complete. 2023-12-11T17:10:17.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.213+0000 7f1896ffd640 1 -- 172.21.15.37:0/2391603843 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1898003990 con 0x7f18a015a580 2023-12-11T17:10:17.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.215+0000 7f1896ffd640 1 --2- 172.21.15.37:0/2391603843 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f188406ae70 0x7f188406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.215+0000 7f1896ffd640 1 -- 172.21.15.37:0/2391603843 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1898089360 con 0x7f18a015a580 2023-12-11T17:10:17.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.209+0000 7f68fb7fe640 1 --2- 172.21.15.37:0/4145277341 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68fc1609b0 0x7f68fc0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.210+0000 7f68fa7fc640 1 --2- 172.21.15.37:0/4145277341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68fc0d1220 0x7f68fc1fd2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.210+0000 7f68faffd640 1 -- 172.21.15.37:0/4145277341 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68fc1609b0 msgr2=0x7f68fc0b77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.210+0000 7f68faffd640 1 --2- 172.21.15.37:0/4145277341 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f68fc1609b0 0x7f68fc0b77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.210+0000 7f68faffd640 1 -- 172.21.15.37:0/4145277341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68fc0d1220 msgr2=0x7f68fc1fd2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.210+0000 7f68faffd640 1 --2- 172.21.15.37:0/4145277341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f68fc0d1220 0x7f68fc1fd2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.210+0000 7f68faffd640 1 -- 172.21.15.37:0/4145277341 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68ec009400 con 0x7f68fc0d0230 2023-12-11T17:10:17.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.213+0000 7f68faffd640 1 --2- 172.21.15.37:0/4145277341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68fc0d0230 0x7f68fc200880 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0097a0 tx=0x7f68ec0046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.214+0000 7f68e37fe640 1 -- 172.21.15.37:0/4145277341 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec03aa60 con 0x7f68fc0d0230 2023-12-11T17:10:17.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.214+0000 7f69013ce640 1 -- 172.21.15.37:0/4145277341 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68fc0b6260 con 0x7f68fc0d0230 2023-12-11T17:10:17.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.214+0000 7f69013ce640 1 -- 172.21.15.37:0/4145277341 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68fc0b6820 con 0x7f68fc0d0230 2023-12-11T17:10:17.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.215+0000 7fbeed7fa640 1 -- 172.21.15.37:0/1706463320 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbee80145e0 con 0x7fbef01609b0 2023-12-11T17:10:17.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.216+0000 7fcb6b090640 1 Processor -- start 2023-12-11T17:10:17.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.216+0000 7fcb6b090640 1 -- start start 2023-12-11T17:10:17.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.216+0000 7f1896ffd640 1 --2- 172.21.15.37:0/2391603843 >> [v2:172.21.15.151:6816/1944498382,v1:172.21.15.151:6817/1944498382] conn(0x7f18840744b0 0x7f18840768f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.216+0000 7f1896ffd640 1 -- 172.21.15.37:0/2391603843 --> [v2:172.21.15.151:6816/1944498382,v1:172.21.15.151:6817/1944498382] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1884076fc0 con 0x7f18840744b0 2023-12-11T17:10:17.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.216+0000 7f1896ffd640 1 -- 172.21.15.37:0/2391603843 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1898089710 con 0x7f18a015a580 2023-12-11T17:10:17.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.216+0000 7f68e37fe640 1 -- 172.21.15.37:0/4145277341 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68ec03abc0 con 0x7f68fc0d0230 2023-12-11T17:10:17.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.216+0000 7f68e37fe640 1 -- 172.21.15.37:0/4145277341 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68ec0443f0 con 0x7f68fc0d0230 2023-12-11T17:10:17.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.217+0000 7f18a58ce640 1 --2- 172.21.15.37:0/2391603843 >> [v2:172.21.15.151:6816/1944498382,v1:172.21.15.151:6817/1944498382] conn(0x7f18840744b0 0x7f18840768f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.217+0000 7f18a60cf640 1 --2- 172.21.15.37:0/2391603843 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f188406ae70 0x7f188406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.217+0000 7fbeed7fa640 1 --2- 172.21.15.37:0/1706463320 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbedc06aea0 0x7fbedc06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.217+0000 7fcb6b090640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb6406c410 0x7fcb6413dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.217+0000 7fcb6b090640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb64072180 0x7fcb6414c7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.217+0000 7fbeed7fa640 1 -- 172.21.15.37:0/1706463320 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fbee808ac10 con 0x7fbef01609b0 2023-12-11T17:10:17.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.217+0000 7fcb6b090640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb64143e00 0x7fcb6413fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.217+0000 7fcb6b090640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb64136e70 con 0x7fcb64143e00 2023-12-11T17:10:17.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.217+0000 7fcb6b090640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6414f650 con 0x7fcb6406c410 2023-12-11T17:10:17.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.217+0000 7fcb6b090640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb64142070 con 0x7fcb64072180 2023-12-11T17:10:17.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.218+0000 7fbeed7fa640 1 --2- 172.21.15.37:0/1706463320 >> [v2:172.21.15.151:6800/491338889,v1:172.21.15.151:6801/491338889] conn(0x7fbedc0744e0 0x7fbedc076920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.218+0000 7fbeed7fa640 1 -- 172.21.15.37:0/1706463320 --> [v2:172.21.15.151:6800/491338889,v1:172.21.15.151:6801/491338889] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbedc076ff0 con 0x7fbedc0744e0 2023-12-11T17:10:17.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.218+0000 7fbeed7fa640 1 -- 172.21.15.37:0/1706463320 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbee808afc0 con 0x7fbef01609b0 2023-12-11T17:10:17.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.218+0000 7fcb6962d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb64143e00 0x7fcb6413fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.217+0000 7fa2e430f640 1 Processor -- start 2023-12-11T17:10:17.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.216+0000 7f5da0ff9640 1 -- 172.21.15.37:0/1745172863 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5d8c004c20 con 0x7f5da4157a60 2023-12-11T17:10:17.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.218+0000 7f5da0ff9640 1 --2- 172.21.15.37:0/1745172863 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5d8406ae40 0x7f5d8406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.218+0000 7fcb6962d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb64143e00 0x7fcb6413fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46734/0 (socket says 172.21.15.37:46734) 2023-12-11T17:10:17.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.218+0000 7fcb6962d640 1 -- 172.21.15.37:0/3032676941 learned_addr learned my addr 172.21.15.37:0/3032676941 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:17.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.218+0000 7f5da0ff9640 1 -- 172.21.15.37:0/1745172863 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f5d8c089eb0 con 0x7f5da4157a60 2023-12-11T17:10:17.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.218+0000 7f5da0ff9640 1 --2- 172.21.15.37:0/1745172863 >> [v2:172.21.15.37:6821/2938574997,v1:172.21.15.37:6823/2938574997] conn(0x7f5d84074480 0x7f5d840768c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.218+0000 7f5da0ff9640 1 -- 172.21.15.37:0/1745172863 --> [v2:172.21.15.37:6821/2938574997,v1:172.21.15.37:6823/2938574997] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5d84076f90 con 0x7f5d84074480 2023-12-11T17:10:17.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.218+0000 7f5da0ff9640 1 -- 172.21.15.37:0/1745172863 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5d8c08a260 con 0x7f5da4157a60 2023-12-11T17:10:17.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.218+0000 7f68e17fa640 1 -- 172.21.15.37:0/4145277341 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f68dc000fc0 con 0x7f68fc0d0230 2023-12-11T17:10:17.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.218+0000 7f18a58ce640 1 --2- 172.21.15.37:0/2391603843 >> [v2:172.21.15.151:6816/1944498382,v1:172.21.15.151:6817/1944498382] conn(0x7f18840744b0 0x7f18840768f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.218+0000 7fa2e430f640 1 -- start start 2023-12-11T17:10:17.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.219+0000 7fcb6962d640 1 -- 172.21.15.37:0/3032676941 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb64072180 msgr2=0x7fcb6414c7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.219+0000 7f5da3fff640 1 --2- 172.21.15.37:0/1745172863 >> [v2:172.21.15.37:6821/2938574997,v1:172.21.15.37:6823/2938574997] conn(0x7f5d84074480 0x7f5d840768c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.219+0000 7fcb5bfff640 1 --2- 172.21.15.37:0/3032676941 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb64072180 0x7fcb6414c7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.219+0000 7fbeeffff640 1 --2- 172.21.15.37:0/1706463320 >> [v2:172.21.15.151:6800/491338889,v1:172.21.15.151:6801/491338889] conn(0x7fbedc0744e0 0x7fbedc076920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.219+0000 7fcb6962d640 1 --2- 172.21.15.37:0/3032676941 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb64072180 0x7fcb6414c7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.219+0000 7fcb6962d640 1 -- 172.21.15.37:0/3032676941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb6406c410 msgr2=0x7fcb6413dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.219+0000 7fcb6962d640 1 --2- 172.21.15.37:0/3032676941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb6406c410 0x7fcb6413dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.219+0000 7fcb6962d640 1 -- 172.21.15.37:0/3032676941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb5c009b30 con 0x7fcb64143e00 2023-12-11T17:10:17.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.219+0000 7f18a60cf640 1 --2- 172.21.15.37:0/2391603843 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f188406ae70 0x7f188406d330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f189c005c00 tx=0x7f189c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.219+0000 7fcb6962d640 1 --2- 172.21.15.37:0/3032676941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb64143e00 0x7fcb6413fe60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009f40 tx=0x7fcb5c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.220+0000 7f5da3fff640 1 --2- 172.21.15.37:0/1745172863 >> [v2:172.21.15.37:6821/2938574997,v1:172.21.15.37:6823/2938574997] conn(0x7f5d84074480 0x7f5d840768c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.220+0000 7fcb597fa640 1 -- 172.21.15.37:0/3032676941 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c009510 con 0x7fcb64143e00 2023-12-11T17:10:17.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.220+0000 7fcb597fa640 1 -- 172.21.15.37:0/3032676941 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb5c004250 con 0x7fcb64143e00 2023-12-11T17:10:17.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.220+0000 7fcb6b090640 1 -- 172.21.15.37:0/3032676941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb64142350 con 0x7fcb64143e00 2023-12-11T17:10:17.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.220+0000 7fcb597fa640 1 -- 172.21.15.37:0/3032676941 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c0045c0 con 0x7fcb64143e00 2023-12-11T17:10:17.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.220+0000 7fcb6b090640 1 -- 172.21.15.37:0/3032676941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb6413e150 con 0x7fcb64143e00 2023-12-11T17:10:17.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.219+0000 7f8d8b7fe640 1 -- 172.21.15.37:0/3167308147 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8da40be980 con 0x7f8d9c052c70 2023-12-11T17:10:17.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.221+0000 7fbef48c1640 1 --2- 172.21.15.37:0/1706463320 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbedc06aea0 0x7fbedc06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.221+0000 7f5da37fe640 1 --2- 172.21.15.37:0/1745172863 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5d8406ae40 0x7f5d8406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.221+0000 7fbeeffff640 1 --2- 172.21.15.37:0/1706463320 >> [v2:172.21.15.151:6800/491338889,v1:172.21.15.151:6801/491338889] conn(0x7fbedc0744e0 0x7fbedc076920 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.221+0000 7fcb6b090640 1 -- 172.21.15.37:0/3032676941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcb640b23f0 con 0x7fcb64143e00 2023-12-11T17:10:17.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.221+0000 7f5da0ff9640 1 -- 172.21.15.37:0/1745172863 <== osd.3 v2:172.21.15.37:6821/2938574997 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f5d84076f90 con 0x7f5d84074480 2023-12-11T17:10:17.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.222+0000 7f8d8b7fe640 1 --2- 172.21.15.37:0/3167308147 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8d9006ae90 0x7f8d9006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.222+0000 7f8d8b7fe640 1 -- 172.21.15.37:0/3167308147 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8da4136bb0 con 0x7f8d9c052c70 2023-12-11T17:10:17.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.222+0000 7f68e37fe640 1 -- 172.21.15.37:0/4145277341 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f68ec04d450 con 0x7f68fc0d0230 2023-12-11T17:10:17.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.222+0000 7fa2e430f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2dc0708d0 0x7fa2dc158280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.222+0000 7fa2e430f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2dc15f260 0x7fa2dc1588a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.222+0000 7fa2e430f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2dc1626b0 0x7fa2dc158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.222+0000 7fa2e430f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc159c60 con 0x7fa2dc0708d0 2023-12-11T17:10:17.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.222+0000 7fa2e430f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc0b2540 con 0x7fa2dc15f260 2023-12-11T17:10:17.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.222+0000 7fa2e430f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc0b2820 con 0x7fa2dc1626b0 2023-12-11T17:10:17.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.223+0000 7f1896ffd640 1 -- 172.21.15.37:0/2391603843 <== osd.4 v2:172.21.15.151:6816/1944498382 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f1884076fc0 con 0x7f18840744b0 2023-12-11T17:10:17.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.223+0000 7fa2e20ab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2dc0708d0 0x7fa2dc158280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.223+0000 7fa2e20ab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2dc0708d0 0x7fa2dc158280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46740/0 (socket says 172.21.15.37:46740) 2023-12-11T17:10:17.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.223+0000 7fa2e20ab640 1 -- 172.21.15.37:0/163106521 learned_addr learned my addr 172.21.15.37:0/163106521 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:17.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.223+0000 7f8da2ffd640 1 --2- 172.21.15.37:0/3167308147 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8d9006ae90 0x7f8d9006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.223+0000 7fa2e18aa640 1 --2- 172.21.15.37:0/163106521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2dc15f260 0x7fa2dc1588a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.223+0000 7fa2e28ac640 1 --2- 172.21.15.37:0/163106521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2dc1626b0 0x7fa2dc158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.223+0000 7fa2e20ab640 1 -- 172.21.15.37:0/163106521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2dc1626b0 msgr2=0x7fa2dc158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.223+0000 7fa2e20ab640 1 --2- 172.21.15.37:0/163106521 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa2dc1626b0 0x7fa2dc158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.223+0000 7fa2e20ab640 1 -- 172.21.15.37:0/163106521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2dc15f260 msgr2=0x7fa2dc1588a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.224+0000 7fbef48c1640 1 --2- 172.21.15.37:0/1706463320 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbedc06aea0 0x7fbedc06d360 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbee00011e0 tx=0x7fbee0007d30 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.223+0000 7fa2e20ab640 1 --2- 172.21.15.37:0/163106521 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2dc15f260 0x7fa2dc1588a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.224+0000 7f68e37fe640 1 --2- 172.21.15.37:0/4145277341 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f68e806ae40 0x7f68e806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.224+0000 7f8d8b7fe640 1 --2- 172.21.15.37:0/3167308147 >> [v2:172.21.15.37:6800/3177893057,v1:172.21.15.37:6801/3177893057] conn(0x7f8d900744d0 0x7f8d90076910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.224+0000 7f8d8b7fe640 1 -- 172.21.15.37:0/3167308147 --> [v2:172.21.15.37:6800/3177893057,v1:172.21.15.37:6801/3177893057] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8d90076fe0 con 0x7f8d900744d0 2023-12-11T17:10:17.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.224+0000 7f8d8b7fe640 1 -- 172.21.15.37:0/3167308147 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8da4137050 con 0x7f8d9c052c70 2023-12-11T17:10:17.263 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.223+0000 7fa2e20ab640 1 -- 172.21.15.37:0/163106521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d4009a70 con 0x7fa2dc0708d0 2023-12-11T17:10:17.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.224+0000 7f8da27fc640 1 --2- 172.21.15.37:0/3167308147 >> [v2:172.21.15.37:6800/3177893057,v1:172.21.15.37:6801/3177893057] conn(0x7f8d900744d0 0x7f8d90076910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.224+0000 7fcb597fa640 1 -- 172.21.15.37:0/3032676941 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcb5c004720 con 0x7fcb64143e00 2023-12-11T17:10:17.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.225+0000 7f8da27fc640 1 --2- 172.21.15.37:0/3167308147 >> [v2:172.21.15.37:6800/3177893057,v1:172.21.15.37:6801/3177893057] conn(0x7f8d900744d0 0x7f8d90076910 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.224+0000 7f68e37fe640 1 -- 172.21.15.37:0/4145277341 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f68ec0ac150 con 0x7f68fc0d0230 2023-12-11T17:10:17.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.225+0000 7f68e37fe640 1 --2- 172.21.15.37:0/4145277341 >> [v2:172.21.15.37:6808/2707368582,v1:172.21.15.37:6809/2707368582] conn(0x7f68e8074400 0x7f68e8076840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.225+0000 7f68e37fe640 1 -- 172.21.15.37:0/4145277341 --> [v2:172.21.15.37:6808/2707368582,v1:172.21.15.37:6809/2707368582] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f68e8076f10 con 0x7f68e8074400 2023-12-11T17:10:17.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.225+0000 7f68e37fe640 1 -- 172.21.15.37:0/4145277341 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7f68ec0ac500 con 0x7f68fc0d0230 2023-12-11T17:10:17.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.226+0000 7f68fb7fe640 1 --2- 172.21.15.37:0/4145277341 >> [v2:172.21.15.37:6808/2707368582,v1:172.21.15.37:6809/2707368582] conn(0x7f68e8074400 0x7f68e8076840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.225+0000 7fcb597fa640 1 --2- 172.21.15.37:0/3032676941 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcb5006ae40 0x7fcb5006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.226+0000 7fcb597fa640 1 -- 172.21.15.37:0/3032676941 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcb5c0acb50 con 0x7fcb64143e00 2023-12-11T17:10:17.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.226+0000 7fcb597fa640 1 --2- 172.21.15.37:0/3032676941 >> [v2:172.21.15.151:6805/1859505134,v1:172.21.15.151:6807/1859505134] conn(0x7fcb50074400 0x7fcb50076840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.226+0000 7fcb597fa640 1 -- 172.21.15.37:0/3032676941 --> [v2:172.21.15.151:6805/1859505134,v1:172.21.15.151:6807/1859505134] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcb50076f10 con 0x7fcb50074400 2023-12-11T17:10:17.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.226+0000 7fcb597fa640 1 -- 172.21.15.37:0/3032676941 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcb5c0acec0 con 0x7fcb64143e00 2023-12-11T17:10:17.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.226+0000 7f68fa7fc640 1 --2- 172.21.15.37:0/4145277341 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f68e806ae40 0x7f68e806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.226+0000 7fa2e20ab640 1 --2- 172.21.15.37:0/163106521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2dc0708d0 0x7fa2dc158280 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa2d802b9e0 tx=0x7fa2d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.227+0000 7f68fb7fe640 1 --2- 172.21.15.37:0/4145277341 >> [v2:172.21.15.37:6808/2707368582,v1:172.21.15.37:6809/2707368582] conn(0x7f68e8074400 0x7f68e8076840 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.227+0000 7fcb5bfff640 1 --2- 172.21.15.37:0/3032676941 >> [v2:172.21.15.151:6805/1859505134,v1:172.21.15.151:6807/1859505134] conn(0x7fcb50074400 0x7fcb50076840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.227+0000 7fa2d2ffd640 1 -- 172.21.15.37:0/163106521 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8030860 con 0x7fa2dc0708d0 2023-12-11T17:10:17.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.227+0000 7f8d8b7fe640 1 -- 172.21.15.37:0/3167308147 <== osd.0 v2:172.21.15.37:6800/3177893057 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f8d90076fe0 con 0x7f8d900744d0 2023-12-11T17:10:17.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.227+0000 7f8da2ffd640 1 --2- 172.21.15.37:0/3167308147 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8d9006ae90 0x7f8d9006d350 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8d94007b20 tx=0x7f8d94009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.227+0000 7fbeed7fa640 1 -- 172.21.15.37:0/1706463320 <== osd.5 v2:172.21.15.151:6800/491338889 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fbedc076ff0 con 0x7fbedc0744e0 2023-12-11T17:10:17.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.227+0000 7fa2d2ffd640 1 -- 172.21.15.37:0/163106521 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d8039d30 con 0x7fa2dc0708d0 2023-12-11T17:10:17.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.227+0000 7fa2d2ffd640 1 -- 172.21.15.37:0/163106521 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d8039ea0 con 0x7fa2dc0708d0 2023-12-11T17:10:17.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.228+0000 7fa2e430f640 1 -- 172.21.15.37:0/163106521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2d80094d0 con 0x7fa2dc0708d0 2023-12-11T17:10:17.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.228+0000 7f68fa7fc640 1 --2- 172.21.15.37:0/4145277341 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f68e806ae40 0x7f68e806d300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0cd250 tx=0x7f68f0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.227+0000 7fcb68e2c640 1 --2- 172.21.15.37:0/3032676941 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcb5006ae40 0x7fcb5006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.228+0000 7f68e37fe640 1 -- 172.21.15.37:0/4145277341 <== osd.2 v2:172.21.15.37:6808/2707368582 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7f68e8076f10 con 0x7f68e8074400 2023-12-11T17:10:17.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.228+0000 7fa2e430f640 1 -- 172.21.15.37:0/163106521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2dc0b2de0 con 0x7fa2dc0708d0 2023-12-11T17:10:17.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.228+0000 7fcb5bfff640 1 --2- 172.21.15.37:0/3032676941 >> [v2:172.21.15.151:6805/1859505134,v1:172.21.15.151:6807/1859505134] conn(0x7fcb50074400 0x7fcb50076840 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.229+0000 7f5da37fe640 1 --2- 172.21.15.37:0/1745172863 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5d8406ae40 0x7f5d8406d300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009280 tx=0x7f5d94008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.230+0000 7fcb68e2c640 1 --2- 172.21.15.37:0/3032676941 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcb5006ae40 0x7fcb5006d300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcb60006fd0 tx=0x7fcb60008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.230+0000 7fa2e430f640 1 -- 172.21.15.37:0/163106521 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fa2dc0af9f0 con 0x7fa2dc0708d0 2023-12-11T17:10:17.270 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.230+0000 7fcb597fa640 1 -- 172.21.15.37:0/3032676941 <== osd.7 v2:172.21.15.151:6805/1859505134 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fcb50076f10 con 0x7fcb50074400 2023-12-11T17:10:17.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.231+0000 7fa2d2ffd640 1 -- 172.21.15.37:0/163106521 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa2d8043620 con 0x7fa2dc0708d0 2023-12-11T17:10:17.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.232+0000 7fa2d2ffd640 1 --2- 172.21.15.37:0/163106521 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa2c006ae90 0x7fa2c006d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.232+0000 7fa2d2ffd640 1 -- 172.21.15.37:0/163106521 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa2d803e070 con 0x7fa2dc0708d0 2023-12-11T17:10:17.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.233+0000 7fa2d2ffd640 1 --2- 172.21.15.37:0/163106521 >> [v2:172.21.15.151:6823/2023784978,v1:172.21.15.151:6825/2023784978] conn(0x7fa2c00744d0 0x7fa2c0076910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.233+0000 7fa2d2ffd640 1 -- 172.21.15.37:0/163106521 --> [v2:172.21.15.151:6823/2023784978,v1:172.21.15.151:6825/2023784978] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fa2c0076fe0 con 0x7fa2c00744d0 2023-12-11T17:10:17.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.233+0000 7fa2d2ffd640 1 -- 172.21.15.37:0/163106521 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=25) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa2d80aed00 con 0x7fa2dc0708d0 2023-12-11T17:10:17.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.233+0000 7fa2e28ac640 1 --2- 172.21.15.37:0/163106521 >> [v2:172.21.15.151:6823/2023784978,v1:172.21.15.151:6825/2023784978] conn(0x7fa2c00744d0 0x7fa2c0076910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.234+0000 7fa2e18aa640 1 --2- 172.21.15.37:0/163106521 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa2c006ae90 0x7fa2c006d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.235+0000 7fa2e18aa640 1 --2- 172.21.15.37:0/163106521 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa2c006ae90 0x7fa2c006d350 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc000f60 tx=0x7fa2cc009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.235+0000 7fa2e28ac640 1 --2- 172.21.15.37:0/163106521 >> [v2:172.21.15.151:6823/2023784978,v1:172.21.15.151:6825/2023784978] conn(0x7fa2c00744d0 0x7fa2c0076910 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.238+0000 7fa2d2ffd640 1 -- 172.21.15.37:0/163106521 <== osd.6 v2:172.21.15.151:6823/2023784978 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+26965 (crc 0 0 0) 0x7fa2c0076fe0 con 0x7fa2c00744d0 2023-12-11T17:10:17.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.253+0000 7ff633a32640 1 -- 172.21.15.37:0/3376864999 --> [v2:172.21.15.37:6813/1457860485,v1:172.21.15.37:6815/1457860485] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7ff60c002cb0 con 0x7ff6100744b0 2023-12-11T17:10:17.272 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.256+0000 7ff621ffb640 1 -- 172.21.15.37:0/3376864999 <== osd.1 v2:172.21.15.37:6813/1457860485 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7ff60c002cb0 con 0x7ff6100744b0 2023-12-11T17:10:17.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.256+0000 7ff633a32640 1 -- 172.21.15.37:0/3376864999 >> [v2:172.21.15.37:6813/1457860485,v1:172.21.15.37:6815/1457860485] conn(0x7ff6100744b0 msgr2=0x7ff6100768f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.256+0000 7ff633a32640 1 --2- 172.21.15.37:0/3376864999 >> [v2:172.21.15.37:6813/1457860485,v1:172.21.15.37:6815/1457860485] conn(0x7ff6100744b0 0x7ff6100768f0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.257+0000 7f18a8333640 1 -- 172.21.15.37:0/2391603843 --> [v2:172.21.15.151:6816/1944498382,v1:172.21.15.151:6817/1944498382] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f18a006d0b0 con 0x7f18840744b0 2023-12-11T17:10:17.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.257+0000 7ff633a32640 1 -- 172.21.15.37:0/3376864999 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff61006ae70 msgr2=0x7ff61006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.257+0000 7ff633a32640 1 --2- 172.21.15.37:0/3376864999 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff61006ae70 0x7ff61006d330 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff628001d50 tx=0x7ff628001ce0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.257+0000 7ff633a32640 1 -- 172.21.15.37:0/3376864999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6240eacd0 msgr2=0x7ff62417d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.257+0000 7ff633a32640 1 --2- 172.21.15.37:0/3376864999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6240eacd0 0x7ff62417d590 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7ff62c063e60 tx=0x7ff62c067ed0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.257+0000 7ff631fcf640 1 -- 172.21.15.37:0/3376864999 reap_dead start 2023-12-11T17:10:17.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.257+0000 7ff633a32640 1 -- 172.21.15.37:0/3376864999 shutdown_connections 2023-12-11T17:10:17.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.257+0000 7ff633a32640 1 -- 172.21.15.37:0/3376864999 >> 172.21.15.37:0/3376864999 conn(0x7ff624009f80 msgr2=0x7ff624004900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.257+0000 7ff633a32640 1 -- 172.21.15.37:0/3376864999 shutdown_connections 2023-12-11T17:10:17.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.257+0000 7ff633a32640 1 -- 172.21.15.37:0/3376864999 wait complete. 2023-12-11T17:10:17.274 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.259+0000 7f1896ffd640 1 -- 172.21.15.37:0/2391603843 <== osd.4 v2:172.21.15.151:6816/1944498382 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f189002fb60 con 0x7f18840744b0 2023-12-11T17:10:17.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.259+0000 7f8da93a9640 1 -- 172.21.15.37:0/3167308147 --> [v2:172.21.15.37:6800/3177893057,v1:172.21.15.37:6801/3177893057] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8d9c050370 con 0x7f8d900744d0 2023-12-11T17:10:17.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.259+0000 7f5daa1a9640 1 -- 172.21.15.37:0/1745172863 --> [v2:172.21.15.37:6821/2938574997,v1:172.21.15.37:6823/2938574997] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f5d88002cb0 con 0x7f5d84074480 2023-12-11T17:10:17.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.259+0000 7f18a8333640 1 -- 172.21.15.37:0/2391603843 >> [v2:172.21.15.151:6816/1944498382,v1:172.21.15.151:6817/1944498382] conn(0x7f18840744b0 msgr2=0x7f18840768f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.259+0000 7f18a8333640 1 --2- 172.21.15.37:0/2391603843 >> [v2:172.21.15.151:6816/1944498382,v1:172.21.15.151:6817/1944498382] conn(0x7f18840744b0 0x7f18840768f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.260+0000 7f18a8333640 1 -- 172.21.15.37:0/2391603843 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f188406ae70 msgr2=0x7f188406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.260+0000 7f18a8333640 1 --2- 172.21.15.37:0/2391603843 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f188406ae70 0x7f188406d330 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f189c005c00 tx=0x7f189c009040 comp rx=0 tx=0).stop 2023-12-11T17:10:17.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.260+0000 7f18a8333640 1 -- 172.21.15.37:0/2391603843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18a015a580 msgr2=0x7f18a0166300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.260+0000 7f18a8333640 1 --2- 172.21.15.37:0/2391603843 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f18a015a580 0x7f18a0166300 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f189800c310 tx=0x7f189800c7d0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.260+0000 7f18a68d0640 1 -- 172.21.15.37:0/2391603843 reap_dead start 2023-12-11T17:10:17.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.260+0000 7f18a8333640 1 -- 172.21.15.37:0/2391603843 shutdown_connections 2023-12-11T17:10:17.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.260+0000 7f5da0ff9640 1 -- 172.21.15.37:0/1745172863 <== osd.3 v2:172.21.15.37:6821/2938574997 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f5d88002cb0 con 0x7f5d84074480 2023-12-11T17:10:17.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.260+0000 7f18a8333640 1 -- 172.21.15.37:0/2391603843 >> 172.21.15.37:0/2391603843 conn(0x7f18a00b0a90 msgr2=0x7f18a00b02e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.260+0000 7f18a8333640 1 -- 172.21.15.37:0/2391603843 shutdown_connections 2023-12-11T17:10:17.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.261+0000 7f8d8b7fe640 1 -- 172.21.15.37:0/3167308147 <== osd.0 v2:172.21.15.37:6800/3177893057 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f8d98009840 con 0x7f8d900744d0 2023-12-11T17:10:17.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.260+0000 7f18a8333640 1 -- 172.21.15.37:0/2391603843 wait complete. 2023-12-11T17:10:17.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.261+0000 7f5daa1a9640 1 -- 172.21.15.37:0/1745172863 >> [v2:172.21.15.37:6821/2938574997,v1:172.21.15.37:6823/2938574997] conn(0x7f5d84074480 msgr2=0x7f5d840768c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.278 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.261+0000 7f5daa1a9640 1 --2- 172.21.15.37:0/1745172863 >> [v2:172.21.15.37:6821/2938574997,v1:172.21.15.37:6823/2938574997] conn(0x7f5d84074480 0x7f5d840768c0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.261+0000 7f68e17fa640 1 -- 172.21.15.37:0/4145277341 --> [v2:172.21.15.37:6808/2707368582,v1:172.21.15.37:6809/2707368582] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f68dc002cb0 con 0x7f68e8074400 2023-12-11T17:10:17.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.261+0000 7f5daa1a9640 1 -- 172.21.15.37:0/1745172863 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5d8406ae40 msgr2=0x7f5d8406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.261+0000 7f5daa1a9640 1 --2- 172.21.15.37:0/1745172863 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5d8406ae40 0x7f5d8406d300 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f5d94009280 tx=0x7f5d94008030 comp rx=0 tx=0).stop 2023-12-11T17:10:17.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.261+0000 7f5daa1a9640 1 -- 172.21.15.37:0/1745172863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5da4157a60 msgr2=0x7f5da415cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.261+0000 7f5daa1a9640 1 --2- 172.21.15.37:0/1745172863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5da4157a60 0x7f5da415cff0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5d8c00c3e0 tx=0x7f5d8c00c8a0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.262+0000 7f8da93a9640 1 -- 172.21.15.37:0/3167308147 >> [v2:172.21.15.37:6800/3177893057,v1:172.21.15.37:6801/3177893057] conn(0x7f8d900744d0 msgr2=0x7f8d90076910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.262+0000 7f8da93a9640 1 --2- 172.21.15.37:0/3167308147 >> [v2:172.21.15.37:6800/3177893057,v1:172.21.15.37:6801/3177893057] conn(0x7f8d900744d0 0x7f8d90076910 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.262+0000 7f8da93a9640 1 -- 172.21.15.37:0/3167308147 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8d9006ae90 msgr2=0x7f8d9006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.262+0000 7f8da93a9640 1 --2- 172.21.15.37:0/3167308147 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8d9006ae90 0x7f8d9006d350 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f8d94007b20 tx=0x7f8d94009040 comp rx=0 tx=0).stop 2023-12-11T17:10:17.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.262+0000 7f8da93a9640 1 -- 172.21.15.37:0/3167308147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d9c052c70 msgr2=0x7f8d9c0530f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.262+0000 7f8da93a9640 1 --2- 172.21.15.37:0/3167308147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8d9c052c70 0x7f8d9c0530f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8da4068ea0 tx=0x7f8da4066000 comp rx=0 tx=0).stop 2023-12-11T17:10:17.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.262+0000 7f8da37fe640 1 -- 172.21.15.37:0/3167308147 reap_dead start 2023-12-11T17:10:17.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.262+0000 7f5da3fff640 1 -- 172.21.15.37:0/1745172863 reap_dead start 2023-12-11T17:10:17.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.262+0000 7f5daa1a9640 1 -- 172.21.15.37:0/1745172863 shutdown_connections 2023-12-11T17:10:17.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.262+0000 7f5daa1a9640 1 -- 172.21.15.37:0/1745172863 >> 172.21.15.37:0/1745172863 conn(0x7f5da40b0a90 msgr2=0x7f5da41581f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.262+0000 7f5daa1a9640 1 -- 172.21.15.37:0/1745172863 shutdown_connections 2023-12-11T17:10:17.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.262+0000 7f5daa1a9640 1 -- 172.21.15.37:0/1745172863 wait complete. 2023-12-11T17:10:17.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.262+0000 7f68e37fe640 1 -- 172.21.15.37:0/4145277341 <== osd.2 v2:172.21.15.37:6808/2707368582 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f68dc002cb0 con 0x7f68e8074400 2023-12-11T17:10:17.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.263+0000 7fbef6b25640 1 -- 172.21.15.37:0/1706463320 --> [v2:172.21.15.151:6800/491338889,v1:172.21.15.151:6801/491338889] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbed0002cb0 con 0x7fbedc0744e0 2023-12-11T17:10:17.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.263+0000 7f68e17fa640 1 -- 172.21.15.37:0/4145277341 >> [v2:172.21.15.37:6808/2707368582,v1:172.21.15.37:6809/2707368582] conn(0x7f68e8074400 msgr2=0x7f68e8076840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.263+0000 7f68e17fa640 1 --2- 172.21.15.37:0/4145277341 >> [v2:172.21.15.37:6808/2707368582,v1:172.21.15.37:6809/2707368582] conn(0x7f68e8074400 0x7f68e8076840 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.263+0000 7f68e17fa640 1 -- 172.21.15.37:0/4145277341 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f68e806ae40 msgr2=0x7f68e806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.263+0000 7f68e17fa640 1 --2- 172.21.15.37:0/4145277341 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f68e806ae40 0x7f68e806d300 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f68fc0cd250 tx=0x7f68f0009040 comp rx=0 tx=0).stop 2023-12-11T17:10:17.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.263+0000 7f68e17fa640 1 -- 172.21.15.37:0/4145277341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68fc0d0230 msgr2=0x7f68fc200880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.263+0000 7f68e17fa640 1 --2- 172.21.15.37:0/4145277341 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68fc0d0230 0x7f68fc200880 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f68ec0097a0 tx=0x7f68ec0046c0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.264+0000 7f68fb7fe640 1 -- 172.21.15.37:0/4145277341 reap_dead start 2023-12-11T17:10:17.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.264+0000 7f8da93a9640 1 -- 172.21.15.37:0/3167308147 shutdown_connections 2023-12-11T17:10:17.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.264+0000 7f8da93a9640 1 -- 172.21.15.37:0/3167308147 >> 172.21.15.37:0/3167308147 conn(0x7f8d9c009f80 msgr2=0x7f8d9c035570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.264+0000 7f68e17fa640 1 -- 172.21.15.37:0/4145277341 shutdown_connections 2023-12-11T17:10:17.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.264+0000 7f68e17fa640 1 -- 172.21.15.37:0/4145277341 >> 172.21.15.37:0/4145277341 conn(0x7f68fc09c450 msgr2=0x7f68fc0ce200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.264+0000 7fbeed7fa640 1 -- 172.21.15.37:0/1706463320 <== osd.5 v2:172.21.15.151:6800/491338889 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbed0002cb0 con 0x7fbedc0744e0 2023-12-11T17:10:17.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.264+0000 7f8da93a9640 1 -- 172.21.15.37:0/3167308147 shutdown_connections 2023-12-11T17:10:17.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.264+0000 7f8da93a9640 1 -- 172.21.15.37:0/3167308147 wait complete. 2023-12-11T17:10:17.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.264+0000 7fbef6b25640 1 -- 172.21.15.37:0/1706463320 >> [v2:172.21.15.151:6800/491338889,v1:172.21.15.151:6801/491338889] conn(0x7fbedc0744e0 msgr2=0x7fbedc076920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.265+0000 7fbef6b25640 1 --2- 172.21.15.37:0/1706463320 >> [v2:172.21.15.151:6800/491338889,v1:172.21.15.151:6801/491338889] conn(0x7fbedc0744e0 0x7fbedc076920 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.265+0000 7fbef6b25640 1 -- 172.21.15.37:0/1706463320 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbedc06aea0 msgr2=0x7fbedc06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.265+0000 7fbef6b25640 1 --2- 172.21.15.37:0/1706463320 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbedc06aea0 0x7fbedc06d360 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbee00011e0 tx=0x7fbee0007d30 comp rx=0 tx=0).stop 2023-12-11T17:10:17.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.265+0000 7fbef6b25640 1 -- 172.21.15.37:0/1706463320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbef01609b0 msgr2=0x7fbef014c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.265+0000 7fbef6b25640 1 --2- 172.21.15.37:0/1706463320 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbef01609b0 0x7fbef014c080 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fbee800efc0 tx=0x7fbee800c490 comp rx=0 tx=0).stop 2023-12-11T17:10:17.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.265+0000 7fbef50c2640 1 -- 172.21.15.37:0/1706463320 reap_dead start 2023-12-11T17:10:17.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.264+0000 7f68e17fa640 1 -- 172.21.15.37:0/4145277341 shutdown_connections 2023-12-11T17:10:17.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.265+0000 7f68e17fa640 1 -- 172.21.15.37:0/4145277341 wait complete. 2023-12-11T17:10:17.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.266+0000 7fbef6b25640 1 -- 172.21.15.37:0/1706463320 shutdown_connections 2023-12-11T17:10:17.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.266+0000 7fbef6b25640 1 -- 172.21.15.37:0/1706463320 >> 172.21.15.37:0/1706463320 conn(0x7fbef009c450 msgr2=0x7fbef00d0cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.268+0000 7fbef6b25640 1 -- 172.21.15.37:0/1706463320 shutdown_connections 2023-12-11T17:10:17.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.268+0000 7fbef6b25640 1 -- 172.21.15.37:0/1706463320 wait complete. 2023-12-11T17:10:17.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.268+0000 7fcb6b090640 1 -- 172.21.15.37:0/3032676941 --> [v2:172.21.15.151:6805/1859505134,v1:172.21.15.151:6807/1859505134] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcb64142870 con 0x7fcb50074400 2023-12-11T17:10:17.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.270+0000 7fcb597fa640 1 -- 172.21.15.37:0/3032676941 <== osd.7 v2:172.21.15.151:6805/1859505134 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcb64142870 con 0x7fcb50074400 2023-12-11T17:10:17.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.273+0000 7fcb6b090640 1 -- 172.21.15.37:0/3032676941 >> [v2:172.21.15.151:6805/1859505134,v1:172.21.15.151:6807/1859505134] conn(0x7fcb50074400 msgr2=0x7fcb50076840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.273+0000 7fcb6b090640 1 --2- 172.21.15.37:0/3032676941 >> [v2:172.21.15.151:6805/1859505134,v1:172.21.15.151:6807/1859505134] conn(0x7fcb50074400 0x7fcb50076840 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.273+0000 7fcb6b090640 1 -- 172.21.15.37:0/3032676941 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcb5006ae40 msgr2=0x7fcb5006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.273+0000 7fa2e430f640 1 -- 172.21.15.37:0/163106521 --> [v2:172.21.15.151:6823/2023784978,v1:172.21.15.151:6825/2023784978] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fa2dc072ee0 con 0x7fa2c00744d0 2023-12-11T17:10:17.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.273+0000 7fcb6b090640 1 --2- 172.21.15.37:0/3032676941 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcb5006ae40 0x7fcb5006d300 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcb60006fd0 tx=0x7fcb60008040 comp rx=0 tx=0).stop 2023-12-11T17:10:17.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.273+0000 7fcb6b090640 1 -- 172.21.15.37:0/3032676941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb64143e00 msgr2=0x7fcb6413fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.273+0000 7fcb6b090640 1 --2- 172.21.15.37:0/3032676941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb64143e00 0x7fcb6413fe60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c009f40 tx=0x7fcb5c004a40 comp rx=0 tx=0).stop 2023-12-11T17:10:17.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.274+0000 7fcb6962d640 1 -- 172.21.15.37:0/3032676941 reap_dead start 2023-12-11T17:10:17.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.274+0000 7fcb6b090640 1 -- 172.21.15.37:0/3032676941 shutdown_connections 2023-12-11T17:10:17.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.274+0000 7fcb6b090640 1 -- 172.21.15.37:0/3032676941 >> 172.21.15.37:0/3032676941 conn(0x7fcb640b0a90 msgr2=0x7fcb640cddf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.274+0000 7fcb6b090640 1 -- 172.21.15.37:0/3032676941 shutdown_connections 2023-12-11T17:10:17.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.274+0000 7fcb6b090640 1 -- 172.21.15.37:0/3032676941 wait complete. 2023-12-11T17:10:17.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.275+0000 7fa2d2ffd640 1 -- 172.21.15.37:0/163106521 <== osd.6 v2:172.21.15.151:6823/2023784978 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fa2dc072ee0 con 0x7fa2c00744d0 2023-12-11T17:10:17.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.277+0000 7fa2e430f640 1 -- 172.21.15.37:0/163106521 >> [v2:172.21.15.151:6823/2023784978,v1:172.21.15.151:6825/2023784978] conn(0x7fa2c00744d0 msgr2=0x7fa2c0076910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.277+0000 7fa2e430f640 1 --2- 172.21.15.37:0/163106521 >> [v2:172.21.15.151:6823/2023784978,v1:172.21.15.151:6825/2023784978] conn(0x7fa2c00744d0 0x7fa2c0076910 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.277+0000 7fa2e430f640 1 -- 172.21.15.37:0/163106521 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa2c006ae90 msgr2=0x7fa2c006d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.277+0000 7fa2e430f640 1 --2- 172.21.15.37:0/163106521 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa2c006ae90 0x7fa2c006d350 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa2cc000f60 tx=0x7fa2cc009040 comp rx=0 tx=0).stop 2023-12-11T17:10:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.277+0000 7fa2e430f640 1 -- 172.21.15.37:0/163106521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2dc0708d0 msgr2=0x7fa2dc158280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.277+0000 7fa2e430f640 1 --2- 172.21.15.37:0/163106521 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa2dc0708d0 0x7fa2dc158280 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fa2d802b9e0 tx=0x7fa2d8004730 comp rx=0 tx=0).stop 2023-12-11T17:10:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.277+0000 7fa2e28ac640 1 -- 172.21.15.37:0/163106521 reap_dead start 2023-12-11T17:10:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.278+0000 7fa2e430f640 1 -- 172.21.15.37:0/163106521 shutdown_connections 2023-12-11T17:10:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.278+0000 7fa2e430f640 1 -- 172.21.15.37:0/163106521 >> 172.21.15.37:0/163106521 conn(0x7fa2dc0b0a90 msgr2=0x7fa2dc0afb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.278+0000 7fa2e430f640 1 -- 172.21.15.37:0/163106521 shutdown_connections 2023-12-11T17:10:17.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.278+0000 7fa2e430f640 1 -- 172.21.15.37:0/163106521 wait complete. 2023-12-11T17:10:17.291 INFO:teuthology.orchestra.run.smithi037.stdout:60129542154 2023-12-11T17:10:17.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-11T17:10:17.297 INFO:teuthology.orchestra.run.smithi037.stdout:60129542154 2023-12-11T17:10:17.298 INFO:teuthology.orchestra.run.smithi037.stdout:60129542155 2023-12-11T17:10:17.298 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-11T17:10:17.299 INFO:teuthology.orchestra.run.smithi037.stdout:60129542154 2023-12-11T17:10:17.299 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-11T17:10:17.300 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-11T17:10:17.300 INFO:teuthology.orchestra.run.smithi037.stdout:60129542153 2023-12-11T17:10:17.301 INFO:teuthology.orchestra.run.smithi037.stdout:60129542154 2023-12-11T17:10:17.301 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-11T17:10:17.302 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-11T17:10:17.303 INFO:teuthology.orchestra.run.smithi037.stdout:60129542153 2023-12-11T17:10:17.303 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-11T17:10:17.304 INFO:teuthology.orchestra.run.smithi037.stdout:60129542154 2023-12-11T17:10:17.305 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-11T17:10:17.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.574+0000 7feeefbd7640 1 Processor -- start 2023-12-11T17:10:17.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.574+0000 7feeefbd7640 1 -- start start 2023-12-11T17:10:17.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.577+0000 7feeefbd7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee003e810 0x7feee0053bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.578+0000 7feeefbd7640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee0058540 con 0x7feee0054100 2023-12-11T17:10:17.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.578+0000 7feeefbd7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee0058820 con 0x7feee00e3090 2023-12-11T17:10:17.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.578+0000 7feeed973640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7feee00e3090 0x7feee0057d60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.37:56452/0 (socket says 172.21.15.37:56452) 2023-12-11T17:10:17.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.578+0000 7feeed973640 1 -- 172.21.15.37:0/1192983224 learned_addr learned my addr 172.21.15.37:0/1192983224 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:17.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.578+0000 7feeed172640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee003e810 0x7feee0053bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.579+0000 7feeefbd7640 1 -- 172.21.15.37:0/1192983224 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee0054590 con 0x7feee003e810 2023-12-11T17:10:17.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.581+0000 7feeec971640 1 -- 172.21.15.37:0/1192983224 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461777709 0 0) 0x7feee0058540 con 0x7feee0054100 2023-12-11T17:10:17.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.581+0000 7feeec971640 1 -- 172.21.15.37:0/1192983224 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feed4003520 con 0x7feee0054100 2023-12-11T17:10:17.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.581+0000 7feeec971640 1 -- 172.21.15.37:0/1192983224 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1008576677 0 0) 0x7feed4003520 con 0x7feee0054100 2023-12-11T17:10:17.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.582+0000 7feeec971640 1 -- 172.21.15.37:0/1192983224 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee003e810 msgr2=0x7feee0053bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:17.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.582+0000 7feeec971640 1 --2- 172.21.15.37:0/1192983224 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee003e810 0x7feee0053bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.582+0000 7feeec971640 1 -- 172.21.15.37:0/1192983224 >> v1:172.21.15.151:6789/0 conn(0x7feee00e3090 legacy=0x7feee0057d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.582+0000 7feeec971640 1 -- 172.21.15.37:0/1192983224 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee0058b00 con 0x7feee0054100 2023-12-11T17:10:17.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.582+0000 7feeec971640 1 -- 172.21.15.37:0/1192983224 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7feee8074230 con 0x7feee0054100 2023-12-11T17:10:17.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.582+0000 7feeec971640 1 -- 172.21.15.37:0/1192983224 >> v1:172.21.15.37:6789/0 conn(0x7feee0054100 legacy=0x7feee00068a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.582+0000 7feeec971640 1 --2- 172.21.15.37:0/1192983224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feed40039a0 0x7feed4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.582+0000 7feeec971640 1 --2- 172.21.15.37:0/1192983224 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feed4004340 0x7feed4004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.582+0000 7feeec971640 1 --2- 172.21.15.37:0/1192983224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feed4004f80 0x7feed4014190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.582+0000 7feeec971640 1 -- 172.21.15.37:0/1192983224 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee0054590 con 0x7feed40039a0 2023-12-11T17:10:17.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.582+0000 7feeec971640 1 -- 172.21.15.37:0/1192983224 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feed40146d0 con 0x7feed4004f80 2023-12-11T17:10:17.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.582+0000 7feeec971640 1 -- 172.21.15.37:0/1192983224 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feed4014860 con 0x7feed4004340 2023-12-11T17:10:17.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.583+0000 7feeee174640 1 --2- 172.21.15.37:0/1192983224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feed4004f80 0x7feed4014190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.583+0000 7feeed172640 1 --2- 172.21.15.37:0/1192983224 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feed4004340 0x7feed4004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.584+0000 7feeee174640 1 -- 172.21.15.37:0/1192983224 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feed4004340 msgr2=0x7feed4004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:17.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.584+0000 7feeee174640 1 --2- 172.21.15.37:0/1192983224 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feed4004340 0x7feed4004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.584+0000 7feeee174640 1 -- 172.21.15.37:0/1192983224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feed40039a0 msgr2=0x7feed4003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:17.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.584+0000 7feeee174640 1 --2- 172.21.15.37:0/1192983224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feed40039a0 0x7feed4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.584+0000 7feeee174640 1 -- 172.21.15.37:0/1192983224 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee0058b00 con 0x7feed4004f80 2023-12-11T17:10:17.586 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.586+0000 7feeee174640 1 --2- 172.21.15.37:0/1192983224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feed4004f80 0x7feed4014190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feee8064180 tx=0x7feed40057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1ed1abacb3758846 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.586+0000 7feeec971640 1 -- 172.21.15.37:0/1192983224 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee80ad660 con 0x7feed4004f80 2023-12-11T17:10:17.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.586+0000 7feeec971640 1 -- 172.21.15.37:0/1192983224 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee80a9050 con 0x7feed4004f80 2023-12-11T17:10:17.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.586+0000 7feeec971640 1 -- 172.21.15.37:0/1192983224 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee80ada60 con 0x7feed4004f80 2023-12-11T17:10:17.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.587+0000 7feeefbd7640 1 -- 172.21.15.37:0/1192983224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feed4004f80 msgr2=0x7feed4014190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.587+0000 7feeefbd7640 1 --2- 172.21.15.37:0/1192983224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feed4004f80 0x7feed4014190 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7feee8064180 tx=0x7feed40057f0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.587+0000 7feeee174640 1 -- 172.21.15.37:0/1192983224 reap_dead start 2023-12-11T17:10:17.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.588+0000 7feeefbd7640 1 -- 172.21.15.37:0/1192983224 shutdown_connections 2023-12-11T17:10:17.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.588+0000 7feeefbd7640 1 -- 172.21.15.37:0/1192983224 >> 172.21.15.37:0/1192983224 conn(0x7feee00559b0 msgr2=0x7feee0055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.588+0000 7feeefbd7640 1 -- 172.21.15.37:0/1192983224 shutdown_connections 2023-12-11T17:10:17.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.588+0000 7feeefbd7640 1 -- 172.21.15.37:0/1192983224 wait complete. 2023-12-11T17:10:17.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.590+0000 7feeefbd7640 1 Processor -- start 2023-12-11T17:10:17.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.591+0000 7feeefbd7640 1 -- start start 2023-12-11T17:10:17.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.593+0000 7feeefbd7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feed4004f80 0x7feee00d5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.593+0000 7ff08a92e640 1 Processor -- start 2023-12-11T17:10:17.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.594+0000 7feeefbd7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee004ffe0 0x7feee00d05b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.594+0000 7feeefbd7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feee00d0af0 0x7feee00d7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.594+0000 7feeefbd7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee00e3de0 con 0x7feed4004f80 2023-12-11T17:10:17.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.595+0000 7feeefbd7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee00d8b00 con 0x7feee00d0af0 2023-12-11T17:10:17.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.595+0000 7feeee174640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feee00d0af0 0x7feee00d7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.595+0000 7feeee174640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feee00d0af0 0x7feee00d7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:52102/0 (socket says 172.21.15.37:52102) 2023-12-11T17:10:17.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.595+0000 7feeee174640 1 -- 172.21.15.37:0/3362450195 learned_addr learned my addr 172.21.15.37:0/3362450195 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:17.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.595+0000 7feeefbd7640 1 -- 172.21.15.37:0/3362450195 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee00d0f70 con 0x7feee004ffe0 2023-12-11T17:10:17.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.595+0000 7feeed172640 1 --2- 172.21.15.37:0/3362450195 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee004ffe0 0x7feee00d05b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.596+0000 7feeed973640 1 --2- 172.21.15.37:0/3362450195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feed4004f80 0x7feee00d5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.593+0000 7ff08a92e640 1 -- start start 2023-12-11T17:10:17.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.595+0000 7ff08a92e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff0840b3b00 0x7ff08415cc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.595+0000 7ff08a92e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff0840b2700 0x7ff0840b2b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.596+0000 7ff08a92e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff08415dc20 con 0x7ff084158fc0 2023-12-11T17:10:17.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.596+0000 7ff08a92e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0840b2270 con 0x7ff0840b3b00 2023-12-11T17:10:17.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.596+0000 7ff08a92e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0840b3050 con 0x7ff0840b2700 2023-12-11T17:10:17.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.596+0000 7f44dffff640 1 Processor -- start 2023-12-11T17:10:17.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.597+0000 7f44dffff640 1 -- start start 2023-12-11T17:10:17.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.597+0000 7ff08a12d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff0840b2700 0x7ff0840b2b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.597+0000 7feeed973640 1 -- 172.21.15.37:0/3362450195 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee004ffe0 msgr2=0x7feee00d05b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.597+0000 7feeed973640 1 --2- 172.21.15.37:0/3362450195 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee004ffe0 0x7feee00d05b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.597+0000 7feeed973640 1 -- 172.21.15.37:0/3362450195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feee00d0af0 msgr2=0x7feee00d7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.597+0000 7feeed973640 1 --2- 172.21.15.37:0/3362450195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feee00d0af0 0x7feee00d7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.597+0000 7feeed973640 1 -- 172.21.15.37:0/3362450195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee00d8820 con 0x7feed4004f80 2023-12-11T17:10:17.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.597+0000 7ff08a12d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff0840b2700 0x7ff0840b2b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:52114/0 (socket says 172.21.15.37:52114) 2023-12-11T17:10:17.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.598+0000 7ff08a12d640 1 -- 172.21.15.37:0/3321441054 learned_addr learned my addr 172.21.15.37:0/3321441054 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:17.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.598+0000 7feeed973640 1 --2- 172.21.15.37:0/3362450195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feed4004f80 0x7feee00d5950 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feed800c3c0 tx=0x7feed800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.598+0000 7ff08912b640 1 --2- 172.21.15.37:0/3321441054 >> v2:172.21.15.37:3300/0 conn(0x7ff0840b3b00 0x7ff08415cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.599+0000 7feede7fc640 1 -- 172.21.15.37:0/3362450195 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed8005cc0 con 0x7feed4004f80 2023-12-11T17:10:17.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.599+0000 7ff08912b640 1 -- 172.21.15.37:0/3321441054 >> v2:172.21.15.151:3300/0 conn(0x7ff0840b2700 msgr2=0x7ff0840b2b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:17.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.599+0000 7ff08912b640 1 --2- 172.21.15.37:0/3321441054 >> v2:172.21.15.151:3300/0 conn(0x7ff0840b2700 0x7ff0840b2b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.599+0000 7ff08912b640 1 -- 172.21.15.37:0/3321441054 >> v1:172.21.15.151:6789/0 conn(0x7ff084158fc0 legacy=0x7ff0840abd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.599+0000 7ff08912b640 1 -- 172.21.15.37:0/3321441054 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08415d380 con 0x7ff0840b3b00 2023-12-11T17:10:17.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.599+0000 7f44dffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f44d80e77f0 0x7f44d8038250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.599+0000 7feede7fc640 1 -- 172.21.15.37:0/3362450195 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed8005e20 con 0x7feed4004f80 2023-12-11T17:10:17.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.600+0000 7fb6721e3640 1 Processor -- start 2023-12-11T17:10:17.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.600+0000 7feeefbd7640 1 -- 172.21.15.37:0/3362450195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee00e3720 con 0x7feed4004f80 2023-12-11T17:10:17.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.600+0000 7feeefbd7640 1 -- 172.21.15.37:0/3362450195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee00d5e90 con 0x7feed4004f80 2023-12-11T17:10:17.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.600+0000 7fb6721e3640 1 -- start start 2023-12-11T17:10:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.600+0000 7f44dffff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f44d8006170 0x7f44d8006600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.601+0000 7f44dffff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44d80e7bd0 con 0x7f44d80eb2d0 2023-12-11T17:10:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.601+0000 7f44dffff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d8057ef0 con 0x7f44d80e77f0 2023-12-11T17:10:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.601+0000 7f44dffff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44d80581d0 con 0x7f44d8006170 2023-12-11T17:10:17.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.601+0000 7feede7fc640 1 -- 172.21.15.37:0/3362450195 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed80072d0 con 0x7feed4004f80 2023-12-11T17:10:17.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.602+0000 7f44de7fc640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f44d80eb2d0 0x7f44d80eb750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.37:56478/0 (socket says 172.21.15.37:56478) 2023-12-11T17:10:17.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.602+0000 7f44deffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f44d80e77f0 0x7f44d8038250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.602+0000 7f44deffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f44d80e77f0 0x7f44d8038250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46792/0 (socket says 172.21.15.37:46792) 2023-12-11T17:10:17.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.602+0000 7f44deffd640 1 -- 172.21.15.37:0/3992550577 learned_addr learned my addr 172.21.15.37:0/3992550577 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:17.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.602+0000 7fb6721e3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb66c153900 0x7fb66c070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.602+0000 7ff08912b640 1 --2- 172.21.15.37:0/3321441054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0840b3b00 0x7ff08415cc80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff0840cadb0 tx=0x7ff07002c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cf8a6febd55327e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.603+0000 7fb6721e3640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb66c153ce0 con 0x7fb66c0b1580 2023-12-11T17:10:17.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.603+0000 7fb6721e3640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb66c06d650 con 0x7fb66c15a580 2023-12-11T17:10:17.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.603+0000 7fb6721e3640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb66c06d3a0 con 0x7fb66c153900 2023-12-11T17:10:17.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.603+0000 7f44deffd640 1 -- 172.21.15.37:0/3992550577 >> v2:172.21.15.151:3300/0 conn(0x7f44d8006170 msgr2=0x7f44d8006600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:17.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.603+0000 7f44deffd640 1 --2- 172.21.15.37:0/3992550577 >> v2:172.21.15.151:3300/0 conn(0x7f44d8006170 0x7f44d8006600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.603+0000 7f44deffd640 1 -- 172.21.15.37:0/3992550577 >> v1:172.21.15.151:6789/0 conn(0x7f44d80eb2d0 legacy=0x7f44d80eb750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:17.605 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.603+0000 7f44deffd640 1 -- 172.21.15.37:0/3992550577 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d80584b0 con 0x7f44d80e77f0 2023-12-11T17:10:17.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.603+0000 7ff08892a640 1 -- 172.21.15.37:0/3321441054 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff070031830 con 0x7ff0840b3b00 2023-12-11T17:10:17.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.603+0000 7ff08892a640 1 -- 172.21.15.37:0/3321441054 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff070031990 con 0x7ff0840b3b00 2023-12-11T17:10:17.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.603+0000 7ff08892a640 1 -- 172.21.15.37:0/3321441054 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff070031830 con 0x7ff0840b3b00 2023-12-11T17:10:17.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.604+0000 7ff08a92e640 1 -- 172.21.15.37:0/3321441054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0840b3b00 msgr2=0x7ff08415cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.604+0000 7ff08a92e640 1 --2- 172.21.15.37:0/3321441054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0840b3b00 0x7ff08415cc80 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ff0840cadb0 tx=0x7ff07002c970 comp rx=0 tx=0).stop 2023-12-11T17:10:17.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.603+0000 7fb663fff640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fb66c15a580 0x7fb66c06cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.37:56490/0 (socket says 172.21.15.37:56490) 2023-12-11T17:10:17.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.603+0000 7fb663fff640 1 -- 172.21.15.37:0/3874696434 learned_addr learned my addr 172.21.15.37:0/3874696434 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:17.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.605+0000 7fb66affd640 1 -- 172.21.15.37:0/3874696434 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055943860 0 0) 0x7fb654001110 con 0x7fb66c15a580 2023-12-11T17:10:17.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.605+0000 7fb66affd640 1 -- 172.21.15.37:0/3874696434 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb658003520 con 0x7fb66c15a580 2023-12-11T17:10:17.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.605+0000 7ff08a92e640 1 -- 172.21.15.37:0/3321441054 shutdown_connections 2023-12-11T17:10:17.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.605+0000 7ff08a92e640 1 --2- 172.21.15.37:0/3321441054 >> v2:172.21.15.151:3300/0 conn(0x7ff0840b2700 0x7ff0840b2b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.605+0000 7ff08a92e640 1 --2- 172.21.15.37:0/3321441054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff0840b3b00 0x7ff08415cc80 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.605+0000 7ff08a92e640 1 -- 172.21.15.37:0/3321441054 >> 172.21.15.37:0/3321441054 conn(0x7ff08406a460 msgr2=0x7ff08406a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.605+0000 7fb66b7fe640 1 --2- 172.21.15.37:0/3874696434 >> v2:172.21.15.37:3300/0 conn(0x7fb66c153900 0x7fb66c070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.605+0000 7f72f8a39640 1 Processor -- start 2023-12-11T17:10:17.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.605+0000 7f44deffd640 1 --2- 172.21.15.37:0/3992550577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44d80e77f0 0x7f44d8038250 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f44d803bf30 tx=0x7f44d002b930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768d16e1777fc388 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.605+0000 7f72f8a39640 1 -- start start 2023-12-11T17:10:17.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.606+0000 7ff08a92e640 1 -- 172.21.15.37:0/3321441054 shutdown_connections 2023-12-11T17:10:17.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.606+0000 7feeefbd7640 1 -- 172.21.15.37:0/3362450195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feed0005250 con 0x7feed4004f80 2023-12-11T17:10:17.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.606+0000 7fb66affd640 1 -- 172.21.15.37:0/3874696434 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2750286594 0 0) 0x7fb664001490 con 0x7fb66c0b1580 2023-12-11T17:10:17.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.606+0000 7fb66affd640 1 -- 172.21.15.37:0/3874696434 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb654001110 con 0x7fb66c0b1580 2023-12-11T17:10:17.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.606+0000 7fb66b7fe640 1 -- 172.21.15.37:0/3874696434 >> v1:172.21.15.151:6789/0 conn(0x7fb66c15a580 legacy=0x7fb66c06cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.606+0000 7fb66b7fe640 1 -- 172.21.15.37:0/3874696434 >> v1:172.21.15.37:6789/0 conn(0x7fb66c0b1580 legacy=0x7fb66c0cd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.606+0000 7fb66b7fe640 1 -- 172.21.15.37:0/3874696434 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb66c0cca90 con 0x7fb66c153900 2023-12-11T17:10:17.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.607+0000 7f44ddffb640 1 -- 172.21.15.37:0/3992550577 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d0031890 con 0x7f44d80e77f0 2023-12-11T17:10:17.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.607+0000 7f44ddffb640 1 -- 172.21.15.37:0/3992550577 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d00319f0 con 0x7f44d80e77f0 2023-12-11T17:10:17.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.608+0000 7f44ddffb640 1 -- 172.21.15.37:0/3992550577 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d0031d80 con 0x7f44d80e77f0 2023-12-11T17:10:17.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.608+0000 7fb66b7fe640 1 --2- 172.21.15.37:0/3874696434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb66c153900 0x7fb66c070a80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb65c0097a0 tx=0x7fb65c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca45ef9c41d6f3d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.609+0000 7f44dffff640 1 -- 172.21.15.37:0/3992550577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44d80e77f0 msgr2=0x7f44d8038250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.609+0000 7f44dffff640 1 --2- 172.21.15.37:0/3992550577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44d80e77f0 0x7f44d8038250 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f44d803bf30 tx=0x7f44d002b930 comp rx=0 tx=0).stop 2023-12-11T17:10:17.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.609+0000 7f72f8a39640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f72ec03c070 0x7f72ec0e7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.609+0000 7f72f8a39640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72ec053c80 0x7f72ec0540d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.609+0000 7f72f8a39640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72ec0587e0 con 0x7f72ec0e3130 2023-12-11T17:10:17.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.609+0000 7f72f8a39640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ec007b40 con 0x7f72ec053c80 2023-12-11T17:10:17.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.609+0000 7f72f8a39640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72ec058ac0 con 0x7f72ec03c070 2023-12-11T17:10:17.612 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.606+0000 7ff08a92e640 1 -- 172.21.15.37:0/3321441054 wait complete. 2023-12-11T17:10:17.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.609+0000 7ff08a92e640 1 Processor -- start 2023-12-11T17:10:17.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.609+0000 7f72f3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f72ec053c80 0x7f72ec0540d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.610+0000 7ff08a92e640 1 -- start start 2023-12-11T17:10:17.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.609+0000 7f72f37fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f72ec0e3130 0x7f72ec058020 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42970/0 (socket says 172.21.15.37:42970) 2023-12-11T17:10:17.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.609+0000 7f72f37fe640 1 -- 172.21.15.37:0/2871057335 learned_addr learned my addr 172.21.15.37:0/2871057335 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:17.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.609+0000 7f72f2ffd640 1 --2- 172.21.15.37:0/2871057335 >> v2:172.21.15.151:3300/0 conn(0x7f72ec03c070 0x7f72ec0e7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.610+0000 7f44dffff640 1 -- 172.21.15.37:0/3992550577 shutdown_connections 2023-12-11T17:10:17.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.610+0000 7f44dffff640 1 --2- 172.21.15.37:0/3992550577 >> v2:172.21.15.151:3300/0 conn(0x7f44d8006170 0x7f44d8006600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.610+0000 7f44dffff640 1 --2- 172.21.15.37:0/3992550577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44d80e77f0 0x7f44d8038250 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.610+0000 7f44dffff640 1 -- 172.21.15.37:0/3992550577 >> 172.21.15.37:0/3992550577 conn(0x7f44d80559b0 msgr2=0x7f44d8055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.610+0000 7f72f3fff640 1 -- 172.21.15.37:0/2871057335 >> v2:172.21.15.151:3300/0 conn(0x7f72ec03c070 msgr2=0x7f72ec0e7750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:17.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.610+0000 7f44dffff640 1 -- 172.21.15.37:0/3992550577 shutdown_connections 2023-12-11T17:10:17.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.610+0000 7f72f3fff640 1 --2- 172.21.15.37:0/2871057335 >> v2:172.21.15.151:3300/0 conn(0x7f72ec03c070 0x7f72ec0e7750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.611+0000 7f44dffff640 1 -- 172.21.15.37:0/3992550577 wait complete. 2023-12-11T17:10:17.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.610+0000 7f72f3fff640 1 -- 172.21.15.37:0/2871057335 >> v1:172.21.15.37:6789/0 conn(0x7f72ec0e3130 legacy=0x7f72ec058020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.610+0000 7f72f3fff640 1 -- 172.21.15.37:0/2871057335 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72ec006330 con 0x7f72ec053c80 2023-12-11T17:10:17.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.611+0000 7f72f3fff640 1 --2- 172.21.15.37:0/2871057335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72ec053c80 0x7f72ec0540d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f72f4063e60 tx=0x7f72f4066000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bde6850b5aba27ce server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.611+0000 7feede7fc640 1 -- 172.21.15.37:0/3362450195 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feed8007430 con 0x7feed4004f80 2023-12-11T17:10:17.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.612+0000 7ff08a92e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0840b2700 0x7ff084099c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.612+0000 7ff08a92e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0840b3b00 0x7ff08413d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.612+0000 7ff08a92e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff084158fc0 0x7ff08413d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.612+0000 7ff08a92e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08414f450 con 0x7ff084158fc0 2023-12-11T17:10:17.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.612+0000 7ff08a92e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff08413d090 con 0x7ff0840b3b00 2023-12-11T17:10:17.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.612+0000 7ff08a92e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff08414eb20 con 0x7ff0840b2700 2023-12-11T17:10:17.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.613+0000 7feede7fc640 1 --2- 172.21.15.37:0/3362450195 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7feecc06af10 0x7feecc06d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.613+0000 7ff08a12d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff084158fc0 0x7ff08413d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.613+0000 7ff08a12d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff084158fc0 0x7ff08413d860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46818/0 (socket says 172.21.15.37:46818) 2023-12-11T17:10:17.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.613+0000 7ff08a12d640 1 -- 172.21.15.37:0/1009840230 learned_addr learned my addr 172.21.15.37:0/1009840230 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:17.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.613+0000 7feede7fc640 1 -- 172.21.15.37:0/3362450195 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7feed8088c70 con 0x7feed4004f80 2023-12-11T17:10:17.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.613+0000 7feeed172640 1 --2- 172.21.15.37:0/3362450195 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7feecc06af10 0x7feecc06d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.613+0000 7f44dffff640 1 Processor -- start 2023-12-11T17:10:17.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.613+0000 7ff08992c640 1 --2- 172.21.15.37:0/1009840230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0840b2700 0x7ff084099c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.613+0000 7ff08a12d640 1 -- 172.21.15.37:0/1009840230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0840b2700 msgr2=0x7ff084099c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.613+0000 7ff08a12d640 1 --2- 172.21.15.37:0/1009840230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0840b2700 0x7ff084099c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.613+0000 7ff08a12d640 1 -- 172.21.15.37:0/1009840230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0840b3b00 msgr2=0x7ff08413d320 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-11T17:10:17.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.614+0000 7f44dffff640 1 -- start start 2023-12-11T17:10:17.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.613+0000 7ff08a12d640 1 --2- 172.21.15.37:0/1009840230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0840b3b00 0x7ff08413d320 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.620 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.614+0000 7ff08a12d640 1 -- 172.21.15.37:0/1009840230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff070009400 con 0x7ff084158fc0 2023-12-11T17:10:17.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.614+0000 7ff08a12d640 1 --2- 172.21.15.37:0/1009840230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff084158fc0 0x7ff08413d860 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff07c00e8d0 tx=0x7ff07c00ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.615+0000 7feeed172640 1 --2- 172.21.15.37:0/3362450195 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7feecc06af10 0x7feecc06d3d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feee00552b0 tx=0x7feee4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.615+0000 7f44dffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44d8006170 0x7f44d80dee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.615+0000 7f44dffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44d80e77f0 0x7f44d8009c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.615+0000 7f44dffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44d80eb2d0 0x7f44d8052550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.615+0000 7f44dffff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d800dbf0 con 0x7f44d80e77f0 2023-12-11T17:10:17.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.615+0000 7f44dffff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44d80df3b0 con 0x7f44d8006170 2023-12-11T17:10:17.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.615+0000 7f44dffff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44d80dfa60 con 0x7f44d80eb2d0 2023-12-11T17:10:17.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.616+0000 7f72f27fc640 1 -- 172.21.15.37:0/2871057335 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f40a6b90 con 0x7f72ec053c80 2023-12-11T17:10:17.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.616+0000 7f44deffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44d8006170 0x7f44d80dee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.616+0000 7f72f27fc640 1 -- 172.21.15.37:0/2871057335 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f40a6d30 con 0x7f72ec053c80 2023-12-11T17:10:17.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.616+0000 7f72f27fc640 1 -- 172.21.15.37:0/2871057335 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f40ae640 con 0x7f72ec053c80 2023-12-11T17:10:17.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.616+0000 7f44df7fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44d80eb2d0 0x7f44d8052550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.616+0000 7f44deffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44d8006170 0x7f44d80dee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:52160/0 (socket says 172.21.15.37:52160) 2023-12-11T17:10:17.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.616+0000 7f44deffd640 1 -- 172.21.15.37:0/1771273651 learned_addr learned my addr 172.21.15.37:0/1771273651 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:17.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.616+0000 7fb66affd640 1 -- 172.21.15.37:0/3874696434 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c031830 con 0x7fb66c153900 2023-12-11T17:10:17.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.616+0000 7ff0827fc640 1 -- 172.21.15.37:0/1009840230 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c009e80 con 0x7ff084158fc0 2023-12-11T17:10:17.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.617+0000 7ff0827fc640 1 -- 172.21.15.37:0/1009840230 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07c00c940 con 0x7ff084158fc0 2023-12-11T17:10:17.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.617+0000 7ff0827fc640 1 -- 172.21.15.37:0/1009840230 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c00ccb0 con 0x7ff084158fc0 2023-12-11T17:10:17.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.617+0000 7ff08a92e640 1 -- 172.21.15.37:0/1009840230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0840ac5b0 con 0x7ff084158fc0 2023-12-11T17:10:17.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.616+0000 7f44de7fc640 1 --2- 172.21.15.37:0/1771273651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44d80e77f0 0x7f44d8009c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.616+0000 7fb66affd640 1 -- 172.21.15.37:0/3874696434 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb65c031990 con 0x7fb66c153900 2023-12-11T17:10:17.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.617+0000 7fb66affd640 1 -- 172.21.15.37:0/3874696434 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb65c031830 con 0x7fb66c153900 2023-12-11T17:10:17.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.617+0000 7feede7fc640 1 -- 172.21.15.37:0/3362450195 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feed8053c10 con 0x7feed4004f80 2023-12-11T17:10:17.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.617+0000 7ff08a92e640 1 -- 172.21.15.37:0/1009840230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff08414ed90 con 0x7ff084158fc0 2023-12-11T17:10:17.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.618+0000 7fb6721e3640 1 -- 172.21.15.37:0/3874696434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb66c153900 msgr2=0x7fb66c070a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.618+0000 7fb6721e3640 1 --2- 172.21.15.37:0/3874696434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb66c153900 0x7fb66c070a80 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb65c0097a0 tx=0x7fb65c02b8d0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.617+0000 7f72f8a39640 1 -- 172.21.15.37:0/2871057335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72ec053c80 msgr2=0x7f72ec0540d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.617+0000 7f72f8a39640 1 --2- 172.21.15.37:0/2871057335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72ec053c80 0x7f72ec0540d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f72f4063e60 tx=0x7f72f4066000 comp rx=0 tx=0).stop 2023-12-11T17:10:17.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.617+0000 7f44df7fe640 1 -- 172.21.15.37:0/1771273651 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44d8006170 msgr2=0x7f44d80dee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.618+0000 7f44df7fe640 1 --2- 172.21.15.37:0/1771273651 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44d8006170 0x7f44d80dee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.618+0000 7f44df7fe640 1 -- 172.21.15.37:0/1771273651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44d80e77f0 msgr2=0x7f44d8009c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.618+0000 7f44df7fe640 1 --2- 172.21.15.37:0/1771273651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44d80e77f0 0x7f44d8009c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.618+0000 7f44df7fe640 1 -- 172.21.15.37:0/1771273651 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d00094d0 con 0x7f44d80eb2d0 2023-12-11T17:10:17.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.618+0000 7f44deffd640 1 --2- 172.21.15.37:0/1771273651 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44d8006170 0x7f44d80dee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:10:17.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.618+0000 7fb6721e3640 1 -- 172.21.15.37:0/3874696434 shutdown_connections 2023-12-11T17:10:17.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.618+0000 7fb6721e3640 1 --2- 172.21.15.37:0/3874696434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb66c153900 0x7fb66c070a80 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.618+0000 7fb6721e3640 1 -- 172.21.15.37:0/3874696434 >> 172.21.15.37:0/3874696434 conn(0x7fb66c0b0a90 msgr2=0x7fb66c0b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.619+0000 7f44df7fe640 1 --2- 172.21.15.37:0/1771273651 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44d80eb2d0 0x7f44d8052550 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f44e0063e60 tx=0x7f44e0067ed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.619+0000 7fb6721e3640 1 -- 172.21.15.37:0/3874696434 shutdown_connections 2023-12-11T17:10:17.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.619+0000 7ff08a92e640 1 -- 172.21.15.37:0/1009840230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff08414f590 con 0x7ff084158fc0 2023-12-11T17:10:17.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.619+0000 7f44c77fe640 1 -- 172.21.15.37:0/1771273651 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e0067830 con 0x7f44d80eb2d0 2023-12-11T17:10:17.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.619+0000 7f44c77fe640 1 -- 172.21.15.37:0/1771273651 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44e0072ee0 con 0x7f44d80eb2d0 2023-12-11T17:10:17.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.619+0000 7f44c77fe640 1 -- 172.21.15.37:0/1771273651 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44e00732f0 con 0x7f44d80eb2d0 2023-12-11T17:10:17.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.619+0000 7f44dffff640 1 -- 172.21.15.37:0/1771273651 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44d80dfd40 con 0x7f44d80eb2d0 2023-12-11T17:10:17.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.620+0000 7f44dffff640 1 -- 172.21.15.37:0/1771273651 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44d80e0300 con 0x7f44d80eb2d0 2023-12-11T17:10:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.619+0000 7fa33c9fa640 1 Processor -- start 2023-12-11T17:10:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.620+0000 7fa33c9fa640 1 -- start start 2023-12-11T17:10:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.621+0000 7fa33c9fa640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa330005e60 0x7fa3300062a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.622+0000 7fa33c9fa640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa3300067e0 0x7fa330006c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.622+0000 7fa33c9fa640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa330054300 con 0x7fa3300eacd0 2023-12-11T17:10:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.622+0000 7fa33c9fa640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3300536f0 con 0x7fa3300067e0 2023-12-11T17:10:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.622+0000 7fa33c9fa640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3300539d0 con 0x7fa330005e60 2023-12-11T17:10:17.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.622+0000 7ff0827fc640 1 -- 172.21.15.37:0/1009840230 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff07c013470 con 0x7ff084158fc0 2023-12-11T17:10:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.618+0000 7f72f8a39640 1 -- 172.21.15.37:0/2871057335 shutdown_connections 2023-12-11T17:10:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.618+0000 7f72f8a39640 1 --2- 172.21.15.37:0/2871057335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72ec053c80 0x7f72ec0540d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.618+0000 7f72f8a39640 1 --2- 172.21.15.37:0/2871057335 >> v2:172.21.15.151:3300/0 conn(0x7f72ec03c070 0x7f72ec0e7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.618+0000 7f72f8a39640 1 -- 172.21.15.37:0/2871057335 >> 172.21.15.37:0/2871057335 conn(0x7f72ec058eb0 msgr2=0x7f72ec059290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.619+0000 7f72f8a39640 1 -- 172.21.15.37:0/2871057335 shutdown_connections 2023-12-11T17:10:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.619+0000 7f72f8a39640 1 -- 172.21.15.37:0/2871057335 wait complete. 2023-12-11T17:10:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.622+0000 7f72f8a39640 1 Processor -- start 2023-12-11T17:10:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.622+0000 7f72f8a39640 1 -- start start 2023-12-11T17:10:17.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.622+0000 7fa336d9d640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7fa3300eacd0 0x7fa33004fa60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.37:56494/0 (socket says 172.21.15.37:56494) 2023-12-11T17:10:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.622+0000 7fa336d9d640 1 -- 172.21.15.37:0/706151263 learned_addr learned my addr 172.21.15.37:0/706151263 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.622+0000 7fa33659c640 1 --2- 172.21.15.37:0/706151263 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa330005e60 0x7fa3300062a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.623+0000 7ff0827fc640 1 --2- 172.21.15.37:0/1009840230 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff06806af40 0x7ff06806d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.631 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.623+0000 7f44c57fa640 1 -- 172.21.15.37:0/1771273651 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44d80057b0 con 0x7f44d80eb2d0 2023-12-11T17:10:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.619+0000 7fb6721e3640 1 -- 172.21.15.37:0/3874696434 wait complete. 2023-12-11T17:10:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.622+0000 7fb6721e3640 1 Processor -- start 2023-12-11T17:10:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.624+0000 7f72f8a39640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f72ec03c070 0x7f72ec0e0670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.624+0000 7f72f8a39640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72ec053c80 0x7f72ec04d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.632 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.623+0000 7ff0827fc640 1 -- 172.21.15.37:0/1009840230 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7ff07c089910 con 0x7ff084158fc0 2023-12-11T17:10:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.624+0000 7f72f8a39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72ec0e3130 0x7f72ec03d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.624+0000 7f72f8a39640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec0e3690 con 0x7f72ec0e3130 2023-12-11T17:10:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.624+0000 7f72f8a39640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec0e0bb0 con 0x7f72ec053c80 2023-12-11T17:10:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.624+0000 7f72f8a39640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72ec04e690 con 0x7f72ec03c070 2023-12-11T17:10:17.633 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.624+0000 7fa335d9b640 1 -- 172.21.15.37:0/706151263 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3972684498 0 0) 0x7fa330054300 con 0x7fa3300eacd0 2023-12-11T17:10:17.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.624+0000 7fa335d9b640 1 -- 172.21.15.37:0/706151263 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa320003520 con 0x7fa3300eacd0 2023-12-11T17:10:17.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.624+0000 7fa33659c640 1 -- 172.21.15.37:0/706151263 >> v2:172.21.15.37:3300/0 conn(0x7fa3300067e0 msgr2=0x7fa330006c70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-11T17:10:17.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.624+0000 7fa33659c640 1 --2- 172.21.15.37:0/706151263 >> v2:172.21.15.37:3300/0 conn(0x7fa3300067e0 0x7fa330006c70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.624+0000 7fa33659c640 1 -- 172.21.15.37:0/706151263 >> v1:172.21.15.151:6789/0 conn(0x7fa3300eacd0 legacy=0x7fa33004fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.624+0000 7fa33659c640 1 -- 172.21.15.37:0/706151263 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa330053cb0 con 0x7fa330005e60 2023-12-11T17:10:17.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.624+0000 7fb6721e3640 1 -- start start 2023-12-11T17:10:17.634 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.624+0000 7ff08992c640 1 --2- 172.21.15.37:0/1009840230 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff06806af40 0x7ff06806d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.624+0000 7f72f3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72ec0e3130 0x7f72ec03d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.625+0000 7f72f3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72ec0e3130 0x7f72ec03d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46834/0 (socket says 172.21.15.37:46834) 2023-12-11T17:10:17.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.625+0000 7f72f3fff640 1 -- 172.21.15.37:0/2928848146 learned_addr learned my addr 172.21.15.37:0/2928848146 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:17.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.625+0000 7f72f37fe640 1 --2- 172.21.15.37:0/2928848146 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f72ec03c070 0x7f72ec0e0670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.635 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.625+0000 7f72f2ffd640 1 --2- 172.21.15.37:0/2928848146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72ec053c80 0x7f72ec04d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.626+0000 7f44c77fe640 1 -- 172.21.15.37:0/1771273651 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f44e0090020 con 0x7f44d80eb2d0 2023-12-11T17:10:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.626+0000 7f72f3fff640 1 -- 172.21.15.37:0/2928848146 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f72ec03c070 msgr2=0x7f72ec0e0670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.626+0000 7f72f3fff640 1 --2- 172.21.15.37:0/2928848146 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f72ec03c070 0x7f72ec0e0670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.626+0000 7f72f3fff640 1 -- 172.21.15.37:0/2928848146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72ec053c80 msgr2=0x7f72ec04d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.626+0000 7f72f3fff640 1 --2- 172.21.15.37:0/2928848146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72ec053c80 0x7f72ec04d3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.636 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.626+0000 7f72f3fff640 1 -- 172.21.15.37:0/2928848146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f4074230 con 0x7f72ec0e3130 2023-12-11T17:10:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.626+0000 7fb6721e3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb66c0b1580 0x7fb66c157b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.626+0000 7fa33659c640 1 --2- 172.21.15.37:0/706151263 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa330005e60 0x7fa3300062a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa3280097a0 tx=0x7fa32802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c01e1e98f262860 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.626+0000 7f72f3fff640 1 --2- 172.21.15.37:0/2928848146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72ec0e3130 0x7f72ec03d650 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f72f4068ea0 tx=0x7f72f4069ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.637 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.627+0000 7fa335d9b640 1 -- 172.21.15.37:0/706151263 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa328031830 con 0x7fa330005e60 2023-12-11T17:10:17.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.627+0000 7ff08992c640 1 --2- 172.21.15.37:0/1009840230 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff06806af40 0x7ff06806d400 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff0780012e0 tx=0x7ff078009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.638 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.627+0000 7fb6721e3640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb66c153900 0x7fb66c1580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.627+0000 7fb6721e3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb66c15a580 0x7fb66c0b2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.627+0000 7fb6721e3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c144dd0 con 0x7fb66c0b1580 2023-12-11T17:10:17.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.627+0000 7fb6721e3640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c1585e0 con 0x7fb66c153900 2023-12-11T17:10:17.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.627+0000 7fb6721e3640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb66c158890 con 0x7fb66c15a580 2023-12-11T17:10:17.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.627+0000 7fb663fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb66c153900 0x7fb66c1580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.627+0000 7fb663fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb66c153900 0x7fb66c1580a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:52172/0 (socket says 172.21.15.37:52172) 2023-12-11T17:10:17.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.627+0000 7fb663fff640 1 -- 172.21.15.37:0/2064708691 learned_addr learned my addr 172.21.15.37:0/2064708691 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:17.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.627+0000 7fa335d9b640 1 -- 172.21.15.37:0/706151263 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa328031990 con 0x7fa330005e60 2023-12-11T17:10:17.639 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.628+0000 7f44c77fe640 1 --2- 172.21.15.37:0/1771273651 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f44cc06ae30 0x7f44cc06d2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.627+0000 7fb66bfff640 1 --2- 172.21.15.37:0/2064708691 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb66c15a580 0x7fb66c0b2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.628+0000 7f44c77fe640 1 -- 172.21.15.37:0/1771273651 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f44e0102ea0 con 0x7f44d80eb2d0 2023-12-11T17:10:17.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.627+0000 7fa335d9b640 1 -- 172.21.15.37:0/706151263 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa328031d00 con 0x7fa330005e60 2023-12-11T17:10:17.640 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.628+0000 7fb66b7fe640 1 --2- 172.21.15.37:0/2064708691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb66c0b1580 0x7fb66c157b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.628+0000 7f44deffd640 1 --2- 172.21.15.37:0/1771273651 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f44cc06ae30 0x7f44cc06d2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.628+0000 7fa33c9fa640 1 -- 172.21.15.37:0/706151263 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa330005e60 msgr2=0x7fa3300062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.628+0000 7fa33c9fa640 1 --2- 172.21.15.37:0/706151263 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa330005e60 0x7fa3300062a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fa3280097a0 tx=0x7fa32802b8d0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.641 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.629+0000 7fa33c9fa640 1 -- 172.21.15.37:0/706151263 shutdown_connections 2023-12-11T17:10:17.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.628+0000 7fb663fff640 1 -- 172.21.15.37:0/2064708691 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb66c15a580 msgr2=0x7fb66c0b2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.628+0000 7fb663fff640 1 --2- 172.21.15.37:0/2064708691 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb66c15a580 0x7fb66c0b2bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.628+0000 7fb663fff640 1 -- 172.21.15.37:0/2064708691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb66c0b1580 msgr2=0x7fb66c157b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.628+0000 7fb663fff640 1 --2- 172.21.15.37:0/2064708691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb66c0b1580 0x7fb66c157b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.628+0000 7fb663fff640 1 -- 172.21.15.37:0/2064708691 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb65c009400 con 0x7fb66c153900 2023-12-11T17:10:17.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.629+0000 7fb663fff640 1 --2- 172.21.15.37:0/2064708691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb66c153900 0x7fb66c1580a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb65400c730 tx=0x7fb65400cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.629+0000 7fa33c9fa640 1 --2- 172.21.15.37:0/706151263 >> v2:172.21.15.37:3300/0 conn(0x7fa3300067e0 0x7fa330006c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.629+0000 7fa33c9fa640 1 --2- 172.21.15.37:0/706151263 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa330005e60 0x7fa3300062a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.629+0000 7fa33c9fa640 1 -- 172.21.15.37:0/706151263 >> 172.21.15.37:0/706151263 conn(0x7fa330009f80 msgr2=0x7fa33000a360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.629+0000 7fb668ff9640 1 -- 172.21.15.37:0/2064708691 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb654005a90 con 0x7fb66c153900 2023-12-11T17:10:17.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.629+0000 7fb6721e3640 1 -- 172.21.15.37:0/2064708691 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb66c158b70 con 0x7fb66c153900 2023-12-11T17:10:17.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.630+0000 7fa33c9fa640 1 -- 172.21.15.37:0/706151263 shutdown_connections 2023-12-11T17:10:17.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.630+0000 7fb668ff9640 1 -- 172.21.15.37:0/2064708691 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb654005bf0 con 0x7fb66c153900 2023-12-11T17:10:17.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.630+0000 7fb668ff9640 1 -- 172.21.15.37:0/2064708691 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb654007070 con 0x7fb66c153900 2023-12-11T17:10:17.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.630+0000 7fa33c9fa640 1 -- 172.21.15.37:0/706151263 wait complete. 2023-12-11T17:10:17.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.630+0000 7f44deffd640 1 --2- 172.21.15.37:0/1771273651 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f44cc06ae30 0x7f44cc06d2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f44d002b970 tx=0x7f44d003c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.630+0000 7fb6721e3640 1 -- 172.21.15.37:0/2064708691 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb66c159130 con 0x7fb66c153900 2023-12-11T17:10:17.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.632+0000 7fb6721e3640 1 -- 172.21.15.37:0/2064708691 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb66c144f40 con 0x7fb66c153900 2023-12-11T17:10:17.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.633+0000 7fa33c9fa640 1 Processor -- start 2023-12-11T17:10:17.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.634+0000 7ff0827fc640 1 -- 172.21.15.37:0/1009840230 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff08414f590 con 0x7ff084158fc0 2023-12-11T17:10:17.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.634+0000 7f72dffff640 1 -- 172.21.15.37:0/2928848146 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f40a6ea0 con 0x7f72ec0e3130 2023-12-11T17:10:17.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.634+0000 7f72dffff640 1 -- 172.21.15.37:0/2928848146 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72f40b7610 con 0x7f72ec0e3130 2023-12-11T17:10:17.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.633+0000 7fa33c9fa640 1 -- start start 2023-12-11T17:10:17.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.634+0000 7f72dffff640 1 -- 172.21.15.37:0/2928848146 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72f40b79c0 con 0x7f72ec0e3130 2023-12-11T17:10:17.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.634+0000 7fa33c9fa640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa330005e60 0x7fa3300cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.634+0000 7fa33c9fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3300067e0 0x7fa3300eb140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.634+0000 7fa33c9fa640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3300eacd0 0x7fa3300ed3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.634+0000 7fa33c9fa640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3300eb680 con 0x7fa3300067e0 2023-12-11T17:10:17.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.635+0000 7f72f8a39640 1 -- 172.21.15.37:0/2928848146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ec04e930 con 0x7f72ec0e3130 2023-12-11T17:10:17.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.634+0000 7fa33c9fa640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3300ec4c0 con 0x7fa3300eacd0 2023-12-11T17:10:17.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.635+0000 7f72f8a39640 1 -- 172.21.15.37:0/2928848146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ec0e38a0 con 0x7f72ec0e3130 2023-12-11T17:10:17.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.634+0000 7fa33c9fa640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3300eb8b0 con 0x7fa330005e60 2023-12-11T17:10:17.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.635+0000 7fa33659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3300067e0 0x7fa3300eb140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.633+0000 7fb668ff9640 1 -- 172.21.15.37:0/2064708691 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb6540071d0 con 0x7fb66c153900 2023-12-11T17:10:17.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.636+0000 7fb668ff9640 1 --2- 172.21.15.37:0/2064708691 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb64c06ae40 0x7fb64c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.635+0000 7fa33759e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3300eacd0 0x7fa3300ed3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.636+0000 7fb668ff9640 1 -- 172.21.15.37:0/2064708691 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fb654088e80 con 0x7fb66c153900 2023-12-11T17:10:17.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.635+0000 7fa33659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3300067e0 0x7fa3300eb140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46858/0 (socket says 172.21.15.37:46858) 2023-12-11T17:10:17.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.635+0000 7fa33659c640 1 -- 172.21.15.37:0/2697135900 learned_addr learned my addr 172.21.15.37:0/2697135900 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:17.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.635+0000 7fa336d9d640 1 --2- 172.21.15.37:0/2697135900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa330005e60 0x7fa3300cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.636+0000 7fa33759e640 1 -- 172.21.15.37:0/2697135900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa330005e60 msgr2=0x7fa3300cdc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.636+0000 7fa33759e640 1 --2- 172.21.15.37:0/2697135900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa330005e60 0x7fa3300cdc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.636+0000 7fa33759e640 1 -- 172.21.15.37:0/2697135900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3300067e0 msgr2=0x7fa3300eb140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.636+0000 7fa33759e640 1 --2- 172.21.15.37:0/2697135900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3300067e0 0x7fa3300eb140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.636+0000 7fa33759e640 1 -- 172.21.15.37:0/2697135900 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa328009400 con 0x7fa3300eacd0 2023-12-11T17:10:17.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.637+0000 7fa33759e640 1 --2- 172.21.15.37:0/2697135900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3300eacd0 0x7fa3300ed3e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa32c00b410 tx=0x7fa32c00b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.636+0000 7fb66b7fe640 1 --2- 172.21.15.37:0/2064708691 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb64c06ae40 0x7fb64c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.651 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.637+0000 7f72ddffb640 1 -- 172.21.15.37:0/2928848146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72cc005250 con 0x7f72ec0e3130 2023-12-11T17:10:17.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.638+0000 7fb66b7fe640 1 --2- 172.21.15.37:0/2064708691 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb64c06ae40 0x7fb64c06d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb65c036000 tx=0x7fb65c03d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.638+0000 7f72dffff640 1 -- 172.21.15.37:0/2928848146 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f72f40b5040 con 0x7f72ec0e3130 2023-12-11T17:10:17.652 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.639+0000 7f72dffff640 1 --2- 172.21.15.37:0/2928848146 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f72d806ae40 0x7f72d806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.639+0000 7f72dffff640 1 -- 172.21.15.37:0/2928848146 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f72f4125760 con 0x7f72ec0e3130 2023-12-11T17:10:17.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.640+0000 7f72f37fe640 1 --2- 172.21.15.37:0/2928848146 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f72d806ae40 0x7f72d806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.641+0000 7f72f37fe640 1 --2- 172.21.15.37:0/2928848146 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f72d806ae40 0x7f72d806d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f72e8005880 tx=0x7f72e8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.649+0000 7f72dffff640 1 -- 172.21.15.37:0/2928848146 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f72f40f05c0 con 0x7f72ec0e3130 2023-12-11T17:10:17.653 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.653+0000 7f9dc58da640 1 Processor -- start 2023-12-11T17:10:17.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.653+0000 7f9dc58da640 1 -- start start 2023-12-11T17:10:17.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.655+0000 7f9dc58da640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9dc01607f0 0x7f9dc00ce770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.655+0000 7f9dc58da640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9dc00cecb0 0x7f9dc00cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.655+0000 7f9dc58da640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dc00b6fe0 con 0x7f9dc00cff00 2023-12-11T17:10:17.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.655+0000 7f9dc58da640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc00d1be0 con 0x7f9dc01607f0 2023-12-11T17:10:17.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.655+0000 7f9dc58da640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dc00d0d50 con 0x7f9dc00cecb0 2023-12-11T17:10:17.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.655+0000 7f9dbeffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9dc01607f0 0x7f9dc00ce770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.656+0000 7f9dbeffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9dc01607f0 0x7f9dc00ce770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46864/0 (socket says 172.21.15.37:46864) 2023-12-11T17:10:17.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.656+0000 7f9dbeffd640 1 -- 172.21.15.37:0/117415517 learned_addr learned my addr 172.21.15.37:0/117415517 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:17.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.656+0000 7f9dbe7fc640 1 --2- 172.21.15.37:0/117415517 >> v2:172.21.15.151:3300/0 conn(0x7f9dc00cecb0 0x7f9dc00cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.656+0000 7f9dbeffd640 1 -- 172.21.15.37:0/117415517 >> v2:172.21.15.151:3300/0 conn(0x7f9dc00cecb0 msgr2=0x7f9dc00cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:17.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.656+0000 7f9dbeffd640 1 --2- 172.21.15.37:0/117415517 >> v2:172.21.15.151:3300/0 conn(0x7f9dc00cecb0 0x7f9dc00cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.656+0000 7f9dbeffd640 1 -- 172.21.15.37:0/117415517 >> v1:172.21.15.37:6789/0 conn(0x7f9dc00cff00 legacy=0x7f9dc0160ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.656+0000 7f9dbeffd640 1 -- 172.21.15.37:0/117415517 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dc00d0f60 con 0x7f9dc01607f0 2023-12-11T17:10:17.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.658+0000 7f9dbeffd640 1 --2- 172.21.15.37:0/117415517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dc01607f0 0x7f9dc00ce770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0073bb0 tx=0x7f9db002b920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3702ad9ac59d3b88 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.657+0000 7f44c77fe640 1 -- 172.21.15.37:0/1771273651 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f44e00cdc70 con 0x7f44d80eb2d0 2023-12-11T17:10:17.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.658+0000 7f9dbdffb640 1 -- 172.21.15.37:0/117415517 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db0031880 con 0x7f9dc01607f0 2023-12-11T17:10:17.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.658+0000 7f9dbdffb640 1 -- 172.21.15.37:0/117415517 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db00319e0 con 0x7f9dc01607f0 2023-12-11T17:10:17.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.658+0000 7f9dbdffb640 1 -- 172.21.15.37:0/117415517 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db0031d70 con 0x7f9dc01607f0 2023-12-11T17:10:17.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.659+0000 7f9dc58da640 1 -- 172.21.15.37:0/117415517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dc01607f0 msgr2=0x7f9dc00ce770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.659+0000 7f9dc58da640 1 --2- 172.21.15.37:0/117415517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dc01607f0 0x7f9dc00ce770 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9dc0073bb0 tx=0x7f9db002b920 comp rx=0 tx=0).stop 2023-12-11T17:10:17.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.660+0000 7f9dc58da640 1 -- 172.21.15.37:0/117415517 shutdown_connections 2023-12-11T17:10:17.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.660+0000 7f9dc58da640 1 --2- 172.21.15.37:0/117415517 >> v2:172.21.15.151:3300/0 conn(0x7f9dc00cecb0 0x7f9dc00cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.660+0000 7f9dc58da640 1 --2- 172.21.15.37:0/117415517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dc01607f0 0x7f9dc00ce770 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.660+0000 7f9dc58da640 1 -- 172.21.15.37:0/117415517 >> 172.21.15.37:0/117415517 conn(0x7f9dc009c450 msgr2=0x7f9dc00d3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.660+0000 7f9dc58da640 1 -- 172.21.15.37:0/117415517 shutdown_connections 2023-12-11T17:10:17.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.660+0000 7f9dc58da640 1 -- 172.21.15.37:0/117415517 wait complete. 2023-12-11T17:10:17.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.663+0000 7f9dc58da640 1 Processor -- start 2023-12-11T17:10:17.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.663+0000 7fa31f7fe640 1 -- 172.21.15.37:0/2697135900 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c011830 con 0x7fa3300eacd0 2023-12-11T17:10:17.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.663+0000 7fa31f7fe640 1 -- 172.21.15.37:0/2697135900 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa32c011990 con 0x7fa3300eacd0 2023-12-11T17:10:17.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.663+0000 7fa31f7fe640 1 -- 172.21.15.37:0/2697135900 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa32c011d40 con 0x7fa3300eacd0 2023-12-11T17:10:17.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.663+0000 7fb668ff9640 1 -- 172.21.15.37:0/2064708691 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb654053c50 con 0x7fb66c153900 2023-12-11T17:10:17.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.663+0000 7f9dc58da640 1 -- start start 2023-12-11T17:10:17.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.664+0000 7fa33c9fa640 1 -- 172.21.15.37:0/2697135900 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3300ebb90 con 0x7fa3300eacd0 2023-12-11T17:10:17.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.664+0000 7fa33c9fa640 1 -- 172.21.15.37:0/2697135900 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3300ec150 con 0x7fa3300eacd0 2023-12-11T17:10:17.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.665+0000 7f9dc58da640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9dc00cecb0 0x7f9dc0149130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.665+0000 7f9dc58da640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dc00cff00 0x7f9dc00c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.665+0000 7f9dc58da640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dc01607f0 0x7f9dc00ca250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.665+0000 7f9dc58da640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc015d250 con 0x7f9dc00cff00 2023-12-11T17:10:17.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.665+0000 7f9dc58da640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc0149670 con 0x7f9dc01607f0 2023-12-11T17:10:17.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.665+0000 7f9dc58da640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dc00c7bd0 con 0x7f9dc00cecb0 2023-12-11T17:10:17.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.666+0000 7f9dbe7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dc00cff00 0x7f9dc00c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.666+0000 7f9dbeffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9dc00cecb0 0x7f9dc0149130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.668+0000 7f9dbeffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9dc00cecb0 0x7f9dc0149130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.37:42716/0 (socket says 172.21.15.37:42716) 2023-12-11T17:10:17.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.668+0000 7f9dbeffd640 1 -- 172.21.15.37:0/90775765 learned_addr learned my addr 172.21.15.37:0/90775765 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:17.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.667+0000 7fda09cbb640 1 Processor -- start 2023-12-11T17:10:17.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.668+0000 7fda09cbb640 1 -- start start 2023-12-11T17:10:17.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.667+0000 7f9dbf7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dc01607f0 0x7f9dc00ca250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.669+0000 7f9dbe7fc640 1 -- 172.21.15.37:0/90775765 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9dc00cecb0 msgr2=0x7f9dc0149130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.669+0000 7f9dbe7fc640 1 --2- 172.21.15.37:0/90775765 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9dc00cecb0 0x7f9dc0149130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.669+0000 7f9dbe7fc640 1 -- 172.21.15.37:0/90775765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dc01607f0 msgr2=0x7f9dc00ca250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.669+0000 7f9dbe7fc640 1 --2- 172.21.15.37:0/90775765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dc01607f0 0x7f9dc00ca250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.669+0000 7f9dbe7fc640 1 -- 172.21.15.37:0/90775765 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9db00094d0 con 0x7f9dc00cff00 2023-12-11T17:10:17.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.669+0000 7f9dbe7fc640 1 --2- 172.21.15.37:0/90775765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dc00cff00 0x7f9dc00c8c70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9db400e870 tx=0x7f9db400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.670+0000 7fda09cbb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda0416e100 0x7fda040ad270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.670+0000 7f9da7fff640 1 -- 172.21.15.37:0/90775765 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db400ee60 con 0x7f9dc00cff00 2023-12-11T17:10:17.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.669+0000 7fa33c9fa640 1 -- 172.21.15.37:0/2697135900 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa330033df0 con 0x7fa3300eacd0 2023-12-11T17:10:17.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.669+0000 7fa31f7fe640 1 -- 172.21.15.37:0/2697135900 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa32c01a400 con 0x7fa3300eacd0 2023-12-11T17:10:17.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.670+0000 7fda09cbb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda040cd750 con 0x7fda0406c5f0 2023-12-11T17:10:17.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.670+0000 7fda09cbb640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda040add30 con 0x7fda04071270 2023-12-11T17:10:17.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.670+0000 7fda09cbb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda040cd1d0 con 0x7fda0416e100 2023-12-11T17:10:17.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.670+0000 7f9da7fff640 1 -- 172.21.15.37:0/90775765 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9db400c940 con 0x7f9dc00cff00 2023-12-11T17:10:17.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.670+0000 7f9dc58da640 1 -- 172.21.15.37:0/90775765 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dc00c7eb0 con 0x7f9dc00cff00 2023-12-11T17:10:17.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.670+0000 7f9da7fff640 1 -- 172.21.15.37:0/90775765 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9db400ccd0 con 0x7f9dc00cff00 2023-12-11T17:10:17.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.670+0000 7f9dc58da640 1 -- 172.21.15.37:0/90775765 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dc00c8470 con 0x7f9dc00cff00 2023-12-11T17:10:17.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.671+0000 7fda037fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda0416e100 0x7fda040ad270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.671+0000 7fda02ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fda0406c5f0 0x7fda04070b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:42980/0 (socket says 172.21.15.37:42980) 2023-12-11T17:10:17.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.671+0000 7fda02ffd640 1 -- 172.21.15.37:0/3905864081 learned_addr learned my addr 172.21.15.37:0/3905864081 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:17.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.671+0000 7fa31f7fe640 1 --2- 172.21.15.37:0/2697135900 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa32406af10 0x7fa32406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.671+0000 7fa31f7fe640 1 -- 172.21.15.37:0/2697135900 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa32c089900 con 0x7fa3300eacd0 2023-12-11T17:10:17.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.672+0000 7fda027fc640 1 -- 172.21.15.37:0/3905864081 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1552770240 0 0) 0x7fda040add30 con 0x7fda04071270 2023-12-11T17:10:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.672+0000 7fda027fc640 1 -- 172.21.15.37:0/3905864081 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd9ec003520 con 0x7fda04071270 2023-12-11T17:10:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.672+0000 7fda027fc640 1 -- 172.21.15.37:0/3905864081 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2935374847 0 0) 0x7fda040cd750 con 0x7fda0406c5f0 2023-12-11T17:10:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.672+0000 7fda027fc640 1 -- 172.21.15.37:0/3905864081 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda040add30 con 0x7fda0406c5f0 2023-12-11T17:10:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.673+0000 7fda037fe640 1 -- 172.21.15.37:0/3905864081 >> v1:172.21.15.151:6789/0 conn(0x7fda04071270 legacy=0x7fda040cdbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.673+0000 7fda037fe640 1 -- 172.21.15.37:0/3905864081 >> v1:172.21.15.37:6789/0 conn(0x7fda0406c5f0 legacy=0x7fda04070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.673+0000 7fda037fe640 1 -- 172.21.15.37:0/3905864081 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda040ae010 con 0x7fda0416e100 2023-12-11T17:10:17.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.672+0000 7f9dc58da640 1 -- 172.21.15.37:0/90775765 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9da0005250 con 0x7f9dc00cff00 2023-12-11T17:10:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.673+0000 7fa336d9d640 1 --2- 172.21.15.37:0/2697135900 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa32406af10 0x7fa32406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.674+0000 7fa336d9d640 1 --2- 172.21.15.37:0/2697135900 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa32406af10 0x7fa32406d3d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa338068ea0 tx=0x7fa338068ac0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.675+0000 7fda037fe640 1 --2- 172.21.15.37:0/3905864081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda0416e100 0x7fda040ad270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd9f40097d0 tx=0x7fd9f402b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d761208af5bdf698 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.675+0000 7f9da7fff640 1 -- 172.21.15.37:0/90775765 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9db4013470 con 0x7f9dc00cff00 2023-12-11T17:10:17.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.675+0000 7fda027fc640 1 -- 172.21.15.37:0/3905864081 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4031770 con 0x7fda0416e100 2023-12-11T17:10:17.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.675+0000 7fda027fc640 1 -- 172.21.15.37:0/3905864081 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f40318d0 con 0x7fda0416e100 2023-12-11T17:10:17.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.675+0000 7fda027fc640 1 -- 172.21.15.37:0/3905864081 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f4031c40 con 0x7fda0416e100 2023-12-11T17:10:17.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.676+0000 7f9da7fff640 1 --2- 172.21.15.37:0/90775765 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9dac06ae90 0x7f9dac06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.676+0000 7f9da7fff640 1 -- 172.21.15.37:0/90775765 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9db40897f0 con 0x7f9dc00cff00 2023-12-11T17:10:17.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.676+0000 7fda09cbb640 1 -- 172.21.15.37:0/3905864081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda0416e100 msgr2=0x7fda040ad270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.676+0000 7fda09cbb640 1 --2- 172.21.15.37:0/3905864081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda0416e100 0x7fda040ad270 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fd9f40097d0 tx=0x7fd9f402b810 comp rx=0 tx=0).stop 2023-12-11T17:10:17.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.677+0000 7f9dbeffd640 1 --2- 172.21.15.37:0/90775765 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9dac06ae90 0x7f9dac06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.678+0000 7fda09cbb640 1 -- 172.21.15.37:0/3905864081 shutdown_connections 2023-12-11T17:10:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.678+0000 7fda09cbb640 1 --2- 172.21.15.37:0/3905864081 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda0416e100 0x7fda040ad270 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.678+0000 7fda09cbb640 1 -- 172.21.15.37:0/3905864081 >> 172.21.15.37:0/3905864081 conn(0x7fda040b0a90 msgr2=0x7fda040b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:17.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.678+0000 7f9dbeffd640 1 --2- 172.21.15.37:0/90775765 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9dac06ae90 0x7f9dac06d350 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9db002b960 tx=0x7f9db003c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.678+0000 7fda09cbb640 1 -- 172.21.15.37:0/3905864081 shutdown_connections 2023-12-11T17:10:17.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.678+0000 7fda09cbb640 1 -- 172.21.15.37:0/3905864081 wait complete. 2023-12-11T17:10:17.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.682+0000 7fda09cbb640 1 Processor -- start 2023-12-11T17:10:17.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.682+0000 7fda09cbb640 1 -- start start 2023-12-11T17:10:17.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.684+0000 7fda09cbb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda0406c5f0 0x7fda0415c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.684+0000 7fda09cbb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda04071270 0x7fda041707f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.684+0000 7fda09cbb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda0416e100 0x7fda04170d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.684+0000 7fda02ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda04071270 0x7fda041707f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.684+0000 7fda02ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda04071270 0x7fda041707f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46880/0 (socket says 172.21.15.37:46880) 2023-12-11T17:10:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.685+0000 7fda09cbb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0415cce0 con 0x7fda04071270 2023-12-11T17:10:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.685+0000 7f9da7fff640 1 -- 172.21.15.37:0/90775765 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9db40546b0 con 0x7f9dc00cff00 2023-12-11T17:10:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.685+0000 7fda037fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda0406c5f0 0x7fda0415c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.685+0000 7fda03fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda0416e100 0x7fda04170d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.685+0000 7fda03fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda0416e100 0x7fda04170d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:52210/0 (socket says 172.21.15.37:52210) 2023-12-11T17:10:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.685+0000 7fda03fff640 1 -- 172.21.15.37:0/1756553883 learned_addr learned my addr 172.21.15.37:0/1756553883 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.685+0000 7fda09cbb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda0416cc90 con 0x7fda0416e100 2023-12-11T17:10:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.685+0000 7fda09cbb640 1 -- 172.21.15.37:0/1756553883 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda0416a680 con 0x7fda0406c5f0 2023-12-11T17:10:17.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.686+0000 7fda02ffd640 1 -- 172.21.15.37:0/1756553883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda0406c5f0 msgr2=0x7fda0415c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.686+0000 7fda02ffd640 1 --2- 172.21.15.37:0/1756553883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda0406c5f0 0x7fda0415c7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.686+0000 7fda02ffd640 1 -- 172.21.15.37:0/1756553883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda0416e100 msgr2=0x7fda04170d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:17.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.686+0000 7fda02ffd640 1 --2- 172.21.15.37:0/1756553883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda0416e100 0x7fda04170d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:17.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.686+0000 7fda02ffd640 1 -- 172.21.15.37:0/1756553883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9f4009400 con 0x7fda04071270 2023-12-11T17:10:17.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.687+0000 7fda03fff640 1 --2- 172.21.15.37:0/1756553883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda0416e100 0x7fda04170d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:10:17.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.687+0000 7fa31f7fe640 1 -- 172.21.15.37:0/2697135900 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa32c0546a0 con 0x7fa3300eacd0 2023-12-11T17:10:17.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.687+0000 7fda02ffd640 1 --2- 172.21.15.37:0/1756553883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda04071270 0x7fda041707f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd9f800c450 tx=0x7fd9f800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.687+0000 7fd9ebfff640 1 -- 172.21.15.37:0/1756553883 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f80074e0 con 0x7fda04071270 2023-12-11T17:10:17.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.687+0000 7fda09cbb640 1 -- 172.21.15.37:0/1756553883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda0416a960 con 0x7fda04071270 2023-12-11T17:10:17.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.688+0000 7fda09cbb640 1 -- 172.21.15.37:0/1756553883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda0416af20 con 0x7fda04071270 2023-12-11T17:10:17.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.688+0000 7fd9ebfff640 1 -- 172.21.15.37:0/1756553883 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9f8007640 con 0x7fda04071270 2023-12-11T17:10:17.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.688+0000 7fd9ebfff640 1 -- 172.21.15.37:0/1756553883 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd9f8004a00 con 0x7fda04071270 2023-12-11T17:10:17.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.692+0000 7fda09cbb640 1 -- 172.21.15.37:0/1756553883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9e4005250 con 0x7fda04071270 2023-12-11T17:10:17.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.693+0000 7fd9ebfff640 1 -- 172.21.15.37:0/1756553883 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd9f8004b60 con 0x7fda04071270 2023-12-11T17:10:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.694+0000 7fd9ebfff640 1 --2- 172.21.15.37:0/1756553883 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fd9f006af10 0x7fd9f006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:17.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.699+0000 7fd9ebfff640 1 -- 172.21.15.37:0/1756553883 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd9f8088e30 con 0x7fda04071270 2023-12-11T17:10:17.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.699+0000 7fda037fe640 1 --2- 172.21.15.37:0/1756553883 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fd9f006af10 0x7fd9f006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:17.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.701+0000 7fda037fe640 1 --2- 172.21.15.37:0/1756553883 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fd9f006af10 0x7fd9f006d3d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4036000 tx=0x7fd9f4008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:17.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:17.702+0000 7fd9ebfff640 1 -- 172.21.15.37:0/1756553883 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd9f8053d40 con 0x7fda04071270 2023-12-11T17:10:18.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.036+0000 7feeefbd7640 1 -- 172.21.15.37:0/3362450195 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7feed0005500 con 0x7feed4004f80 2023-12-11T17:10:18.040 INFO:teuthology.orchestra.run.smithi037.stdout:60129542153 2023-12-11T17:10:18.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.037+0000 7feede7fc640 1 -- 172.21.15.37:0/3362450195 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7feed8057230 con 0x7feed4004f80 2023-12-11T17:10:18.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.039+0000 7ff08a92e640 1 -- 172.21.15.37:0/1009840230 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7ff08414f590 con 0x7ff084158fc0 2023-12-11T17:10:18.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.040+0000 7ff0827fc640 1 -- 172.21.15.37:0/1009840230 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff08414f590 con 0x7ff084158fc0 2023-12-11T17:10:18.041 INFO:teuthology.orchestra.run.smithi037.stdout:60129542153 2023-12-11T17:10:18.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.041+0000 7feeefbd7640 1 -- 172.21.15.37:0/3362450195 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7feecc06af10 msgr2=0x7feecc06d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:18.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.041+0000 7feeefbd7640 1 --2- 172.21.15.37:0/3362450195 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7feecc06af10 0x7feecc06d3d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feee00552b0 tx=0x7feee4008040 comp rx=0 tx=0).stop 2023-12-11T17:10:18.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.041+0000 7feeefbd7640 1 -- 172.21.15.37:0/3362450195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feed4004f80 msgr2=0x7feee00d5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:18.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.041+0000 7feeefbd7640 1 --2- 172.21.15.37:0/3362450195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feed4004f80 0x7feee00d5950 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7feed800c3c0 tx=0x7feed800c880 comp rx=0 tx=0).stop 2023-12-11T17:10:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.041+0000 7feeefbd7640 1 -- 172.21.15.37:0/3362450195 shutdown_connections 2023-12-11T17:10:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.041+0000 7feeefbd7640 1 --2- 172.21.15.37:0/3362450195 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7feecc06af10 0x7feecc06d3d0 secure :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7feee00552b0 tx=0x7feee4008040 comp rx=0 tx=0).stop 2023-12-11T17:10:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.041+0000 7feeefbd7640 1 --2- 172.21.15.37:0/3362450195 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feee00d0af0 0x7feee00d7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.041+0000 7feeefbd7640 1 --2- 172.21.15.37:0/3362450195 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feee004ffe0 0x7feee00d05b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.041+0000 7feeefbd7640 1 --2- 172.21.15.37:0/3362450195 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feed4004f80 0x7feee00d5950 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.041+0000 7feeefbd7640 1 -- 172.21.15.37:0/3362450195 >> 172.21.15.37:0/3362450195 conn(0x7feee00559b0 msgr2=0x7feee0057350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:18.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.042+0000 7feeefbd7640 1 -- 172.21.15.37:0/3362450195 shutdown_connections 2023-12-11T17:10:18.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.042+0000 7feeefbd7640 1 -- 172.21.15.37:0/3362450195 wait complete. 2023-12-11T17:10:18.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.044+0000 7ff08a92e640 1 -- 172.21.15.37:0/1009840230 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff06806af40 msgr2=0x7ff06806d400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:18.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.044+0000 7ff08a92e640 1 --2- 172.21.15.37:0/1009840230 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff06806af40 0x7ff06806d400 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7ff0780012e0 tx=0x7ff078009040 comp rx=0 tx=0).stop 2023-12-11T17:10:18.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.044+0000 7ff08a92e640 1 -- 172.21.15.37:0/1009840230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff084158fc0 msgr2=0x7ff08413d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:18.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.044+0000 7ff08a92e640 1 --2- 172.21.15.37:0/1009840230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff084158fc0 0x7ff08413d860 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7ff07c00e8d0 tx=0x7ff07c00ed90 comp rx=0 tx=0).stop 2023-12-11T17:10:18.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.044+0000 7ff08a92e640 1 -- 172.21.15.37:0/1009840230 shutdown_connections 2023-12-11T17:10:18.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.044+0000 7ff08a92e640 1 --2- 172.21.15.37:0/1009840230 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff06806af40 0x7ff06806d400 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.044+0000 7ff08a92e640 1 --2- 172.21.15.37:0/1009840230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0840b3b00 0x7ff08413d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.044+0000 7ff08a92e640 1 --2- 172.21.15.37:0/1009840230 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff084158fc0 0x7ff08413d860 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.044+0000 7ff08a92e640 1 --2- 172.21.15.37:0/1009840230 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff0840b2700 0x7ff084099c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.044+0000 7ff08a92e640 1 -- 172.21.15.37:0/1009840230 >> 172.21.15.37:0/1009840230 conn(0x7ff08406a460 msgr2=0x7ff084156950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:18.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.045+0000 7ff08a92e640 1 -- 172.21.15.37:0/1009840230 shutdown_connections 2023-12-11T17:10:18.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.045+0000 7ff08a92e640 1 -- 172.21.15.37:0/1009840230 wait complete. 2023-12-11T17:10:18.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.072+0000 7f72ddffb640 1 -- 172.21.15.37:0/2928848146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f72cc005500 con 0x7f72ec0e3130 2023-12-11T17:10:18.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.072+0000 7f72dffff640 1 -- 172.21.15.37:0/2928848146 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f72f40f3be0 con 0x7f72ec0e3130 2023-12-11T17:10:18.074 INFO:teuthology.orchestra.run.smithi037.stdout:60129542153 2023-12-11T17:10:18.074 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.1 2023-12-11T17:10:18.075 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.0 2023-12-11T17:10:18.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.076+0000 7f72ddffb640 1 -- 172.21.15.37:0/2928848146 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f72d806ae40 msgr2=0x7f72d806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.076+0000 7f72ddffb640 1 --2- 172.21.15.37:0/2928848146 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f72d806ae40 0x7f72d806d300 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f72e8005880 tx=0x7f72e8009040 comp rx=0 tx=0).stop 2023-12-11T17:10:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.076+0000 7f72ddffb640 1 -- 172.21.15.37:0/2928848146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72ec0e3130 msgr2=0x7f72ec03d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:18.077 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.076+0000 7f72ddffb640 1 --2- 172.21.15.37:0/2928848146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72ec0e3130 0x7f72ec03d650 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f72f4068ea0 tx=0x7f72f4069ea0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.076+0000 7f72ddffb640 1 -- 172.21.15.37:0/2928848146 shutdown_connections 2023-12-11T17:10:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.076+0000 7f72ddffb640 1 --2- 172.21.15.37:0/2928848146 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f72d806ae40 0x7f72d806d300 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.076+0000 7f72ddffb640 1 --2- 172.21.15.37:0/2928848146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f72ec053c80 0x7f72ec04d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.076+0000 7f72ddffb640 1 --2- 172.21.15.37:0/2928848146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f72ec0e3130 0x7f72ec03d650 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.076+0000 7f72ddffb640 1 --2- 172.21.15.37:0/2928848146 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f72ec03c070 0x7f72ec0e0670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.076+0000 7f72ddffb640 1 -- 172.21.15.37:0/2928848146 >> 172.21.15.37:0/2928848146 conn(0x7f72ec058eb0 msgr2=0x7f72ec039c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.076+0000 7f72ddffb640 1 -- 172.21.15.37:0/2928848146 shutdown_connections 2023-12-11T17:10:18.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.076+0000 7f72ddffb640 1 -- 172.21.15.37:0/2928848146 wait complete. 2023-12-11T17:10:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.079+0000 7f44c57fa640 1 -- 172.21.15.37:0/1771273651 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f44d80e6a20 con 0x7f44d80eb2d0 2023-12-11T17:10:18.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.080+0000 7f44c77fe640 1 -- 172.21.15.37:0/1771273651 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f44e00d1290 con 0x7f44d80eb2d0 2023-12-11T17:10:18.081 INFO:teuthology.orchestra.run.smithi037.stdout:60129542154 2023-12-11T17:10:18.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.082+0000 7f44c57fa640 1 -- 172.21.15.37:0/1771273651 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f44cc06ae30 msgr2=0x7f44cc06d2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.082+0000 7f44c57fa640 1 --2- 172.21.15.37:0/1771273651 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f44cc06ae30 0x7f44cc06d2f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f44d002b970 tx=0x7f44d003c040 comp rx=0 tx=0).stop 2023-12-11T17:10:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.082+0000 7f44c57fa640 1 -- 172.21.15.37:0/1771273651 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44d80eb2d0 msgr2=0x7f44d8052550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.082+0000 7f44c57fa640 1 --2- 172.21.15.37:0/1771273651 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44d80eb2d0 0x7f44d8052550 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f44e0063e60 tx=0x7f44e0067ed0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.082+0000 7f44c57fa640 1 -- 172.21.15.37:0/1771273651 shutdown_connections 2023-12-11T17:10:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.082+0000 7f44c57fa640 1 --2- 172.21.15.37:0/1771273651 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f44cc06ae30 0x7f44cc06d2f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.082+0000 7f44c57fa640 1 --2- 172.21.15.37:0/1771273651 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f44d80eb2d0 0x7f44d8052550 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.082+0000 7f44c57fa640 1 --2- 172.21.15.37:0/1771273651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f44d80e77f0 0x7f44d8009c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.082+0000 7f44c57fa640 1 --2- 172.21.15.37:0/1771273651 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f44d8006170 0x7f44d80dee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.082+0000 7f44c57fa640 1 -- 172.21.15.37:0/1771273651 >> 172.21.15.37:0/1771273651 conn(0x7f44d80559b0 msgr2=0x7f44d80e59b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.083+0000 7f44c57fa640 1 -- 172.21.15.37:0/1771273651 shutdown_connections 2023-12-11T17:10:18.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.083+0000 7f44c57fa640 1 -- 172.21.15.37:0/1771273651 wait complete. 2023-12-11T17:10:18.088 INFO:teuthology.orchestra.run.smithi037.stdout:60129542153 2023-12-11T17:10:18.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.084+0000 7fb6721e3640 1 -- 172.21.15.37:0/2064708691 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fb66c06d650 con 0x7fb66c153900 2023-12-11T17:10:18.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.085+0000 7fb668ff9640 1 -- 172.21.15.37:0/2064708691 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb66c06d650 con 0x7fb66c153900 2023-12-11T17:10:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.088+0000 7fb6721e3640 1 -- 172.21.15.37:0/2064708691 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb64c06ae40 msgr2=0x7fb64c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.088+0000 7fb6721e3640 1 --2- 172.21.15.37:0/2064708691 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb64c06ae40 0x7fb64c06d300 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fb65c036000 tx=0x7fb65c03d040 comp rx=0 tx=0).stop 2023-12-11T17:10:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.088+0000 7fb6721e3640 1 -- 172.21.15.37:0/2064708691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb66c153900 msgr2=0x7fb66c1580a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.088+0000 7fb6721e3640 1 --2- 172.21.15.37:0/2064708691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb66c153900 0x7fb66c1580a0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb65400c730 tx=0x7fb65400cbf0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.089+0000 7fb6721e3640 1 -- 172.21.15.37:0/2064708691 shutdown_connections 2023-12-11T17:10:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.089+0000 7fb6721e3640 1 --2- 172.21.15.37:0/2064708691 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb64c06ae40 0x7fb64c06d300 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.089+0000 7fb6721e3640 1 --2- 172.21.15.37:0/2064708691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb66c153900 0x7fb66c1580a0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.089+0000 7fb6721e3640 1 --2- 172.21.15.37:0/2064708691 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb66c15a580 0x7fb66c0b2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.089+0000 7fb6721e3640 1 --2- 172.21.15.37:0/2064708691 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb66c0b1580 0x7fb66c157b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.089+0000 7fb6721e3640 1 -- 172.21.15.37:0/2064708691 >> 172.21.15.37:0/2064708691 conn(0x7fb66c0b0a90 msgr2=0x7fb66c0aea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.089+0000 7fb6721e3640 1 -- 172.21.15.37:0/2064708691 shutdown_connections 2023-12-11T17:10:18.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.089+0000 7fb6721e3640 1 -- 172.21.15.37:0/2064708691 wait complete. 2023-12-11T17:10:18.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.091+0000 7fa33c9fa640 1 -- 172.21.15.37:0/2697135900 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fa3300374b0 con 0x7fa3300eacd0 2023-12-11T17:10:18.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.092+0000 7fa31f7fe640 1 -- 172.21.15.37:0/2697135900 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa32c057cc0 con 0x7fa3300eacd0 2023-12-11T17:10:18.093 INFO:teuthology.orchestra.run.smithi037.stdout:60129542152 2023-12-11T17:10:18.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.095+0000 7fa33c9fa640 1 -- 172.21.15.37:0/2697135900 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa32406af10 msgr2=0x7fa32406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:18.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.095+0000 7fa33c9fa640 1 --2- 172.21.15.37:0/2697135900 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa32406af10 0x7fa32406d3d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fa338068ea0 tx=0x7fa338068ac0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.095+0000 7fa33c9fa640 1 -- 172.21.15.37:0/2697135900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3300eacd0 msgr2=0x7fa3300ed3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:18.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.095+0000 7fa33c9fa640 1 --2- 172.21.15.37:0/2697135900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3300eacd0 0x7fa3300ed3e0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa32c00b410 tx=0x7fa32c00b810 comp rx=0 tx=0).stop 2023-12-11T17:10:18.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.095+0000 7fa33c9fa640 1 -- 172.21.15.37:0/2697135900 shutdown_connections 2023-12-11T17:10:18.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.095+0000 7fa33c9fa640 1 --2- 172.21.15.37:0/2697135900 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa32406af10 0x7fa32406d3d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.095+0000 7fa33c9fa640 1 --2- 172.21.15.37:0/2697135900 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa3300eacd0 0x7fa3300ed3e0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.095+0000 7fa33c9fa640 1 --2- 172.21.15.37:0/2697135900 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3300067e0 0x7fa3300eb140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.095+0000 7fa33c9fa640 1 --2- 172.21.15.37:0/2697135900 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa330005e60 0x7fa3300cdc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.096 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.095+0000 7fa33c9fa640 1 -- 172.21.15.37:0/2697135900 >> 172.21.15.37:0/2697135900 conn(0x7fa330009f80 msgr2=0x7fa33004db70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:18.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.095+0000 7fa33c9fa640 1 -- 172.21.15.37:0/2697135900 shutdown_connections 2023-12-11T17:10:18.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.095+0000 7fa33c9fa640 1 -- 172.21.15.37:0/2697135900 wait complete. 2023-12-11T17:10:18.106 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542154 for osd.3 2023-12-11T17:10:18.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.5 2023-12-11T17:10:18.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.108+0000 7f9dc58da640 1 -- 172.21.15.37:0/90775765 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f9da00057d0 con 0x7f9dc00cff00 2023-12-11T17:10:18.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.108+0000 7f9da7fff640 1 -- 172.21.15.37:0/90775765 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9db4017090 con 0x7f9dc00cff00 2023-12-11T17:10:18.109 INFO:teuthology.orchestra.run.smithi037.stdout:60129542152 2023-12-11T17:10:18.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.110+0000 7f9dc58da640 1 -- 172.21.15.37:0/90775765 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9dac06ae90 msgr2=0x7f9dac06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:18.111 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.110+0000 7f9dc58da640 1 --2- 172.21.15.37:0/90775765 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9dac06ae90 0x7f9dac06d350 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9db002b960 tx=0x7f9db003c040 comp rx=0 tx=0).stop 2023-12-11T17:10:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.110+0000 7f9dc58da640 1 -- 172.21.15.37:0/90775765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dc00cff00 msgr2=0x7f9dc00c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.110+0000 7f9dc58da640 1 --2- 172.21.15.37:0/90775765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dc00cff00 0x7f9dc00c8c70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9db400e870 tx=0x7f9db400ed30 comp rx=0 tx=0).stop 2023-12-11T17:10:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.110+0000 7f9dc58da640 1 -- 172.21.15.37:0/90775765 shutdown_connections 2023-12-11T17:10:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.110+0000 7f9dc58da640 1 --2- 172.21.15.37:0/90775765 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9dac06ae90 0x7f9dac06d350 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.110+0000 7f9dc58da640 1 --2- 172.21.15.37:0/90775765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9dc01607f0 0x7f9dc00ca250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.110+0000 7f9dc58da640 1 --2- 172.21.15.37:0/90775765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dc00cff00 0x7f9dc00c8c70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.110+0000 7f9dc58da640 1 --2- 172.21.15.37:0/90775765 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9dc00cecb0 0x7f9dc0149130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.110+0000 7f9dc58da640 1 -- 172.21.15.37:0/90775765 >> 172.21.15.37:0/90775765 conn(0x7f9dc009c450 msgr2=0x7f9dc00b7290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.110+0000 7f9dc58da640 1 -- 172.21.15.37:0/90775765 shutdown_connections 2023-12-11T17:10:18.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.110+0000 7f9dc58da640 1 -- 172.21.15.37:0/90775765 wait complete. 2023-12-11T17:10:18.115 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.2 2023-12-11T17:10:18.116 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.4 2023-12-11T17:10:18.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.120+0000 7fda09cbb640 1 -- 172.21.15.37:0/1756553883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fd9e4005500 con 0x7fda04071270 2023-12-11T17:10:18.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.120+0000 7fd9ebfff640 1 -- 172.21.15.37:0/1756553883 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd9f8018070 con 0x7fda04071270 2023-12-11T17:10:18.121 INFO:teuthology.orchestra.run.smithi037.stdout:60129542153 2023-12-11T17:10:18.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.123+0000 7fda09cbb640 1 -- 172.21.15.37:0/1756553883 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fd9f006af10 msgr2=0x7fd9f006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:18.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.123+0000 7fda09cbb640 1 --2- 172.21.15.37:0/1756553883 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fd9f006af10 0x7fd9f006d3d0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd9f4036000 tx=0x7fd9f4008030 comp rx=0 tx=0).stop 2023-12-11T17:10:18.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.123+0000 7fda09cbb640 1 -- 172.21.15.37:0/1756553883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda04071270 msgr2=0x7fda041707f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:18.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.123+0000 7fda09cbb640 1 --2- 172.21.15.37:0/1756553883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda04071270 0x7fda041707f0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd9f800c450 tx=0x7fd9f800c910 comp rx=0 tx=0).stop 2023-12-11T17:10:18.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.123+0000 7fda09cbb640 1 -- 172.21.15.37:0/1756553883 shutdown_connections 2023-12-11T17:10:18.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.123+0000 7fda09cbb640 1 --2- 172.21.15.37:0/1756553883 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fd9f006af10 0x7fd9f006d3d0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.123+0000 7fda09cbb640 1 --2- 172.21.15.37:0/1756553883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fda0416e100 0x7fda04170d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.123+0000 7fda09cbb640 1 --2- 172.21.15.37:0/1756553883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fda04071270 0x7fda041707f0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.123+0000 7fda09cbb640 1 --2- 172.21.15.37:0/1756553883 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fda0406c5f0 0x7fda0415c7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:18.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.123+0000 7fda09cbb640 1 -- 172.21.15.37:0/1756553883 >> 172.21.15.37:0/1756553883 conn(0x7fda040b0a90 msgr2=0x7fda040cf130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:18.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.123+0000 7fda09cbb640 1 -- 172.21.15.37:0/1756553883 shutdown_connections 2023-12-11T17:10:18.125 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:18.123+0000 7fda09cbb640 1 -- 172.21.15.37:0/1756553883 wait complete. 2023-12-11T17:10:18.127 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542152 for osd.7 2023-12-11T17:10:18.140 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542153 for osd.6 2023-12-11T17:10:19.075 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-11T17:10:19.076 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-11T17:10:19.107 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-11T17:10:19.108 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-11T17:10:19.116 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-11T17:10:19.117 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-11T17:10:19.128 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-11T17:10:19.141 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-11T17:10:19.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.364+0000 7f52abfff640 1 Processor -- start 2023-12-11T17:10:19.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.364+0000 7f52abfff640 1 -- start start 2023-12-11T17:10:19.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.367+0000 7f52abfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f52a40e3130 0x7f52a40e7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.367+0000 7f52abfff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f52a403c070 0x7f52a4058020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.368+0000 7f52abfff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52a4058560 con 0x7f52a4053c80 2023-12-11T17:10:19.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.368+0000 7f52abfff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a4007b40 con 0x7f52a40e3130 2023-12-11T17:10:19.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.369+0000 7f52abfff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52a40587e0 con 0x7f52a403c070 2023-12-11T17:10:19.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.370+0000 7f52aa7fc640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f52a403c070 0x7f52a4058020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.370+0000 7f52aaffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f52a40e3130 0x7f52a40e7750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.371+0000 7f52aaffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f52a40e3130 0x7f52a40e7750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37920/0 (socket says 172.21.15.37:37920) 2023-12-11T17:10:19.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.371+0000 7f52aaffd640 1 -- 172.21.15.37:0/1685691998 learned_addr learned my addr 172.21.15.37:0/1685691998 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:19.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.370+0000 7f52ab7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f52a4053c80 0x7f52a40540d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41842/0 (socket says 172.21.15.37:41842) 2023-12-11T17:10:19.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.372+0000 7f52aaffd640 1 -- 172.21.15.37:0/1685691998 >> v2:172.21.15.151:3300/0 conn(0x7f52a403c070 msgr2=0x7f52a4058020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:19.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.372+0000 7f52aaffd640 1 --2- 172.21.15.37:0/1685691998 >> v2:172.21.15.151:3300/0 conn(0x7f52a403c070 0x7f52a4058020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.372+0000 7f52aaffd640 1 -- 172.21.15.37:0/1685691998 >> v1:172.21.15.37:6789/0 conn(0x7f52a4053c80 legacy=0x7f52a40540d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.372+0000 7f52aaffd640 1 -- 172.21.15.37:0/1685691998 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a4058ac0 con 0x7f52a40e3130 2023-12-11T17:10:19.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.373+0000 7f3ff7c90640 1 Processor -- start 2023-12-11T17:10:19.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.373+0000 7f3ff7c90640 1 -- start start 2023-12-11T17:10:19.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.375+0000 7f52aaffd640 1 --2- 172.21.15.37:0/1685691998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52a40e3130 0x7f52a40e7750 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f52a40536d0 tx=0x7f52a002bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22eec203c64c86a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.375+0000 7f3ff7c90640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3fe80e3090 0x7f3fe8057d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.375+0000 7f3ff7c90640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe80542d0 0x7f3fe80068a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.375+0000 7f3ff7c90640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe80582a0 con 0x7f3fe803e810 2023-12-11T17:10:19.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.375+0000 7f3ff7c90640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe8006170 con 0x7f3fe80e3090 2023-12-11T17:10:19.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.375+0000 7f3ff7c90640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe8058540 con 0x7f3fe80542d0 2023-12-11T17:10:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.376+0000 7f52a9ffb640 1 -- 172.21.15.37:0/1685691998 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a002c7b0 con 0x7f52a40e3130 2023-12-11T17:10:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.376+0000 7f52a9ffb640 1 -- 172.21.15.37:0/1685691998 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52a002c910 con 0x7f52a40e3130 2023-12-11T17:10:19.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.376+0000 7f52a9ffb640 1 -- 172.21.15.37:0/1685691998 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52a002cca0 con 0x7f52a40e3130 2023-12-11T17:10:19.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.377+0000 7f3ff5a2c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3fe80e3090 0x7f3fe8057d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.377+0000 7f3ff622d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe80542d0 0x7f3fe80068a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.377+0000 7f3ff5a2c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3fe80e3090 0x7f3fe8057d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:58718/0 (socket says 172.21.15.37:58718) 2023-12-11T17:10:19.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.377+0000 7f3ff5a2c640 1 -- 172.21.15.37:0/4263523418 learned_addr learned my addr 172.21.15.37:0/4263523418 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:19.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.378+0000 7f52abfff640 1 -- 172.21.15.37:0/1685691998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52a40e3130 msgr2=0x7f52a40e7750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.378+0000 7f52abfff640 1 --2- 172.21.15.37:0/1685691998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52a40e3130 0x7f52a40e7750 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f52a40536d0 tx=0x7f52a002bc10 comp rx=0 tx=0).stop 2023-12-11T17:10:19.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.378+0000 7f3ff622d640 1 -- 172.21.15.37:0/4263523418 >> v2:172.21.15.151:3300/0 conn(0x7f3fe80e3090 msgr2=0x7f3fe8057d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:19.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.378+0000 7f3ff622d640 1 --2- 172.21.15.37:0/4263523418 >> v2:172.21.15.151:3300/0 conn(0x7f3fe80e3090 0x7f3fe8057d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.378+0000 7f3ff622d640 1 -- 172.21.15.37:0/4263523418 >> v1:172.21.15.37:6789/0 conn(0x7f3fe803e810 legacy=0x7f3fe8053bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:19.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.378+0000 7f52abfff640 1 -- 172.21.15.37:0/1685691998 shutdown_connections 2023-12-11T17:10:19.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.378+0000 7f52abfff640 1 --2- 172.21.15.37:0/1685691998 >> v2:172.21.15.151:3300/0 conn(0x7f52a403c070 0x7f52a4058020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.378+0000 7f52abfff640 1 --2- 172.21.15.37:0/1685691998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52a40e3130 0x7f52a40e7750 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.378+0000 7f52abfff640 1 -- 172.21.15.37:0/1685691998 >> 172.21.15.37:0/1685691998 conn(0x7f52a4058eb0 msgr2=0x7f52a4059290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:19.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.379+0000 7f52abfff640 1 -- 172.21.15.37:0/1685691998 shutdown_connections 2023-12-11T17:10:19.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.379+0000 7f3ff622d640 1 -- 172.21.15.37:0/4263523418 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe8058820 con 0x7f3fe80542d0 2023-12-11T17:10:19.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.379+0000 7f52abfff640 1 -- 172.21.15.37:0/1685691998 wait complete. 2023-12-11T17:10:19.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.381+0000 7f3ff622d640 1 --2- 172.21.15.37:0/4263523418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe80542d0 0x7f3fe80068a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0068ea0 tx=0x7f3ff0066000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=234eb4c6fb42be0a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.381+0000 7f3ff4a2a640 1 -- 172.21.15.37:0/4263523418 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff00a6c30 con 0x7f3fe80542d0 2023-12-11T17:10:19.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.381+0000 7f3ff4a2a640 1 -- 172.21.15.37:0/4263523418 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff00a6dd0 con 0x7f3fe80542d0 2023-12-11T17:10:19.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.381+0000 7f3ff4a2a640 1 -- 172.21.15.37:0/4263523418 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff00ae640 con 0x7f3fe80542d0 2023-12-11T17:10:19.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.382+0000 7f52abfff640 1 Processor -- start 2023-12-11T17:10:19.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.382+0000 7f52abfff640 1 -- start start 2023-12-11T17:10:19.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.382+0000 7f3ff7c90640 1 -- 172.21.15.37:0/4263523418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe80542d0 msgr2=0x7f3fe80068a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.383+0000 7f3ff7c90640 1 --2- 172.21.15.37:0/4263523418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe80542d0 0x7f3fe80068a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f3ff0068ea0 tx=0x7f3ff0066000 comp rx=0 tx=0).stop 2023-12-11T17:10:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.383+0000 7f3ff7c90640 1 -- 172.21.15.37:0/4263523418 shutdown_connections 2023-12-11T17:10:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.383+0000 7f3ff7c90640 1 --2- 172.21.15.37:0/4263523418 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe80542d0 0x7f3fe80068a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.383+0000 7f3ff7c90640 1 --2- 172.21.15.37:0/4263523418 >> v2:172.21.15.151:3300/0 conn(0x7f3fe80e3090 0x7f3fe8057d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.383+0000 7f3ff7c90640 1 -- 172.21.15.37:0/4263523418 >> 172.21.15.37:0/4263523418 conn(0x7f3fe80559b0 msgr2=0x7f3fe8055dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.383+0000 7f3ff7c90640 1 -- 172.21.15.37:0/4263523418 shutdown_connections 2023-12-11T17:10:19.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.383+0000 7f3ff7c90640 1 -- 172.21.15.37:0/4263523418 wait complete. 2023-12-11T17:10:19.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.385+0000 7f52abfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52a403c070 0x7f52a40e3690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.385+0000 7f52abfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52a4053c80 0x7f52a4051b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.385+0000 7f52abfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52a40e3130 0x7f52a40d4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.386+0000 7f52aaffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52a403c070 0x7f52a40e3690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.386+0000 7f52abfff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a4052080 con 0x7f52a40e3130 2023-12-11T17:10:19.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.386+0000 7f3ff7c90640 1 Processor -- start 2023-12-11T17:10:19.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.386+0000 7f52abfff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52a40d48a0 con 0x7f52a403c070 2023-12-11T17:10:19.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.387+0000 7f3ff7c90640 1 -- start start 2023-12-11T17:10:19.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.386+0000 7f52abfff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52a40e3d90 con 0x7f52a4053c80 2023-12-11T17:10:19.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.386+0000 7f52ab7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52a40e3130 0x7f52a40d4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.387+0000 7f52aa7fc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52a4053c80 0x7f52a4051b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.387+0000 7f52ab7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52a40e3130 0x7f52a40d4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37926/0 (socket says 172.21.15.37:37926) 2023-12-11T17:10:19.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.387+0000 7f52ab7fe640 1 -- 172.21.15.37:0/1233917280 learned_addr learned my addr 172.21.15.37:0/1233917280 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:19.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.388+0000 7f52ab7fe640 1 -- 172.21.15.37:0/1233917280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52a4053c80 msgr2=0x7f52a4051b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.388+0000 7f52ab7fe640 1 --2- 172.21.15.37:0/1233917280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52a4053c80 0x7f52a4051b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.388+0000 7f52ab7fe640 1 -- 172.21.15.37:0/1233917280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52a403c070 msgr2=0x7f52a40e3690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.388+0000 7f52ab7fe640 1 --2- 172.21.15.37:0/1233917280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52a403c070 0x7f52a40e3690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.389+0000 7f3ff7c90640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe803e810 0x7f3fe81856d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.388+0000 7f52ab7fe640 1 -- 172.21.15.37:0/1233917280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52a00094d0 con 0x7f52a40e3130 2023-12-11T17:10:19.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.389+0000 7f3ff7c90640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe80542d0 0x7f3fe80e36e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.389+0000 7f3ff7c90640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe80e3090 0x7f3fe80e0c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.390+0000 7f3ff5a2c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe803e810 0x7f3fe81856d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.390+0000 7f52ab7fe640 1 --2- 172.21.15.37:0/1233917280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52a40e3130 0x7f52a40d4360 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0697f0 tx=0x7f52ac067ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.390+0000 7f3ff7c90640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe804da90 con 0x7f3fe80e3090 2023-12-11T17:10:19.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.390+0000 7f3ff7c90640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe804dd70 con 0x7f3fe80542d0 2023-12-11T17:10:19.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.390+0000 7f3ff7c90640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe804e050 con 0x7f3fe803e810 2023-12-11T17:10:19.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.390+0000 7f3ff522b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe80542d0 0x7f3fe80e36e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.396 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.391+0000 7f3ff522b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe80542d0 0x7f3fe80e36e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:58736/0 (socket says 172.21.15.37:58736) 2023-12-11T17:10:19.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.391+0000 7f3ff5a2c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe803e810 0x7f3fe81856d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.37:34076/0 (socket says 172.21.15.37:34076) 2023-12-11T17:10:19.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.391+0000 7f52937fe640 1 -- 172.21.15.37:0/1233917280 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac072ee0 con 0x7f52a40e3130 2023-12-11T17:10:19.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.391+0000 7f3ff5a2c640 1 -- 172.21.15.37:0/4030172820 learned_addr learned my addr 172.21.15.37:0/4030172820 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:19.397 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.391+0000 7f52abfff640 1 -- 172.21.15.37:0/1233917280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52a40e4070 con 0x7f52a40e3130 2023-12-11T17:10:19.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.391+0000 7f52abfff640 1 -- 172.21.15.37:0/1233917280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52a40e4630 con 0x7f52a40e3130 2023-12-11T17:10:19.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.392+0000 7f3ff622d640 1 --2- 172.21.15.37:0/4030172820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe80e3090 0x7f3fe80e0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.392+0000 7f3ff5a2c640 1 -- 172.21.15.37:0/4030172820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe80542d0 msgr2=0x7f3fe80e36e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.392+0000 7f3ff5a2c640 1 --2- 172.21.15.37:0/4030172820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe80542d0 0x7f3fe80e36e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.392+0000 7f3ff5a2c640 1 -- 172.21.15.37:0/4030172820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe80e3090 msgr2=0x7f3fe80e0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.392+0000 7f3ff5a2c640 1 --2- 172.21.15.37:0/4030172820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe80e3090 0x7f3fe80e0c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.399 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.392+0000 7f3ff5a2c640 1 -- 172.21.15.37:0/4030172820 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff0074230 con 0x7f3fe803e810 2023-12-11T17:10:19.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.393+0000 7f3ff622d640 1 --2- 172.21.15.37:0/4030172820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe80e3090 0x7f3fe80e0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:10:19.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.393+0000 7f3ff522b640 1 --2- 172.21.15.37:0/4030172820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe80542d0 0x7f3fe80e36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:10:19.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.392+0000 7f52937fe640 1 -- 172.21.15.37:0/1233917280 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52ac08e070 con 0x7f52a40e3130 2023-12-11T17:10:19.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.392+0000 7f52937fe640 1 -- 172.21.15.37:0/1233917280 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52ac072ee0 con 0x7f52a40e3130 2023-12-11T17:10:19.400 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.394+0000 7f3ff5a2c640 1 --2- 172.21.15.37:0/4030172820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe803e810 0x7f3fe81856d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3fec009fd0 tx=0x7f3fec00ed40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.394+0000 7f52abfff640 1 -- 172.21.15.37:0/1233917280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52a40e4850 con 0x7f52a40e3130 2023-12-11T17:10:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.395+0000 7f3fe67fc640 1 -- 172.21.15.37:0/4030172820 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec00c940 con 0x7f3fe803e810 2023-12-11T17:10:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.395+0000 7f3ff7c90640 1 -- 172.21.15.37:0/4030172820 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe804e330 con 0x7f3fe803e810 2023-12-11T17:10:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.395+0000 7f3ff7c90640 1 -- 172.21.15.37:0/4030172820 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe818a320 con 0x7f3fe803e810 2023-12-11T17:10:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.395+0000 7f3fe67fc640 1 -- 172.21.15.37:0/4030172820 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fec00caa0 con 0x7f3fe803e810 2023-12-11T17:10:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.395+0000 7f3fe67fc640 1 -- 172.21.15.37:0/4030172820 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fec00c940 con 0x7f3fe803e810 2023-12-11T17:10:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.400+0000 7f3fe67fc640 1 -- 172.21.15.37:0/4030172820 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3fec00cc10 con 0x7f3fe803e810 2023-12-11T17:10:19.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.401+0000 7f3ff7c90640 1 -- 172.21.15.37:0/4030172820 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fd8005250 con 0x7f3fe803e810 2023-12-11T17:10:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.401+0000 7f52937fe640 1 -- 172.21.15.37:0/1233917280 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f52ac0730a0 con 0x7f52a40e3130 2023-12-11T17:10:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.402+0000 7f52937fe640 1 --2- 172.21.15.37:0/1233917280 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f529806aed0 0x7f529806d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.402+0000 7f52937fe640 1 -- 172.21.15.37:0/1233917280 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f52ac102f10 con 0x7f52a40e3130 2023-12-11T17:10:19.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.403+0000 7f52aaffd640 1 --2- 172.21.15.37:0/1233917280 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f529806aed0 0x7f529806d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.405+0000 7f3fe67fc640 1 --2- 172.21.15.37:0/4030172820 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3fd406aea0 0x7f3fd406d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.405+0000 7f3fe67fc640 1 -- 172.21.15.37:0/4030172820 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3fec0896b0 con 0x7f3fe803e810 2023-12-11T17:10:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.407+0000 7f52aaffd640 1 --2- 172.21.15.37:0/1233917280 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f529806aed0 0x7f529806d390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f52a0036000 tx=0x7f52a0030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.407+0000 7f3ff522b640 1 --2- 172.21.15.37:0/4030172820 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3fd406aea0 0x7f3fd406d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.409+0000 7f3ff522b640 1 --2- 172.21.15.37:0/4030172820 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3fd406aea0 0x7f3fd406d360 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8057a50 tx=0x7f3fe0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.410+0000 7f52937fe640 1 -- 172.21.15.37:0/1233917280 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f52ac0d1770 con 0x7f52a40e3130 2023-12-11T17:10:19.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.417+0000 7f3fe67fc640 1 -- 172.21.15.37:0/4030172820 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3fec054480 con 0x7f3fe803e810 2023-12-11T17:10:19.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.429+0000 7f78b9b1d640 1 Processor -- start 2023-12-11T17:10:19.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.429+0000 7f78b9b1d640 1 -- start start 2023-12-11T17:10:19.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.431+0000 7f78b9b1d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78b4153900 0x7f78b4070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.431+0000 7f78b9b1d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f78b40b43e0 0x7f78b40b4800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.431+0000 7f78b9b1d640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78b4153ce0 con 0x7f78b415a580 2023-12-11T17:10:19.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.431+0000 7f78b9b1d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78b406d650 con 0x7f78b40b43e0 2023-12-11T17:10:19.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.431+0000 7f78b9b1d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b40b4d40 con 0x7f78b4153900 2023-12-11T17:10:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.432+0000 7f78b37fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78b4153900 0x7f78b4070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.432+0000 7f78b3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f78b40b43e0 0x7f78b40b4800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.433+0000 7f78b37fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78b4153900 0x7f78b4070a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.37:34080/0 (socket says 172.21.15.37:34080) 2023-12-11T17:10:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.433+0000 7f78b37fe640 1 -- 172.21.15.37:0/723842936 learned_addr learned my addr 172.21.15.37:0/723842936 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.432+0000 7f78b2ffd640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f78b415a580 0x7f78b406cc90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.37:40042/0 (socket says 172.21.15.37:40042) 2023-12-11T17:10:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.433+0000 7f78b37fe640 1 -- 172.21.15.37:0/723842936 >> v2:172.21.15.37:3300/0 conn(0x7f78b40b43e0 msgr2=0x7f78b40b4800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.433+0000 7f78b37fe640 1 --2- 172.21.15.37:0/723842936 >> v2:172.21.15.37:3300/0 conn(0x7f78b40b43e0 0x7f78b40b4800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.433+0000 7f78b37fe640 1 -- 172.21.15.37:0/723842936 >> v1:172.21.15.151:6789/0 conn(0x7f78b415a580 legacy=0x7f78b406cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.433+0000 7f78b37fe640 1 -- 172.21.15.37:0/723842936 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78b406d3a0 con 0x7f78b4153900 2023-12-11T17:10:19.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.434+0000 7f78b3fff640 1 --2- 172.21.15.37:0/723842936 >> v2:172.21.15.37:3300/0 conn(0x7f78b40b43e0 0x7f78b40b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:10:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.435+0000 7f78b37fe640 1 --2- 172.21.15.37:0/723842936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78b4153900 0x7f78b4070a80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f789c0091e0 tx=0x7f789c02bbb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59c6dc27b6257e40 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.436+0000 7f78b27fc640 1 -- 172.21.15.37:0/723842936 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c02c960 con 0x7f78b4153900 2023-12-11T17:10:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.436+0000 7f78b27fc640 1 -- 172.21.15.37:0/723842936 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c02cac0 con 0x7f78b4153900 2023-12-11T17:10:19.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.436+0000 7f78b27fc640 1 -- 172.21.15.37:0/723842936 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c02ce50 con 0x7f78b4153900 2023-12-11T17:10:19.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.437+0000 7f78b9b1d640 1 -- 172.21.15.37:0/723842936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78b4153900 msgr2=0x7f78b4070a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.436+0000 7f2e03fff640 1 Processor -- start 2023-12-11T17:10:19.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.436+0000 7f2e03fff640 1 -- start start 2023-12-11T17:10:19.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.437+0000 7f78b9b1d640 1 --2- 172.21.15.37:0/723842936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78b4153900 0x7f78b4070a80 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f789c0091e0 tx=0x7f789c02bbb0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.438+0000 7f78b9b1d640 1 -- 172.21.15.37:0/723842936 shutdown_connections 2023-12-11T17:10:19.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.438+0000 7f78b9b1d640 1 --2- 172.21.15.37:0/723842936 >> v2:172.21.15.37:3300/0 conn(0x7f78b40b43e0 0x7f78b40b4800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.438+0000 7f78b9b1d640 1 --2- 172.21.15.37:0/723842936 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78b4153900 0x7f78b4070a80 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.438+0000 7f78b9b1d640 1 -- 172.21.15.37:0/723842936 >> 172.21.15.37:0/723842936 conn(0x7f78b40b0a90 msgr2=0x7f78b40b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.439+0000 7f2e03fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e04070070 0x7f2e040704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.439+0000 7f78b9b1d640 1 -- 172.21.15.37:0/723842936 shutdown_connections 2023-12-11T17:10:19.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.439+0000 7f78b9b1d640 1 -- 172.21.15.37:0/723842936 wait complete. 2023-12-11T17:10:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.439+0000 7f2e03fff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e0406ca40 con 0x7f2e0415a180 2023-12-11T17:10:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.439+0000 7f2e03fff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e0406cd20 con 0x7f2e0406bdf0 2023-12-11T17:10:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.439+0000 7f2e03fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e04159af0 con 0x7f2e04070070 2023-12-11T17:10:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.439+0000 7f2e02ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2e0415a180 0x7f2e0415c570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41866/0 (socket says 172.21.15.37:41866) 2023-12-11T17:10:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.439+0000 7f2e02ffd640 1 -- 172.21.15.37:0/3738614766 learned_addr learned my addr 172.21.15.37:0/3738614766 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:19.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.440+0000 7f2e027fc640 1 --2- 172.21.15.37:0/3738614766 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e04070070 0x7f2e040704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.440+0000 7f2e027fc640 1 -- 172.21.15.37:0/3738614766 >> v1:172.21.15.151:6789/0 conn(0x7f2e0406bdf0 legacy=0x7f2e0406c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.440+0000 7f2e027fc640 1 -- 172.21.15.37:0/3738614766 >> v1:172.21.15.37:6789/0 conn(0x7f2e0415a180 legacy=0x7f2e0415c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.440+0000 7f2e027fc640 1 -- 172.21.15.37:0/3738614766 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e0406d000 con 0x7f2e04070070 2023-12-11T17:10:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.442+0000 7f78b9b1d640 1 Processor -- start 2023-12-11T17:10:19.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.443+0000 7f78b9b1d640 1 -- start start 2023-12-11T17:10:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.443+0000 7f2e027fc640 1 --2- 172.21.15.37:0/3738614766 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e04070070 0x7f2e040704f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2df40097d0 tx=0x7f2df402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6fcdfa7eb8badefe server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.443+0000 7f2e01ffb640 1 -- 172.21.15.37:0/3738614766 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df4031830 con 0x7f2e04070070 2023-12-11T17:10:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.443+0000 7f2e01ffb640 1 -- 172.21.15.37:0/3738614766 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df4031990 con 0x7f2e04070070 2023-12-11T17:10:19.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.443+0000 7f2e01ffb640 1 -- 172.21.15.37:0/3738614766 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df4031d60 con 0x7f2e04070070 2023-12-11T17:10:19.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.444+0000 7f7d8ba4f640 1 Processor -- start 2023-12-11T17:10:19.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.444+0000 7f7d8ba4f640 1 -- start start 2023-12-11T17:10:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.445+0000 7f78b9b1d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78b40b43e0 0x7f78b41f1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.445+0000 7f78b9b1d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78b4153900 0x7f78b4153e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.445+0000 7f78b9b1d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78b415a580 0x7f78b4155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.445+0000 7f78b9b1d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b414fd20 con 0x7f78b40b43e0 2023-12-11T17:10:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.445+0000 7f78b9b1d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78b4149220 con 0x7f78b415a580 2023-12-11T17:10:19.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.445+0000 7f78b9b1d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78b4154500 con 0x7f78b4153900 2023-12-11T17:10:19.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.445+0000 7f2e03fff640 1 -- 172.21.15.37:0/3738614766 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e04070070 msgr2=0x7f2e040704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.445+0000 7f2e03fff640 1 --2- 172.21.15.37:0/3738614766 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e04070070 0x7f2e040704f0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f2df40097d0 tx=0x7f2df402b8d0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.445+0000 7f78b37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78b40b43e0 0x7f78b41f1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.445+0000 7f78b37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78b40b43e0 0x7f78b41f1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37944/0 (socket says 172.21.15.37:37944) 2023-12-11T17:10:19.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.445+0000 7f78b37fe640 1 -- 172.21.15.37:0/2721933677 learned_addr learned my addr 172.21.15.37:0/2721933677 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:19.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.446+0000 7f78b3fff640 1 --2- 172.21.15.37:0/2721933677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78b415a580 0x7f78b4155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.446+0000 7f2e03fff640 1 -- 172.21.15.37:0/3738614766 shutdown_connections 2023-12-11T17:10:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.446+0000 7f78b2ffd640 1 --2- 172.21.15.37:0/2721933677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78b4153900 0x7f78b4153e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.446+0000 7f78b37fe640 1 -- 172.21.15.37:0/2721933677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78b4153900 msgr2=0x7f78b4153e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.446+0000 7f78b37fe640 1 --2- 172.21.15.37:0/2721933677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78b4153900 0x7f78b4153e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.446+0000 7f78b37fe640 1 -- 172.21.15.37:0/2721933677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78b415a580 msgr2=0x7f78b4155e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.446+0000 7f78b37fe640 1 --2- 172.21.15.37:0/2721933677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78b415a580 0x7f78b4155e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.446+0000 7f78b37fe640 1 -- 172.21.15.37:0/2721933677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f789c009d60 con 0x7f78b40b43e0 2023-12-11T17:10:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.446+0000 7f2e03fff640 1 --2- 172.21.15.37:0/3738614766 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e04070070 0x7f2e040704f0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.446+0000 7f2e03fff640 1 -- 172.21.15.37:0/3738614766 >> 172.21.15.37:0/3738614766 conn(0x7f2e040b0860 msgr2=0x7f2e040b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.446+0000 7f7d8ba4f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7d84071270 0x7f7d84179110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.446+0000 7f7d8ba4f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d840cd750 con 0x7f7d8406c5f0 2023-12-11T17:10:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.446+0000 7f7d8ba4f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7d840add30 con 0x7f7d8416e100 2023-12-11T17:10:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.446+0000 7f7d8ba4f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d840cd1d0 con 0x7f7d84071270 2023-12-11T17:10:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.447+0000 7f78b37fe640 1 --2- 172.21.15.37:0/2721933677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78b40b43e0 0x7f78b41f1ad0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f789c0091e0 tx=0x7f789c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.446+0000 7f2e03fff640 1 -- 172.21.15.37:0/3738614766 shutdown_connections 2023-12-11T17:10:19.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.446+0000 7f2e03fff640 1 -- 172.21.15.37:0/3738614766 wait complete. 2023-12-11T17:10:19.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.447+0000 7f7d89fec640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7d84071270 0x7f7d84179110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.447+0000 7f7d897eb640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f7d8416e100 0x7f7d840ad270 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.37:40056/0 (socket says 172.21.15.37:40056) 2023-12-11T17:10:19.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.447+0000 7f7d897eb640 1 -- 172.21.15.37:0/1845267849 learned_addr learned my addr 172.21.15.37:0/1845267849 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:19.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.447+0000 7f78abfff640 1 -- 172.21.15.37:0/2721933677 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c03d630 con 0x7f78b40b43e0 2023-12-11T17:10:19.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.447+0000 7f78abfff640 1 -- 172.21.15.37:0/2721933677 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c03d7b0 con 0x7f78b40b43e0 2023-12-11T17:10:19.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.448+0000 7f3b2c778640 1 Processor -- start 2023-12-11T17:10:19.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.448+0000 7f3b2c778640 1 -- start start 2023-12-11T17:10:19.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.447+0000 7f78abfff640 1 -- 172.21.15.37:0/2721933677 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c03db60 con 0x7f78b40b43e0 2023-12-11T17:10:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.448+0000 7f78b9b1d640 1 -- 172.21.15.37:0/2721933677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78b41547e0 con 0x7f78b40b43e0 2023-12-11T17:10:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.448+0000 7f78b9b1d640 1 -- 172.21.15.37:0/2721933677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78b4154da0 con 0x7f78b40b43e0 2023-12-11T17:10:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.449+0000 7f2e03fff640 1 Processor -- start 2023-12-11T17:10:19.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.450+0000 7f2e03fff640 1 -- start start 2023-12-11T17:10:19.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.450+0000 7f3b2c778640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b240b4750 0x7f3b24161ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.450+0000 7f3b2c778640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3b24165d30 0x7f3b2406c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.450+0000 7f3b2c778640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b2406c950 0x7f3b24146db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.451+0000 7f3b2c778640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b2406cde0 con 0x7f3b2406c950 2023-12-11T17:10:19.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.451+0000 7f3b2c778640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b240cc8f0 con 0x7f3b24165d30 2023-12-11T17:10:19.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.451+0000 7f3b2c778640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b240b4b30 con 0x7f3b240b4750 2023-12-11T17:10:19.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.450+0000 7f786467c640 1 Processor -- start 2023-12-11T17:10:19.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.450+0000 7f786467c640 1 -- start start 2023-12-11T17:10:19.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.451+0000 7f78b9b1d640 1 -- 172.21.15.37:0/2721933677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78b4149390 con 0x7f78b40b43e0 2023-12-11T17:10:19.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.451+0000 7f7d89fec640 1 -- 172.21.15.37:0/1845267849 >> v1:172.21.15.151:6789/0 conn(0x7f7d8416e100 legacy=0x7f7d840ad270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.451+0000 7f7d7bfff640 1 -- 172.21.15.37:0/1845267849 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1444027037 0 0) 0x7f7d840cd750 con 0x7f7d8406c5f0 2023-12-11T17:10:19.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.451+0000 7f3b2a514640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b240b4750 0x7f3b24161ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.451+0000 7f3b2a514640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b240b4750 0x7f3b24161ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.37:34098/0 (socket says 172.21.15.37:34098) 2023-12-11T17:10:19.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.451+0000 7f3b2a514640 1 -- 172.21.15.37:0/209853859 learned_addr learned my addr 172.21.15.37:0/209853859 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:19.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.451+0000 7f7d89fec640 1 -- 172.21.15.37:0/1845267849 >> v1:172.21.15.37:6789/0 conn(0x7f7d8406c5f0 legacy=0x7f7d84070b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.451+0000 7f7d89fec640 1 -- 172.21.15.37:0/1845267849 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d840ae010 con 0x7f7d84071270 2023-12-11T17:10:19.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.451+0000 7f3b29d13640 1 --2- 172.21.15.37:0/209853859 >> v2:172.21.15.151:3300/0 conn(0x7f3b24165d30 0x7f3b2406c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.452+0000 7f78abfff640 1 -- 172.21.15.37:0/2721933677 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f789c03b040 con 0x7f78b40b43e0 2023-12-11T17:10:19.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.452+0000 7f3b2a514640 1 -- 172.21.15.37:0/209853859 >> v2:172.21.15.151:3300/0 conn(0x7f3b24165d30 msgr2=0x7f3b2406c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:19.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.452+0000 7f3b2a514640 1 --2- 172.21.15.37:0/209853859 >> v2:172.21.15.151:3300/0 conn(0x7f3b24165d30 0x7f3b2406c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.452+0000 7f3b2a514640 1 -- 172.21.15.37:0/209853859 >> v2:172.21.15.37:3300/0 conn(0x7f3b2406c950 msgr2=0x7f3b24146db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:19.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.452+0000 7f786467c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f785c0d1e50 0x7f785c0b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.452+0000 7f786467c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785c0cdc90 con 0x7f785c0c6510 2023-12-11T17:10:19.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.452+0000 7f786467c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f785c0d3a30 con 0x7f785c0b4770 2023-12-11T17:10:19.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.452+0000 7f786467c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785c0d3d10 con 0x7f785c0d1e50 2023-12-11T17:10:19.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.453+0000 7f2e03fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e0406bdf0 0x7f2e0413fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.453+0000 7f3b2ad15640 1 --2- 172.21.15.37:0/209853859 >> v2:172.21.15.37:3300/0 conn(0x7f3b2406c950 0x7f3b24146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.453+0000 7f3b2a514640 1 --2- 172.21.15.37:0/209853859 >> v2:172.21.15.37:3300/0 conn(0x7f3b2406c950 0x7f3b24146db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.453+0000 7f3b2a514640 1 -- 172.21.15.37:0/209853859 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b241623f0 con 0x7f3b240b4750 2023-12-11T17:10:19.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.453+0000 7f3b2ad15640 1 --2- 172.21.15.37:0/209853859 >> v2:172.21.15.37:3300/0 conn(0x7f3b2406c950 0x7f3b24146db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:19.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.453+0000 7f7d89fec640 1 --2- 172.21.15.37:0/1845267849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d84071270 0x7f7d84179110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7d80009750 tx=0x7f7d8002b690 comp rx=0 tx=0).ready entity=mon.1 client_cookie=72624488d97ba82d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.453+0000 7f2e03fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e04070070 0x7f2e04140230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.453+0000 7f2e03fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e0415a180 0x7f2e0413c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.453+0000 7f2e03fff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e041f7060 con 0x7f2e04070070 2023-12-11T17:10:19.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.453+0000 7f2e03fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e04155640 con 0x7f2e0406bdf0 2023-12-11T17:10:19.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.453+0000 7f2e03fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e04099eb0 con 0x7f2e0415a180 2023-12-11T17:10:19.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.453+0000 7f7862418640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f785c0b4770 0x7f785c0d0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.37:40058/0 (socket says 172.21.15.37:40058) 2023-12-11T17:10:19.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.453+0000 7f7862418640 1 -- 172.21.15.37:0/2634851846 learned_addr learned my addr 172.21.15.37:0/2634851846 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:19.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.453+0000 7f78abfff640 1 --2- 172.21.15.37:0/2721933677 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f789406af10 0x7f789406d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.454+0000 7f78abfff640 1 -- 172.21.15.37:0/2721933677 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f789c0abf50 con 0x7f78b40b43e0 2023-12-11T17:10:19.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.454+0000 7f7d7bfff640 1 -- 172.21.15.37:0/1845267849 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d80030710 con 0x7f7d84071270 2023-12-11T17:10:19.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.454+0000 7f7d7bfff640 1 -- 172.21.15.37:0/1845267849 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8002e050 con 0x7f7d84071270 2023-12-11T17:10:19.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.454+0000 7f7d7bfff640 1 -- 172.21.15.37:0/1845267849 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d80030a90 con 0x7f7d84071270 2023-12-11T17:10:19.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.454+0000 7f2e027fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e04070070 0x7f2e04140230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.454+0000 7f2e02ffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e0406bdf0 0x7f2e0413fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.454+0000 7f2e02ffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e0406bdf0 0x7f2e0413fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:58780/0 (socket says 172.21.15.37:58780) 2023-12-11T17:10:19.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.454+0000 7f2e02ffd640 1 -- 172.21.15.37:0/790328914 learned_addr learned my addr 172.21.15.37:0/790328914 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:19.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.454+0000 7f7862c19640 1 --2- 172.21.15.37:0/2634851846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f785c0d1e50 0x7f785c0b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.455+0000 7f2e037fe640 1 --2- 172.21.15.37:0/790328914 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e0415a180 0x7f2e0413c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.455+0000 7f7d8ba4f640 1 -- 172.21.15.37:0/1845267849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d84071270 msgr2=0x7f7d84179110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.455+0000 7f78b2ffd640 1 --2- 172.21.15.37:0/2721933677 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f789406af10 0x7f789406d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.455+0000 7f7d8ba4f640 1 --2- 172.21.15.37:0/1845267849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d84071270 0x7f7d84179110 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f7d80009750 tx=0x7f7d8002b690 comp rx=0 tx=0).stop 2023-12-11T17:10:19.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.455+0000 7f7861416640 1 -- 172.21.15.37:0/2634851846 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3826525998 0 0) 0x7f785c0d3a30 con 0x7f785c0b4770 2023-12-11T17:10:19.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.455+0000 7f7861416640 1 -- 172.21.15.37:0/2634851846 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7844003520 con 0x7f785c0b4770 2023-12-11T17:10:19.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.455+0000 7f3b2a514640 1 --2- 172.21.15.37:0/209853859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b240b4750 0x7f3b24161ae0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3b2406fd50 tx=0x7f3b2002bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b7c6faf871f47f08 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.455+0000 7f2e02ffd640 1 -- 172.21.15.37:0/790328914 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e0415a180 msgr2=0x7f2e0413c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.456+0000 7f7862c19640 1 -- 172.21.15.37:0/2634851846 >> v1:172.21.15.151:6789/0 conn(0x7f785c0b4770 legacy=0x7f785c0d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.456+0000 7f7862c19640 1 -- 172.21.15.37:0/2634851846 >> v1:172.21.15.37:6789/0 conn(0x7f785c0c6510 legacy=0x7f785c0d1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.456+0000 7f7862c19640 1 -- 172.21.15.37:0/2634851846 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f785c0cdf30 con 0x7f785c0d1e50 2023-12-11T17:10:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.455+0000 7f2e02ffd640 1 --2- 172.21.15.37:0/790328914 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e0415a180 0x7f2e0413c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.456+0000 7f7d8ba4f640 1 -- 172.21.15.37:0/1845267849 shutdown_connections 2023-12-11T17:10:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.456+0000 7f7d8ba4f640 1 --2- 172.21.15.37:0/1845267849 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d84071270 0x7f7d84179110 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.456+0000 7f7d8ba4f640 1 -- 172.21.15.37:0/1845267849 >> 172.21.15.37:0/1845267849 conn(0x7f7d840b0a90 msgr2=0x7f7d840b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.455+0000 7f2e02ffd640 1 -- 172.21.15.37:0/790328914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e04070070 msgr2=0x7f2e04140230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.455+0000 7f2e02ffd640 1 --2- 172.21.15.37:0/790328914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e04070070 0x7f2e04140230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.455+0000 7f2e02ffd640 1 -- 172.21.15.37:0/790328914 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df4009400 con 0x7f2e0406bdf0 2023-12-11T17:10:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.456+0000 7f2e02ffd640 1 --2- 172.21.15.37:0/790328914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e0406bdf0 0x7f2e0413fcf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2df80016c0 tx=0x7f2df8001b80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.457+0000 7f78b2ffd640 1 --2- 172.21.15.37:0/2721933677 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f789406af10 0x7f789406d3d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f78a4007fd0 tx=0x7f78a4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.456+0000 7f7d8ba4f640 1 -- 172.21.15.37:0/1845267849 shutdown_connections 2023-12-11T17:10:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.457+0000 7f7d8ba4f640 1 -- 172.21.15.37:0/1845267849 wait complete. 2023-12-11T17:10:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.456+0000 7f3b29512640 1 -- 172.21.15.37:0/209853859 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2002ca70 con 0x7f3b240b4750 2023-12-11T17:10:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.456+0000 7f3b29512640 1 -- 172.21.15.37:0/209853859 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2002cbd0 con 0x7f3b240b4750 2023-12-11T17:10:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.456+0000 7f3b29512640 1 -- 172.21.15.37:0/209853859 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b200343f0 con 0x7f3b240b4750 2023-12-11T17:10:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.457+0000 7f3b2c778640 1 -- 172.21.15.37:0/209853859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b240b4750 msgr2=0x7f3b24161ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.457+0000 7f2debfff640 1 -- 172.21.15.37:0/790328914 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df800f070 con 0x7f2e0406bdf0 2023-12-11T17:10:19.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.458+0000 7f2debfff640 1 -- 172.21.15.37:0/790328914 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df8007170 con 0x7f2e0406bdf0 2023-12-11T17:10:19.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.458+0000 7f2debfff640 1 -- 172.21.15.37:0/790328914 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df80074e0 con 0x7f2e0406bdf0 2023-12-11T17:10:19.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.457+0000 7f3b2c778640 1 --2- 172.21.15.37:0/209853859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b240b4750 0x7f3b24161ae0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3b2406fd50 tx=0x7f3b2002bed0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.458+0000 7f2e03fff640 1 -- 172.21.15.37:0/790328914 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e041558c0 con 0x7f2e0406bdf0 2023-12-11T17:10:19.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.458+0000 7f7862c19640 1 --2- 172.21.15.37:0/2634851846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f785c0d1e50 0x7f785c0b5fd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f784c009dc0 tx=0x7f784c02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=546ceaf0a3b65837 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.458+0000 7f3b2c778640 1 -- 172.21.15.37:0/209853859 shutdown_connections 2023-12-11T17:10:19.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.458+0000 7f2e03fff640 1 -- 172.21.15.37:0/790328914 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e04155e80 con 0x7f2e0406bdf0 2023-12-11T17:10:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.458+0000 7f3b2c778640 1 --2- 172.21.15.37:0/209853859 >> v2:172.21.15.37:3300/0 conn(0x7f3b2406c950 0x7f3b24146db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.458+0000 7f3b2c778640 1 --2- 172.21.15.37:0/209853859 >> v2:172.21.15.151:3300/0 conn(0x7f3b24165d30 0x7f3b2406c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.458+0000 7f3b2c778640 1 --2- 172.21.15.37:0/209853859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b240b4750 0x7f3b24161ae0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.458+0000 7f7861416640 1 -- 172.21.15.37:0/2634851846 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c02cc50 con 0x7f785c0d1e50 2023-12-11T17:10:19.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.458+0000 7f3b2c778640 1 -- 172.21.15.37:0/209853859 >> 172.21.15.37:0/209853859 conn(0x7f3b240b0a90 msgr2=0x7f3b240b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:19.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.459+0000 7f7861416640 1 -- 172.21.15.37:0/2634851846 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f784c02cdb0 con 0x7f785c0d1e50 2023-12-11T17:10:19.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.459+0000 7f7d8ba4f640 1 Processor -- start 2023-12-11T17:10:19.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.459+0000 7f7861416640 1 -- 172.21.15.37:0/2634851846 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f784c034640 con 0x7f785c0d1e50 2023-12-11T17:10:19.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.459+0000 7f7d8ba4f640 1 -- start start 2023-12-11T17:10:19.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.460+0000 7f2e03fff640 1 -- 172.21.15.37:0/790328914 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e04074450 con 0x7f2e0406bdf0 2023-12-11T17:10:19.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.460+0000 7f786467c640 1 -- 172.21.15.37:0/2634851846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f785c0d1e50 msgr2=0x7f785c0b5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.460+0000 7f786467c640 1 --2- 172.21.15.37:0/2634851846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f785c0d1e50 0x7f785c0b5fd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f784c009dc0 tx=0x7f784c02bea0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.460+0000 7f786467c640 1 -- 172.21.15.37:0/2634851846 shutdown_connections 2023-12-11T17:10:19.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.460+0000 7f786467c640 1 --2- 172.21.15.37:0/2634851846 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f785c0d1e50 0x7f785c0b5fd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.460+0000 7f786467c640 1 -- 172.21.15.37:0/2634851846 >> 172.21.15.37:0/2634851846 conn(0x7f785c09c450 msgr2=0x7f785c0d3180 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:19.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.461+0000 7f3b2c778640 1 -- 172.21.15.37:0/209853859 shutdown_connections 2023-12-11T17:10:19.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.461+0000 7f3b2c778640 1 -- 172.21.15.37:0/209853859 wait complete. 2023-12-11T17:10:19.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.461+0000 7f7d8ba4f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d8406c5f0 0x7f7d84167a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.461+0000 7f7d8ba4f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d84071270 0x7f7d8420b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.461+0000 7f7d8ba4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d8416e100 0x7f7d8420bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.461+0000 7f7d8ba4f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d84167f90 con 0x7f7d8416e100 2023-12-11T17:10:19.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.461+0000 7f7d8ba4f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d840b2240 con 0x7f7d84071270 2023-12-11T17:10:19.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.461+0000 7f7d8ba4f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d840b4650 con 0x7f7d8406c5f0 2023-12-11T17:10:19.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.462+0000 7f2debfff640 1 -- 172.21.15.37:0/790328914 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2df80047e0 con 0x7f2e0406bdf0 2023-12-11T17:10:19.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.461+0000 7f786467c640 1 -- 172.21.15.37:0/2634851846 shutdown_connections 2023-12-11T17:10:19.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.462+0000 7f7d88fea640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d84071270 0x7f7d8420b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.462+0000 7f7d897eb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d8406c5f0 0x7f7d84167a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.462+0000 7f7d89fec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d8416e100 0x7f7d8420bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.462+0000 7f7d88fea640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d84071270 0x7f7d8420b6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:58782/0 (socket says 172.21.15.37:58782) 2023-12-11T17:10:19.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.463+0000 7f7d88fea640 1 -- 172.21.15.37:0/2819570780 learned_addr learned my addr 172.21.15.37:0/2819570780 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:19.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.462+0000 7f7d897eb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d8406c5f0 0x7f7d84167a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.37:34120/0 (socket says 172.21.15.37:34120) 2023-12-11T17:10:19.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.464+0000 7f2debfff640 1 --2- 172.21.15.37:0/790328914 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f2df006af10 0x7f2df006d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.464+0000 7f78abfff640 1 -- 172.21.15.37:0/2721933677 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f78b4149390 con 0x7f78b40b43e0 2023-12-11T17:10:19.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.464+0000 7f2debfff640 1 -- 172.21.15.37:0/790328914 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2df8089330 con 0x7f2e0406bdf0 2023-12-11T17:10:19.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.464+0000 7f7d89fec640 1 -- 172.21.15.37:0/2819570780 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d8406c5f0 msgr2=0x7f7d84167a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.464+0000 7f7d89fec640 1 --2- 172.21.15.37:0/2819570780 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d8406c5f0 0x7f7d84167a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.464+0000 7f3b2c778640 1 Processor -- start 2023-12-11T17:10:19.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.464+0000 7f3b2c778640 1 -- start start 2023-12-11T17:10:19.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.461+0000 7f786467c640 1 -- 172.21.15.37:0/2634851846 wait complete. 2023-12-11T17:10:19.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.464+0000 7f7d89fec640 1 -- 172.21.15.37:0/2819570780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d84071270 msgr2=0x7f7d8420b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.464+0000 7f786467c640 1 Processor -- start 2023-12-11T17:10:19.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.464+0000 7f7d89fec640 1 --2- 172.21.15.37:0/2819570780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d84071270 0x7f7d8420b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.464+0000 7f7d89fec640 1 -- 172.21.15.37:0/2819570780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d80009400 con 0x7f7d8416e100 2023-12-11T17:10:19.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.465+0000 7f7d88fea640 1 --2- 172.21.15.37:0/2819570780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d84071270 0x7f7d8420b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:10:19.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.465+0000 7f7d89fec640 1 --2- 172.21.15.37:0/2819570780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d8416e100 0x7f7d8420bbf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7d80032000 tx=0x7f7d800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.465+0000 7f786467c640 1 -- start start 2023-12-11T17:10:19.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.465+0000 7f2e027fc640 1 --2- 172.21.15.37:0/790328914 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f2df006af10 0x7f2df006d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.465+0000 7f7d79ffb640 1 -- 172.21.15.37:0/2819570780 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8003d950 con 0x7f7d8416e100 2023-12-11T17:10:19.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.466+0000 7f7d79ffb640 1 -- 172.21.15.37:0/2819570780 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d8003dab0 con 0x7f7d8416e100 2023-12-11T17:10:19.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.466+0000 7f7d79ffb640 1 -- 172.21.15.37:0/2819570780 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d8003de20 con 0x7f7d8416e100 2023-12-11T17:10:19.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.466+0000 7f3b2c778640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b2406c950 0x7f3b240b3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.466+0000 7f3b2c778640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b240b4750 0x7f3b24158030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.466+0000 7f3b2c778640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b24165d30 0x7f3b240afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.466+0000 7f7d8ba4f640 1 -- 172.21.15.37:0/2819570780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d840adb00 con 0x7f7d8416e100 2023-12-11T17:10:19.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.466+0000 7f3b2c778640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b24157ec0 con 0x7f3b240b4750 2023-12-11T17:10:19.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.466+0000 7f3b2c778640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b240b3950 con 0x7f3b2406c950 2023-12-11T17:10:19.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.466+0000 7f3b2c778640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b24142bf0 con 0x7f3b24165d30 2023-12-11T17:10:19.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.466+0000 7f3b29d13640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b240b4750 0x7f3b24158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.466+0000 7f3b29d13640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b240b4750 0x7f3b24158030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37984/0 (socket says 172.21.15.37:37984) 2023-12-11T17:10:19.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.466+0000 7f3b29d13640 1 -- 172.21.15.37:0/975663717 learned_addr learned my addr 172.21.15.37:0/975663717 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:19.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.466+0000 7f3b2a514640 1 --2- 172.21.15.37:0/975663717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b2406c950 0x7f3b240b3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.478 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.467+0000 7f3b2ad15640 1 --2- 172.21.15.37:0/975663717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b24165d30 0x7f3b240afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.467+0000 7f786467c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f785c0b4770 0x7f785c0cac40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.466+0000 7f7d8ba4f640 1 -- 172.21.15.37:0/2819570780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d8420c290 con 0x7f7d8416e100 2023-12-11T17:10:19.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.468+0000 7f786467c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f785c0c6510 0x7f785c0cc630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.467+0000 7f3b29d13640 1 -- 172.21.15.37:0/975663717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b24165d30 msgr2=0x7f3b240afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.467+0000 7f3b29d13640 1 --2- 172.21.15.37:0/975663717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b24165d30 0x7f3b240afa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.467+0000 7f3b29d13640 1 -- 172.21.15.37:0/975663717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b2406c950 msgr2=0x7f3b240b3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.467+0000 7f3b29d13640 1 --2- 172.21.15.37:0/975663717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b2406c950 0x7f3b240b3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.467+0000 7f3b29d13640 1 -- 172.21.15.37:0/975663717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b20009b30 con 0x7f3b240b4750 2023-12-11T17:10:19.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.468+0000 7f786467c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f785c0d1e50 0x7f785c0ccb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.468+0000 7f7862418640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f785c0b4770 0x7f785c0cac40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.468+0000 7f7862418640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f785c0b4770 0x7f785c0cac40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.37:34146/0 (socket says 172.21.15.37:34146) 2023-12-11T17:10:19.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.468+0000 7f786467c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785c15c7a0 con 0x7f785c0c6510 2023-12-11T17:10:19.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.468+0000 7f786467c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f785c0cd0b0 con 0x7f785c0d1e50 2023-12-11T17:10:19.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.468+0000 7f786467c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f785c0c9940 con 0x7f785c0b4770 2023-12-11T17:10:19.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.469+0000 7f7862418640 1 -- 172.21.15.37:0/3648420615 learned_addr learned my addr 172.21.15.37:0/3648420615 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:19.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.468+0000 7f3b29d13640 1 --2- 172.21.15.37:0/975663717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b240b4750 0x7f3b24158030 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00e9b0 tx=0x7f3b1c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.468+0000 7f7d8ba4f640 1 -- 172.21.15.37:0/2819570780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d840ad900 con 0x7f7d8416e100 2023-12-11T17:10:19.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.469+0000 7f7862c19640 1 --2- 172.21.15.37:0/3648420615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f785c0d1e50 0x7f785c0ccb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.469+0000 7f7861c17640 1 --2- 172.21.15.37:0/3648420615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f785c0c6510 0x7f785c0cc630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.470+0000 7f7862418640 1 -- 172.21.15.37:0/3648420615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f785c0d1e50 msgr2=0x7f785c0ccb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.470+0000 7f7862418640 1 --2- 172.21.15.37:0/3648420615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f785c0d1e50 0x7f785c0ccb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.470+0000 7f7862418640 1 -- 172.21.15.37:0/3648420615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f785c0c6510 msgr2=0x7f785c0cc630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.470+0000 7f7862418640 1 --2- 172.21.15.37:0/3648420615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f785c0c6510 0x7f785c0cc630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.470+0000 7f7862418640 1 -- 172.21.15.37:0/3648420615 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f784c009a70 con 0x7f785c0b4770 2023-12-11T17:10:19.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.470+0000 7f7862c19640 1 --2- 172.21.15.37:0/3648420615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f785c0d1e50 0x7f785c0ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:10:19.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.471+0000 7f7861c17640 1 --2- 172.21.15.37:0/3648420615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f785c0c6510 0x7f785c0cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:19.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.471+0000 7f2e027fc640 1 --2- 172.21.15.37:0/790328914 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f2df006af10 0x7f2df006d3d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2df4036000 tx=0x7f2df403d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.471+0000 7f7d79ffb640 1 -- 172.21.15.37:0/2819570780 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7d80039040 con 0x7f7d8416e100 2023-12-11T17:10:19.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.471+0000 7f7862418640 1 --2- 172.21.15.37:0/3648420615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f785c0b4770 0x7f785c0cac40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f785000c500 tx=0x7f785000c9c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.472+0000 7f785affd640 1 -- 172.21.15.37:0/3648420615 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7850005ce0 con 0x7f785c0b4770 2023-12-11T17:10:19.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.472+0000 7f786467c640 1 -- 172.21.15.37:0/3648420615 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f785c0cb180 con 0x7f785c0b4770 2023-12-11T17:10:19.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.472+0000 7f785affd640 1 -- 172.21.15.37:0/3648420615 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7850005e40 con 0x7f785c0b4770 2023-12-11T17:10:19.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.473+0000 7f786467c640 1 -- 172.21.15.37:0/3648420615 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f785c0b85f0 con 0x7f785c0b4770 2023-12-11T17:10:19.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.473+0000 7f785affd640 1 -- 172.21.15.37:0/3648420615 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7850007330 con 0x7f785c0b4770 2023-12-11T17:10:19.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.473+0000 7f7d79ffb640 1 --2- 172.21.15.37:0/2819570780 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7d6806ae90 0x7f7d6806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.473+0000 7f7d79ffb640 1 -- 172.21.15.37:0/2819570780 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7d800abd10 con 0x7f7d8416e100 2023-12-11T17:10:19.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.474+0000 7f7d897eb640 1 --2- 172.21.15.37:0/2819570780 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7d6806ae90 0x7f7d6806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.475+0000 7f786467c640 1 -- 172.21.15.37:0/3648420615 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f785c0745d0 con 0x7f785c0b4770 2023-12-11T17:10:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.476+0000 7f7d897eb640 1 --2- 172.21.15.37:0/2819570780 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7d6806ae90 0x7f7d6806d350 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0012e0 tx=0x7f7d7c001740 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.476+0000 7f3b1affd640 1 -- 172.21.15.37:0/975663717 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c009670 con 0x7f3b240b4750 2023-12-11T17:10:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.476+0000 7f3b2c778640 1 -- 172.21.15.37:0/975663717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b24142ed0 con 0x7f3b240b4750 2023-12-11T17:10:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.476+0000 7f3b2c778640 1 -- 172.21.15.37:0/975663717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b24143490 con 0x7f3b240b4750 2023-12-11T17:10:19.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.476+0000 7f7d79ffb640 1 -- 172.21.15.37:0/2819570780 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7d80076bf0 con 0x7f7d8416e100 2023-12-11T17:10:19.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.476+0000 7f3b1affd640 1 -- 172.21.15.37:0/975663717 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b1c00c9a0 con 0x7f3b240b4750 2023-12-11T17:10:19.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.478+0000 7f3b1affd640 1 -- 172.21.15.37:0/975663717 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c009670 con 0x7f3b240b4750 2023-12-11T17:10:19.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.478+0000 7f3b2c778640 1 -- 172.21.15.37:0/975663717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b0c005250 con 0x7f3b240b4750 2023-12-11T17:10:19.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.478+0000 7f785affd640 1 -- 172.21.15.37:0/3648420615 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7850007550 con 0x7f785c0b4770 2023-12-11T17:10:19.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.479+0000 7f785affd640 1 --2- 172.21.15.37:0/3648420615 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f784806af10 0x7f784806d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.480+0000 7f785affd640 1 -- 172.21.15.37:0/3648420615 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f7850088ed0 con 0x7f785c0b4770 2023-12-11T17:10:19.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.480+0000 7f2debfff640 1 -- 172.21.15.37:0/790328914 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2df8054240 con 0x7f2e0406bdf0 2023-12-11T17:10:19.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.481+0000 7f7861c17640 1 --2- 172.21.15.37:0/3648420615 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f784806af10 0x7f784806d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.480+0000 7f3b1affd640 1 -- 172.21.15.37:0/975663717 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3b1c00cb10 con 0x7f3b240b4750 2023-12-11T17:10:19.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.482+0000 7f3b1affd640 1 --2- 172.21.15.37:0/975663717 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3b0806ae60 0x7f3b0806d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.482+0000 7f3b1affd640 1 -- 172.21.15.37:0/975663717 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3b1c089650 con 0x7f3b240b4750 2023-12-11T17:10:19.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.483+0000 7f3b2a514640 1 --2- 172.21.15.37:0/975663717 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3b0806ae60 0x7f3b0806d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.482+0000 7f7861c17640 1 --2- 172.21.15.37:0/3648420615 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f784806af10 0x7f784806d3d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f785c164f90 tx=0x7f7854009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.485+0000 7f3b2a514640 1 --2- 172.21.15.37:0/975663717 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3b0806ae60 0x7f3b0806d320 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3b20035000 tx=0x7f3b20030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.487+0000 7f3b1affd640 1 -- 172.21.15.37:0/975663717 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3b1c054420 con 0x7f3b240b4750 2023-12-11T17:10:19.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.492+0000 7f785affd640 1 -- 172.21.15.37:0/3648420615 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7850053e70 con 0x7f785c0b4770 2023-12-11T17:10:19.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.521+0000 7fcbe44ec640 1 Processor -- start 2023-12-11T17:10:19.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.521+0000 7fcbe44ec640 1 -- start start 2023-12-11T17:10:19.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.523+0000 7fcbe44ec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcbd400ab10 0x7fcbd4009d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.523+0000 7fcbe44ec640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbd40516b0 0x7fcbd400a260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.523+0000 7fcbe44ec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbd40558f0 con 0x7fcbd40e12e0 2023-12-11T17:10:19.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.523+0000 7fcbe44ec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbd40e16c0 con 0x7fcbd400ab10 2023-12-11T17:10:19.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.523+0000 7fcbe44ec640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd4054ce0 con 0x7fcbd40516b0 2023-12-11T17:10:19.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.524+0000 7fcbe2288640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcbd40e12e0 0x7fcbd403a140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41882/0 (socket says 172.21.15.37:41882) 2023-12-11T17:10:19.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.524+0000 7fcbe2288640 1 -- 172.21.15.37:0/1418801255 learned_addr learned my addr 172.21.15.37:0/1418801255 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:19.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.524+0000 7fcbe2a89640 1 --2- 172.21.15.37:0/1418801255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbd40516b0 0x7fcbd400a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.525+0000 7fcbe1a87640 1 --2- 172.21.15.37:0/1418801255 >> v2:172.21.15.37:3300/0 conn(0x7fcbd400ab10 0x7fcbd4009d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.525+0000 7fcbe1286640 1 -- 172.21.15.37:0/1418801255 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2222095058 0 0) 0x7fcbd40558f0 con 0x7fcbd40e12e0 2023-12-11T17:10:19.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.525+0000 7fcbe1286640 1 -- 172.21.15.37:0/1418801255 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbc8003520 con 0x7fcbd40e12e0 2023-12-11T17:10:19.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.525+0000 7fcbe2a89640 1 -- 172.21.15.37:0/1418801255 >> v2:172.21.15.37:3300/0 conn(0x7fcbd400ab10 msgr2=0x7fcbd4009d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:19.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.525+0000 7fcbe2a89640 1 --2- 172.21.15.37:0/1418801255 >> v2:172.21.15.37:3300/0 conn(0x7fcbd400ab10 0x7fcbd4009d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.526+0000 7fcbe2a89640 1 -- 172.21.15.37:0/1418801255 >> v1:172.21.15.37:6789/0 conn(0x7fcbd40e12e0 legacy=0x7fcbd403a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.526+0000 7fcbe2a89640 1 -- 172.21.15.37:0/1418801255 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbd4054fc0 con 0x7fcbd40516b0 2023-12-11T17:10:19.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.526+0000 7fcbe1a87640 1 --2- 172.21.15.37:0/1418801255 >> v2:172.21.15.37:3300/0 conn(0x7fcbd400ab10 0x7fcbd4009d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:10:19.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.527+0000 7fcbe2a89640 1 --2- 172.21.15.37:0/1418801255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbd40516b0 0x7fcbd400a260 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc068ea0 tx=0x7fcbdc066000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=59a0d271b42e8d7d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.528+0000 7fcbe1286640 1 -- 172.21.15.37:0/1418801255 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc0a6b90 con 0x7fcbd40516b0 2023-12-11T17:10:19.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.528+0000 7fcbe1286640 1 -- 172.21.15.37:0/1418801255 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbdc0a6d30 con 0x7fcbd40516b0 2023-12-11T17:10:19.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.529+0000 7fcbe1286640 1 -- 172.21.15.37:0/1418801255 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbdc0ae640 con 0x7fcbd40516b0 2023-12-11T17:10:19.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.530+0000 7fcbe44ec640 1 -- 172.21.15.37:0/1418801255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbd40516b0 msgr2=0x7fcbd400a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.530+0000 7fcbe44ec640 1 --2- 172.21.15.37:0/1418801255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbd40516b0 0x7fcbd400a260 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fcbdc068ea0 tx=0x7fcbdc066000 comp rx=0 tx=0).stop 2023-12-11T17:10:19.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.530+0000 7fcbe44ec640 1 -- 172.21.15.37:0/1418801255 shutdown_connections 2023-12-11T17:10:19.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.531+0000 7fcbe44ec640 1 --2- 172.21.15.37:0/1418801255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbd40516b0 0x7fcbd400a260 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.531+0000 7fcbe44ec640 1 --2- 172.21.15.37:0/1418801255 >> v2:172.21.15.37:3300/0 conn(0x7fcbd400ab10 0x7fcbd4009d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.531+0000 7fcbe44ec640 1 -- 172.21.15.37:0/1418801255 >> 172.21.15.37:0/1418801255 conn(0x7fcbd4056ca0 msgr2=0x7fcbd40570b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:19.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.531+0000 7fcbe44ec640 1 -- 172.21.15.37:0/1418801255 shutdown_connections 2023-12-11T17:10:19.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.534+0000 7fcbe44ec640 1 -- 172.21.15.37:0/1418801255 wait complete. 2023-12-11T17:10:19.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.537+0000 7fcbe44ec640 1 Processor -- start 2023-12-11T17:10:19.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.537+0000 7fcbe44ec640 1 -- start start 2023-12-11T17:10:19.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.539+0000 7fcbe44ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbd400ab10 0x7fcbd404bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.540+0000 7fcbe44ec640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbd40516b0 0x7fcbd404f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.540+0000 7fcbe44ec640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbd40e12e0 0x7fcbd402e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.540+0000 7fcbe2288640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbd400ab10 0x7fcbd404bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.540+0000 7fcbe2288640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbd400ab10 0x7fcbd404bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38028/0 (socket says 172.21.15.37:38028) 2023-12-11T17:10:19.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.541+0000 7fcbe1a87640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbd40516b0 0x7fcbd404f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.541+0000 7fcbe1a87640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbd40516b0 0x7fcbd404f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:58818/0 (socket says 172.21.15.37:58818) 2023-12-11T17:10:19.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.541+0000 7fcbe2288640 1 -- 172.21.15.37:0/318206692 learned_addr learned my addr 172.21.15.37:0/318206692 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:19.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.541+0000 7fcbe2a89640 1 --2- 172.21.15.37:0/318206692 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbd40e12e0 0x7fcbd402e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.541+0000 7fcbe44ec640 1 -- 172.21.15.37:0/318206692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd404ae20 con 0x7fcbd400ab10 2023-12-11T17:10:19.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.541+0000 7fcbe44ec640 1 -- 172.21.15.37:0/318206692 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd404b100 con 0x7fcbd40516b0 2023-12-11T17:10:19.544 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.541+0000 7fcbe44ec640 1 -- 172.21.15.37:0/318206692 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbd404b3e0 con 0x7fcbd40e12e0 2023-12-11T17:10:19.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.543+0000 7fcbe2288640 1 -- 172.21.15.37:0/318206692 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbd40e12e0 msgr2=0x7fcbd402e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.543+0000 7fcbe2288640 1 --2- 172.21.15.37:0/318206692 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbd40e12e0 0x7fcbd402e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.543+0000 7fcbe2288640 1 -- 172.21.15.37:0/318206692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbd40516b0 msgr2=0x7fcbd404f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.543+0000 7fcbe2288640 1 --2- 172.21.15.37:0/318206692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbd40516b0 0x7fcbd404f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.543+0000 7fcbe2288640 1 -- 172.21.15.37:0/318206692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbdc074230 con 0x7fcbd400ab10 2023-12-11T17:10:19.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.543+0000 7fcbe2a89640 1 --2- 172.21.15.37:0/318206692 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbd40e12e0 0x7fcbd402e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:19.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.544+0000 7fcbe2288640 1 --2- 172.21.15.37:0/318206692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbd400ab10 0x7fcbd404bec0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00c410 tx=0x7fcbcc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.544+0000 7fcbd2ffd640 1 -- 172.21.15.37:0/318206692 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc005ce0 con 0x7fcbd400ab10 2023-12-11T17:10:19.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.545+0000 7fcbd2ffd640 1 -- 172.21.15.37:0/318206692 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbcc005e40 con 0x7fcbd400ab10 2023-12-11T17:10:19.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.545+0000 7fcbd2ffd640 1 -- 172.21.15.37:0/318206692 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbcc0072f0 con 0x7fcbd400ab10 2023-12-11T17:10:19.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.545+0000 7fcbe44ec640 1 -- 172.21.15.37:0/318206692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbd404b6c0 con 0x7fcbd400ab10 2023-12-11T17:10:19.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.545+0000 7fcbe44ec640 1 -- 172.21.15.37:0/318206692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbd40dfd40 con 0x7fcbd400ab10 2023-12-11T17:10:19.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.547+0000 7fcbe44ec640 1 -- 172.21.15.37:0/318206692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbd404bbe0 con 0x7fcbd400ab10 2023-12-11T17:10:19.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.553+0000 7fcbd2ffd640 1 -- 172.21.15.37:0/318206692 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcbcc007510 con 0x7fcbd400ab10 2023-12-11T17:10:19.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.554+0000 7fcbd2ffd640 1 --2- 172.21.15.37:0/318206692 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcbc006ae40 0x7fcbc006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:19.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.558+0000 7fcbe1a87640 1 --2- 172.21.15.37:0/318206692 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcbc006ae40 0x7fcbc006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:19.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.560+0000 7fcbd2ffd640 1 -- 172.21.15.37:0/318206692 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fcbcc0584f0 con 0x7fcbd400ab10 2023-12-11T17:10:19.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.562+0000 7fcbd2ffd640 1 -- 172.21.15.37:0/318206692 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcbcc054130 con 0x7fcbd400ab10 2023-12-11T17:10:19.567 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.565+0000 7fcbe1a87640 1 --2- 172.21.15.37:0/318206692 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcbc006ae40 0x7fcbc006d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8006fd0 tx=0x7fcbd8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:19.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.848+0000 7f52abfff640 1 -- 172.21.15.37:0/1233917280 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f52a404fc60 con 0x7f52a40e3130 2023-12-11T17:10:19.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.848+0000 7f3ff7c90640 1 -- 172.21.15.37:0/4030172820 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f3fd8005500 con 0x7f3fe803e810 2023-12-11T17:10:19.849 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.849+0000 7f3fe67fc640 1 -- 172.21.15.37:0/4030172820 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3fec057aa0 con 0x7f3fe803e810 2023-12-11T17:10:19.852 INFO:teuthology.orchestra.run.smithi037.stdout:60129542154 2023-12-11T17:10:19.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.849+0000 7f52937fe640 1 -- 172.21.15.37:0/1233917280 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f52ac099070 con 0x7f52a40e3130 2023-12-11T17:10:19.853 INFO:teuthology.orchestra.run.smithi037.stdout:60129542155 2023-12-11T17:10:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.852+0000 7f3ff7c90640 1 -- 172.21.15.37:0/4030172820 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3fd406aea0 msgr2=0x7f3fd406d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.852+0000 7f3ff7c90640 1 --2- 172.21.15.37:0/4030172820 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3fd406aea0 0x7f3fd406d360 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8057a50 tx=0x7f3fe0009040 comp rx=0 tx=0).stop 2023-12-11T17:10:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.853+0000 7f3ff7c90640 1 -- 172.21.15.37:0/4030172820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe803e810 msgr2=0x7f3fe81856d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.853+0000 7f3ff7c90640 1 --2- 172.21.15.37:0/4030172820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe803e810 0x7f3fe81856d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f3fec009fd0 tx=0x7f3fec00ed40 comp rx=0 tx=0).stop 2023-12-11T17:10:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.853+0000 7f3ff7c90640 1 -- 172.21.15.37:0/4030172820 shutdown_connections 2023-12-11T17:10:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.853+0000 7f3ff7c90640 1 --2- 172.21.15.37:0/4030172820 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3fd406aea0 0x7f3fd406d360 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.853+0000 7f3ff7c90640 1 --2- 172.21.15.37:0/4030172820 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe80542d0 0x7f3fe80e36e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.853+0000 7f3ff7c90640 1 --2- 172.21.15.37:0/4030172820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fe80e3090 0x7f3fe80e0c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.853+0000 7f3ff7c90640 1 --2- 172.21.15.37:0/4030172820 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe803e810 0x7f3fe81856d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.853+0000 7f3ff7c90640 1 -- 172.21.15.37:0/4030172820 >> 172.21.15.37:0/4030172820 conn(0x7f3fe80559b0 msgr2=0x7f3fe80db380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:19.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.853+0000 7f3ff7c90640 1 -- 172.21.15.37:0/4030172820 shutdown_connections 2023-12-11T17:10:19.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.853+0000 7f3ff7c90640 1 -- 172.21.15.37:0/4030172820 wait complete. 2023-12-11T17:10:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.854+0000 7f52abfff640 1 -- 172.21.15.37:0/1233917280 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f529806aed0 msgr2=0x7f529806d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.854+0000 7f52abfff640 1 --2- 172.21.15.37:0/1233917280 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f529806aed0 0x7f529806d390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f52a0036000 tx=0x7f52a0030000 comp rx=0 tx=0).stop 2023-12-11T17:10:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.854+0000 7f52abfff640 1 -- 172.21.15.37:0/1233917280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52a40e3130 msgr2=0x7f52a40d4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.854+0000 7f52abfff640 1 --2- 172.21.15.37:0/1233917280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52a40e3130 0x7f52a40d4360 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f52ac0697f0 tx=0x7f52ac067ed0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.854+0000 7f52abfff640 1 -- 172.21.15.37:0/1233917280 shutdown_connections 2023-12-11T17:10:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.854+0000 7f52abfff640 1 --2- 172.21.15.37:0/1233917280 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f529806aed0 0x7f529806d390 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.854+0000 7f52abfff640 1 --2- 172.21.15.37:0/1233917280 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f52a40e3130 0x7f52a40d4360 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.854+0000 7f52abfff640 1 --2- 172.21.15.37:0/1233917280 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f52a4053c80 0x7f52a4051b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.854+0000 7f52abfff640 1 --2- 172.21.15.37:0/1233917280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52a403c070 0x7f52a40e3690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.854+0000 7f52abfff640 1 -- 172.21.15.37:0/1233917280 >> 172.21.15.37:0/1233917280 conn(0x7f52a4058eb0 msgr2=0x7f52a40e1030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.855+0000 7f52abfff640 1 -- 172.21.15.37:0/1233917280 shutdown_connections 2023-12-11T17:10:19.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.855+0000 7f52abfff640 1 -- 172.21.15.37:0/1233917280 wait complete. 2023-12-11T17:10:19.884 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542155 for osd.0 2023-12-11T17:10:19.885 DEBUG:teuthology.parallel:result is None 2023-12-11T17:10:19.885 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.1 2023-12-11T17:10:19.885 DEBUG:teuthology.parallel:result is None 2023-12-11T17:10:19.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.891+0000 7f78b9b1d640 1 -- 172.21.15.37:0/2721933677 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f78b4149390 con 0x7f78b40b43e0 2023-12-11T17:10:19.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.892+0000 7f78abfff640 1 -- 172.21.15.37:0/2721933677 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f78b4149390 con 0x7f78b40b43e0 2023-12-11T17:10:19.893 INFO:teuthology.orchestra.run.smithi037.stdout:60129542155 2023-12-11T17:10:19.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.895+0000 7f2e03fff640 1 -- 172.21.15.37:0/790328914 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f2e04152e40 con 0x7f2e0406bdf0 2023-12-11T17:10:19.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.895+0000 7f78b9b1d640 1 -- 172.21.15.37:0/2721933677 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f789406af10 msgr2=0x7f789406d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.895+0000 7f78b9b1d640 1 --2- 172.21.15.37:0/2721933677 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f789406af10 0x7f789406d3d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f78a4007fd0 tx=0x7f78a4009040 comp rx=0 tx=0).stop 2023-12-11T17:10:19.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.895+0000 7f78b9b1d640 1 -- 172.21.15.37:0/2721933677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78b40b43e0 msgr2=0x7f78b41f1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.895+0000 7f78b9b1d640 1 --2- 172.21.15.37:0/2721933677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78b40b43e0 0x7f78b41f1ad0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f789c0091e0 tx=0x7f789c0046c0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.895+0000 7f78b9b1d640 1 -- 172.21.15.37:0/2721933677 shutdown_connections 2023-12-11T17:10:19.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.895+0000 7f78b9b1d640 1 --2- 172.21.15.37:0/2721933677 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f789406af10 0x7f789406d3d0 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f78a4007fd0 tx=0x7f78a4009040 comp rx=0 tx=0).stop 2023-12-11T17:10:19.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.895+0000 7f78b9b1d640 1 --2- 172.21.15.37:0/2721933677 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f78b415a580 0x7f78b4155e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.895+0000 7f78b9b1d640 1 --2- 172.21.15.37:0/2721933677 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f78b4153900 0x7f78b4153e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.896+0000 7f7d8ba4f640 1 -- 172.21.15.37:0/2819570780 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f7d840745d0 con 0x7f7d8416e100 2023-12-11T17:10:19.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.896+0000 7f78b9b1d640 1 --2- 172.21.15.37:0/2721933677 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f78b40b43e0 0x7f78b41f1ad0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.896+0000 7f78b9b1d640 1 -- 172.21.15.37:0/2721933677 >> 172.21.15.37:0/2721933677 conn(0x7f78b40b0a90 msgr2=0x7f78b4158cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:19.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.896+0000 7f78b9b1d640 1 -- 172.21.15.37:0/2721933677 shutdown_connections 2023-12-11T17:10:19.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.896+0000 7f78b9b1d640 1 -- 172.21.15.37:0/2721933677 wait complete. 2023-12-11T17:10:19.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.896+0000 7f2debfff640 1 -- 172.21.15.37:0/790328914 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2df8057860 con 0x7f2e0406bdf0 2023-12-11T17:10:19.900 INFO:teuthology.orchestra.run.smithi037.stdout:60129542154 2023-12-11T17:10:19.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.896+0000 7f7d79ffb640 1 -- 172.21.15.37:0/2819570780 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7d80037090 con 0x7f7d8416e100 2023-12-11T17:10:19.901 INFO:teuthology.orchestra.run.smithi037.stdout:60129542155 2023-12-11T17:10:19.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.897+0000 7f3b2c778640 1 -- 172.21.15.37:0/975663717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f3b0c005500 con 0x7f3b240b4750 2023-12-11T17:10:19.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.897+0000 7f3b1affd640 1 -- 172.21.15.37:0/975663717 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3b1c057a40 con 0x7f3b240b4750 2023-12-11T17:10:19.902 INFO:teuthology.orchestra.run.smithi037.stdout:60129542154 2023-12-11T17:10:19.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.899+0000 7f7d8ba4f640 1 -- 172.21.15.37:0/2819570780 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7d6806ae90 msgr2=0x7f7d6806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.899+0000 7f7d8ba4f640 1 --2- 172.21.15.37:0/2819570780 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7d6806ae90 0x7f7d6806d350 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f7d7c0012e0 tx=0x7f7d7c001740 comp rx=0 tx=0).stop 2023-12-11T17:10:19.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.899+0000 7f7d8ba4f640 1 -- 172.21.15.37:0/2819570780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d8416e100 msgr2=0x7f7d8420bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.899+0000 7f7d8ba4f640 1 --2- 172.21.15.37:0/2819570780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d8416e100 0x7f7d8420bbf0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f7d80032000 tx=0x7f7d800046c0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.900+0000 7f7d8ba4f640 1 -- 172.21.15.37:0/2819570780 shutdown_connections 2023-12-11T17:10:19.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.900+0000 7f7d8ba4f640 1 --2- 172.21.15.37:0/2819570780 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7d6806ae90 0x7f7d6806d350 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.900+0000 7f7d8ba4f640 1 --2- 172.21.15.37:0/2819570780 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7d84071270 0x7f7d8420b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.900+0000 7f7d8ba4f640 1 --2- 172.21.15.37:0/2819570780 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7d8416e100 0x7f7d8420bbf0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.900+0000 7f7d8ba4f640 1 --2- 172.21.15.37:0/2819570780 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7d8406c5f0 0x7f7d84167a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.900+0000 7f7d8ba4f640 1 -- 172.21.15.37:0/2819570780 >> 172.21.15.37:0/2819570780 conn(0x7f7d840b0a90 msgr2=0x7f7d840ce680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:19.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.900+0000 7f2e03fff640 1 -- 172.21.15.37:0/790328914 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f2df006af10 msgr2=0x7f2df006d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.900+0000 7f2e03fff640 1 --2- 172.21.15.37:0/790328914 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f2df006af10 0x7f2df006d3d0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2df4036000 tx=0x7f2df403d040 comp rx=0 tx=0).stop 2023-12-11T17:10:19.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.900+0000 7f2e03fff640 1 -- 172.21.15.37:0/790328914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e0406bdf0 msgr2=0x7f2e0413fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.900+0000 7f2e03fff640 1 --2- 172.21.15.37:0/790328914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e0406bdf0 0x7f2e0413fcf0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f2df80016c0 tx=0x7f2df8001b80 comp rx=0 tx=0).stop 2023-12-11T17:10:19.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.900+0000 7f2e03fff640 1 -- 172.21.15.37:0/790328914 shutdown_connections 2023-12-11T17:10:19.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.900+0000 7f2e03fff640 1 --2- 172.21.15.37:0/790328914 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f2df006af10 0x7f2df006d3d0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.900+0000 7f2e03fff640 1 --2- 172.21.15.37:0/790328914 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2e0415a180 0x7f2e0413c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.900+0000 7f2e03fff640 1 --2- 172.21.15.37:0/790328914 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2e04070070 0x7f2e04140230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.900+0000 7f2e03fff640 1 --2- 172.21.15.37:0/790328914 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2e0406bdf0 0x7f2e0413fcf0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.900+0000 7f2e03fff640 1 -- 172.21.15.37:0/790328914 >> 172.21.15.37:0/790328914 conn(0x7f2e040b0860 msgr2=0x7f2e040ad690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:19.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.900+0000 7f7d8ba4f640 1 -- 172.21.15.37:0/2819570780 shutdown_connections 2023-12-11T17:10:19.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.900+0000 7f7d8ba4f640 1 -- 172.21.15.37:0/2819570780 wait complete. 2023-12-11T17:10:19.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.900+0000 7f3b2c778640 1 -- 172.21.15.37:0/975663717 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3b0806ae60 msgr2=0x7f3b0806d320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.900+0000 7f3b2c778640 1 --2- 172.21.15.37:0/975663717 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3b0806ae60 0x7f3b0806d320 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3b20035000 tx=0x7f3b20030000 comp rx=0 tx=0).stop 2023-12-11T17:10:19.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.900+0000 7f3b2c778640 1 -- 172.21.15.37:0/975663717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b240b4750 msgr2=0x7f3b24158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.900+0000 7f3b2c778640 1 --2- 172.21.15.37:0/975663717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b240b4750 0x7f3b24158030 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00e9b0 tx=0x7f3b1c00ee70 comp rx=0 tx=0).stop 2023-12-11T17:10:19.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.901+0000 7f2e03fff640 1 -- 172.21.15.37:0/790328914 shutdown_connections 2023-12-11T17:10:19.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.901+0000 7f2e03fff640 1 -- 172.21.15.37:0/790328914 wait complete. 2023-12-11T17:10:19.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.901+0000 7f3b2c778640 1 -- 172.21.15.37:0/975663717 shutdown_connections 2023-12-11T17:10:19.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.901+0000 7f3b2c778640 1 --2- 172.21.15.37:0/975663717 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3b0806ae60 0x7f3b0806d320 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.901+0000 7f3b2c778640 1 --2- 172.21.15.37:0/975663717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b24165d30 0x7f3b240afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.901+0000 7f3b2c778640 1 --2- 172.21.15.37:0/975663717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b240b4750 0x7f3b24158030 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.901+0000 7f3b2c778640 1 --2- 172.21.15.37:0/975663717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b2406c950 0x7f3b240b3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.901+0000 7f3b2c778640 1 -- 172.21.15.37:0/975663717 >> 172.21.15.37:0/975663717 conn(0x7f3b240b0a90 msgr2=0x7f3b240cd0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:19.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.902+0000 7f3b2c778640 1 -- 172.21.15.37:0/975663717 shutdown_connections 2023-12-11T17:10:19.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.902+0000 7f3b2c778640 1 -- 172.21.15.37:0/975663717 wait complete. 2023-12-11T17:10:19.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.912+0000 7f786467c640 1 -- 172.21.15.37:0/3648420615 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f785c0c9b70 con 0x7f785c0b4770 2023-12-11T17:10:19.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.913+0000 7f785affd640 1 -- 172.21.15.37:0/3648420615 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f7850017020 con 0x7f785c0b4770 2023-12-11T17:10:19.915 INFO:teuthology.orchestra.run.smithi037.stdout:60129542154 2023-12-11T17:10:19.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.917+0000 7f786467c640 1 -- 172.21.15.37:0/3648420615 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f784806af10 msgr2=0x7f784806d3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.917+0000 7f786467c640 1 --2- 172.21.15.37:0/3648420615 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f784806af10 0x7f784806d3d0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f785c164f90 tx=0x7f7854009040 comp rx=0 tx=0).stop 2023-12-11T17:10:19.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.917+0000 7f786467c640 1 -- 172.21.15.37:0/3648420615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f785c0b4770 msgr2=0x7f785c0cac40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.917+0000 7f786467c640 1 --2- 172.21.15.37:0/3648420615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f785c0b4770 0x7f785c0cac40 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f785000c500 tx=0x7f785000c9c0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.917+0000 7f786467c640 1 -- 172.21.15.37:0/3648420615 shutdown_connections 2023-12-11T17:10:19.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.917+0000 7f786467c640 1 --2- 172.21.15.37:0/3648420615 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f784806af10 0x7f784806d3d0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.917+0000 7f786467c640 1 --2- 172.21.15.37:0/3648420615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f785c0d1e50 0x7f785c0ccb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.917+0000 7f786467c640 1 --2- 172.21.15.37:0/3648420615 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f785c0c6510 0x7f785c0cc630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.917+0000 7f786467c640 1 --2- 172.21.15.37:0/3648420615 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f785c0b4770 0x7f785c0cac40 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.917+0000 7f786467c640 1 -- 172.21.15.37:0/3648420615 >> 172.21.15.37:0/3648420615 conn(0x7f785c09c450 msgr2=0x7f785c161f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:19.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.918+0000 7f786467c640 1 -- 172.21.15.37:0/3648420615 shutdown_connections 2023-12-11T17:10:19.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.918+0000 7f786467c640 1 -- 172.21.15.37:0/3648420615 wait complete. 2023-12-11T17:10:19.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542155 got 60129542155 for osd.3 2023-12-11T17:10:19.923 DEBUG:teuthology.parallel:result is None 2023-12-11T17:10:19.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542155 for osd.4 2023-12-11T17:10:19.926 DEBUG:teuthology.parallel:result is None 2023-12-11T17:10:19.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.5 2023-12-11T17:10:19.931 DEBUG:teuthology.parallel:result is None 2023-12-11T17:10:19.932 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542154 for osd.7 2023-12-11T17:10:19.932 DEBUG:teuthology.parallel:result is None 2023-12-11T17:10:19.937 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542153 got 60129542154 for osd.2 2023-12-11T17:10:19.937 DEBUG:teuthology.parallel:result is None 2023-12-11T17:10:19.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.952+0000 7fcbe44ec640 1 -- 172.21.15.37:0/318206692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fcbd404bbe0 con 0x7fcbd400ab10 2023-12-11T17:10:19.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.953+0000 7fcbd2ffd640 1 -- 172.21.15.37:0/318206692 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fcbd404bbe0 con 0x7fcbd400ab10 2023-12-11T17:10:19.955 INFO:teuthology.orchestra.run.smithi037.stdout:60129542154 2023-12-11T17:10:19.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.955+0000 7fcbe44ec640 1 -- 172.21.15.37:0/318206692 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcbc006ae40 msgr2=0x7fcbc006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.955+0000 7fcbe44ec640 1 --2- 172.21.15.37:0/318206692 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcbc006ae40 0x7fcbc006d300 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fcbd8006fd0 tx=0x7fcbd8008040 comp rx=0 tx=0).stop 2023-12-11T17:10:19.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.955+0000 7fcbe44ec640 1 -- 172.21.15.37:0/318206692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbd400ab10 msgr2=0x7fcbd404bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:19.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.955+0000 7fcbe44ec640 1 --2- 172.21.15.37:0/318206692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbd400ab10 0x7fcbd404bec0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fcbcc00c410 tx=0x7fcbcc00c8d0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.955+0000 7fcbe44ec640 1 -- 172.21.15.37:0/318206692 shutdown_connections 2023-12-11T17:10:19.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.955+0000 7fcbe44ec640 1 --2- 172.21.15.37:0/318206692 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcbc006ae40 0x7fcbc006d300 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.955+0000 7fcbe44ec640 1 --2- 172.21.15.37:0/318206692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbd40516b0 0x7fcbd404f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.955+0000 7fcbe44ec640 1 --2- 172.21.15.37:0/318206692 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcbd40e12e0 0x7fcbd402e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.955+0000 7fcbe44ec640 1 --2- 172.21.15.37:0/318206692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcbd400ab10 0x7fcbd404bec0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:19.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.955+0000 7fcbe44ec640 1 -- 172.21.15.37:0/318206692 >> 172.21.15.37:0/318206692 conn(0x7fcbd4056ca0 msgr2=0x7fcbd4055d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:19.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.955+0000 7fcbe44ec640 1 -- 172.21.15.37:0/318206692 shutdown_connections 2023-12-11T17:10:19.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:19.955+0000 7fcbe44ec640 1 -- 172.21.15.37:0/318206692 wait complete. 2023-12-11T17:10:19.973 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542154 got 60129542154 for osd.6 2023-12-11T17:10:19.973 DEBUG:teuthology.parallel:result is None 2023-12-11T17:10:19.973 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-11T17:10:19.973 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-11T17:10:20.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.242+0000 7f9a8b278640 1 Processor -- start 2023-12-11T17:10:20.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.242+0000 7f9a8b278640 1 -- start start 2023-12-11T17:10:20.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.244+0000 7f9a8b278640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9a84070780 0x7f9a84071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:20.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.244+0000 7f9a8b278640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a840abd20 con 0x7f9a8415d150 2023-12-11T17:10:20.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.244+0000 7f9a8b278640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a8415d530 con 0x7f9a8406dd00 2023-12-11T17:10:20.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.244+0000 7f9a8b278640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a840b2950 con 0x7f9a84070780 2023-12-11T17:10:20.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.244+0000 7f9a8a276640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9a8415d150 0x7f9a84070070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41888/0 (socket says 172.21.15.37:41888) 2023-12-11T17:10:20.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.245+0000 7f9a8a276640 1 -- 172.21.15.37:0/3688793238 learned_addr learned my addr 172.21.15.37:0/3688793238 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:20.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.245+0000 7f9a89a75640 1 --2- 172.21.15.37:0/3688793238 >> v2:172.21.15.151:3300/0 conn(0x7f9a84070780 0x7f9a84071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:20.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.245+0000 7f9a89274640 1 -- 172.21.15.37:0/3688793238 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2149160982 0 0) 0x7f9a840abd20 con 0x7f9a8415d150 2023-12-11T17:10:20.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.245+0000 7f9a89274640 1 -- 172.21.15.37:0/3688793238 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9a70003520 con 0x7f9a8415d150 2023-12-11T17:10:20.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.245+0000 7f9a89274640 1 -- 172.21.15.37:0/3688793238 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1386601119 0 0) 0x7f9a70003520 con 0x7f9a8415d150 2023-12-11T17:10:20.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.245+0000 7f9a89274640 1 -- 172.21.15.37:0/3688793238 >> v2:172.21.15.151:3300/0 conn(0x7f9a84070780 msgr2=0x7f9a84071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:20.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.245+0000 7f9a89274640 1 --2- 172.21.15.37:0/3688793238 >> v2:172.21.15.151:3300/0 conn(0x7f9a84070780 0x7f9a84071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:20.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.245+0000 7f9a89274640 1 -- 172.21.15.37:0/3688793238 >> v1:172.21.15.151:6789/0 conn(0x7f9a8406dd00 legacy=0x7f9a8406c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:20.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.245+0000 7f9a89274640 1 -- 172.21.15.37:0/3688793238 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a840b2c30 con 0x7f9a8415d150 2023-12-11T17:10:20.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.245+0000 7f9a89274640 1 -- 172.21.15.37:0/3688793238 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f9a80001670 con 0x7f9a8415d150 2023-12-11T17:10:20.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.245+0000 7f9a89274640 1 -- 172.21.15.37:0/3688793238 >> v1:172.21.15.37:6789/0 conn(0x7f9a8415d150 legacy=0x7f9a84070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:20.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.246+0000 7f9a89274640 1 --2- 172.21.15.37:0/3688793238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a700039c0 0x7f9a70003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:20.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.246+0000 7f9a89274640 1 --2- 172.21.15.37:0/3688793238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a700047c0 0x7f9a70004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:20.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.246+0000 7f9a89274640 1 --2- 172.21.15.37:0/3688793238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a70005180 0x7f9a7000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:20.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.246+0000 7f9a89274640 1 -- 172.21.15.37:0/3688793238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a840b2950 con 0x7f9a700039c0 2023-12-11T17:10:20.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.246+0000 7f9a89274640 1 -- 172.21.15.37:0/3688793238 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7000c080 con 0x7f9a700047c0 2023-12-11T17:10:20.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.246+0000 7f9a89274640 1 -- 172.21.15.37:0/3688793238 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a7000c240 con 0x7f9a70005180 2023-12-11T17:10:20.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.246+0000 7f9a8a276640 1 --2- 172.21.15.37:0/3688793238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a700039c0 0x7f9a70003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:20.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.246+0000 7f9a89a75640 1 --2- 172.21.15.37:0/3688793238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a700047c0 0x7f9a70004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:20.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.246+0000 7f9a8a276640 1 -- 172.21.15.37:0/3688793238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a70005180 msgr2=0x7f9a7000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:20.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.246+0000 7f9a8aa77640 1 --2- 172.21.15.37:0/3688793238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a70005180 0x7f9a7000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:20.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.246+0000 7f9a8a276640 1 --2- 172.21.15.37:0/3688793238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a70005180 0x7f9a7000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:20.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.246+0000 7f9a8a276640 1 -- 172.21.15.37:0/3688793238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a700047c0 msgr2=0x7f9a70004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:20.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.246+0000 7f9a8a276640 1 --2- 172.21.15.37:0/3688793238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a700047c0 0x7f9a70004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:20.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.246+0000 7f9a8a276640 1 -- 172.21.15.37:0/3688793238 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a70003520 con 0x7f9a700039c0 2023-12-11T17:10:20.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.246+0000 7f9a89a75640 1 --2- 172.21.15.37:0/3688793238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a700047c0 0x7f9a70004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:20.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.246+0000 7f9a8aa77640 1 --2- 172.21.15.37:0/3688793238 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a70005180 0x7f9a7000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:20.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.246+0000 7f9a8aa77640 1 -- 172.21.15.37:0/3688793238 reap_dead start 2023-12-11T17:10:20.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.248+0000 7f9a8a276640 1 --2- 172.21.15.37:0/3688793238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a700039c0 0x7f9a70003de0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9a8000c0e0 tx=0x7f9a700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0527c712d89944f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:20.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.248+0000 7f9a89274640 1 -- 172.21.15.37:0/3688793238 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a80005ad0 con 0x7f9a700039c0 2023-12-11T17:10:20.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.248+0000 7f9a89274640 1 -- 172.21.15.37:0/3688793238 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a80005c50 con 0x7f9a700039c0 2023-12-11T17:10:20.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.248+0000 7f9a89274640 1 -- 172.21.15.37:0/3688793238 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8002c7f0 con 0x7f9a700039c0 2023-12-11T17:10:20.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.248+0000 7f9a8b278640 1 -- 172.21.15.37:0/3688793238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a700039c0 msgr2=0x7f9a70003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:20.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.248+0000 7f9a8b278640 1 --2- 172.21.15.37:0/3688793238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a700039c0 0x7f9a70003de0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f9a8000c0e0 tx=0x7f9a700057f0 comp rx=0 tx=0).stop 2023-12-11T17:10:20.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.248+0000 7f9a8b278640 1 -- 172.21.15.37:0/3688793238 shutdown_connections 2023-12-11T17:10:20.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.248+0000 7f9a8b278640 1 --2- 172.21.15.37:0/3688793238 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a700039c0 0x7f9a70003de0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:20.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.248+0000 7f9a8b278640 1 -- 172.21.15.37:0/3688793238 >> 172.21.15.37:0/3688793238 conn(0x7f9a840b0860 msgr2=0x7f9a840b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:20.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.249+0000 7f9a8b278640 1 -- 172.21.15.37:0/3688793238 shutdown_connections 2023-12-11T17:10:20.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.249+0000 7f9a8b278640 1 -- 172.21.15.37:0/3688793238 wait complete. 2023-12-11T17:10:20.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.250+0000 7f9a8b278640 1 Processor -- start 2023-12-11T17:10:20.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.251+0000 7f9a8b278640 1 -- start start 2023-12-11T17:10:20.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.251+0000 7f9a8b278640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a700039c0 0x7f9a8406cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:20.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.251+0000 7f9a8b278640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a841462c0 0x7f9a84146740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:20.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.251+0000 7f9a8b278640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a8409ac70 0x7f9a8409b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:20.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.251+0000 7f9a8b278640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a8409c620 con 0x7f9a841462c0 2023-12-11T17:10:20.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.252+0000 7f9a8b278640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a84146c80 con 0x7f9a700039c0 2023-12-11T17:10:20.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.252+0000 7f9a8b278640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a84158f00 con 0x7f9a8409ac70 2023-12-11T17:10:20.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.252+0000 7f9a89a75640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a841462c0 0x7f9a84146740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:20.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.252+0000 7f9a89a75640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a841462c0 0x7f9a84146740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38044/0 (socket says 172.21.15.37:38044) 2023-12-11T17:10:20.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.252+0000 7f9a89a75640 1 -- 172.21.15.37:0/4152182893 learned_addr learned my addr 172.21.15.37:0/4152182893 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:20.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.252+0000 7f9a8aa77640 1 --2- 172.21.15.37:0/4152182893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a8409ac70 0x7f9a8409b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:20.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.252+0000 7f9a8a276640 1 --2- 172.21.15.37:0/4152182893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a700039c0 0x7f9a8406cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:20.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.252+0000 7f9a89a75640 1 -- 172.21.15.37:0/4152182893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a8409ac70 msgr2=0x7f9a8409b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:20.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.252+0000 7f9a89a75640 1 --2- 172.21.15.37:0/4152182893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a8409ac70 0x7f9a8409b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:20.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.252+0000 7f9a89a75640 1 -- 172.21.15.37:0/4152182893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a700039c0 msgr2=0x7f9a8406cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:20.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.252+0000 7f9a89a75640 1 --2- 172.21.15.37:0/4152182893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a700039c0 0x7f9a8406cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:20.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.252+0000 7f9a89a75640 1 -- 172.21.15.37:0/4152182893 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8409ca40 con 0x7f9a841462c0 2023-12-11T17:10:20.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.253+0000 7f9a89a75640 1 --2- 172.21.15.37:0/4152182893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a841462c0 0x7f9a84146740 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9a74010950 tx=0x7f9a74010e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:20.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.253+0000 7f9a7affd640 1 -- 172.21.15.37:0/4152182893 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7400ebc0 con 0x7f9a841462c0 2023-12-11T17:10:20.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.253+0000 7f9a7affd640 1 -- 172.21.15.37:0/4152182893 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7400ed20 con 0x7f9a841462c0 2023-12-11T17:10:20.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.253+0000 7f9a8b278640 1 -- 172.21.15.37:0/4152182893 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a8409b9a0 con 0x7f9a841462c0 2023-12-11T17:10:20.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.253+0000 7f9a7affd640 1 -- 172.21.15.37:0/4152182893 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7401c640 con 0x7f9a841462c0 2023-12-11T17:10:20.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.253+0000 7f9a8b278640 1 -- 172.21.15.37:0/4152182893 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a8409bf60 con 0x7f9a841462c0 2023-12-11T17:10:20.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.255+0000 7f9a8b278640 1 -- 172.21.15.37:0/4152182893 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a84074450 con 0x7f9a841462c0 2023-12-11T17:10:20.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.256+0000 7f9a7affd640 1 -- 172.21.15.37:0/4152182893 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9a7401c7a0 con 0x7f9a841462c0 2023-12-11T17:10:20.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.257+0000 7f9a7affd640 1 --2- 172.21.15.37:0/4152182893 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9a6806ae70 0x7f9a6806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:20.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.257+0000 7f9a7affd640 1 -- 172.21.15.37:0/4152182893 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9a74089e60 con 0x7f9a841462c0 2023-12-11T17:10:20.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.257+0000 7f9a8a276640 1 --2- 172.21.15.37:0/4152182893 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9a6806ae70 0x7f9a6806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:20.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.258+0000 7f9a8a276640 1 --2- 172.21.15.37:0/4152182893 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9a6806ae70 0x7f9a6806d330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9a80034000 tx=0x7f9a80009030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:20.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.261+0000 7f9a7affd640 1 -- 172.21.15.37:0/4152182893 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9a74054b80 con 0x7f9a841462c0 2023-12-11T17:10:20.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.448+0000 7f9a8b278640 1 -- 172.21.15.37:0/4152182893 --> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9a8406c170 con 0x7f9a6806ae70 2023-12-11T17:10:20.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.474+0000 7f9a7affd640 1 -- 172.21.15.37:0/4152182893 <== mgr.4111 v2:172.21.15.151:6832/3081040918 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345083 (secure 0 0 0) 0x7f9a8003d040 con 0x7f9a6806ae70 2023-12-11T17:10:20.480 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:20.481 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-12-11T17:10:20.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.480+0000 7f9a8b278640 1 -- 172.21.15.37:0/4152182893 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9a6806ae70 msgr2=0x7f9a6806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:20.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.480+0000 7f9a8b278640 1 --2- 172.21.15.37:0/4152182893 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9a6806ae70 0x7f9a6806d330 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f9a80034000 tx=0x7f9a80009030 comp rx=0 tx=0).stop 2023-12-11T17:10:20.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.480+0000 7f9a8b278640 1 -- 172.21.15.37:0/4152182893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a841462c0 msgr2=0x7f9a84146740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:20.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.480+0000 7f9a8b278640 1 --2- 172.21.15.37:0/4152182893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a841462c0 0x7f9a84146740 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f9a74010950 tx=0x7f9a74010e10 comp rx=0 tx=0).stop 2023-12-11T17:10:20.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.480+0000 7f9a8b278640 1 -- 172.21.15.37:0/4152182893 shutdown_connections 2023-12-11T17:10:20.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.480+0000 7f9a8b278640 1 --2- 172.21.15.37:0/4152182893 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9a6806ae70 0x7f9a6806d330 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:20.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.480+0000 7f9a8b278640 1 --2- 172.21.15.37:0/4152182893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9a8409ac70 0x7f9a8409b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:20.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.480+0000 7f9a8b278640 1 --2- 172.21.15.37:0/4152182893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9a841462c0 0x7f9a84146740 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:20.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.480+0000 7f9a8b278640 1 --2- 172.21.15.37:0/4152182893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9a700039c0 0x7f9a8406cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:20.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.480+0000 7f9a8b278640 1 -- 172.21.15.37:0/4152182893 >> 172.21.15.37:0/4152182893 conn(0x7f9a840b0860 msgr2=0x7f9a840aeee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:20.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.480+0000 7f9a8b278640 1 -- 172.21.15.37:0/4152182893 shutdown_connections 2023-12-11T17:10:20.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.480+0000 7f9a8b278640 1 -- 172.21.15.37:0/4152182893 wait complete. 2023-12-11T17:10:20.498 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-12-11T17:10:20.351780+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595006,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219428,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755292,"statfs":{"total":773094113280,"available":772869419008,"internally_reserved":0,"allocated":3350528,"data_stored":2014708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005570"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.264778+0000","last_change":"2023-12-11T17:09:44.205494+0000","last_active":"2023-12-11T17:09:49.264778+0000","last_peered":"2023-12-11T17:09:49.264778+0000","last_clean":"2023-12-11T17:09:49.264778+0000","last_became_active":"2023-12-11T17:09:44.205155+0000","last_became_peered":"2023-12-11T17:09:44.205155+0000","last_unstale":"2023-12-11T17:09:49.264778+0000","last_undegraded":"2023-12-11T17:09:49.264778+0000","last_fullsized":"2023-12-11T17:09:49.264778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:13:55.603067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242077+0000","last_change":"2023-12-11T17:09:45.206887+0000","last_active":"2023-12-11T17:09:49.242077+0000","last_peered":"2023-12-11T17:09:49.242077+0000","last_clean":"2023-12-11T17:09:49.242077+0000","last_became_active":"2023-12-11T17:09:45.206696+0000","last_became_peered":"2023-12-11T17:09:45.206696+0000","last_unstale":"2023-12-11T17:09:49.242077+0000","last_undegraded":"2023-12-11T17:09:49.242077+0000","last_fullsized":"2023-12-11T17:09:49.242077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:13:50.995140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.248574+0000","last_change":"2023-12-11T17:09:49.282316+0000","last_active":"2023-12-11T17:09:50.248574+0000","last_peered":"2023-12-11T17:09:50.248574+0000","last_clean":"2023-12-11T17:09:50.248574+0000","last_became_active":"2023-12-11T17:09:49.281935+0000","last_became_peered":"2023-12-11T17:09:49.281935+0000","last_unstale":"2023-12-11T17:09:50.248574+0000","last_undegraded":"2023-12-11T17:09:50.248574+0000","last_fullsized":"2023-12-11T17:09:50.248574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:09:37.168887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242245+0000","last_change":"2023-12-11T17:09:44.197711+0000","last_active":"2023-12-11T17:09:49.242245+0000","last_peered":"2023-12-11T17:09:49.242245+0000","last_clean":"2023-12-11T17:09:49.242245+0000","last_became_active":"2023-12-11T17:09:44.197229+0000","last_became_peered":"2023-12-11T17:09:44.197229+0000","last_unstale":"2023-12-11T17:09:49.242245+0000","last_undegraded":"2023-12-11T17:09:49.242245+0000","last_fullsized":"2023-12-11T17:09:49.242245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:56:33.686127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.264591+0000","last_change":"2023-12-11T17:09:45.215263+0000","last_active":"2023-12-11T17:09:49.264591+0000","last_peered":"2023-12-11T17:09:49.264591+0000","last_clean":"2023-12-11T17:09:49.264591+0000","last_became_active":"2023-12-11T17:09:45.214989+0000","last_became_peered":"2023-12-11T17:09:45.214989+0000","last_unstale":"2023-12-11T17:09:49.264591+0000","last_undegraded":"2023-12-11T17:09:49.264591+0000","last_fullsized":"2023-12-11T17:09:49.264591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:05.364711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669349+0000","last_change":"2023-12-11T17:09:49.281985+0000","last_active":"2023-12-11T17:09:51.669349+0000","last_peered":"2023-12-11T17:09:51.669349+0000","last_clean":"2023-12-11T17:09:51.669349+0000","last_became_active":"2023-12-11T17:09:49.280479+0000","last_became_peered":"2023-12-11T17:09:49.280479+0000","last_unstale":"2023-12-11T17:09:51.669349+0000","last_undegraded":"2023-12-11T17:09:51.669349+0000","last_fullsized":"2023-12-11T17:09:51.669349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:13:55.059808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274621+0000","last_change":"2023-12-11T17:09:44.209993+0000","last_active":"2023-12-11T17:09:49.274621+0000","last_peered":"2023-12-11T17:09:49.274621+0000","last_clean":"2023-12-11T17:09:49.274621+0000","last_became_active":"2023-12-11T17:09:44.209695+0000","last_became_peered":"2023-12-11T17:09:44.209695+0000","last_unstale":"2023-12-11T17:09:49.274621+0000","last_undegraded":"2023-12-11T17:09:49.274621+0000","last_fullsized":"2023-12-11T17:09:49.274621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:08:15.250298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267955+0000","last_change":"2023-12-11T17:09:45.222374+0000","last_active":"2023-12-11T17:09:49.267955+0000","last_peered":"2023-12-11T17:09:49.267955+0000","last_clean":"2023-12-11T17:09:49.267955+0000","last_became_active":"2023-12-11T17:09:45.222069+0000","last_became_peered":"2023-12-11T17:09:45.222069+0000","last_unstale":"2023-12-11T17:09:49.267955+0000","last_undegraded":"2023-12-11T17:09:49.267955+0000","last_fullsized":"2023-12-11T17:09:49.267955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:33:36.618495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669784+0000","last_change":"2023-12-11T17:09:49.277595+0000","last_active":"2023-12-11T17:09:51.669784+0000","last_peered":"2023-12-11T17:09:51.669784+0000","last_clean":"2023-12-11T17:09:51.669784+0000","last_became_active":"2023-12-11T17:09:49.276806+0000","last_became_peered":"2023-12-11T17:09:49.276806+0000","last_unstale":"2023-12-11T17:09:51.669784+0000","last_undegraded":"2023-12-11T17:09:51.669784+0000","last_fullsized":"2023-12-11T17:09:51.669784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:08.141530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274475+0000","last_change":"2023-12-11T17:09:44.213170+0000","last_active":"2023-12-11T17:09:49.274475+0000","last_peered":"2023-12-11T17:09:49.274475+0000","last_clean":"2023-12-11T17:09:49.274475+0000","last_became_active":"2023-12-11T17:09:44.212695+0000","last_became_peered":"2023-12-11T17:09:44.212695+0000","last_unstale":"2023-12-11T17:09:49.274475+0000","last_undegraded":"2023-12-11T17:09:49.274475+0000","last_fullsized":"2023-12-11T17:09:49.274475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:38:29.306893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267473+0000","last_change":"2023-12-11T17:09:45.222217+0000","last_active":"2023-12-11T17:09:49.267473+0000","last_peered":"2023-12-11T17:09:49.267473+0000","last_clean":"2023-12-11T17:09:49.267473+0000","last_became_active":"2023-12-11T17:09:45.221985+0000","last_became_peered":"2023-12-11T17:09:45.221985+0000","last_unstale":"2023-12-11T17:09:49.267473+0000","last_undegraded":"2023-12-11T17:09:49.267473+0000","last_fullsized":"2023-12-11T17:09:49.267473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:02:04.180131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.668985+0000","last_change":"2023-12-11T17:09:49.271236+0000","last_active":"2023-12-11T17:09:51.668985+0000","last_peered":"2023-12-11T17:09:51.668985+0000","last_clean":"2023-12-11T17:09:51.668985+0000","last_became_active":"2023-12-11T17:09:49.268635+0000","last_became_peered":"2023-12-11T17:09:49.268635+0000","last_unstale":"2023-12-11T17:09:51.668985+0000","last_undegraded":"2023-12-11T17:09:51.668985+0000","last_fullsized":"2023-12-11T17:09:51.668985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:36:14.458597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244251+0000","last_change":"2023-12-11T17:09:45.215612+0000","last_active":"2023-12-11T17:09:49.244251+0000","last_peered":"2023-12-11T17:09:49.244251+0000","last_clean":"2023-12-11T17:09:49.244251+0000","last_became_active":"2023-12-11T17:09:45.215222+0000","last_became_peered":"2023-12-11T17:09:45.215222+0000","last_unstale":"2023-12-11T17:09:49.244251+0000","last_undegraded":"2023-12-11T17:09:49.244251+0000","last_fullsized":"2023-12-11T17:09:49.244251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:39:10.691125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275270+0000","last_change":"2023-12-11T17:09:44.208572+0000","last_active":"2023-12-11T17:09:49.275270+0000","last_peered":"2023-12-11T17:09:49.275270+0000","last_clean":"2023-12-11T17:09:49.275270+0000","last_became_active":"2023-12-11T17:09:44.208062+0000","last_became_peered":"2023-12-11T17:09:44.208062+0000","last_unstale":"2023-12-11T17:09:49.275270+0000","last_undegraded":"2023-12-11T17:09:49.275270+0000","last_fullsized":"2023-12-11T17:09:49.275270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:22:33.669469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669908+0000","last_change":"2023-12-11T17:09:49.280949+0000","last_active":"2023-12-11T17:09:51.669908+0000","last_peered":"2023-12-11T17:09:51.669908+0000","last_clean":"2023-12-11T17:09:51.669908+0000","last_became_active":"2023-12-11T17:09:49.280486+0000","last_became_peered":"2023-12-11T17:09:49.280486+0000","last_unstale":"2023-12-11T17:09:51.669908+0000","last_undegraded":"2023-12-11T17:09:51.669908+0000","last_fullsized":"2023-12-11T17:09:51.669908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:28:35.459824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242397+0000","last_change":"2023-12-11T17:09:45.200951+0000","last_active":"2023-12-11T17:09:49.242397+0000","last_peered":"2023-12-11T17:09:49.242397+0000","last_clean":"2023-12-11T17:09:49.242397+0000","last_became_active":"2023-12-11T17:09:45.199504+0000","last_became_peered":"2023-12-11T17:09:45.199504+0000","last_unstale":"2023-12-11T17:09:49.242397+0000","last_undegraded":"2023-12-11T17:09:49.242397+0000","last_fullsized":"2023-12-11T17:09:49.242397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:51:29.300195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.247683+0000","last_change":"2023-12-11T17:09:44.195059+0000","last_active":"2023-12-11T17:09:49.247683+0000","last_peered":"2023-12-11T17:09:49.247683+0000","last_clean":"2023-12-11T17:09:49.247683+0000","last_became_active":"2023-12-11T17:09:44.194799+0000","last_became_peered":"2023-12-11T17:09:44.194799+0000","last_unstale":"2023-12-11T17:09:49.247683+0000","last_undegraded":"2023-12-11T17:09:49.247683+0000","last_fullsized":"2023-12-11T17:09:49.247683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:43:26.684582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669518+0000","last_change":"2023-12-11T17:09:49.279664+0000","last_active":"2023-12-11T17:09:51.669518+0000","last_peered":"2023-12-11T17:09:51.669518+0000","last_clean":"2023-12-11T17:09:51.669518+0000","last_became_active":"2023-12-11T17:09:49.279207+0000","last_became_peered":"2023-12-11T17:09:49.279207+0000","last_unstale":"2023-12-11T17:09:51.669518+0000","last_undegraded":"2023-12-11T17:09:51.669518+0000","last_fullsized":"2023-12-11T17:09:51.669518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:02:08.244798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242731+0000","last_change":"2023-12-11T17:09:45.209162+0000","last_active":"2023-12-11T17:09:49.242731+0000","last_peered":"2023-12-11T17:09:49.242731+0000","last_clean":"2023-12-11T17:09:49.242731+0000","last_became_active":"2023-12-11T17:09:45.204781+0000","last_became_peered":"2023-12-11T17:09:45.204781+0000","last_unstale":"2023-12-11T17:09:49.242731+0000","last_undegraded":"2023-12-11T17:09:49.242731+0000","last_fullsized":"2023-12-11T17:09:49.242731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:27:18.925357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.241243+0000","last_change":"2023-12-11T17:09:44.196375+0000","last_active":"2023-12-11T17:09:49.241243+0000","last_peered":"2023-12-11T17:09:49.241243+0000","last_clean":"2023-12-11T17:09:49.241243+0000","last_became_active":"2023-12-11T17:09:44.196046+0000","last_became_peered":"2023-12-11T17:09:44.196046+0000","last_unstale":"2023-12-11T17:09:49.241243+0000","last_undegraded":"2023-12-11T17:09:49.241243+0000","last_fullsized":"2023-12-11T17:09:49.241243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:42:30.903444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.673124+0000","last_change":"2023-12-11T17:09:49.280698+0000","last_active":"2023-12-11T17:09:51.673124+0000","last_peered":"2023-12-11T17:09:51.673124+0000","last_clean":"2023-12-11T17:09:51.673124+0000","last_became_active":"2023-12-11T17:09:49.280309+0000","last_became_peered":"2023-12-11T17:09:49.280309+0000","last_unstale":"2023-12-11T17:09:51.673124+0000","last_undegraded":"2023-12-11T17:09:51.673124+0000","last_fullsized":"2023-12-11T17:09:51.673124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:24:45.184380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.270508+0000","last_change":"2023-12-11T17:09:45.210450+0000","last_active":"2023-12-11T17:09:49.270508+0000","last_peered":"2023-12-11T17:09:49.270508+0000","last_clean":"2023-12-11T17:09:49.270508+0000","last_became_active":"2023-12-11T17:09:45.202201+0000","last_became_peered":"2023-12-11T17:09:45.202201+0000","last_unstale":"2023-12-11T17:09:49.270508+0000","last_undegraded":"2023-12-11T17:09:49.270508+0000","last_fullsized":"2023-12-11T17:09:49.270508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:43:19.164503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.271955+0000","last_change":"2023-12-11T17:09:44.209283+0000","last_active":"2023-12-11T17:09:49.271955+0000","last_peered":"2023-12-11T17:09:49.271955+0000","last_clean":"2023-12-11T17:09:49.271955+0000","last_became_active":"2023-12-11T17:09:44.208995+0000","last_became_peered":"2023-12-11T17:09:44.208995+0000","last_unstale":"2023-12-11T17:09:49.271955+0000","last_undegraded":"2023-12-11T17:09:49.271955+0000","last_fullsized":"2023-12-11T17:09:49.271955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:43:26.684582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669445+0000","last_change":"2023-12-11T17:09:49.278872+0000","last_active":"2023-12-11T17:09:51.669445+0000","last_peered":"2023-12-11T17:09:51.669445+0000","last_clean":"2023-12-11T17:09:51.669445+0000","last_became_active":"2023-12-11T17:09:49.276738+0000","last_became_peered":"2023-12-11T17:09:49.276738+0000","last_unstale":"2023-12-11T17:09:51.669445+0000","last_undegraded":"2023-12-11T17:09:51.669445+0000","last_fullsized":"2023-12-11T17:09:51.669445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:17:51.127675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.261226+0000","last_change":"2023-12-11T17:09:45.211027+0000","last_active":"2023-12-11T17:09:49.261226+0000","last_peered":"2023-12-11T17:09:49.261226+0000","last_clean":"2023-12-11T17:09:49.261226+0000","last_became_active":"2023-12-11T17:09:45.210763+0000","last_became_peered":"2023-12-11T17:09:45.210763+0000","last_unstale":"2023-12-11T17:09:49.261226+0000","last_undegraded":"2023-12-11T17:09:49.261226+0000","last_fullsized":"2023-12-11T17:09:49.261226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:08:16.262435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.247483+0000","last_change":"2023-12-11T17:09:44.203386+0000","last_active":"2023-12-11T17:09:49.247483+0000","last_peered":"2023-12-11T17:09:49.247483+0000","last_clean":"2023-12-11T17:09:49.247483+0000","last_became_active":"2023-12-11T17:09:44.203053+0000","last_became_peered":"2023-12-11T17:09:44.203053+0000","last_unstale":"2023-12-11T17:09:49.247483+0000","last_undegraded":"2023-12-11T17:09:49.247483+0000","last_fullsized":"2023-12-11T17:09:49.247483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:44.213311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.668973+0000","last_change":"2023-12-11T17:09:49.282875+0000","last_active":"2023-12-11T17:09:51.668973+0000","last_peered":"2023-12-11T17:09:51.668973+0000","last_clean":"2023-12-11T17:09:51.668973+0000","last_became_active":"2023-12-11T17:09:49.282315+0000","last_became_peered":"2023-12-11T17:09:49.282315+0000","last_unstale":"2023-12-11T17:09:51.668973+0000","last_undegraded":"2023-12-11T17:09:51.668973+0000","last_fullsized":"2023-12-11T17:09:51.668973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:51:33.364863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.243142+0000","last_change":"2023-12-11T17:09:45.195150+0000","last_active":"2023-12-11T17:09:49.243142+0000","last_peered":"2023-12-11T17:09:49.243142+0000","last_clean":"2023-12-11T17:09:49.243142+0000","last_became_active":"2023-12-11T17:09:45.194871+0000","last_became_peered":"2023-12-11T17:09:45.194871+0000","last_unstale":"2023-12-11T17:09:49.243142+0000","last_undegraded":"2023-12-11T17:09:49.243142+0000","last_fullsized":"2023-12-11T17:09:49.243142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:36:10.393929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.247741+0000","last_change":"2023-12-11T17:09:44.194695+0000","last_active":"2023-12-11T17:09:49.247741+0000","last_peered":"2023-12-11T17:09:49.247741+0000","last_clean":"2023-12-11T17:09:49.247741+0000","last_became_active":"2023-12-11T17:09:44.193709+0000","last_became_peered":"2023-12-11T17:09:44.193709+0000","last_unstale":"2023-12-11T17:09:49.247741+0000","last_undegraded":"2023-12-11T17:09:49.247741+0000","last_fullsized":"2023-12-11T17:09:49.247741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:47:06.501355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.245990+0000","last_change":"2023-12-11T17:09:49.278389+0000","last_active":"2023-12-11T17:09:50.245990+0000","last_peered":"2023-12-11T17:09:50.245990+0000","last_clean":"2023-12-11T17:09:50.245990+0000","last_became_active":"2023-12-11T17:09:49.277824+0000","last_became_peered":"2023-12-11T17:09:49.277824+0000","last_unstale":"2023-12-11T17:09:50.245990+0000","last_undegraded":"2023-12-11T17:09:50.245990+0000","last_fullsized":"2023-12-11T17:09:50.245990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:35:53.618553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244690+0000","last_change":"2023-12-11T17:09:45.201703+0000","last_active":"2023-12-11T17:09:49.244690+0000","last_peered":"2023-12-11T17:09:49.244690+0000","last_clean":"2023-12-11T17:09:49.244690+0000","last_became_active":"2023-12-11T17:09:45.200824+0000","last_became_peered":"2023-12-11T17:09:45.200824+0000","last_unstale":"2023-12-11T17:09:49.244690+0000","last_undegraded":"2023-12-11T17:09:49.244690+0000","last_fullsized":"2023-12-11T17:09:49.244690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:39:10.691125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274750+0000","last_change":"2023-12-11T17:09:44.208756+0000","last_active":"2023-12-11T17:09:49.274750+0000","last_peered":"2023-12-11T17:09:49.274750+0000","last_clean":"2023-12-11T17:09:49.274750+0000","last_became_active":"2023-12-11T17:09:44.208390+0000","last_became_peered":"2023-12-11T17:09:44.208390+0000","last_unstale":"2023-12-11T17:09:49.274750+0000","last_undegraded":"2023-12-11T17:09:49.274750+0000","last_fullsized":"2023-12-11T17:09:49.274750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:04.352574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.671162+0000","last_change":"2023-12-11T17:09:49.283760+0000","last_active":"2023-12-11T17:09:51.671162+0000","last_peered":"2023-12-11T17:09:51.671162+0000","last_clean":"2023-12-11T17:09:51.671162+0000","last_became_active":"2023-12-11T17:09:49.281062+0000","last_became_peered":"2023-12-11T17:09:49.281062+0000","last_unstale":"2023-12-11T17:09:51.671162+0000","last_undegraded":"2023-12-11T17:09:51.671162+0000","last_fullsized":"2023-12-11T17:09:51.671162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:01:12.186325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267581+0000","last_change":"2023-12-11T17:09:45.214708+0000","last_active":"2023-12-11T17:09:49.267581+0000","last_peered":"2023-12-11T17:09:49.267581+0000","last_clean":"2023-12-11T17:09:49.267581+0000","last_became_active":"2023-12-11T17:09:45.214453+0000","last_became_peered":"2023-12-11T17:09:45.214453+0000","last_unstale":"2023-12-11T17:09:49.267581+0000","last_undegraded":"2023-12-11T17:09:49.267581+0000","last_fullsized":"2023-12-11T17:09:49.267581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:04.076862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244838+0000","last_change":"2023-12-11T17:09:44.192839+0000","last_active":"2023-12-11T17:09:49.244838+0000","last_peered":"2023-12-11T17:09:49.244838+0000","last_clean":"2023-12-11T17:09:49.244838+0000","last_became_active":"2023-12-11T17:09:44.192441+0000","last_became_peered":"2023-12-11T17:09:44.192441+0000","last_unstale":"2023-12-11T17:09:49.244838+0000","last_undegraded":"2023-12-11T17:09:49.244838+0000","last_fullsized":"2023-12-11T17:09:49.244838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:52:53.972126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.670689+0000","last_change":"2023-12-11T17:09:49.270432+0000","last_active":"2023-12-11T17:09:51.670689+0000","last_peered":"2023-12-11T17:09:51.670689+0000","last_clean":"2023-12-11T17:09:51.670689+0000","last_became_active":"2023-12-11T17:09:49.269987+0000","last_became_peered":"2023-12-11T17:09:49.269987+0000","last_unstale":"2023-12-11T17:09:51.670689+0000","last_undegraded":"2023-12-11T17:09:51.670689+0000","last_fullsized":"2023-12-11T17:09:51.670689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:08.141530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.271570+0000","last_change":"2023-12-11T17:09:45.222655+0000","last_active":"2023-12-11T17:09:49.271570+0000","last_peered":"2023-12-11T17:09:49.271570+0000","last_clean":"2023-12-11T17:09:49.271570+0000","last_became_active":"2023-12-11T17:09:45.222198+0000","last_became_peered":"2023-12-11T17:09:45.222198+0000","last_unstale":"2023-12-11T17:09:49.271570+0000","last_undegraded":"2023-12-11T17:09:49.271570+0000","last_fullsized":"2023-12-11T17:09:49.271570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:28:10.075039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.263830+0000","last_change":"2023-12-11T17:09:44.207657+0000","last_active":"2023-12-11T17:09:49.263830+0000","last_peered":"2023-12-11T17:09:49.263830+0000","last_clean":"2023-12-11T17:09:49.263830+0000","last_became_active":"2023-12-11T17:09:44.205012+0000","last_became_peered":"2023-12-11T17:09:44.205012+0000","last_unstale":"2023-12-11T17:09:49.263830+0000","last_undegraded":"2023-12-11T17:09:49.263830+0000","last_fullsized":"2023-12-11T17:09:49.263830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:17:03.000720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.672166+0000","last_change":"2023-12-11T17:09:49.270417+0000","last_active":"2023-12-11T17:09:51.672166+0000","last_peered":"2023-12-11T17:09:51.672166+0000","last_clean":"2023-12-11T17:09:51.672166+0000","last_became_active":"2023-12-11T17:09:49.270052+0000","last_became_peered":"2023-12-11T17:09:49.270052+0000","last_unstale":"2023-12-11T17:09:51.672166+0000","last_undegraded":"2023-12-11T17:09:51.672166+0000","last_fullsized":"2023-12-11T17:09:51.672166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:03:14.942737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.240098+0000","last_change":"2023-12-11T17:09:45.205128+0000","last_active":"2023-12-11T17:09:49.240098+0000","last_peered":"2023-12-11T17:09:49.240098+0000","last_clean":"2023-12-11T17:09:49.240098+0000","last_became_active":"2023-12-11T17:09:45.204869+0000","last_became_peered":"2023-12-11T17:09:45.204869+0000","last_unstale":"2023-12-11T17:09:49.240098+0000","last_undegraded":"2023-12-11T17:09:49.240098+0000","last_fullsized":"2023-12-11T17:09:49.240098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:17:04.012857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.250848+0000","last_change":"2023-12-11T17:09:44.198305+0000","last_active":"2023-12-11T17:09:49.250848+0000","last_peered":"2023-12-11T17:09:49.250848+0000","last_clean":"2023-12-11T17:09:49.250848+0000","last_became_active":"2023-12-11T17:09:44.196890+0000","last_became_peered":"2023-12-11T17:09:44.196890+0000","last_unstale":"2023-12-11T17:09:49.250848+0000","last_undegraded":"2023-12-11T17:09:49.250848+0000","last_fullsized":"2023-12-11T17:09:49.250848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:59:22.990940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.673145+0000","last_change":"2023-12-11T17:09:49.272669+0000","last_active":"2023-12-11T17:09:51.673145+0000","last_peered":"2023-12-11T17:09:51.673145+0000","last_clean":"2023-12-11T17:09:51.673145+0000","last_became_active":"2023-12-11T17:09:49.269739+0000","last_became_peered":"2023-12-11T17:09:49.269739+0000","last_unstale":"2023-12-11T17:09:51.673145+0000","last_undegraded":"2023-12-11T17:09:51.673145+0000","last_fullsized":"2023-12-11T17:09:51.673145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:01:12.186325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259188+0000","last_change":"2023-12-11T17:09:45.215855+0000","last_active":"2023-12-11T17:09:49.259188+0000","last_peered":"2023-12-11T17:09:49.259188+0000","last_clean":"2023-12-11T17:09:49.259188+0000","last_became_active":"2023-12-11T17:09:45.214930+0000","last_became_peered":"2023-12-11T17:09:45.214930+0000","last_unstale":"2023-12-11T17:09:49.259188+0000","last_undegraded":"2023-12-11T17:09:49.259188+0000","last_fullsized":"2023-12-11T17:09:49.259188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:38:30.319030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.272045+0000","last_change":"2023-12-11T17:09:44.206866+0000","last_active":"2023-12-11T17:09:49.272045+0000","last_peered":"2023-12-11T17:09:49.272045+0000","last_clean":"2023-12-11T17:09:49.272045+0000","last_became_active":"2023-12-11T17:09:44.205821+0000","last_became_peered":"2023-12-11T17:09:44.205821+0000","last_unstale":"2023-12-11T17:09:49.272045+0000","last_undegraded":"2023-12-11T17:09:49.272045+0000","last_fullsized":"2023-12-11T17:09:49.272045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:44.213311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.670848+0000","last_change":"2023-12-11T17:09:49.285904+0000","last_active":"2023-12-11T17:09:51.670848+0000","last_peered":"2023-12-11T17:09:51.670848+0000","last_clean":"2023-12-11T17:09:51.670848+0000","last_became_active":"2023-12-11T17:09:49.282906+0000","last_became_peered":"2023-12-11T17:09:49.282906+0000","last_unstale":"2023-12-11T17:09:51.670848+0000","last_undegraded":"2023-12-11T17:09:51.670848+0000","last_fullsized":"2023-12-11T17:09:51.670848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:03:14.942737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242151+0000","last_change":"2023-12-11T17:09:45.213664+0000","last_active":"2023-12-11T17:09:49.242151+0000","last_peered":"2023-12-11T17:09:49.242151+0000","last_clean":"2023-12-11T17:09:49.242151+0000","last_became_active":"2023-12-11T17:09:45.213356+0000","last_became_peered":"2023-12-11T17:09:45.213356+0000","last_unstale":"2023-12-11T17:09:49.242151+0000","last_undegraded":"2023-12-11T17:09:49.242151+0000","last_fullsized":"2023-12-11T17:09:49.242151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:17:04.012857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.266436+0000","last_change":"2023-12-11T17:09:44.196934+0000","last_active":"2023-12-11T17:09:49.266436+0000","last_peered":"2023-12-11T17:09:49.266436+0000","last_clean":"2023-12-11T17:09:49.266436+0000","last_became_active":"2023-12-11T17:09:44.192526+0000","last_became_peered":"2023-12-11T17:09:44.192526+0000","last_unstale":"2023-12-11T17:09:49.266436+0000","last_undegraded":"2023-12-11T17:09:49.266436+0000","last_fullsized":"2023-12-11T17:09:49.266436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:08:15.250298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.272132+0000","last_change":"2023-12-11T17:09:40.320298+0000","last_active":"2023-12-11T17:09:49.272132+0000","last_peered":"2023-12-11T17:09:49.272132+0000","last_clean":"2023-12-11T17:09:49.272132+0000","last_became_active":"2023-12-11T17:09:40.318118+0000","last_became_peered":"2023-12-11T17:09:40.318118+0000","last_unstale":"2023-12-11T17:09:49.272132+0000","last_undegraded":"2023-12-11T17:09:49.272132+0000","last_fullsized":"2023-12-11T17:09:49.272132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:38.641841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:38.641841+0000","last_clean_scrub_stamp":"2023-12-11T17:09:38.641841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:36:05.856847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.246854+0000","last_change":"2023-12-11T17:09:49.284105+0000","last_active":"2023-12-11T17:09:50.246854+0000","last_peered":"2023-12-11T17:09:50.246854+0000","last_clean":"2023-12-11T17:09:50.246854+0000","last_became_active":"2023-12-11T17:09:49.282365+0000","last_became_peered":"2023-12-11T17:09:49.282365+0000","last_unstale":"2023-12-11T17:09:50.246854+0000","last_undegraded":"2023-12-11T17:09:50.246854+0000","last_fullsized":"2023-12-11T17:09:50.246854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:33:40.683163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274490+0000","last_change":"2023-12-11T17:09:45.227132+0000","last_active":"2023-12-11T17:09:49.274490+0000","last_peered":"2023-12-11T17:09:49.274490+0000","last_clean":"2023-12-11T17:09:49.274490+0000","last_became_active":"2023-12-11T17:09:45.224674+0000","last_became_peered":"2023-12-11T17:09:45.224674+0000","last_unstale":"2023-12-11T17:09:49.274490+0000","last_undegraded":"2023-12-11T17:09:49.274490+0000","last_fullsized":"2023-12-11T17:09:49.274490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:02:04.180131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.251498+0000","last_change":"2023-12-11T17:09:44.207068+0000","last_active":"2023-12-11T17:09:49.251498+0000","last_peered":"2023-12-11T17:09:49.251498+0000","last_clean":"2023-12-11T17:09:49.251498+0000","last_became_active":"2023-12-11T17:09:44.206365+0000","last_became_peered":"2023-12-11T17:09:44.206365+0000","last_unstale":"2023-12-11T17:09:49.251498+0000","last_undegraded":"2023-12-11T17:09:49.251498+0000","last_fullsized":"2023-12-11T17:09:49.251498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:53:23.727946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.245537+0000","last_change":"2023-12-11T17:09:49.282432+0000","last_active":"2023-12-11T17:09:50.245537+0000","last_peered":"2023-12-11T17:09:50.245537+0000","last_clean":"2023-12-11T17:09:50.245537+0000","last_became_active":"2023-12-11T17:09:49.281688+0000","last_became_peered":"2023-12-11T17:09:49.281688+0000","last_unstale":"2023-12-11T17:09:50.245537+0000","last_undegraded":"2023-12-11T17:09:50.245537+0000","last_fullsized":"2023-12-11T17:09:50.245537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:02:08.244798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.268082+0000","last_change":"2023-12-11T17:09:45.212177+0000","last_active":"2023-12-11T17:09:49.268082+0000","last_peered":"2023-12-11T17:09:49.268082+0000","last_clean":"2023-12-11T17:09:49.268082+0000","last_became_active":"2023-12-11T17:09:45.211897+0000","last_became_peered":"2023-12-11T17:09:45.211897+0000","last_unstale":"2023-12-11T17:09:49.268082+0000","last_undegraded":"2023-12-11T17:09:49.268082+0000","last_fullsized":"2023-12-11T17:09:49.268082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:28:31.395156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244887+0000","last_change":"2023-12-11T17:09:44.200317+0000","last_active":"2023-12-11T17:09:49.244887+0000","last_peered":"2023-12-11T17:09:49.244887+0000","last_clean":"2023-12-11T17:09:49.244887+0000","last_became_active":"2023-12-11T17:09:44.199797+0000","last_became_peered":"2023-12-11T17:09:44.199797+0000","last_unstale":"2023-12-11T17:09:49.244887+0000","last_undegraded":"2023-12-11T17:09:49.244887+0000","last_fullsized":"2023-12-11T17:09:49.244887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:56:33.686127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.670045+0000","last_change":"2023-12-11T17:09:49.267135+0000","last_active":"2023-12-11T17:09:51.670045+0000","last_peered":"2023-12-11T17:09:51.670045+0000","last_clean":"2023-12-11T17:09:51.670045+0000","last_became_active":"2023-12-11T17:09:49.266709+0000","last_became_peered":"2023-12-11T17:09:49.266709+0000","last_unstale":"2023-12-11T17:09:51.670045+0000","last_undegraded":"2023-12-11T17:09:51.670045+0000","last_fullsized":"2023-12-11T17:09:51.670045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:08.141530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275410+0000","last_change":"2023-12-11T17:09:45.227783+0000","last_active":"2023-12-11T17:09:49.275410+0000","last_peered":"2023-12-11T17:09:49.275410+0000","last_clean":"2023-12-11T17:09:49.275410+0000","last_became_active":"2023-12-11T17:09:45.225563+0000","last_became_peered":"2023-12-11T17:09:45.225563+0000","last_unstale":"2023-12-11T17:09:49.275410+0000","last_undegraded":"2023-12-11T17:09:49.275410+0000","last_fullsized":"2023-12-11T17:09:49.275410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:35:49.553886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.252708+0000","last_change":"2023-12-11T17:09:44.197835+0000","last_active":"2023-12-11T17:09:49.252708+0000","last_peered":"2023-12-11T17:09:49.252708+0000","last_clean":"2023-12-11T17:09:49.252708+0000","last_became_active":"2023-12-11T17:09:44.197550+0000","last_became_peered":"2023-12-11T17:09:44.197550+0000","last_unstale":"2023-12-11T17:09:49.252708+0000","last_undegraded":"2023-12-11T17:09:49.252708+0000","last_fullsized":"2023-12-11T17:09:49.252708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:48:05.507260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.734122+0000","last_change":"2023-12-11T17:09:49.277218+0000","last_active":"2023-12-11T17:09:50.734122+0000","last_peered":"2023-12-11T17:09:50.734122+0000","last_clean":"2023-12-11T17:09:50.734122+0000","last_became_active":"2023-12-11T17:09:49.276790+0000","last_became_peered":"2023-12-11T17:09:49.276790+0000","last_unstale":"2023-12-11T17:09:50.734122+0000","last_undegraded":"2023-12-11T17:09:50.734122+0000","last_fullsized":"2023-12-11T17:09:50.734122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:09:37.168887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274765+0000","last_change":"2023-12-11T17:09:45.228047+0000","last_active":"2023-12-11T17:09:49.274765+0000","last_peered":"2023-12-11T17:09:49.274765+0000","last_clean":"2023-12-11T17:09:49.274765+0000","last_became_active":"2023-12-11T17:09:45.225286+0000","last_became_peered":"2023-12-11T17:09:45.225286+0000","last_unstale":"2023-12-11T17:09:49.274765+0000","last_undegraded":"2023-12-11T17:09:49.274765+0000","last_fullsized":"2023-12-11T17:09:49.274765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:28:31.395156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.270765+0000","last_change":"2023-12-11T17:09:44.203193+0000","last_active":"2023-12-11T17:09:49.270765+0000","last_peered":"2023-12-11T17:09:49.270765+0000","last_clean":"2023-12-11T17:09:49.270765+0000","last_became_active":"2023-12-11T17:09:44.202663+0000","last_became_peered":"2023-12-11T17:09:44.202663+0000","last_unstale":"2023-12-11T17:09:49.270765+0000","last_undegraded":"2023-12-11T17:09:49.270765+0000","last_fullsized":"2023-12-11T17:09:49.270765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:17:24.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.668651+0000","last_change":"2023-12-11T17:09:49.274246+0000","last_active":"2023-12-11T17:09:51.668651+0000","last_peered":"2023-12-11T17:09:51.668651+0000","last_clean":"2023-12-11T17:09:51.668651+0000","last_became_active":"2023-12-11T17:09:49.273634+0000","last_became_peered":"2023-12-11T17:09:49.273634+0000","last_unstale":"2023-12-11T17:09:51.668651+0000","last_undegraded":"2023-12-11T17:09:51.668651+0000","last_fullsized":"2023-12-11T17:09:51.668651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:56.216955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.276177+0000","last_change":"2023-12-11T17:09:45.227483+0000","last_active":"2023-12-11T17:09:49.276177+0000","last_peered":"2023-12-11T17:09:49.276177+0000","last_clean":"2023-12-11T17:09:49.276177+0000","last_became_active":"2023-12-11T17:09:45.227150+0000","last_became_peered":"2023-12-11T17:09:45.227150+0000","last_unstale":"2023-12-11T17:09:49.276177+0000","last_undegraded":"2023-12-11T17:09:49.276177+0000","last_fullsized":"2023-12-11T17:09:49.276177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:36:10.393929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.249199+0000","last_change":"2023-12-11T17:09:44.185666+0000","last_active":"2023-12-11T17:09:49.249199+0000","last_peered":"2023-12-11T17:09:49.249199+0000","last_clean":"2023-12-11T17:09:49.249199+0000","last_became_active":"2023-12-11T17:09:44.185302+0000","last_became_peered":"2023-12-11T17:09:44.185302+0000","last_unstale":"2023-12-11T17:09:49.249199+0000","last_undegraded":"2023-12-11T17:09:49.249199+0000","last_fullsized":"2023-12-11T17:09:49.249199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:17:35.452188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.670426+0000","last_change":"2023-12-11T17:09:49.268722+0000","last_active":"2023-12-11T17:09:51.670426+0000","last_peered":"2023-12-11T17:09:51.670426+0000","last_clean":"2023-12-11T17:09:51.670426+0000","last_became_active":"2023-12-11T17:09:49.268340+0000","last_became_peered":"2023-12-11T17:09:49.268340+0000","last_unstale":"2023-12-11T17:09:51.670426+0000","last_undegraded":"2023-12-11T17:09:51.670426+0000","last_fullsized":"2023-12-11T17:09:51.670426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:28:35.459824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242938+0000","last_change":"2023-12-11T17:09:45.215129+0000","last_active":"2023-12-11T17:09:49.242938+0000","last_peered":"2023-12-11T17:09:49.242938+0000","last_clean":"2023-12-11T17:09:49.242938+0000","last_became_active":"2023-12-11T17:09:45.214556+0000","last_became_peered":"2023-12-11T17:09:45.214556+0000","last_unstale":"2023-12-11T17:09:49.242938+0000","last_undegraded":"2023-12-11T17:09:49.242938+0000","last_fullsized":"2023-12-11T17:09:49.242938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:27:18.925357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.243243+0000","last_change":"2023-12-11T17:09:44.195851+0000","last_active":"2023-12-11T17:09:49.243243+0000","last_peered":"2023-12-11T17:09:49.243243+0000","last_clean":"2023-12-11T17:09:49.243243+0000","last_became_active":"2023-12-11T17:09:44.195539+0000","last_became_peered":"2023-12-11T17:09:44.195539+0000","last_unstale":"2023-12-11T17:09:49.243243+0000","last_undegraded":"2023-12-11T17:09:49.243243+0000","last_fullsized":"2023-12-11T17:09:49.243243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:52:53.972126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.250040+0000","last_change":"2023-12-11T17:09:49.288681+0000","last_active":"2023-12-11T17:09:50.250040+0000","last_peered":"2023-12-11T17:09:50.250040+0000","last_clean":"2023-12-11T17:09:50.250040+0000","last_became_active":"2023-12-11T17:09:49.280484+0000","last_became_peered":"2023-12-11T17:09:49.280484+0000","last_unstale":"2023-12-11T17:09:50.250040+0000","last_undegraded":"2023-12-11T17:09:50.250040+0000","last_fullsized":"2023-12-11T17:09:50.250040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:28:03.097522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275178+0000","last_change":"2023-12-11T17:09:45.228655+0000","last_active":"2023-12-11T17:09:49.275178+0000","last_peered":"2023-12-11T17:09:49.275178+0000","last_clean":"2023-12-11T17:09:49.275178+0000","last_became_active":"2023-12-11T17:09:45.225530+0000","last_became_peered":"2023-12-11T17:09:45.225530+0000","last_unstale":"2023-12-11T17:09:49.275178+0000","last_undegraded":"2023-12-11T17:09:49.275178+0000","last_fullsized":"2023-12-11T17:09:49.275178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:04.076862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.263735+0000","last_change":"2023-12-11T17:09:44.197598+0000","last_active":"2023-12-11T17:09:49.263735+0000","last_peered":"2023-12-11T17:09:49.263735+0000","last_clean":"2023-12-11T17:09:49.263735+0000","last_became_active":"2023-12-11T17:09:44.197143+0000","last_became_peered":"2023-12-11T17:09:44.197143+0000","last_unstale":"2023-12-11T17:09:49.263735+0000","last_undegraded":"2023-12-11T17:09:49.263735+0000","last_fullsized":"2023-12-11T17:09:49.263735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:11:14.773136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.249485+0000","last_change":"2023-12-11T17:09:49.281263+0000","last_active":"2023-12-11T17:09:50.249485+0000","last_peered":"2023-12-11T17:09:50.249485+0000","last_clean":"2023-12-11T17:09:50.249485+0000","last_became_active":"2023-12-11T17:09:49.280311+0000","last_became_peered":"2023-12-11T17:09:49.280311+0000","last_unstale":"2023-12-11T17:09:50.249485+0000","last_undegraded":"2023-12-11T17:09:50.249485+0000","last_fullsized":"2023-12-11T17:09:50.249485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:14:54.962202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259318+0000","last_change":"2023-12-11T17:09:45.222607+0000","last_active":"2023-12-11T17:09:49.259318+0000","last_peered":"2023-12-11T17:09:49.259318+0000","last_clean":"2023-12-11T17:09:49.259318+0000","last_became_active":"2023-12-11T17:09:45.221704+0000","last_became_peered":"2023-12-11T17:09:45.221704+0000","last_unstale":"2023-12-11T17:09:49.259318+0000","last_undegraded":"2023-12-11T17:09:49.259318+0000","last_fullsized":"2023-12-11T17:09:49.259318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:27:18.925357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259851+0000","last_change":"2023-12-11T17:09:44.201116+0000","last_active":"2023-12-11T17:09:49.259851+0000","last_peered":"2023-12-11T17:09:49.259851+0000","last_clean":"2023-12-11T17:09:49.259851+0000","last_became_active":"2023-12-11T17:09:44.200316+0000","last_became_peered":"2023-12-11T17:09:44.200316+0000","last_unstale":"2023-12-11T17:09:49.259851+0000","last_undegraded":"2023-12-11T17:09:49.259851+0000","last_fullsized":"2023-12-11T17:09:49.259851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:22:33.669469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.735500+0000","last_change":"2023-12-11T17:09:49.284856+0000","last_active":"2023-12-11T17:09:50.735500+0000","last_peered":"2023-12-11T17:09:50.735500+0000","last_clean":"2023-12-11T17:09:50.735500+0000","last_became_active":"2023-12-11T17:09:49.284294+0000","last_became_peered":"2023-12-11T17:09:49.284294+0000","last_unstale":"2023-12-11T17:09:50.735500+0000","last_undegraded":"2023-12-11T17:09:50.735500+0000","last_fullsized":"2023-12-11T17:09:50.735500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:14:54.962202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274536+0000","last_change":"2023-12-11T17:09:45.220222+0000","last_active":"2023-12-11T17:09:49.274536+0000","last_peered":"2023-12-11T17:09:49.274536+0000","last_clean":"2023-12-11T17:09:49.274536+0000","last_became_active":"2023-12-11T17:09:45.218938+0000","last_became_peered":"2023-12-11T17:09:45.218938+0000","last_unstale":"2023-12-11T17:09:49.274536+0000","last_undegraded":"2023-12-11T17:09:49.274536+0000","last_fullsized":"2023-12-11T17:09:49.274536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:33:36.618495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:10:04.440884+0000","last_change":"2023-12-11T17:09:44.198146+0000","last_active":"2023-12-11T17:10:04.440884+0000","last_peered":"2023-12-11T17:10:04.440884+0000","last_clean":"2023-12-11T17:10:04.440884+0000","last_became_active":"2023-12-11T17:09:44.197814+0000","last_became_peered":"2023-12-11T17:09:44.197814+0000","last_unstale":"2023-12-11T17:10:04.440884+0000","last_undegraded":"2023-12-11T17:10:04.440884+0000","last_fullsized":"2023-12-11T17:10:04.440884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:43:18.152366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3840,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.671230+0000","last_change":"2023-12-11T17:09:49.267215+0000","last_active":"2023-12-11T17:09:51.671230+0000","last_peered":"2023-12-11T17:09:51.671230+0000","last_clean":"2023-12-11T17:09:51.671230+0000","last_became_active":"2023-12-11T17:09:49.266813+0000","last_became_peered":"2023-12-11T17:09:49.266813+0000","last_unstale":"2023-12-11T17:09:51.671230+0000","last_undegraded":"2023-12-11T17:09:51.671230+0000","last_fullsized":"2023-12-11T17:09:51.671230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:28:35.459824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.270634+0000","last_change":"2023-12-11T17:09:45.207339+0000","last_active":"2023-12-11T17:09:49.270634+0000","last_peered":"2023-12-11T17:09:49.270634+0000","last_clean":"2023-12-11T17:09:49.270634+0000","last_became_active":"2023-12-11T17:09:45.206332+0000","last_became_peered":"2023-12-11T17:09:45.206332+0000","last_unstale":"2023-12-11T17:09:49.270634+0000","last_undegraded":"2023-12-11T17:09:49.270634+0000","last_fullsized":"2023-12-11T17:09:49.270634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:13:56.615204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.241546+0000","last_change":"2023-12-11T17:09:44.204047+0000","last_active":"2023-12-11T17:09:49.241546+0000","last_peered":"2023-12-11T17:09:49.241546+0000","last_clean":"2023-12-11T17:09:49.241546+0000","last_became_active":"2023-12-11T17:09:44.203606+0000","last_became_peered":"2023-12-11T17:09:44.203606+0000","last_unstale":"2023-12-11T17:09:49.241546+0000","last_undegraded":"2023-12-11T17:09:49.241546+0000","last_fullsized":"2023-12-11T17:09:49.241546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:38:29.306893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669605+0000","last_change":"2023-12-11T17:09:49.277690+0000","last_active":"2023-12-11T17:09:51.669605+0000","last_peered":"2023-12-11T17:09:51.669605+0000","last_clean":"2023-12-11T17:09:51.669605+0000","last_became_active":"2023-12-11T17:09:49.277278+0000","last_became_peered":"2023-12-11T17:09:49.277278+0000","last_unstale":"2023-12-11T17:09:51.669605+0000","last_undegraded":"2023-12-11T17:09:51.669605+0000","last_fullsized":"2023-12-11T17:09:51.669605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:33:40.683163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.264691+0000","last_change":"2023-12-11T17:09:45.223576+0000","last_active":"2023-12-11T17:09:49.264691+0000","last_peered":"2023-12-11T17:09:49.264691+0000","last_clean":"2023-12-11T17:09:49.264691+0000","last_became_active":"2023-12-11T17:09:45.216938+0000","last_became_peered":"2023-12-11T17:09:45.216938+0000","last_unstale":"2023-12-11T17:09:49.264691+0000","last_undegraded":"2023-12-11T17:09:49.264691+0000","last_fullsized":"2023-12-11T17:09:49.264691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:52.152287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267786+0000","last_change":"2023-12-11T17:09:44.203731+0000","last_active":"2023-12-11T17:09:49.267786+0000","last_peered":"2023-12-11T17:09:49.267786+0000","last_clean":"2023-12-11T17:09:49.267786+0000","last_became_active":"2023-12-11T17:09:44.202145+0000","last_became_peered":"2023-12-11T17:09:44.202145+0000","last_unstale":"2023-12-11T17:09:49.267786+0000","last_undegraded":"2023-12-11T17:09:49.267786+0000","last_fullsized":"2023-12-11T17:09:49.267786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:27:17.913220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.247224+0000","last_change":"2023-12-11T17:09:49.268109+0000","last_active":"2023-12-11T17:09:50.247224+0000","last_peered":"2023-12-11T17:09:50.247224+0000","last_clean":"2023-12-11T17:09:50.247224+0000","last_became_active":"2023-12-11T17:09:49.264048+0000","last_became_peered":"2023-12-11T17:09:49.264048+0000","last_unstale":"2023-12-11T17:09:50.247224+0000","last_undegraded":"2023-12-11T17:09:50.247224+0000","last_fullsized":"2023-12-11T17:09:50.247224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:08:53.883159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267673+0000","last_change":"2023-12-11T17:09:45.225214+0000","last_active":"2023-12-11T17:09:49.267673+0000","last_peered":"2023-12-11T17:09:49.267673+0000","last_clean":"2023-12-11T17:09:49.267673+0000","last_became_active":"2023-12-11T17:09:45.224870+0000","last_became_peered":"2023-12-11T17:09:45.224870+0000","last_unstale":"2023-12-11T17:09:49.267673+0000","last_undegraded":"2023-12-11T17:09:49.267673+0000","last_fullsized":"2023-12-11T17:09:49.267673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:01:08.121657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.247231+0000","last_change":"2023-12-11T17:09:44.205313+0000","last_active":"2023-12-11T17:09:49.247231+0000","last_peered":"2023-12-11T17:09:49.247231+0000","last_clean":"2023-12-11T17:09:49.247231+0000","last_became_active":"2023-12-11T17:09:44.205016+0000","last_became_peered":"2023-12-11T17:09:44.205016+0000","last_unstale":"2023-12-11T17:09:49.247231+0000","last_undegraded":"2023-12-11T17:09:49.247231+0000","last_fullsized":"2023-12-11T17:09:49.247231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:43:26.684582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.247679+0000","last_change":"2023-12-11T17:09:49.282289+0000","last_active":"2023-12-11T17:09:50.247679+0000","last_peered":"2023-12-11T17:09:50.247679+0000","last_clean":"2023-12-11T17:09:50.247679+0000","last_became_active":"2023-12-11T17:09:49.281891+0000","last_became_peered":"2023-12-11T17:09:49.281891+0000","last_unstale":"2023-12-11T17:09:50.247679+0000","last_undegraded":"2023-12-11T17:09:50.247679+0000","last_fullsized":"2023-12-11T17:09:50.247679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:07:56.022278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.671580+0000","last_change":"2023-12-11T17:09:49.280847+0000","last_active":"2023-12-11T17:09:51.671580+0000","last_peered":"2023-12-11T17:09:51.671580+0000","last_clean":"2023-12-11T17:09:51.671580+0000","last_became_active":"2023-12-11T17:09:49.280442+0000","last_became_peered":"2023-12-11T17:09:49.280442+0000","last_unstale":"2023-12-11T17:09:51.671580+0000","last_undegraded":"2023-12-11T17:09:51.671580+0000","last_fullsized":"2023-12-11T17:09:51.671580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:24:45.184380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.240253+0000","last_change":"2023-12-11T17:09:45.198219+0000","last_active":"2023-12-11T17:09:49.240253+0000","last_peered":"2023-12-11T17:09:49.240253+0000","last_clean":"2023-12-11T17:09:49.240253+0000","last_became_active":"2023-12-11T17:09:45.196218+0000","last_became_peered":"2023-12-11T17:09:45.196218+0000","last_unstale":"2023-12-11T17:09:49.240253+0000","last_undegraded":"2023-12-11T17:09:49.240253+0000","last_fullsized":"2023-12-11T17:09:49.240253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:27:18.925357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.261218+0000","last_change":"2023-12-11T17:09:44.208638+0000","last_active":"2023-12-11T17:09:49.261218+0000","last_peered":"2023-12-11T17:09:49.261218+0000","last_clean":"2023-12-11T17:09:49.261218+0000","last_became_active":"2023-12-11T17:09:44.208143+0000","last_became_peered":"2023-12-11T17:09:44.208143+0000","last_unstale":"2023-12-11T17:09:49.261218+0000","last_undegraded":"2023-12-11T17:09:49.261218+0000","last_fullsized":"2023-12-11T17:09:49.261218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:39:09.678988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.247175+0000","last_change":"2023-12-11T17:09:49.270558+0000","last_active":"2023-12-11T17:09:50.247175+0000","last_peered":"2023-12-11T17:09:50.247175+0000","last_clean":"2023-12-11T17:09:50.247175+0000","last_became_active":"2023-12-11T17:09:49.270065+0000","last_became_peered":"2023-12-11T17:09:49.270065+0000","last_unstale":"2023-12-11T17:09:50.247175+0000","last_undegraded":"2023-12-11T17:09:50.247175+0000","last_fullsized":"2023-12-11T17:09:50.247175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:08.141530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242639+0000","last_change":"2023-12-11T17:09:45.209539+0000","last_active":"2023-12-11T17:09:49.242639+0000","last_peered":"2023-12-11T17:09:49.242639+0000","last_clean":"2023-12-11T17:09:49.242639+0000","last_became_active":"2023-12-11T17:09:45.209135+0000","last_became_peered":"2023-12-11T17:09:45.209135+0000","last_unstale":"2023-12-11T17:09:49.242639+0000","last_undegraded":"2023-12-11T17:09:49.242639+0000","last_fullsized":"2023-12-11T17:09:49.242639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:08:16.262435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.243583+0000","last_change":"2023-12-11T17:09:44.203078+0000","last_active":"2023-12-11T17:09:49.243583+0000","last_peered":"2023-12-11T17:09:49.243583+0000","last_clean":"2023-12-11T17:09:49.243583+0000","last_became_active":"2023-12-11T17:09:44.202856+0000","last_became_peered":"2023-12-11T17:09:44.202856+0000","last_unstale":"2023-12-11T17:09:49.243583+0000","last_undegraded":"2023-12-11T17:09:49.243583+0000","last_fullsized":"2023-12-11T17:09:49.243583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:13:55.603067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244507+0000","last_change":"2023-12-11T17:09:44.200256+0000","last_active":"2023-12-11T17:09:49.244507+0000","last_peered":"2023-12-11T17:09:49.244507+0000","last_clean":"2023-12-11T17:09:49.244507+0000","last_became_active":"2023-12-11T17:09:44.199854+0000","last_became_peered":"2023-12-11T17:09:44.199854+0000","last_unstale":"2023-12-11T17:09:49.244507+0000","last_undegraded":"2023-12-11T17:09:49.244507+0000","last_fullsized":"2023-12-11T17:09:49.244507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:22:33.669469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259758+0000","last_change":"2023-12-11T17:09:45.223465+0000","last_active":"2023-12-11T17:09:49.259758+0000","last_peered":"2023-12-11T17:09:49.259758+0000","last_clean":"2023-12-11T17:09:49.259758+0000","last_became_active":"2023-12-11T17:09:45.223204+0000","last_became_peered":"2023-12-11T17:09:45.223204+0000","last_unstale":"2023-12-11T17:09:49.259758+0000","last_undegraded":"2023-12-11T17:09:49.259758+0000","last_fullsized":"2023-12-11T17:09:49.259758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:39:10.691125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.245254+0000","last_change":"2023-12-11T17:09:49.264568+0000","last_active":"2023-12-11T17:09:50.245254+0000","last_peered":"2023-12-11T17:09:50.245254+0000","last_clean":"2023-12-11T17:09:50.245254+0000","last_became_active":"2023-12-11T17:09:49.263931+0000","last_became_peered":"2023-12-11T17:09:49.263931+0000","last_unstale":"2023-12-11T17:09:50.245254+0000","last_undegraded":"2023-12-11T17:09:50.245254+0000","last_fullsized":"2023-12-11T17:09:50.245254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T17:20:54.594805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242524+0000","last_change":"2023-12-11T17:09:44.205097+0000","last_active":"2023-12-11T17:09:49.242524+0000","last_peered":"2023-12-11T17:09:49.242524+0000","last_clean":"2023-12-11T17:09:49.242524+0000","last_became_active":"2023-12-11T17:09:44.204802+0000","last_became_peered":"2023-12-11T17:09:44.204802+0000","last_unstale":"2023-12-11T17:09:49.242524+0000","last_undegraded":"2023-12-11T17:09:49.242524+0000","last_fullsized":"2023-12-11T17:09:49.242524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:38:29.306893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.270946+0000","last_change":"2023-12-11T17:09:45.213754+0000","last_active":"2023-12-11T17:09:49.270946+0000","last_peered":"2023-12-11T17:09:49.270946+0000","last_clean":"2023-12-11T17:09:49.270946+0000","last_became_active":"2023-12-11T17:09:45.213235+0000","last_became_peered":"2023-12-11T17:09:45.213235+0000","last_unstale":"2023-12-11T17:09:49.270946+0000","last_undegraded":"2023-12-11T17:09:49.270946+0000","last_fullsized":"2023-12-11T17:09:49.270946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:45.225448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.249535+0000","last_change":"2023-12-11T17:09:49.275093+0000","last_active":"2023-12-11T17:09:50.249535+0000","last_peered":"2023-12-11T17:09:50.249535+0000","last_clean":"2023-12-11T17:09:50.249535+0000","last_became_active":"2023-12-11T17:09:49.274728+0000","last_became_peered":"2023-12-11T17:09:49.274728+0000","last_unstale":"2023-12-11T17:09:50.249535+0000","last_undegraded":"2023-12-11T17:09:50.249535+0000","last_fullsized":"2023-12-11T17:09:50.249535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:41:31.040376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242805+0000","last_change":"2023-12-11T17:09:45.214934+0000","last_active":"2023-12-11T17:09:49.242805+0000","last_peered":"2023-12-11T17:09:49.242805+0000","last_clean":"2023-12-11T17:09:49.242805+0000","last_became_active":"2023-12-11T17:09:45.214572+0000","last_became_peered":"2023-12-11T17:09:45.214572+0000","last_unstale":"2023-12-11T17:09:49.242805+0000","last_undegraded":"2023-12-11T17:09:49.242805+0000","last_fullsized":"2023-12-11T17:09:49.242805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:08:16.262435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.250749+0000","last_change":"2023-12-11T17:09:45.211423+0000","last_active":"2023-12-11T17:09:49.250749+0000","last_peered":"2023-12-11T17:09:49.250749+0000","last_clean":"2023-12-11T17:09:49.250749+0000","last_became_active":"2023-12-11T17:09:45.211056+0000","last_became_peered":"2023-12-11T17:09:45.211056+0000","last_unstale":"2023-12-11T17:09:49.250749+0000","last_undegraded":"2023-12-11T17:09:49.250749+0000","last_fullsized":"2023-12-11T17:09:49.250749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:46:02.502338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.263639+0000","last_change":"2023-12-11T17:09:45.197421+0000","last_active":"2023-12-11T17:09:49.263639+0000","last_peered":"2023-12-11T17:09:49.263639+0000","last_clean":"2023-12-11T17:09:49.263639+0000","last_became_active":"2023-12-11T17:09:45.197128+0000","last_became_peered":"2023-12-11T17:09:45.197128+0000","last_unstale":"2023-12-11T17:09:49.263639+0000","last_undegraded":"2023-12-11T17:09:49.263639+0000","last_fullsized":"2023-12-11T17:09:49.263639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:13:50.995140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259671+0000","last_change":"2023-12-11T17:09:45.208645+0000","last_active":"2023-12-11T17:09:49.259671+0000","last_peered":"2023-12-11T17:09:49.259671+0000","last_clean":"2023-12-11T17:09:49.259671+0000","last_became_active":"2023-12-11T17:09:45.203739+0000","last_became_peered":"2023-12-11T17:09:45.203739+0000","last_unstale":"2023-12-11T17:09:49.259671+0000","last_undegraded":"2023-12-11T17:09:49.259671+0000","last_fullsized":"2023-12-11T17:09:49.259671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:17:04.012857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242521+0000","last_change":"2023-12-11T17:09:45.220379+0000","last_active":"2023-12-11T17:09:49.242521+0000","last_peered":"2023-12-11T17:09:49.242521+0000","last_clean":"2023-12-11T17:09:49.242521+0000","last_became_active":"2023-12-11T17:09:45.220153+0000","last_became_peered":"2023-12-11T17:09:45.220153+0000","last_unstale":"2023-12-11T17:09:49.242521+0000","last_undegraded":"2023-12-11T17:09:49.242521+0000","last_fullsized":"2023-12-11T17:09:49.242521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:52.152287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.241402+0000","last_change":"2023-12-11T17:09:45.194086+0000","last_active":"2023-12-11T17:09:49.241402+0000","last_peered":"2023-12-11T17:09:49.241402+0000","last_clean":"2023-12-11T17:09:49.241402+0000","last_became_active":"2023-12-11T17:09:45.193835+0000","last_became_peered":"2023-12-11T17:09:45.193835+0000","last_unstale":"2023-12-11T17:09:49.241402+0000","last_undegraded":"2023-12-11T17:09:49.241402+0000","last_fullsized":"2023-12-11T17:09:49.241402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:05.364711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244539+0000","last_change":"2023-12-11T17:09:45.219697+0000","last_active":"2023-12-11T17:09:49.244539+0000","last_peered":"2023-12-11T17:09:49.244539+0000","last_clean":"2023-12-11T17:09:49.244539+0000","last_became_active":"2023-12-11T17:09:45.219406+0000","last_became_peered":"2023-12-11T17:09:45.219406+0000","last_unstale":"2023-12-11T17:09:49.244539+0000","last_undegraded":"2023-12-11T17:09:49.244539+0000","last_fullsized":"2023-12-11T17:09:49.244539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:52.152287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.243089+0000","last_change":"2023-12-11T17:09:45.220707+0000","last_active":"2023-12-11T17:09:49.243089+0000","last_peered":"2023-12-11T17:09:49.243089+0000","last_clean":"2023-12-11T17:09:49.243089+0000","last_became_active":"2023-12-11T17:09:45.220357+0000","last_became_peered":"2023-12-11T17:09:45.220357+0000","last_unstale":"2023-12-11T17:09:49.243089+0000","last_undegraded":"2023-12-11T17:09:49.243089+0000","last_fullsized":"2023-12-11T17:09:49.243089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:39:10.691125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.261207+0000","last_change":"2023-12-11T17:09:45.196150+0000","last_active":"2023-12-11T17:09:49.261207+0000","last_peered":"2023-12-11T17:09:49.261207+0000","last_clean":"2023-12-11T17:09:49.261207+0000","last_became_active":"2023-12-11T17:09:45.195878+0000","last_became_peered":"2023-12-11T17:09:45.195878+0000","last_unstale":"2023-12-11T17:09:49.261207+0000","last_undegraded":"2023-12-11T17:09:49.261207+0000","last_fullsized":"2023-12-11T17:09:49.261207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:51:29.300195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.243497+0000","last_change":"2023-12-11T17:09:45.220663+0000","last_active":"2023-12-11T17:09:49.243497+0000","last_peered":"2023-12-11T17:09:49.243497+0000","last_clean":"2023-12-11T17:09:49.243497+0000","last_became_active":"2023-12-11T17:09:45.220349+0000","last_became_peered":"2023-12-11T17:09:45.220349+0000","last_unstale":"2023-12-11T17:09:49.243497+0000","last_undegraded":"2023-12-11T17:09:49.243497+0000","last_fullsized":"2023-12-11T17:09:49.243497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:11:15.785273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.263544+0000","last_change":"2023-12-11T17:09:45.213788+0000","last_active":"2023-12-11T17:09:49.263544+0000","last_peered":"2023-12-11T17:09:49.263544+0000","last_clean":"2023-12-11T17:09:49.263544+0000","last_became_active":"2023-12-11T17:09:45.213454+0000","last_became_peered":"2023-12-11T17:09:45.213454+0000","last_unstale":"2023-12-11T17:09:49.263544+0000","last_undegraded":"2023-12-11T17:09:49.263544+0000","last_fullsized":"2023-12-11T17:09:49.263544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:36:10.393929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259552+0000","last_change":"2023-12-11T17:09:45.219309+0000","last_active":"2023-12-11T17:09:49.259552+0000","last_peered":"2023-12-11T17:09:49.259552+0000","last_clean":"2023-12-11T17:09:49.259552+0000","last_became_active":"2023-12-11T17:09:45.218538+0000","last_became_peered":"2023-12-11T17:09:45.218538+0000","last_unstale":"2023-12-11T17:09:49.259552+0000","last_undegraded":"2023-12-11T17:09:49.259552+0000","last_fullsized":"2023-12-11T17:09:49.259552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:11:15.785273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.246802+0000","last_change":"2023-12-11T17:09:45.217105+0000","last_active":"2023-12-11T17:09:49.246802+0000","last_peered":"2023-12-11T17:09:49.246802+0000","last_clean":"2023-12-11T17:09:49.246802+0000","last_became_active":"2023-12-11T17:09:45.215966+0000","last_became_peered":"2023-12-11T17:09:45.215966+0000","last_unstale":"2023-12-11T17:09:49.246802+0000","last_undegraded":"2023-12-11T17:09:49.246802+0000","last_fullsized":"2023-12-11T17:09:49.246802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:17:04.012857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274639+0000","last_change":"2023-12-11T17:09:45.225041+0000","last_active":"2023-12-11T17:09:49.274639+0000","last_peered":"2023-12-11T17:09:49.274639+0000","last_clean":"2023-12-11T17:09:49.274639+0000","last_became_active":"2023-12-11T17:09:45.224696+0000","last_became_peered":"2023-12-11T17:09:45.224696+0000","last_unstale":"2023-12-11T17:09:49.274639+0000","last_undegraded":"2023-12-11T17:09:49.274639+0000","last_fullsized":"2023-12-11T17:09:49.274639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:03:10.878069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.252605+0000","last_change":"2023-12-11T17:09:45.207821+0000","last_active":"2023-12-11T17:09:49.252605+0000","last_peered":"2023-12-11T17:09:49.252605+0000","last_clean":"2023-12-11T17:09:49.252605+0000","last_became_active":"2023-12-11T17:09:45.207541+0000","last_became_peered":"2023-12-11T17:09:45.207541+0000","last_unstale":"2023-12-11T17:09:49.252605+0000","last_undegraded":"2023-12-11T17:09:49.252605+0000","last_fullsized":"2023-12-11T17:09:49.252605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:51:44.769227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267963+0000","last_change":"2023-12-11T17:09:45.212081+0000","last_active":"2023-12-11T17:09:49.267963+0000","last_peered":"2023-12-11T17:09:49.267963+0000","last_clean":"2023-12-11T17:09:49.267963+0000","last_became_active":"2023-12-11T17:09:45.211781+0000","last_became_peered":"2023-12-11T17:09:45.211781+0000","last_unstale":"2023-12-11T17:09:49.267963+0000","last_undegraded":"2023-12-11T17:09:49.267963+0000","last_fullsized":"2023-12-11T17:09:49.267963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:03:10.878069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.260999+0000","last_change":"2023-12-11T17:09:45.218896+0000","last_active":"2023-12-11T17:09:49.260999+0000","last_peered":"2023-12-11T17:09:49.260999+0000","last_clean":"2023-12-11T17:09:49.260999+0000","last_became_active":"2023-12-11T17:09:45.218071+0000","last_became_peered":"2023-12-11T17:09:45.218071+0000","last_unstale":"2023-12-11T17:09:49.260999+0000","last_undegraded":"2023-12-11T17:09:49.260999+0000","last_fullsized":"2023-12-11T17:09:49.260999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:05.364711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.240603+0000","last_change":"2023-12-11T17:09:45.208633+0000","last_active":"2023-12-11T17:09:49.240603+0000","last_peered":"2023-12-11T17:09:49.240603+0000","last_clean":"2023-12-11T17:09:49.240603+0000","last_became_active":"2023-12-11T17:09:45.208337+0000","last_became_peered":"2023-12-11T17:09:45.208337+0000","last_unstale":"2023-12-11T17:09:49.240603+0000","last_undegraded":"2023-12-11T17:09:49.240603+0000","last_fullsized":"2023-12-11T17:09:49.240603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:11:15.785273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259315+0000","last_change":"2023-12-11T17:09:45.216391+0000","last_active":"2023-12-11T17:09:49.259315+0000","last_peered":"2023-12-11T17:09:49.259315+0000","last_clean":"2023-12-11T17:09:49.259315+0000","last_became_active":"2023-12-11T17:09:45.215314+0000","last_became_peered":"2023-12-11T17:09:45.215314+0000","last_unstale":"2023-12-11T17:09:49.259315+0000","last_undegraded":"2023-12-11T17:09:49.259315+0000","last_fullsized":"2023-12-11T17:09:49.259315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:42:31.915581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242252+0000","last_change":"2023-12-11T17:09:45.206222+0000","last_active":"2023-12-11T17:09:49.242252+0000","last_peered":"2023-12-11T17:09:49.242252+0000","last_clean":"2023-12-11T17:09:49.242252+0000","last_became_active":"2023-12-11T17:09:45.206027+0000","last_became_peered":"2023-12-11T17:09:45.206027+0000","last_unstale":"2023-12-11T17:09:49.242252+0000","last_undegraded":"2023-12-11T17:09:49.242252+0000","last_fullsized":"2023-12-11T17:09:49.242252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:05.364711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.270530+0000","last_change":"2023-12-11T17:09:45.209961+0000","last_active":"2023-12-11T17:09:49.270530+0000","last_peered":"2023-12-11T17:09:49.270530+0000","last_clean":"2023-12-11T17:09:49.270530+0000","last_became_active":"2023-12-11T17:09:45.207836+0000","last_became_peered":"2023-12-11T17:09:45.207836+0000","last_unstale":"2023-12-11T17:09:49.270530+0000","last_undegraded":"2023-12-11T17:09:49.270530+0000","last_fullsized":"2023-12-11T17:09:49.270530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:47:07.513492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.245215+0000","last_change":"2023-12-11T17:09:45.218319+0000","last_active":"2023-12-11T17:09:49.245215+0000","last_peered":"2023-12-11T17:09:49.245215+0000","last_clean":"2023-12-11T17:09:49.245215+0000","last_became_active":"2023-12-11T17:09:45.217465+0000","last_became_peered":"2023-12-11T17:09:45.217465+0000","last_unstale":"2023-12-11T17:09:49.245215+0000","last_undegraded":"2023-12-11T17:09:49.245215+0000","last_fullsized":"2023-12-11T17:09:49.245215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:11:15.785273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244369+0000","last_change":"2023-12-11T17:09:45.219120+0000","last_active":"2023-12-11T17:09:49.244369+0000","last_peered":"2023-12-11T17:09:49.244369+0000","last_clean":"2023-12-11T17:09:49.244369+0000","last_became_active":"2023-12-11T17:09:45.216692+0000","last_became_peered":"2023-12-11T17:09:45.216692+0000","last_unstale":"2023-12-11T17:09:49.244369+0000","last_undegraded":"2023-12-11T17:09:49.244369+0000","last_fullsized":"2023-12-11T17:09:49.244369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:05.364711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275330+0000","last_change":"2023-12-11T17:09:45.227610+0000","last_active":"2023-12-11T17:09:49.275330+0000","last_peered":"2023-12-11T17:09:49.275330+0000","last_clean":"2023-12-11T17:09:49.275330+0000","last_became_active":"2023-12-11T17:09:45.220917+0000","last_became_peered":"2023-12-11T17:09:45.220917+0000","last_unstale":"2023-12-11T17:09:49.275330+0000","last_undegraded":"2023-12-11T17:09:49.275330+0000","last_fullsized":"2023-12-11T17:09:49.275330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:24:41.119712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.241871+0000","last_change":"2023-12-11T17:09:45.213329+0000","last_active":"2023-12-11T17:09:49.241871+0000","last_peered":"2023-12-11T17:09:49.241871+0000","last_clean":"2023-12-11T17:09:49.241871+0000","last_became_active":"2023-12-11T17:09:45.211552+0000","last_became_peered":"2023-12-11T17:09:45.211552+0000","last_unstale":"2023-12-11T17:09:49.241871+0000","last_undegraded":"2023-12-11T17:09:49.241871+0000","last_fullsized":"2023-12-11T17:09:49.241871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:42:31.915581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274314+0000","last_change":"2023-12-11T17:09:45.219662+0000","last_active":"2023-12-11T17:09:49.274314+0000","last_peered":"2023-12-11T17:09:49.274314+0000","last_clean":"2023-12-11T17:09:49.274314+0000","last_became_active":"2023-12-11T17:09:45.219315+0000","last_became_peered":"2023-12-11T17:09:45.219315+0000","last_unstale":"2023-12-11T17:09:49.274314+0000","last_undegraded":"2023-12-11T17:09:49.274314+0000","last_fullsized":"2023-12-11T17:09:49.274314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:17:47.063007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.263442+0000","last_change":"2023-12-11T17:09:45.214165+0000","last_active":"2023-12-11T17:09:49.263442+0000","last_peered":"2023-12-11T17:09:49.263442+0000","last_clean":"2023-12-11T17:09:49.263442+0000","last_became_active":"2023-12-11T17:09:45.211191+0000","last_became_peered":"2023-12-11T17:09:45.211191+0000","last_unstale":"2023-12-11T17:09:49.263442+0000","last_undegraded":"2023-12-11T17:09:49.263442+0000","last_fullsized":"2023-12-11T17:09:49.263442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:52.152287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275091+0000","last_change":"2023-12-11T17:09:45.210404+0000","last_active":"2023-12-11T17:09:49.275091+0000","last_peered":"2023-12-11T17:09:49.275091+0000","last_clean":"2023-12-11T17:09:49.275091+0000","last_became_active":"2023-12-11T17:09:45.210084+0000","last_became_peered":"2023-12-11T17:09:45.210084+0000","last_unstale":"2023-12-11T17:09:49.275091+0000","last_undegraded":"2023-12-11T17:09:49.275091+0000","last_fullsized":"2023-12-11T17:09:49.275091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:13:50.995140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267850+0000","last_change":"2023-12-11T17:09:45.213977+0000","last_active":"2023-12-11T17:09:49.267850+0000","last_peered":"2023-12-11T17:09:49.267850+0000","last_clean":"2023-12-11T17:09:49.267850+0000","last_became_active":"2023-12-11T17:09:45.212551+0000","last_became_peered":"2023-12-11T17:09:45.212551+0000","last_unstale":"2023-12-11T17:09:49.267850+0000","last_undegraded":"2023-12-11T17:09:49.267850+0000","last_fullsized":"2023-12-11T17:09:49.267850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:17:47.063007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259640+0000","last_change":"2023-12-11T17:09:45.216618+0000","last_active":"2023-12-11T17:09:49.259640+0000","last_peered":"2023-12-11T17:09:49.259640+0000","last_clean":"2023-12-11T17:09:49.259640+0000","last_became_active":"2023-12-11T17:09:45.209865+0000","last_became_peered":"2023-12-11T17:09:45.209865+0000","last_unstale":"2023-12-11T17:09:49.259640+0000","last_undegraded":"2023-12-11T17:09:49.259640+0000","last_fullsized":"2023-12-11T17:09:49.259640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:56:34.698264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.241316+0000","last_change":"2023-12-11T17:09:45.208109+0000","last_active":"2023-12-11T17:09:49.241316+0000","last_peered":"2023-12-11T17:09:49.241316+0000","last_clean":"2023-12-11T17:09:49.241316+0000","last_became_active":"2023-12-11T17:09:45.204247+0000","last_became_peered":"2023-12-11T17:09:45.204247+0000","last_unstale":"2023-12-11T17:09:49.241316+0000","last_undegraded":"2023-12-11T17:09:49.241316+0000","last_fullsized":"2023-12-11T17:09:49.241316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:52.152287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275224+0000","last_change":"2023-12-11T17:09:45.225873+0000","last_active":"2023-12-11T17:09:49.275224+0000","last_peered":"2023-12-11T17:09:49.275224+0000","last_clean":"2023-12-11T17:09:49.275224+0000","last_became_active":"2023-12-11T17:09:45.225223+0000","last_became_peered":"2023-12-11T17:09:45.225223+0000","last_unstale":"2023-12-11T17:09:49.275224+0000","last_undegraded":"2023-12-11T17:09:49.275224+0000","last_fullsized":"2023-12-11T17:09:49.275224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:01:08.121657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4638,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":694037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.385}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.538}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]}]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":103177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.508}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":103213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6339999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1120000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8090000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4889999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8759999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":103087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9019999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.278}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.339}]}]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":103247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]}]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":694093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4930000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-11T17:10:20.503 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-11T17:10:20.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.760+0000 7fe980a3c640 1 Processor -- start 2023-12-11T17:10:20.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.760+0000 7fe980a3c640 1 -- start start 2023-12-11T17:10:20.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.761+0000 7fe980a3c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe97c159fd0 0x7fe97c0ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:20.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.761+0000 7fe980a3c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe97c070750 0x7fe97c070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:20.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.761+0000 7fe980a3c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe97c0711e0 0x7fe97c0ac700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:20.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.761+0000 7fe980a3c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe97c0705f0 con 0x7fe97c0711e0 2023-12-11T17:10:20.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.761+0000 7fe980a3c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe97c071650 con 0x7fe97c070750 2023-12-11T17:10:20.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.761+0000 7fe980a3c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c070070 con 0x7fe97c159fd0 2023-12-11T17:10:20.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.762+0000 7fe97b59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe97c0711e0 0x7fe97c0ac700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:20.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.762+0000 7fe97b59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe97c0711e0 0x7fe97c0ac700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38048/0 (socket says 172.21.15.37:38048) 2023-12-11T17:10:20.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.762+0000 7fe97b59e640 1 -- 172.21.15.37:0/2055769219 learned_addr learned my addr 172.21.15.37:0/2055769219 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:20.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.762+0000 7fe97ad9d640 1 --2- 172.21.15.37:0/2055769219 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe97c159fd0 0x7fe97c0ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:20.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.762+0000 7fe97a59c640 1 --2- 172.21.15.37:0/2055769219 >> v2:172.21.15.151:3300/0 conn(0x7fe97c070750 0x7fe97c070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:20.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.762+0000 7fe97b59e640 1 -- 172.21.15.37:0/2055769219 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe97c159fd0 msgr2=0x7fe97c0ae1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:20.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.762+0000 7fe97b59e640 1 --2- 172.21.15.37:0/2055769219 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe97c159fd0 0x7fe97c0ae1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:20.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.762+0000 7fe97b59e640 1 -- 172.21.15.37:0/2055769219 >> v2:172.21.15.151:3300/0 conn(0x7fe97c070750 msgr2=0x7fe97c070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:20.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.762+0000 7fe97b59e640 1 --2- 172.21.15.37:0/2055769219 >> v2:172.21.15.151:3300/0 conn(0x7fe97c070750 0x7fe97c070ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:20.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.762+0000 7fe97b59e640 1 -- 172.21.15.37:0/2055769219 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe97c070310 con 0x7fe97c0711e0 2023-12-11T17:10:20.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.762+0000 7fe97ad9d640 1 --2- 172.21.15.37:0/2055769219 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe97c159fd0 0x7fe97c0ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:20.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.762+0000 7fe97a59c640 1 --2- 172.21.15.37:0/2055769219 >> v2:172.21.15.151:3300/0 conn(0x7fe97c070750 0x7fe97c070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:20.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.763+0000 7fe97b59e640 1 --2- 172.21.15.37:0/2055769219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe97c0711e0 0x7fe97c0ac700 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0b1920 tx=0x7fe97402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386fa7f9733bf7cf server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:20.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.764+0000 7fe979d9b640 1 -- 172.21.15.37:0/2055769219 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe97402cb00 con 0x7fe97c0711e0 2023-12-11T17:10:20.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.764+0000 7fe979d9b640 1 -- 172.21.15.37:0/2055769219 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe97402cc60 con 0x7fe97c0711e0 2023-12-11T17:10:20.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.764+0000 7fe979d9b640 1 -- 172.21.15.37:0/2055769219 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9740343f0 con 0x7fe97c0711e0 2023-12-11T17:10:20.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.764+0000 7fe980a3c640 1 -- 172.21.15.37:0/2055769219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe97c0711e0 msgr2=0x7fe97c0ac700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:20.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.764+0000 7fe980a3c640 1 --2- 172.21.15.37:0/2055769219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe97c0711e0 0x7fe97c0ac700 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fe97c0b1920 tx=0x7fe97402bf60 comp rx=0 tx=0).stop 2023-12-11T17:10:20.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.764+0000 7fe980a3c640 1 -- 172.21.15.37:0/2055769219 shutdown_connections 2023-12-11T17:10:20.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.764+0000 7fe980a3c640 1 --2- 172.21.15.37:0/2055769219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe97c0711e0 0x7fe97c0ac700 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:20.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.764+0000 7fe980a3c640 1 --2- 172.21.15.37:0/2055769219 >> v2:172.21.15.151:3300/0 conn(0x7fe97c070750 0x7fe97c070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:20.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.764+0000 7fe980a3c640 1 --2- 172.21.15.37:0/2055769219 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe97c159fd0 0x7fe97c0ae1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:20.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.764+0000 7fe980a3c640 1 -- 172.21.15.37:0/2055769219 >> 172.21.15.37:0/2055769219 conn(0x7fe97c0b0860 msgr2=0x7fe97c0b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:20.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.764+0000 7fe980a3c640 1 -- 172.21.15.37:0/2055769219 shutdown_connections 2023-12-11T17:10:20.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.765+0000 7fe980a3c640 1 -- 172.21.15.37:0/2055769219 wait complete. 2023-12-11T17:10:20.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.766+0000 7fe980a3c640 1 Processor -- start 2023-12-11T17:10:20.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.766+0000 7fe980a3c640 1 -- start start 2023-12-11T17:10:20.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.767+0000 7fe980a3c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe97c070750 0x7fe97c14c1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:20.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.767+0000 7fe980a3c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe97c0711e0 0x7fe97c15bcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:20.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.767+0000 7fe980a3c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe97c159fd0 0x7fe97c15c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:20.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.767+0000 7fe980a3c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c14c710 con 0x7fe97c070750 2023-12-11T17:10:20.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.767+0000 7fe980a3c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c09a890 con 0x7fe97c159fd0 2023-12-11T17:10:20.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.767+0000 7fe980a3c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe97c09ab70 con 0x7fe97c0711e0 2023-12-11T17:10:20.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.767+0000 7fe97ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe97c070750 0x7fe97c14c1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:20.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.768+0000 7fe97ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe97c070750 0x7fe97c14c1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38052/0 (socket says 172.21.15.37:38052) 2023-12-11T17:10:20.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.768+0000 7fe97ad9d640 1 -- 172.21.15.37:0/3275070631 learned_addr learned my addr 172.21.15.37:0/3275070631 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:20.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.768+0000 7fe97ad9d640 1 -- 172.21.15.37:0/3275070631 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe97c0711e0 msgr2=0x7fe97c15bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:20.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.768+0000 7fe97ad9d640 1 --2- 172.21.15.37:0/3275070631 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe97c0711e0 0x7fe97c15bcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:20.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.768+0000 7fe97ad9d640 1 -- 172.21.15.37:0/3275070631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe97c159fd0 msgr2=0x7fe97c15c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:20.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.768+0000 7fe97ad9d640 1 --2- 172.21.15.37:0/3275070631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe97c159fd0 0x7fe97c15c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:20.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.768+0000 7fe97ad9d640 1 -- 172.21.15.37:0/3275070631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe974009b30 con 0x7fe97c070750 2023-12-11T17:10:20.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.768+0000 7fe97ad9d640 1 --2- 172.21.15.37:0/3275070631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe97c070750 0x7fe97c14c1d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00c7f0 tx=0x7fe96c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:20.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.768+0000 7fe9637fe640 1 -- 172.21.15.37:0/3275070631 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c007820 con 0x7fe97c070750 2023-12-11T17:10:20.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.768+0000 7fe9637fe640 1 -- 172.21.15.37:0/3275070631 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96c007980 con 0x7fe97c070750 2023-12-11T17:10:20.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.768+0000 7fe9637fe640 1 -- 172.21.15.37:0/3275070631 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96c007cf0 con 0x7fe97c070750 2023-12-11T17:10:20.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.768+0000 7fe980a3c640 1 -- 172.21.15.37:0/3275070631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe97c09ae50 con 0x7fe97c070750 2023-12-11T17:10:20.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.769+0000 7fe980a3c640 1 -- 172.21.15.37:0/3275070631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe97c09b410 con 0x7fe97c070750 2023-12-11T17:10:20.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.770+0000 7fe980a3c640 1 -- 172.21.15.37:0/3275070631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe97c074450 con 0x7fe97c070750 2023-12-11T17:10:20.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.770+0000 7fe9637fe640 1 -- 172.21.15.37:0/3275070631 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe96c0113f0 con 0x7fe97c070750 2023-12-11T17:10:20.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.771+0000 7fe9637fe640 1 --2- 172.21.15.37:0/3275070631 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe96806ae40 0x7fe96806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:20.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.771+0000 7fe9637fe640 1 -- 172.21.15.37:0/3275070631 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe96c089cb0 con 0x7fe97c070750 2023-12-11T17:10:20.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.772+0000 7fe97a59c640 1 --2- 172.21.15.37:0/3275070631 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe96806ae40 0x7fe96806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:20.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.773+0000 7fe97a59c640 1 --2- 172.21.15.37:0/3275070631 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe96806ae40 0x7fe96806d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe970006b10 tx=0x7fe970008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:20.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.775+0000 7fe9637fe640 1 -- 172.21.15.37:0/3275070631 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe96c0549d0 con 0x7fe97c070750 2023-12-11T17:10:20.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.959+0000 7fe980a3c640 1 -- 172.21.15.37:0/3275070631 --> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe97c0b22c0 con 0x7fe96806ae40 2023-12-11T17:10:20.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.985+0000 7fe9637fe640 1 -- 172.21.15.37:0/3275070631 <== mgr.4111 v2:172.21.15.151:6832/3081040918 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+345083 (secure 0 0 0) 0x7fe97000ae30 con 0x7fe96806ae40 2023-12-11T17:10:20.990 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:20.992 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-12-11T17:10:20.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.990+0000 7fe980a3c640 1 -- 172.21.15.37:0/3275070631 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe96806ae40 msgr2=0x7fe96806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:20.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.990+0000 7fe980a3c640 1 --2- 172.21.15.37:0/3275070631 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe96806ae40 0x7fe96806d300 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fe970006b10 tx=0x7fe970008040 comp rx=0 tx=0).stop 2023-12-11T17:10:20.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.990+0000 7fe980a3c640 1 -- 172.21.15.37:0/3275070631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe97c070750 msgr2=0x7fe97c14c1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:20.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.990+0000 7fe980a3c640 1 --2- 172.21.15.37:0/3275070631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe97c070750 0x7fe97c14c1d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe96c00c7f0 tx=0x7fe96c00ccb0 comp rx=0 tx=0).stop 2023-12-11T17:10:20.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.990+0000 7fe980a3c640 1 -- 172.21.15.37:0/3275070631 shutdown_connections 2023-12-11T17:10:20.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.990+0000 7fe980a3c640 1 --2- 172.21.15.37:0/3275070631 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe96806ae40 0x7fe96806d300 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:20.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.990+0000 7fe980a3c640 1 --2- 172.21.15.37:0/3275070631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe97c159fd0 0x7fe97c15c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:20.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.990+0000 7fe980a3c640 1 --2- 172.21.15.37:0/3275070631 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe97c0711e0 0x7fe97c15bcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:20.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.990+0000 7fe980a3c640 1 --2- 172.21.15.37:0/3275070631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe97c070750 0x7fe97c14c1d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:20.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.990+0000 7fe980a3c640 1 -- 172.21.15.37:0/3275070631 >> 172.21.15.37:0/3275070631 conn(0x7fe97c0b0860 msgr2=0x7fe97c0b3820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:20.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.991+0000 7fe980a3c640 1 -- 172.21.15.37:0/3275070631 shutdown_connections 2023-12-11T17:10:20.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:20.991+0000 7fe980a3c640 1 -- 172.21.15.37:0/3275070631 wait complete. 2023-12-11T17:10:21.011 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2023-12-11T17:10:20.351780+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595006,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":208,"num_write_kb":2435,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":160,"ondisk_log_size":160,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219428,"kb_used_data":3272,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755292,"statfs":{"total":773094113280,"available":772869419008,"internally_reserved":0,"allocated":3350528,"data_stored":2014708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":141,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005570"},"pg_stats":[{"pgid":"2.1f","version":"20'4","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.264778+0000","last_change":"2023-12-11T17:09:44.205494+0000","last_active":"2023-12-11T17:09:49.264778+0000","last_peered":"2023-12-11T17:09:49.264778+0000","last_clean":"2023-12-11T17:09:49.264778+0000","last_became_active":"2023-12-11T17:09:44.205155+0000","last_became_peered":"2023-12-11T17:09:44.205155+0000","last_unstale":"2023-12-11T17:09:49.264778+0000","last_undegraded":"2023-12-11T17:09:49.264778+0000","last_fullsized":"2023-12-11T17:09:49.264778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:13:55.603067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242077+0000","last_change":"2023-12-11T17:09:45.206887+0000","last_active":"2023-12-11T17:09:49.242077+0000","last_peered":"2023-12-11T17:09:49.242077+0000","last_clean":"2023-12-11T17:09:49.242077+0000","last_became_active":"2023-12-11T17:09:45.206696+0000","last_became_peered":"2023-12-11T17:09:45.206696+0000","last_unstale":"2023-12-11T17:09:49.242077+0000","last_undegraded":"2023-12-11T17:09:49.242077+0000","last_fullsized":"2023-12-11T17:09:49.242077+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:13:50.995140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.248574+0000","last_change":"2023-12-11T17:09:49.282316+0000","last_active":"2023-12-11T17:09:50.248574+0000","last_peered":"2023-12-11T17:09:50.248574+0000","last_clean":"2023-12-11T17:09:50.248574+0000","last_became_active":"2023-12-11T17:09:49.281935+0000","last_became_peered":"2023-12-11T17:09:49.281935+0000","last_unstale":"2023-12-11T17:09:50.248574+0000","last_undegraded":"2023-12-11T17:09:50.248574+0000","last_fullsized":"2023-12-11T17:09:50.248574+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:09:37.168887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242245+0000","last_change":"2023-12-11T17:09:44.197711+0000","last_active":"2023-12-11T17:09:49.242245+0000","last_peered":"2023-12-11T17:09:49.242245+0000","last_clean":"2023-12-11T17:09:49.242245+0000","last_became_active":"2023-12-11T17:09:44.197229+0000","last_became_peered":"2023-12-11T17:09:44.197229+0000","last_unstale":"2023-12-11T17:09:49.242245+0000","last_undegraded":"2023-12-11T17:09:49.242245+0000","last_fullsized":"2023-12-11T17:09:49.242245+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:56:33.686127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.264591+0000","last_change":"2023-12-11T17:09:45.215263+0000","last_active":"2023-12-11T17:09:49.264591+0000","last_peered":"2023-12-11T17:09:49.264591+0000","last_clean":"2023-12-11T17:09:49.264591+0000","last_became_active":"2023-12-11T17:09:45.214989+0000","last_became_peered":"2023-12-11T17:09:45.214989+0000","last_unstale":"2023-12-11T17:09:49.264591+0000","last_undegraded":"2023-12-11T17:09:49.264591+0000","last_fullsized":"2023-12-11T17:09:49.264591+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:05.364711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669349+0000","last_change":"2023-12-11T17:09:49.281985+0000","last_active":"2023-12-11T17:09:51.669349+0000","last_peered":"2023-12-11T17:09:51.669349+0000","last_clean":"2023-12-11T17:09:51.669349+0000","last_became_active":"2023-12-11T17:09:49.280479+0000","last_became_peered":"2023-12-11T17:09:49.280479+0000","last_unstale":"2023-12-11T17:09:51.669349+0000","last_undegraded":"2023-12-11T17:09:51.669349+0000","last_fullsized":"2023-12-11T17:09:51.669349+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:13:55.059808+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274621+0000","last_change":"2023-12-11T17:09:44.209993+0000","last_active":"2023-12-11T17:09:49.274621+0000","last_peered":"2023-12-11T17:09:49.274621+0000","last_clean":"2023-12-11T17:09:49.274621+0000","last_became_active":"2023-12-11T17:09:44.209695+0000","last_became_peered":"2023-12-11T17:09:44.209695+0000","last_unstale":"2023-12-11T17:09:49.274621+0000","last_undegraded":"2023-12-11T17:09:49.274621+0000","last_fullsized":"2023-12-11T17:09:49.274621+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:08:15.250298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267955+0000","last_change":"2023-12-11T17:09:45.222374+0000","last_active":"2023-12-11T17:09:49.267955+0000","last_peered":"2023-12-11T17:09:49.267955+0000","last_clean":"2023-12-11T17:09:49.267955+0000","last_became_active":"2023-12-11T17:09:45.222069+0000","last_became_peered":"2023-12-11T17:09:45.222069+0000","last_unstale":"2023-12-11T17:09:49.267955+0000","last_undegraded":"2023-12-11T17:09:49.267955+0000","last_fullsized":"2023-12-11T17:09:49.267955+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:33:36.618495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669784+0000","last_change":"2023-12-11T17:09:49.277595+0000","last_active":"2023-12-11T17:09:51.669784+0000","last_peered":"2023-12-11T17:09:51.669784+0000","last_clean":"2023-12-11T17:09:51.669784+0000","last_became_active":"2023-12-11T17:09:49.276806+0000","last_became_peered":"2023-12-11T17:09:49.276806+0000","last_unstale":"2023-12-11T17:09:51.669784+0000","last_undegraded":"2023-12-11T17:09:51.669784+0000","last_fullsized":"2023-12-11T17:09:51.669784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:08.141530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274475+0000","last_change":"2023-12-11T17:09:44.213170+0000","last_active":"2023-12-11T17:09:49.274475+0000","last_peered":"2023-12-11T17:09:49.274475+0000","last_clean":"2023-12-11T17:09:49.274475+0000","last_became_active":"2023-12-11T17:09:44.212695+0000","last_became_peered":"2023-12-11T17:09:44.212695+0000","last_unstale":"2023-12-11T17:09:49.274475+0000","last_undegraded":"2023-12-11T17:09:49.274475+0000","last_fullsized":"2023-12-11T17:09:49.274475+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:38:29.306893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267473+0000","last_change":"2023-12-11T17:09:45.222217+0000","last_active":"2023-12-11T17:09:49.267473+0000","last_peered":"2023-12-11T17:09:49.267473+0000","last_clean":"2023-12-11T17:09:49.267473+0000","last_became_active":"2023-12-11T17:09:45.221985+0000","last_became_peered":"2023-12-11T17:09:45.221985+0000","last_unstale":"2023-12-11T17:09:49.267473+0000","last_undegraded":"2023-12-11T17:09:49.267473+0000","last_fullsized":"2023-12-11T17:09:49.267473+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:02:04.180131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.668985+0000","last_change":"2023-12-11T17:09:49.271236+0000","last_active":"2023-12-11T17:09:51.668985+0000","last_peered":"2023-12-11T17:09:51.668985+0000","last_clean":"2023-12-11T17:09:51.668985+0000","last_became_active":"2023-12-11T17:09:49.268635+0000","last_became_peered":"2023-12-11T17:09:49.268635+0000","last_unstale":"2023-12-11T17:09:51.668985+0000","last_undegraded":"2023-12-11T17:09:51.668985+0000","last_fullsized":"2023-12-11T17:09:51.668985+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:36:14.458597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244251+0000","last_change":"2023-12-11T17:09:45.215612+0000","last_active":"2023-12-11T17:09:49.244251+0000","last_peered":"2023-12-11T17:09:49.244251+0000","last_clean":"2023-12-11T17:09:49.244251+0000","last_became_active":"2023-12-11T17:09:45.215222+0000","last_became_peered":"2023-12-11T17:09:45.215222+0000","last_unstale":"2023-12-11T17:09:49.244251+0000","last_undegraded":"2023-12-11T17:09:49.244251+0000","last_fullsized":"2023-12-11T17:09:49.244251+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:39:10.691125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275270+0000","last_change":"2023-12-11T17:09:44.208572+0000","last_active":"2023-12-11T17:09:49.275270+0000","last_peered":"2023-12-11T17:09:49.275270+0000","last_clean":"2023-12-11T17:09:49.275270+0000","last_became_active":"2023-12-11T17:09:44.208062+0000","last_became_peered":"2023-12-11T17:09:44.208062+0000","last_unstale":"2023-12-11T17:09:49.275270+0000","last_undegraded":"2023-12-11T17:09:49.275270+0000","last_fullsized":"2023-12-11T17:09:49.275270+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:22:33.669469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669908+0000","last_change":"2023-12-11T17:09:49.280949+0000","last_active":"2023-12-11T17:09:51.669908+0000","last_peered":"2023-12-11T17:09:51.669908+0000","last_clean":"2023-12-11T17:09:51.669908+0000","last_became_active":"2023-12-11T17:09:49.280486+0000","last_became_peered":"2023-12-11T17:09:49.280486+0000","last_unstale":"2023-12-11T17:09:51.669908+0000","last_undegraded":"2023-12-11T17:09:51.669908+0000","last_fullsized":"2023-12-11T17:09:51.669908+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:28:35.459824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242397+0000","last_change":"2023-12-11T17:09:45.200951+0000","last_active":"2023-12-11T17:09:49.242397+0000","last_peered":"2023-12-11T17:09:49.242397+0000","last_clean":"2023-12-11T17:09:49.242397+0000","last_became_active":"2023-12-11T17:09:45.199504+0000","last_became_peered":"2023-12-11T17:09:45.199504+0000","last_unstale":"2023-12-11T17:09:49.242397+0000","last_undegraded":"2023-12-11T17:09:49.242397+0000","last_fullsized":"2023-12-11T17:09:49.242397+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:51:29.300195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.247683+0000","last_change":"2023-12-11T17:09:44.195059+0000","last_active":"2023-12-11T17:09:49.247683+0000","last_peered":"2023-12-11T17:09:49.247683+0000","last_clean":"2023-12-11T17:09:49.247683+0000","last_became_active":"2023-12-11T17:09:44.194799+0000","last_became_peered":"2023-12-11T17:09:44.194799+0000","last_unstale":"2023-12-11T17:09:49.247683+0000","last_undegraded":"2023-12-11T17:09:49.247683+0000","last_fullsized":"2023-12-11T17:09:49.247683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:43:26.684582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669518+0000","last_change":"2023-12-11T17:09:49.279664+0000","last_active":"2023-12-11T17:09:51.669518+0000","last_peered":"2023-12-11T17:09:51.669518+0000","last_clean":"2023-12-11T17:09:51.669518+0000","last_became_active":"2023-12-11T17:09:49.279207+0000","last_became_peered":"2023-12-11T17:09:49.279207+0000","last_unstale":"2023-12-11T17:09:51.669518+0000","last_undegraded":"2023-12-11T17:09:51.669518+0000","last_fullsized":"2023-12-11T17:09:51.669518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:02:08.244798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242731+0000","last_change":"2023-12-11T17:09:45.209162+0000","last_active":"2023-12-11T17:09:49.242731+0000","last_peered":"2023-12-11T17:09:49.242731+0000","last_clean":"2023-12-11T17:09:49.242731+0000","last_became_active":"2023-12-11T17:09:45.204781+0000","last_became_peered":"2023-12-11T17:09:45.204781+0000","last_unstale":"2023-12-11T17:09:49.242731+0000","last_undegraded":"2023-12-11T17:09:49.242731+0000","last_fullsized":"2023-12-11T17:09:49.242731+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:27:18.925357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.241243+0000","last_change":"2023-12-11T17:09:44.196375+0000","last_active":"2023-12-11T17:09:49.241243+0000","last_peered":"2023-12-11T17:09:49.241243+0000","last_clean":"2023-12-11T17:09:49.241243+0000","last_became_active":"2023-12-11T17:09:44.196046+0000","last_became_peered":"2023-12-11T17:09:44.196046+0000","last_unstale":"2023-12-11T17:09:49.241243+0000","last_undegraded":"2023-12-11T17:09:49.241243+0000","last_fullsized":"2023-12-11T17:09:49.241243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:42:30.903444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.673124+0000","last_change":"2023-12-11T17:09:49.280698+0000","last_active":"2023-12-11T17:09:51.673124+0000","last_peered":"2023-12-11T17:09:51.673124+0000","last_clean":"2023-12-11T17:09:51.673124+0000","last_became_active":"2023-12-11T17:09:49.280309+0000","last_became_peered":"2023-12-11T17:09:49.280309+0000","last_unstale":"2023-12-11T17:09:51.673124+0000","last_undegraded":"2023-12-11T17:09:51.673124+0000","last_fullsized":"2023-12-11T17:09:51.673124+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:24:45.184380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.270508+0000","last_change":"2023-12-11T17:09:45.210450+0000","last_active":"2023-12-11T17:09:49.270508+0000","last_peered":"2023-12-11T17:09:49.270508+0000","last_clean":"2023-12-11T17:09:49.270508+0000","last_became_active":"2023-12-11T17:09:45.202201+0000","last_became_peered":"2023-12-11T17:09:45.202201+0000","last_unstale":"2023-12-11T17:09:49.270508+0000","last_undegraded":"2023-12-11T17:09:49.270508+0000","last_fullsized":"2023-12-11T17:09:49.270508+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:43:19.164503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.271955+0000","last_change":"2023-12-11T17:09:44.209283+0000","last_active":"2023-12-11T17:09:49.271955+0000","last_peered":"2023-12-11T17:09:49.271955+0000","last_clean":"2023-12-11T17:09:49.271955+0000","last_became_active":"2023-12-11T17:09:44.208995+0000","last_became_peered":"2023-12-11T17:09:44.208995+0000","last_unstale":"2023-12-11T17:09:49.271955+0000","last_undegraded":"2023-12-11T17:09:49.271955+0000","last_fullsized":"2023-12-11T17:09:49.271955+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:43:26.684582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669445+0000","last_change":"2023-12-11T17:09:49.278872+0000","last_active":"2023-12-11T17:09:51.669445+0000","last_peered":"2023-12-11T17:09:51.669445+0000","last_clean":"2023-12-11T17:09:51.669445+0000","last_became_active":"2023-12-11T17:09:49.276738+0000","last_became_peered":"2023-12-11T17:09:49.276738+0000","last_unstale":"2023-12-11T17:09:51.669445+0000","last_undegraded":"2023-12-11T17:09:51.669445+0000","last_fullsized":"2023-12-11T17:09:51.669445+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:17:51.127675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.261226+0000","last_change":"2023-12-11T17:09:45.211027+0000","last_active":"2023-12-11T17:09:49.261226+0000","last_peered":"2023-12-11T17:09:49.261226+0000","last_clean":"2023-12-11T17:09:49.261226+0000","last_became_active":"2023-12-11T17:09:45.210763+0000","last_became_peered":"2023-12-11T17:09:45.210763+0000","last_unstale":"2023-12-11T17:09:49.261226+0000","last_undegraded":"2023-12-11T17:09:49.261226+0000","last_fullsized":"2023-12-11T17:09:49.261226+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:08:16.262435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"20'2","reported_seq":18,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.247483+0000","last_change":"2023-12-11T17:09:44.203386+0000","last_active":"2023-12-11T17:09:49.247483+0000","last_peered":"2023-12-11T17:09:49.247483+0000","last_clean":"2023-12-11T17:09:49.247483+0000","last_became_active":"2023-12-11T17:09:44.203053+0000","last_became_peered":"2023-12-11T17:09:44.203053+0000","last_unstale":"2023-12-11T17:09:49.247483+0000","last_undegraded":"2023-12-11T17:09:49.247483+0000","last_fullsized":"2023-12-11T17:09:49.247483+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:44.213311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.668973+0000","last_change":"2023-12-11T17:09:49.282875+0000","last_active":"2023-12-11T17:09:51.668973+0000","last_peered":"2023-12-11T17:09:51.668973+0000","last_clean":"2023-12-11T17:09:51.668973+0000","last_became_active":"2023-12-11T17:09:49.282315+0000","last_became_peered":"2023-12-11T17:09:49.282315+0000","last_unstale":"2023-12-11T17:09:51.668973+0000","last_undegraded":"2023-12-11T17:09:51.668973+0000","last_fullsized":"2023-12-11T17:09:51.668973+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:51:33.364863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.243142+0000","last_change":"2023-12-11T17:09:45.195150+0000","last_active":"2023-12-11T17:09:49.243142+0000","last_peered":"2023-12-11T17:09:49.243142+0000","last_clean":"2023-12-11T17:09:49.243142+0000","last_became_active":"2023-12-11T17:09:45.194871+0000","last_became_peered":"2023-12-11T17:09:45.194871+0000","last_unstale":"2023-12-11T17:09:49.243142+0000","last_undegraded":"2023-12-11T17:09:49.243142+0000","last_fullsized":"2023-12-11T17:09:49.243142+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:36:10.393929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"22'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.247741+0000","last_change":"2023-12-11T17:09:44.194695+0000","last_active":"2023-12-11T17:09:49.247741+0000","last_peered":"2023-12-11T17:09:49.247741+0000","last_clean":"2023-12-11T17:09:49.247741+0000","last_became_active":"2023-12-11T17:09:44.193709+0000","last_became_peered":"2023-12-11T17:09:44.193709+0000","last_unstale":"2023-12-11T17:09:49.247741+0000","last_undegraded":"2023-12-11T17:09:49.247741+0000","last_fullsized":"2023-12-11T17:09:49.247741+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:47:06.501355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.245990+0000","last_change":"2023-12-11T17:09:49.278389+0000","last_active":"2023-12-11T17:09:50.245990+0000","last_peered":"2023-12-11T17:09:50.245990+0000","last_clean":"2023-12-11T17:09:50.245990+0000","last_became_active":"2023-12-11T17:09:49.277824+0000","last_became_peered":"2023-12-11T17:09:49.277824+0000","last_unstale":"2023-12-11T17:09:50.245990+0000","last_undegraded":"2023-12-11T17:09:50.245990+0000","last_fullsized":"2023-12-11T17:09:50.245990+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:35:53.618553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244690+0000","last_change":"2023-12-11T17:09:45.201703+0000","last_active":"2023-12-11T17:09:49.244690+0000","last_peered":"2023-12-11T17:09:49.244690+0000","last_clean":"2023-12-11T17:09:49.244690+0000","last_became_active":"2023-12-11T17:09:45.200824+0000","last_became_peered":"2023-12-11T17:09:45.200824+0000","last_unstale":"2023-12-11T17:09:49.244690+0000","last_undegraded":"2023-12-11T17:09:49.244690+0000","last_fullsized":"2023-12-11T17:09:49.244690+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:39:10.691125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274750+0000","last_change":"2023-12-11T17:09:44.208756+0000","last_active":"2023-12-11T17:09:49.274750+0000","last_peered":"2023-12-11T17:09:49.274750+0000","last_clean":"2023-12-11T17:09:49.274750+0000","last_became_active":"2023-12-11T17:09:44.208390+0000","last_became_peered":"2023-12-11T17:09:44.208390+0000","last_unstale":"2023-12-11T17:09:49.274750+0000","last_undegraded":"2023-12-11T17:09:49.274750+0000","last_fullsized":"2023-12-11T17:09:49.274750+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:04.352574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.671162+0000","last_change":"2023-12-11T17:09:49.283760+0000","last_active":"2023-12-11T17:09:51.671162+0000","last_peered":"2023-12-11T17:09:51.671162+0000","last_clean":"2023-12-11T17:09:51.671162+0000","last_became_active":"2023-12-11T17:09:49.281062+0000","last_became_peered":"2023-12-11T17:09:49.281062+0000","last_unstale":"2023-12-11T17:09:51.671162+0000","last_undegraded":"2023-12-11T17:09:51.671162+0000","last_fullsized":"2023-12-11T17:09:51.671162+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:01:12.186325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267581+0000","last_change":"2023-12-11T17:09:45.214708+0000","last_active":"2023-12-11T17:09:49.267581+0000","last_peered":"2023-12-11T17:09:49.267581+0000","last_clean":"2023-12-11T17:09:49.267581+0000","last_became_active":"2023-12-11T17:09:45.214453+0000","last_became_peered":"2023-12-11T17:09:45.214453+0000","last_unstale":"2023-12-11T17:09:49.267581+0000","last_undegraded":"2023-12-11T17:09:49.267581+0000","last_fullsized":"2023-12-11T17:09:49.267581+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:04.076862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244838+0000","last_change":"2023-12-11T17:09:44.192839+0000","last_active":"2023-12-11T17:09:49.244838+0000","last_peered":"2023-12-11T17:09:49.244838+0000","last_clean":"2023-12-11T17:09:49.244838+0000","last_became_active":"2023-12-11T17:09:44.192441+0000","last_became_peered":"2023-12-11T17:09:44.192441+0000","last_unstale":"2023-12-11T17:09:49.244838+0000","last_undegraded":"2023-12-11T17:09:49.244838+0000","last_fullsized":"2023-12-11T17:09:49.244838+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:52:53.972126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.670689+0000","last_change":"2023-12-11T17:09:49.270432+0000","last_active":"2023-12-11T17:09:51.670689+0000","last_peered":"2023-12-11T17:09:51.670689+0000","last_clean":"2023-12-11T17:09:51.670689+0000","last_became_active":"2023-12-11T17:09:49.269987+0000","last_became_peered":"2023-12-11T17:09:49.269987+0000","last_unstale":"2023-12-11T17:09:51.670689+0000","last_undegraded":"2023-12-11T17:09:51.670689+0000","last_fullsized":"2023-12-11T17:09:51.670689+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:08.141530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.271570+0000","last_change":"2023-12-11T17:09:45.222655+0000","last_active":"2023-12-11T17:09:49.271570+0000","last_peered":"2023-12-11T17:09:49.271570+0000","last_clean":"2023-12-11T17:09:49.271570+0000","last_became_active":"2023-12-11T17:09:45.222198+0000","last_became_peered":"2023-12-11T17:09:45.222198+0000","last_unstale":"2023-12-11T17:09:49.271570+0000","last_undegraded":"2023-12-11T17:09:49.271570+0000","last_fullsized":"2023-12-11T17:09:49.271570+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:28:10.075039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.263830+0000","last_change":"2023-12-11T17:09:44.207657+0000","last_active":"2023-12-11T17:09:49.263830+0000","last_peered":"2023-12-11T17:09:49.263830+0000","last_clean":"2023-12-11T17:09:49.263830+0000","last_became_active":"2023-12-11T17:09:44.205012+0000","last_became_peered":"2023-12-11T17:09:44.205012+0000","last_unstale":"2023-12-11T17:09:49.263830+0000","last_undegraded":"2023-12-11T17:09:49.263830+0000","last_fullsized":"2023-12-11T17:09:49.263830+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:17:03.000720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.672166+0000","last_change":"2023-12-11T17:09:49.270417+0000","last_active":"2023-12-11T17:09:51.672166+0000","last_peered":"2023-12-11T17:09:51.672166+0000","last_clean":"2023-12-11T17:09:51.672166+0000","last_became_active":"2023-12-11T17:09:49.270052+0000","last_became_peered":"2023-12-11T17:09:49.270052+0000","last_unstale":"2023-12-11T17:09:51.672166+0000","last_undegraded":"2023-12-11T17:09:51.672166+0000","last_fullsized":"2023-12-11T17:09:51.672166+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:03:14.942737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.240098+0000","last_change":"2023-12-11T17:09:45.205128+0000","last_active":"2023-12-11T17:09:49.240098+0000","last_peered":"2023-12-11T17:09:49.240098+0000","last_clean":"2023-12-11T17:09:49.240098+0000","last_became_active":"2023-12-11T17:09:45.204869+0000","last_became_peered":"2023-12-11T17:09:45.204869+0000","last_unstale":"2023-12-11T17:09:49.240098+0000","last_undegraded":"2023-12-11T17:09:49.240098+0000","last_fullsized":"2023-12-11T17:09:49.240098+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:17:04.012857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.250848+0000","last_change":"2023-12-11T17:09:44.198305+0000","last_active":"2023-12-11T17:09:49.250848+0000","last_peered":"2023-12-11T17:09:49.250848+0000","last_clean":"2023-12-11T17:09:49.250848+0000","last_became_active":"2023-12-11T17:09:44.196890+0000","last_became_peered":"2023-12-11T17:09:44.196890+0000","last_unstale":"2023-12-11T17:09:49.250848+0000","last_undegraded":"2023-12-11T17:09:49.250848+0000","last_fullsized":"2023-12-11T17:09:49.250848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:59:22.990940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.673145+0000","last_change":"2023-12-11T17:09:49.272669+0000","last_active":"2023-12-11T17:09:51.673145+0000","last_peered":"2023-12-11T17:09:51.673145+0000","last_clean":"2023-12-11T17:09:51.673145+0000","last_became_active":"2023-12-11T17:09:49.269739+0000","last_became_peered":"2023-12-11T17:09:49.269739+0000","last_unstale":"2023-12-11T17:09:51.673145+0000","last_undegraded":"2023-12-11T17:09:51.673145+0000","last_fullsized":"2023-12-11T17:09:51.673145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:01:12.186325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259188+0000","last_change":"2023-12-11T17:09:45.215855+0000","last_active":"2023-12-11T17:09:49.259188+0000","last_peered":"2023-12-11T17:09:49.259188+0000","last_clean":"2023-12-11T17:09:49.259188+0000","last_became_active":"2023-12-11T17:09:45.214930+0000","last_became_peered":"2023-12-11T17:09:45.214930+0000","last_unstale":"2023-12-11T17:09:49.259188+0000","last_undegraded":"2023-12-11T17:09:49.259188+0000","last_fullsized":"2023-12-11T17:09:49.259188+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:38:30.319030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.272045+0000","last_change":"2023-12-11T17:09:44.206866+0000","last_active":"2023-12-11T17:09:49.272045+0000","last_peered":"2023-12-11T17:09:49.272045+0000","last_clean":"2023-12-11T17:09:49.272045+0000","last_became_active":"2023-12-11T17:09:44.205821+0000","last_became_peered":"2023-12-11T17:09:44.205821+0000","last_unstale":"2023-12-11T17:09:49.272045+0000","last_undegraded":"2023-12-11T17:09:49.272045+0000","last_fullsized":"2023-12-11T17:09:49.272045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:44.213311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.670848+0000","last_change":"2023-12-11T17:09:49.285904+0000","last_active":"2023-12-11T17:09:51.670848+0000","last_peered":"2023-12-11T17:09:51.670848+0000","last_clean":"2023-12-11T17:09:51.670848+0000","last_became_active":"2023-12-11T17:09:49.282906+0000","last_became_peered":"2023-12-11T17:09:49.282906+0000","last_unstale":"2023-12-11T17:09:51.670848+0000","last_undegraded":"2023-12-11T17:09:51.670848+0000","last_fullsized":"2023-12-11T17:09:51.670848+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:03:14.942737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242151+0000","last_change":"2023-12-11T17:09:45.213664+0000","last_active":"2023-12-11T17:09:49.242151+0000","last_peered":"2023-12-11T17:09:49.242151+0000","last_clean":"2023-12-11T17:09:49.242151+0000","last_became_active":"2023-12-11T17:09:45.213356+0000","last_became_peered":"2023-12-11T17:09:45.213356+0000","last_unstale":"2023-12-11T17:09:49.242151+0000","last_undegraded":"2023-12-11T17:09:49.242151+0000","last_fullsized":"2023-12-11T17:09:49.242151+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:17:04.012857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.266436+0000","last_change":"2023-12-11T17:09:44.196934+0000","last_active":"2023-12-11T17:09:49.266436+0000","last_peered":"2023-12-11T17:09:49.266436+0000","last_clean":"2023-12-11T17:09:49.266436+0000","last_became_active":"2023-12-11T17:09:44.192526+0000","last_became_peered":"2023-12-11T17:09:44.192526+0000","last_unstale":"2023-12-11T17:09:49.266436+0000","last_undegraded":"2023-12-11T17:09:49.266436+0000","last_fullsized":"2023-12-11T17:09:49.266436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:08:15.250298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":168,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.272132+0000","last_change":"2023-12-11T17:09:40.320298+0000","last_active":"2023-12-11T17:09:49.272132+0000","last_peered":"2023-12-11T17:09:49.272132+0000","last_clean":"2023-12-11T17:09:49.272132+0000","last_became_active":"2023-12-11T17:09:40.318118+0000","last_became_peered":"2023-12-11T17:09:40.318118+0000","last_unstale":"2023-12-11T17:09:49.272132+0000","last_undegraded":"2023-12-11T17:09:49.272132+0000","last_fullsized":"2023-12-11T17:09:49.272132+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:38.641841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:38.641841+0000","last_clean_scrub_stamp":"2023-12-11T17:09:38.641841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:36:05.856847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.246854+0000","last_change":"2023-12-11T17:09:49.284105+0000","last_active":"2023-12-11T17:09:50.246854+0000","last_peered":"2023-12-11T17:09:50.246854+0000","last_clean":"2023-12-11T17:09:50.246854+0000","last_became_active":"2023-12-11T17:09:49.282365+0000","last_became_peered":"2023-12-11T17:09:49.282365+0000","last_unstale":"2023-12-11T17:09:50.246854+0000","last_undegraded":"2023-12-11T17:09:50.246854+0000","last_fullsized":"2023-12-11T17:09:50.246854+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:33:40.683163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274490+0000","last_change":"2023-12-11T17:09:45.227132+0000","last_active":"2023-12-11T17:09:49.274490+0000","last_peered":"2023-12-11T17:09:49.274490+0000","last_clean":"2023-12-11T17:09:49.274490+0000","last_became_active":"2023-12-11T17:09:45.224674+0000","last_became_peered":"2023-12-11T17:09:45.224674+0000","last_unstale":"2023-12-11T17:09:49.274490+0000","last_undegraded":"2023-12-11T17:09:49.274490+0000","last_fullsized":"2023-12-11T17:09:49.274490+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:02:04.180131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.251498+0000","last_change":"2023-12-11T17:09:44.207068+0000","last_active":"2023-12-11T17:09:49.251498+0000","last_peered":"2023-12-11T17:09:49.251498+0000","last_clean":"2023-12-11T17:09:49.251498+0000","last_became_active":"2023-12-11T17:09:44.206365+0000","last_became_peered":"2023-12-11T17:09:44.206365+0000","last_unstale":"2023-12-11T17:09:49.251498+0000","last_undegraded":"2023-12-11T17:09:49.251498+0000","last_fullsized":"2023-12-11T17:09:49.251498+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:53:23.727946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.245537+0000","last_change":"2023-12-11T17:09:49.282432+0000","last_active":"2023-12-11T17:09:50.245537+0000","last_peered":"2023-12-11T17:09:50.245537+0000","last_clean":"2023-12-11T17:09:50.245537+0000","last_became_active":"2023-12-11T17:09:49.281688+0000","last_became_peered":"2023-12-11T17:09:49.281688+0000","last_unstale":"2023-12-11T17:09:50.245537+0000","last_undegraded":"2023-12-11T17:09:50.245537+0000","last_fullsized":"2023-12-11T17:09:50.245537+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:02:08.244798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.268082+0000","last_change":"2023-12-11T17:09:45.212177+0000","last_active":"2023-12-11T17:09:49.268082+0000","last_peered":"2023-12-11T17:09:49.268082+0000","last_clean":"2023-12-11T17:09:49.268082+0000","last_became_active":"2023-12-11T17:09:45.211897+0000","last_became_peered":"2023-12-11T17:09:45.211897+0000","last_unstale":"2023-12-11T17:09:49.268082+0000","last_undegraded":"2023-12-11T17:09:49.268082+0000","last_fullsized":"2023-12-11T17:09:49.268082+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:28:31.395156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244887+0000","last_change":"2023-12-11T17:09:44.200317+0000","last_active":"2023-12-11T17:09:49.244887+0000","last_peered":"2023-12-11T17:09:49.244887+0000","last_clean":"2023-12-11T17:09:49.244887+0000","last_became_active":"2023-12-11T17:09:44.199797+0000","last_became_peered":"2023-12-11T17:09:44.199797+0000","last_unstale":"2023-12-11T17:09:49.244887+0000","last_undegraded":"2023-12-11T17:09:49.244887+0000","last_fullsized":"2023-12-11T17:09:49.244887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:56:33.686127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.670045+0000","last_change":"2023-12-11T17:09:49.267135+0000","last_active":"2023-12-11T17:09:51.670045+0000","last_peered":"2023-12-11T17:09:51.670045+0000","last_clean":"2023-12-11T17:09:51.670045+0000","last_became_active":"2023-12-11T17:09:49.266709+0000","last_became_peered":"2023-12-11T17:09:49.266709+0000","last_unstale":"2023-12-11T17:09:51.670045+0000","last_undegraded":"2023-12-11T17:09:51.670045+0000","last_fullsized":"2023-12-11T17:09:51.670045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:08.141530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275410+0000","last_change":"2023-12-11T17:09:45.227783+0000","last_active":"2023-12-11T17:09:49.275410+0000","last_peered":"2023-12-11T17:09:49.275410+0000","last_clean":"2023-12-11T17:09:49.275410+0000","last_became_active":"2023-12-11T17:09:45.225563+0000","last_became_peered":"2023-12-11T17:09:45.225563+0000","last_unstale":"2023-12-11T17:09:49.275410+0000","last_undegraded":"2023-12-11T17:09:49.275410+0000","last_fullsized":"2023-12-11T17:09:49.275410+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:35:49.553886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.252708+0000","last_change":"2023-12-11T17:09:44.197835+0000","last_active":"2023-12-11T17:09:49.252708+0000","last_peered":"2023-12-11T17:09:49.252708+0000","last_clean":"2023-12-11T17:09:49.252708+0000","last_became_active":"2023-12-11T17:09:44.197550+0000","last_became_peered":"2023-12-11T17:09:44.197550+0000","last_unstale":"2023-12-11T17:09:49.252708+0000","last_undegraded":"2023-12-11T17:09:49.252708+0000","last_fullsized":"2023-12-11T17:09:49.252708+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:48:05.507260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.734122+0000","last_change":"2023-12-11T17:09:49.277218+0000","last_active":"2023-12-11T17:09:50.734122+0000","last_peered":"2023-12-11T17:09:50.734122+0000","last_clean":"2023-12-11T17:09:50.734122+0000","last_became_active":"2023-12-11T17:09:49.276790+0000","last_became_peered":"2023-12-11T17:09:49.276790+0000","last_unstale":"2023-12-11T17:09:50.734122+0000","last_undegraded":"2023-12-11T17:09:50.734122+0000","last_fullsized":"2023-12-11T17:09:50.734122+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:09:37.168887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274765+0000","last_change":"2023-12-11T17:09:45.228047+0000","last_active":"2023-12-11T17:09:49.274765+0000","last_peered":"2023-12-11T17:09:49.274765+0000","last_clean":"2023-12-11T17:09:49.274765+0000","last_became_active":"2023-12-11T17:09:45.225286+0000","last_became_peered":"2023-12-11T17:09:45.225286+0000","last_unstale":"2023-12-11T17:09:49.274765+0000","last_undegraded":"2023-12-11T17:09:49.274765+0000","last_fullsized":"2023-12-11T17:09:49.274765+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:28:31.395156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.270765+0000","last_change":"2023-12-11T17:09:44.203193+0000","last_active":"2023-12-11T17:09:49.270765+0000","last_peered":"2023-12-11T17:09:49.270765+0000","last_clean":"2023-12-11T17:09:49.270765+0000","last_became_active":"2023-12-11T17:09:44.202663+0000","last_became_peered":"2023-12-11T17:09:44.202663+0000","last_unstale":"2023-12-11T17:09:49.270765+0000","last_undegraded":"2023-12-11T17:09:49.270765+0000","last_fullsized":"2023-12-11T17:09:49.270765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:17:24.831081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.668651+0000","last_change":"2023-12-11T17:09:49.274246+0000","last_active":"2023-12-11T17:09:51.668651+0000","last_peered":"2023-12-11T17:09:51.668651+0000","last_clean":"2023-12-11T17:09:51.668651+0000","last_became_active":"2023-12-11T17:09:49.273634+0000","last_became_peered":"2023-12-11T17:09:49.273634+0000","last_unstale":"2023-12-11T17:09:51.668651+0000","last_undegraded":"2023-12-11T17:09:51.668651+0000","last_fullsized":"2023-12-11T17:09:51.668651+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:56.216955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.276177+0000","last_change":"2023-12-11T17:09:45.227483+0000","last_active":"2023-12-11T17:09:49.276177+0000","last_peered":"2023-12-11T17:09:49.276177+0000","last_clean":"2023-12-11T17:09:49.276177+0000","last_became_active":"2023-12-11T17:09:45.227150+0000","last_became_peered":"2023-12-11T17:09:45.227150+0000","last_unstale":"2023-12-11T17:09:49.276177+0000","last_undegraded":"2023-12-11T17:09:49.276177+0000","last_fullsized":"2023-12-11T17:09:49.276177+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:36:10.393929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"20'8","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.249199+0000","last_change":"2023-12-11T17:09:44.185666+0000","last_active":"2023-12-11T17:09:49.249199+0000","last_peered":"2023-12-11T17:09:49.249199+0000","last_clean":"2023-12-11T17:09:49.249199+0000","last_became_active":"2023-12-11T17:09:44.185302+0000","last_became_peered":"2023-12-11T17:09:44.185302+0000","last_unstale":"2023-12-11T17:09:49.249199+0000","last_undegraded":"2023-12-11T17:09:49.249199+0000","last_fullsized":"2023-12-11T17:09:49.249199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:17:35.452188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.670426+0000","last_change":"2023-12-11T17:09:49.268722+0000","last_active":"2023-12-11T17:09:51.670426+0000","last_peered":"2023-12-11T17:09:51.670426+0000","last_clean":"2023-12-11T17:09:51.670426+0000","last_became_active":"2023-12-11T17:09:49.268340+0000","last_became_peered":"2023-12-11T17:09:49.268340+0000","last_unstale":"2023-12-11T17:09:51.670426+0000","last_undegraded":"2023-12-11T17:09:51.670426+0000","last_fullsized":"2023-12-11T17:09:51.670426+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:28:35.459824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242938+0000","last_change":"2023-12-11T17:09:45.215129+0000","last_active":"2023-12-11T17:09:49.242938+0000","last_peered":"2023-12-11T17:09:49.242938+0000","last_clean":"2023-12-11T17:09:49.242938+0000","last_became_active":"2023-12-11T17:09:45.214556+0000","last_became_peered":"2023-12-11T17:09:45.214556+0000","last_unstale":"2023-12-11T17:09:49.242938+0000","last_undegraded":"2023-12-11T17:09:49.242938+0000","last_fullsized":"2023-12-11T17:09:49.242938+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:27:18.925357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.243243+0000","last_change":"2023-12-11T17:09:44.195851+0000","last_active":"2023-12-11T17:09:49.243243+0000","last_peered":"2023-12-11T17:09:49.243243+0000","last_clean":"2023-12-11T17:09:49.243243+0000","last_became_active":"2023-12-11T17:09:44.195539+0000","last_became_peered":"2023-12-11T17:09:44.195539+0000","last_unstale":"2023-12-11T17:09:49.243243+0000","last_undegraded":"2023-12-11T17:09:49.243243+0000","last_fullsized":"2023-12-11T17:09:49.243243+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:52:53.972126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.250040+0000","last_change":"2023-12-11T17:09:49.288681+0000","last_active":"2023-12-11T17:09:50.250040+0000","last_peered":"2023-12-11T17:09:50.250040+0000","last_clean":"2023-12-11T17:09:50.250040+0000","last_became_active":"2023-12-11T17:09:49.280484+0000","last_became_peered":"2023-12-11T17:09:49.280484+0000","last_unstale":"2023-12-11T17:09:50.250040+0000","last_undegraded":"2023-12-11T17:09:50.250040+0000","last_fullsized":"2023-12-11T17:09:50.250040+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:28:03.097522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275178+0000","last_change":"2023-12-11T17:09:45.228655+0000","last_active":"2023-12-11T17:09:49.275178+0000","last_peered":"2023-12-11T17:09:49.275178+0000","last_clean":"2023-12-11T17:09:49.275178+0000","last_became_active":"2023-12-11T17:09:45.225530+0000","last_became_peered":"2023-12-11T17:09:45.225530+0000","last_unstale":"2023-12-11T17:09:49.275178+0000","last_undegraded":"2023-12-11T17:09:49.275178+0000","last_fullsized":"2023-12-11T17:09:49.275178+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:04.076862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.263735+0000","last_change":"2023-12-11T17:09:44.197598+0000","last_active":"2023-12-11T17:09:49.263735+0000","last_peered":"2023-12-11T17:09:49.263735+0000","last_clean":"2023-12-11T17:09:49.263735+0000","last_became_active":"2023-12-11T17:09:44.197143+0000","last_became_peered":"2023-12-11T17:09:44.197143+0000","last_unstale":"2023-12-11T17:09:49.263735+0000","last_undegraded":"2023-12-11T17:09:49.263735+0000","last_fullsized":"2023-12-11T17:09:49.263735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:11:14.773136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.249485+0000","last_change":"2023-12-11T17:09:49.281263+0000","last_active":"2023-12-11T17:09:50.249485+0000","last_peered":"2023-12-11T17:09:50.249485+0000","last_clean":"2023-12-11T17:09:50.249485+0000","last_became_active":"2023-12-11T17:09:49.280311+0000","last_became_peered":"2023-12-11T17:09:49.280311+0000","last_unstale":"2023-12-11T17:09:50.249485+0000","last_undegraded":"2023-12-11T17:09:50.249485+0000","last_fullsized":"2023-12-11T17:09:50.249485+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:14:54.962202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259318+0000","last_change":"2023-12-11T17:09:45.222607+0000","last_active":"2023-12-11T17:09:49.259318+0000","last_peered":"2023-12-11T17:09:49.259318+0000","last_clean":"2023-12-11T17:09:49.259318+0000","last_became_active":"2023-12-11T17:09:45.221704+0000","last_became_peered":"2023-12-11T17:09:45.221704+0000","last_unstale":"2023-12-11T17:09:49.259318+0000","last_undegraded":"2023-12-11T17:09:49.259318+0000","last_fullsized":"2023-12-11T17:09:49.259318+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:27:18.925357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"20'2","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259851+0000","last_change":"2023-12-11T17:09:44.201116+0000","last_active":"2023-12-11T17:09:49.259851+0000","last_peered":"2023-12-11T17:09:49.259851+0000","last_clean":"2023-12-11T17:09:49.259851+0000","last_became_active":"2023-12-11T17:09:44.200316+0000","last_became_peered":"2023-12-11T17:09:44.200316+0000","last_unstale":"2023-12-11T17:09:49.259851+0000","last_undegraded":"2023-12-11T17:09:49.259851+0000","last_fullsized":"2023-12-11T17:09:49.259851+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:22:33.669469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.735500+0000","last_change":"2023-12-11T17:09:49.284856+0000","last_active":"2023-12-11T17:09:50.735500+0000","last_peered":"2023-12-11T17:09:50.735500+0000","last_clean":"2023-12-11T17:09:50.735500+0000","last_became_active":"2023-12-11T17:09:49.284294+0000","last_became_peered":"2023-12-11T17:09:49.284294+0000","last_unstale":"2023-12-11T17:09:50.735500+0000","last_undegraded":"2023-12-11T17:09:50.735500+0000","last_fullsized":"2023-12-11T17:09:50.735500+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:14:54.962202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274536+0000","last_change":"2023-12-11T17:09:45.220222+0000","last_active":"2023-12-11T17:09:49.274536+0000","last_peered":"2023-12-11T17:09:49.274536+0000","last_clean":"2023-12-11T17:09:49.274536+0000","last_became_active":"2023-12-11T17:09:45.218938+0000","last_became_peered":"2023-12-11T17:09:45.218938+0000","last_unstale":"2023-12-11T17:09:49.274536+0000","last_undegraded":"2023-12-11T17:09:49.274536+0000","last_fullsized":"2023-12-11T17:09:49.274536+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:33:36.618495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"25'10","reported_seq":26,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:10:04.440884+0000","last_change":"2023-12-11T17:09:44.198146+0000","last_active":"2023-12-11T17:10:04.440884+0000","last_peered":"2023-12-11T17:10:04.440884+0000","last_clean":"2023-12-11T17:10:04.440884+0000","last_became_active":"2023-12-11T17:09:44.197814+0000","last_became_peered":"2023-12-11T17:09:44.197814+0000","last_unstale":"2023-12-11T17:10:04.440884+0000","last_undegraded":"2023-12-11T17:10:04.440884+0000","last_fullsized":"2023-12-11T17:10:04.440884+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:43:18.152366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3840,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.671230+0000","last_change":"2023-12-11T17:09:49.267215+0000","last_active":"2023-12-11T17:09:51.671230+0000","last_peered":"2023-12-11T17:09:51.671230+0000","last_clean":"2023-12-11T17:09:51.671230+0000","last_became_active":"2023-12-11T17:09:49.266813+0000","last_became_peered":"2023-12-11T17:09:49.266813+0000","last_unstale":"2023-12-11T17:09:51.671230+0000","last_undegraded":"2023-12-11T17:09:51.671230+0000","last_fullsized":"2023-12-11T17:09:51.671230+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:28:35.459824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.270634+0000","last_change":"2023-12-11T17:09:45.207339+0000","last_active":"2023-12-11T17:09:49.270634+0000","last_peered":"2023-12-11T17:09:49.270634+0000","last_clean":"2023-12-11T17:09:49.270634+0000","last_became_active":"2023-12-11T17:09:45.206332+0000","last_became_peered":"2023-12-11T17:09:45.206332+0000","last_unstale":"2023-12-11T17:09:49.270634+0000","last_undegraded":"2023-12-11T17:09:49.270634+0000","last_fullsized":"2023-12-11T17:09:49.270634+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:13:56.615204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"20'3","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.241546+0000","last_change":"2023-12-11T17:09:44.204047+0000","last_active":"2023-12-11T17:09:49.241546+0000","last_peered":"2023-12-11T17:09:49.241546+0000","last_clean":"2023-12-11T17:09:49.241546+0000","last_became_active":"2023-12-11T17:09:44.203606+0000","last_became_peered":"2023-12-11T17:09:44.203606+0000","last_unstale":"2023-12-11T17:09:49.241546+0000","last_undegraded":"2023-12-11T17:09:49.241546+0000","last_fullsized":"2023-12-11T17:09:49.241546+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:38:29.306893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.669605+0000","last_change":"2023-12-11T17:09:49.277690+0000","last_active":"2023-12-11T17:09:51.669605+0000","last_peered":"2023-12-11T17:09:51.669605+0000","last_clean":"2023-12-11T17:09:51.669605+0000","last_became_active":"2023-12-11T17:09:49.277278+0000","last_became_peered":"2023-12-11T17:09:49.277278+0000","last_unstale":"2023-12-11T17:09:51.669605+0000","last_undegraded":"2023-12-11T17:09:51.669605+0000","last_fullsized":"2023-12-11T17:09:51.669605+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:33:40.683163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.264691+0000","last_change":"2023-12-11T17:09:45.223576+0000","last_active":"2023-12-11T17:09:49.264691+0000","last_peered":"2023-12-11T17:09:49.264691+0000","last_clean":"2023-12-11T17:09:49.264691+0000","last_became_active":"2023-12-11T17:09:45.216938+0000","last_became_peered":"2023-12-11T17:09:45.216938+0000","last_unstale":"2023-12-11T17:09:49.264691+0000","last_undegraded":"2023-12-11T17:09:49.264691+0000","last_fullsized":"2023-12-11T17:09:49.264691+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:52.152287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267786+0000","last_change":"2023-12-11T17:09:44.203731+0000","last_active":"2023-12-11T17:09:49.267786+0000","last_peered":"2023-12-11T17:09:49.267786+0000","last_clean":"2023-12-11T17:09:49.267786+0000","last_became_active":"2023-12-11T17:09:44.202145+0000","last_became_peered":"2023-12-11T17:09:44.202145+0000","last_unstale":"2023-12-11T17:09:49.267786+0000","last_undegraded":"2023-12-11T17:09:49.267786+0000","last_fullsized":"2023-12-11T17:09:49.267786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:27:17.913220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.247224+0000","last_change":"2023-12-11T17:09:49.268109+0000","last_active":"2023-12-11T17:09:50.247224+0000","last_peered":"2023-12-11T17:09:50.247224+0000","last_clean":"2023-12-11T17:09:50.247224+0000","last_became_active":"2023-12-11T17:09:49.264048+0000","last_became_peered":"2023-12-11T17:09:49.264048+0000","last_unstale":"2023-12-11T17:09:50.247224+0000","last_undegraded":"2023-12-11T17:09:50.247224+0000","last_fullsized":"2023-12-11T17:09:50.247224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:08:53.883159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267673+0000","last_change":"2023-12-11T17:09:45.225214+0000","last_active":"2023-12-11T17:09:49.267673+0000","last_peered":"2023-12-11T17:09:49.267673+0000","last_clean":"2023-12-11T17:09:49.267673+0000","last_became_active":"2023-12-11T17:09:45.224870+0000","last_became_peered":"2023-12-11T17:09:45.224870+0000","last_unstale":"2023-12-11T17:09:49.267673+0000","last_undegraded":"2023-12-11T17:09:49.267673+0000","last_fullsized":"2023-12-11T17:09:49.267673+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:01:08.121657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.247231+0000","last_change":"2023-12-11T17:09:44.205313+0000","last_active":"2023-12-11T17:09:49.247231+0000","last_peered":"2023-12-11T17:09:49.247231+0000","last_clean":"2023-12-11T17:09:49.247231+0000","last_became_active":"2023-12-11T17:09:44.205016+0000","last_became_peered":"2023-12-11T17:09:44.205016+0000","last_unstale":"2023-12-11T17:09:49.247231+0000","last_undegraded":"2023-12-11T17:09:49.247231+0000","last_fullsized":"2023-12-11T17:09:49.247231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:43:26.684582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.247679+0000","last_change":"2023-12-11T17:09:49.282289+0000","last_active":"2023-12-11T17:09:50.247679+0000","last_peered":"2023-12-11T17:09:50.247679+0000","last_clean":"2023-12-11T17:09:50.247679+0000","last_became_active":"2023-12-11T17:09:49.281891+0000","last_became_peered":"2023-12-11T17:09:49.281891+0000","last_unstale":"2023-12-11T17:09:50.247679+0000","last_undegraded":"2023-12-11T17:09:50.247679+0000","last_fullsized":"2023-12-11T17:09:50.247679+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:07:56.022278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:51.671580+0000","last_change":"2023-12-11T17:09:49.280847+0000","last_active":"2023-12-11T17:09:51.671580+0000","last_peered":"2023-12-11T17:09:51.671580+0000","last_clean":"2023-12-11T17:09:51.671580+0000","last_became_active":"2023-12-11T17:09:49.280442+0000","last_became_peered":"2023-12-11T17:09:49.280442+0000","last_unstale":"2023-12-11T17:09:51.671580+0000","last_undegraded":"2023-12-11T17:09:51.671580+0000","last_fullsized":"2023-12-11T17:09:51.671580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:24:45.184380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.240253+0000","last_change":"2023-12-11T17:09:45.198219+0000","last_active":"2023-12-11T17:09:49.240253+0000","last_peered":"2023-12-11T17:09:49.240253+0000","last_clean":"2023-12-11T17:09:49.240253+0000","last_became_active":"2023-12-11T17:09:45.196218+0000","last_became_peered":"2023-12-11T17:09:45.196218+0000","last_unstale":"2023-12-11T17:09:49.240253+0000","last_undegraded":"2023-12-11T17:09:49.240253+0000","last_fullsized":"2023-12-11T17:09:49.240253+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:27:18.925357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.261218+0000","last_change":"2023-12-11T17:09:44.208638+0000","last_active":"2023-12-11T17:09:49.261218+0000","last_peered":"2023-12-11T17:09:49.261218+0000","last_clean":"2023-12-11T17:09:49.261218+0000","last_became_active":"2023-12-11T17:09:44.208143+0000","last_became_peered":"2023-12-11T17:09:44.208143+0000","last_unstale":"2023-12-11T17:09:49.261218+0000","last_undegraded":"2023-12-11T17:09:49.261218+0000","last_fullsized":"2023-12-11T17:09:49.261218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:39:09.678988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.247175+0000","last_change":"2023-12-11T17:09:49.270558+0000","last_active":"2023-12-11T17:09:50.247175+0000","last_peered":"2023-12-11T17:09:50.247175+0000","last_clean":"2023-12-11T17:09:50.247175+0000","last_became_active":"2023-12-11T17:09:49.270065+0000","last_became_peered":"2023-12-11T17:09:49.270065+0000","last_unstale":"2023-12-11T17:09:50.247175+0000","last_undegraded":"2023-12-11T17:09:50.247175+0000","last_fullsized":"2023-12-11T17:09:50.247175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:08.141530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242639+0000","last_change":"2023-12-11T17:09:45.209539+0000","last_active":"2023-12-11T17:09:49.242639+0000","last_peered":"2023-12-11T17:09:49.242639+0000","last_clean":"2023-12-11T17:09:49.242639+0000","last_became_active":"2023-12-11T17:09:45.209135+0000","last_became_peered":"2023-12-11T17:09:45.209135+0000","last_unstale":"2023-12-11T17:09:49.242639+0000","last_undegraded":"2023-12-11T17:09:49.242639+0000","last_fullsized":"2023-12-11T17:09:49.242639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:08:16.262435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.243583+0000","last_change":"2023-12-11T17:09:44.203078+0000","last_active":"2023-12-11T17:09:49.243583+0000","last_peered":"2023-12-11T17:09:49.243583+0000","last_clean":"2023-12-11T17:09:49.243583+0000","last_became_active":"2023-12-11T17:09:44.202856+0000","last_became_peered":"2023-12-11T17:09:44.202856+0000","last_unstale":"2023-12-11T17:09:49.243583+0000","last_undegraded":"2023-12-11T17:09:49.243583+0000","last_fullsized":"2023-12-11T17:09:49.243583+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:13:55.603067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"20'1","reported_seq":17,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244507+0000","last_change":"2023-12-11T17:09:44.200256+0000","last_active":"2023-12-11T17:09:49.244507+0000","last_peered":"2023-12-11T17:09:49.244507+0000","last_clean":"2023-12-11T17:09:49.244507+0000","last_became_active":"2023-12-11T17:09:44.199854+0000","last_became_peered":"2023-12-11T17:09:44.199854+0000","last_unstale":"2023-12-11T17:09:49.244507+0000","last_undegraded":"2023-12-11T17:09:49.244507+0000","last_fullsized":"2023-12-11T17:09:49.244507+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:22:33.669469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259758+0000","last_change":"2023-12-11T17:09:45.223465+0000","last_active":"2023-12-11T17:09:49.259758+0000","last_peered":"2023-12-11T17:09:49.259758+0000","last_clean":"2023-12-11T17:09:49.259758+0000","last_became_active":"2023-12-11T17:09:45.223204+0000","last_became_peered":"2023-12-11T17:09:45.223204+0000","last_unstale":"2023-12-11T17:09:49.259758+0000","last_undegraded":"2023-12-11T17:09:49.259758+0000","last_fullsized":"2023-12-11T17:09:49.259758+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:39:10.691125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.245254+0000","last_change":"2023-12-11T17:09:49.264568+0000","last_active":"2023-12-11T17:09:50.245254+0000","last_peered":"2023-12-11T17:09:50.245254+0000","last_clean":"2023-12-11T17:09:50.245254+0000","last_became_active":"2023-12-11T17:09:49.263931+0000","last_became_peered":"2023-12-11T17:09:49.263931+0000","last_unstale":"2023-12-11T17:09:50.245254+0000","last_undegraded":"2023-12-11T17:09:50.245254+0000","last_fullsized":"2023-12-11T17:09:50.245254+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T17:20:54.594805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"20'1","reported_seq":16,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242524+0000","last_change":"2023-12-11T17:09:44.205097+0000","last_active":"2023-12-11T17:09:49.242524+0000","last_peered":"2023-12-11T17:09:49.242524+0000","last_clean":"2023-12-11T17:09:49.242524+0000","last_became_active":"2023-12-11T17:09:44.204802+0000","last_became_peered":"2023-12-11T17:09:44.204802+0000","last_unstale":"2023-12-11T17:09:49.242524+0000","last_undegraded":"2023-12-11T17:09:49.242524+0000","last_fullsized":"2023-12-11T17:09:49.242524+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:43.134248+0000","last_clean_scrub_stamp":"2023-12-11T17:09:43.134248+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:38:29.306893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.270946+0000","last_change":"2023-12-11T17:09:45.213754+0000","last_active":"2023-12-11T17:09:49.270946+0000","last_peered":"2023-12-11T17:09:49.270946+0000","last_clean":"2023-12-11T17:09:49.270946+0000","last_became_active":"2023-12-11T17:09:45.213235+0000","last_became_peered":"2023-12-11T17:09:45.213235+0000","last_unstale":"2023-12-11T17:09:49.270946+0000","last_undegraded":"2023-12-11T17:09:49.270946+0000","last_fullsized":"2023-12-11T17:09:49.270946+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:45.225448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":13,"reported_epoch":25,"state":"active+clean","last_fresh":"2023-12-11T17:09:50.249535+0000","last_change":"2023-12-11T17:09:49.275093+0000","last_active":"2023-12-11T17:09:50.249535+0000","last_peered":"2023-12-11T17:09:50.249535+0000","last_clean":"2023-12-11T17:09:50.249535+0000","last_became_active":"2023-12-11T17:09:49.274728+0000","last_became_peered":"2023-12-11T17:09:49.274728+0000","last_unstale":"2023-12-11T17:09:50.249535+0000","last_undegraded":"2023-12-11T17:09:50.249535+0000","last_fullsized":"2023-12-11T17:09:50.249535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:48.211053+0000","last_clean_scrub_stamp":"2023-12-11T17:09:48.211053+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:41:31.040376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242805+0000","last_change":"2023-12-11T17:09:45.214934+0000","last_active":"2023-12-11T17:09:49.242805+0000","last_peered":"2023-12-11T17:09:49.242805+0000","last_clean":"2023-12-11T17:09:49.242805+0000","last_became_active":"2023-12-11T17:09:45.214572+0000","last_became_peered":"2023-12-11T17:09:45.214572+0000","last_unstale":"2023-12-11T17:09:49.242805+0000","last_undegraded":"2023-12-11T17:09:49.242805+0000","last_fullsized":"2023-12-11T17:09:49.242805+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:08:16.262435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.250749+0000","last_change":"2023-12-11T17:09:45.211423+0000","last_active":"2023-12-11T17:09:49.250749+0000","last_peered":"2023-12-11T17:09:49.250749+0000","last_clean":"2023-12-11T17:09:49.250749+0000","last_became_active":"2023-12-11T17:09:45.211056+0000","last_became_peered":"2023-12-11T17:09:45.211056+0000","last_unstale":"2023-12-11T17:09:49.250749+0000","last_undegraded":"2023-12-11T17:09:49.250749+0000","last_fullsized":"2023-12-11T17:09:49.250749+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:46:02.502338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.263639+0000","last_change":"2023-12-11T17:09:45.197421+0000","last_active":"2023-12-11T17:09:49.263639+0000","last_peered":"2023-12-11T17:09:49.263639+0000","last_clean":"2023-12-11T17:09:49.263639+0000","last_became_active":"2023-12-11T17:09:45.197128+0000","last_became_peered":"2023-12-11T17:09:45.197128+0000","last_unstale":"2023-12-11T17:09:49.263639+0000","last_undegraded":"2023-12-11T17:09:49.263639+0000","last_fullsized":"2023-12-11T17:09:49.263639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:13:50.995140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259671+0000","last_change":"2023-12-11T17:09:45.208645+0000","last_active":"2023-12-11T17:09:49.259671+0000","last_peered":"2023-12-11T17:09:49.259671+0000","last_clean":"2023-12-11T17:09:49.259671+0000","last_became_active":"2023-12-11T17:09:45.203739+0000","last_became_peered":"2023-12-11T17:09:45.203739+0000","last_unstale":"2023-12-11T17:09:49.259671+0000","last_undegraded":"2023-12-11T17:09:49.259671+0000","last_fullsized":"2023-12-11T17:09:49.259671+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:17:04.012857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242521+0000","last_change":"2023-12-11T17:09:45.220379+0000","last_active":"2023-12-11T17:09:49.242521+0000","last_peered":"2023-12-11T17:09:49.242521+0000","last_clean":"2023-12-11T17:09:49.242521+0000","last_became_active":"2023-12-11T17:09:45.220153+0000","last_became_peered":"2023-12-11T17:09:45.220153+0000","last_unstale":"2023-12-11T17:09:49.242521+0000","last_undegraded":"2023-12-11T17:09:49.242521+0000","last_fullsized":"2023-12-11T17:09:49.242521+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:52.152287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.241402+0000","last_change":"2023-12-11T17:09:45.194086+0000","last_active":"2023-12-11T17:09:49.241402+0000","last_peered":"2023-12-11T17:09:49.241402+0000","last_clean":"2023-12-11T17:09:49.241402+0000","last_became_active":"2023-12-11T17:09:45.193835+0000","last_became_peered":"2023-12-11T17:09:45.193835+0000","last_unstale":"2023-12-11T17:09:49.241402+0000","last_undegraded":"2023-12-11T17:09:49.241402+0000","last_fullsized":"2023-12-11T17:09:49.241402+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:05.364711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244539+0000","last_change":"2023-12-11T17:09:45.219697+0000","last_active":"2023-12-11T17:09:49.244539+0000","last_peered":"2023-12-11T17:09:49.244539+0000","last_clean":"2023-12-11T17:09:49.244539+0000","last_became_active":"2023-12-11T17:09:45.219406+0000","last_became_peered":"2023-12-11T17:09:45.219406+0000","last_unstale":"2023-12-11T17:09:49.244539+0000","last_undegraded":"2023-12-11T17:09:49.244539+0000","last_fullsized":"2023-12-11T17:09:49.244539+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:52.152287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.243089+0000","last_change":"2023-12-11T17:09:45.220707+0000","last_active":"2023-12-11T17:09:49.243089+0000","last_peered":"2023-12-11T17:09:49.243089+0000","last_clean":"2023-12-11T17:09:49.243089+0000","last_became_active":"2023-12-11T17:09:45.220357+0000","last_became_peered":"2023-12-11T17:09:45.220357+0000","last_unstale":"2023-12-11T17:09:49.243089+0000","last_undegraded":"2023-12-11T17:09:49.243089+0000","last_fullsized":"2023-12-11T17:09:49.243089+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:39:10.691125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.261207+0000","last_change":"2023-12-11T17:09:45.196150+0000","last_active":"2023-12-11T17:09:49.261207+0000","last_peered":"2023-12-11T17:09:49.261207+0000","last_clean":"2023-12-11T17:09:49.261207+0000","last_became_active":"2023-12-11T17:09:45.195878+0000","last_became_peered":"2023-12-11T17:09:45.195878+0000","last_unstale":"2023-12-11T17:09:49.261207+0000","last_undegraded":"2023-12-11T17:09:49.261207+0000","last_fullsized":"2023-12-11T17:09:49.261207+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:51:29.300195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.243497+0000","last_change":"2023-12-11T17:09:45.220663+0000","last_active":"2023-12-11T17:09:49.243497+0000","last_peered":"2023-12-11T17:09:49.243497+0000","last_clean":"2023-12-11T17:09:49.243497+0000","last_became_active":"2023-12-11T17:09:45.220349+0000","last_became_peered":"2023-12-11T17:09:45.220349+0000","last_unstale":"2023-12-11T17:09:49.243497+0000","last_undegraded":"2023-12-11T17:09:49.243497+0000","last_fullsized":"2023-12-11T17:09:49.243497+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:11:15.785273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.263544+0000","last_change":"2023-12-11T17:09:45.213788+0000","last_active":"2023-12-11T17:09:49.263544+0000","last_peered":"2023-12-11T17:09:49.263544+0000","last_clean":"2023-12-11T17:09:49.263544+0000","last_became_active":"2023-12-11T17:09:45.213454+0000","last_became_peered":"2023-12-11T17:09:45.213454+0000","last_unstale":"2023-12-11T17:09:49.263544+0000","last_undegraded":"2023-12-11T17:09:49.263544+0000","last_fullsized":"2023-12-11T17:09:49.263544+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:36:10.393929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259552+0000","last_change":"2023-12-11T17:09:45.219309+0000","last_active":"2023-12-11T17:09:49.259552+0000","last_peered":"2023-12-11T17:09:49.259552+0000","last_clean":"2023-12-11T17:09:49.259552+0000","last_became_active":"2023-12-11T17:09:45.218538+0000","last_became_peered":"2023-12-11T17:09:45.218538+0000","last_unstale":"2023-12-11T17:09:49.259552+0000","last_undegraded":"2023-12-11T17:09:49.259552+0000","last_fullsized":"2023-12-11T17:09:49.259552+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:11:15.785273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.246802+0000","last_change":"2023-12-11T17:09:45.217105+0000","last_active":"2023-12-11T17:09:49.246802+0000","last_peered":"2023-12-11T17:09:49.246802+0000","last_clean":"2023-12-11T17:09:49.246802+0000","last_became_active":"2023-12-11T17:09:45.215966+0000","last_became_peered":"2023-12-11T17:09:45.215966+0000","last_unstale":"2023-12-11T17:09:49.246802+0000","last_undegraded":"2023-12-11T17:09:49.246802+0000","last_fullsized":"2023-12-11T17:09:49.246802+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:17:04.012857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274639+0000","last_change":"2023-12-11T17:09:45.225041+0000","last_active":"2023-12-11T17:09:49.274639+0000","last_peered":"2023-12-11T17:09:49.274639+0000","last_clean":"2023-12-11T17:09:49.274639+0000","last_became_active":"2023-12-11T17:09:45.224696+0000","last_became_peered":"2023-12-11T17:09:45.224696+0000","last_unstale":"2023-12-11T17:09:49.274639+0000","last_undegraded":"2023-12-11T17:09:49.274639+0000","last_fullsized":"2023-12-11T17:09:49.274639+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:03:10.878069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.252605+0000","last_change":"2023-12-11T17:09:45.207821+0000","last_active":"2023-12-11T17:09:49.252605+0000","last_peered":"2023-12-11T17:09:49.252605+0000","last_clean":"2023-12-11T17:09:49.252605+0000","last_became_active":"2023-12-11T17:09:45.207541+0000","last_became_peered":"2023-12-11T17:09:45.207541+0000","last_unstale":"2023-12-11T17:09:49.252605+0000","last_undegraded":"2023-12-11T17:09:49.252605+0000","last_fullsized":"2023-12-11T17:09:49.252605+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:51:44.769227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267963+0000","last_change":"2023-12-11T17:09:45.212081+0000","last_active":"2023-12-11T17:09:49.267963+0000","last_peered":"2023-12-11T17:09:49.267963+0000","last_clean":"2023-12-11T17:09:49.267963+0000","last_became_active":"2023-12-11T17:09:45.211781+0000","last_became_peered":"2023-12-11T17:09:45.211781+0000","last_unstale":"2023-12-11T17:09:49.267963+0000","last_undegraded":"2023-12-11T17:09:49.267963+0000","last_fullsized":"2023-12-11T17:09:49.267963+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T05:03:10.878069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.260999+0000","last_change":"2023-12-11T17:09:45.218896+0000","last_active":"2023-12-11T17:09:49.260999+0000","last_peered":"2023-12-11T17:09:49.260999+0000","last_clean":"2023-12-11T17:09:49.260999+0000","last_became_active":"2023-12-11T17:09:45.218071+0000","last_became_peered":"2023-12-11T17:09:45.218071+0000","last_unstale":"2023-12-11T17:09:49.260999+0000","last_undegraded":"2023-12-11T17:09:49.260999+0000","last_fullsized":"2023-12-11T17:09:49.260999+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:05.364711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.240603+0000","last_change":"2023-12-11T17:09:45.208633+0000","last_active":"2023-12-11T17:09:49.240603+0000","last_peered":"2023-12-11T17:09:49.240603+0000","last_clean":"2023-12-11T17:09:49.240603+0000","last_became_active":"2023-12-11T17:09:45.208337+0000","last_became_peered":"2023-12-11T17:09:45.208337+0000","last_unstale":"2023-12-11T17:09:49.240603+0000","last_undegraded":"2023-12-11T17:09:49.240603+0000","last_fullsized":"2023-12-11T17:09:49.240603+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:11:15.785273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259315+0000","last_change":"2023-12-11T17:09:45.216391+0000","last_active":"2023-12-11T17:09:49.259315+0000","last_peered":"2023-12-11T17:09:49.259315+0000","last_clean":"2023-12-11T17:09:49.259315+0000","last_became_active":"2023-12-11T17:09:45.215314+0000","last_became_peered":"2023-12-11T17:09:45.215314+0000","last_unstale":"2023-12-11T17:09:49.259315+0000","last_undegraded":"2023-12-11T17:09:49.259315+0000","last_fullsized":"2023-12-11T17:09:49.259315+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:42:31.915581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.242252+0000","last_change":"2023-12-11T17:09:45.206222+0000","last_active":"2023-12-11T17:09:49.242252+0000","last_peered":"2023-12-11T17:09:49.242252+0000","last_clean":"2023-12-11T17:09:49.242252+0000","last_became_active":"2023-12-11T17:09:45.206027+0000","last_became_peered":"2023-12-11T17:09:45.206027+0000","last_unstale":"2023-12-11T17:09:49.242252+0000","last_undegraded":"2023-12-11T17:09:49.242252+0000","last_fullsized":"2023-12-11T17:09:49.242252+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:05.364711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.270530+0000","last_change":"2023-12-11T17:09:45.209961+0000","last_active":"2023-12-11T17:09:49.270530+0000","last_peered":"2023-12-11T17:09:49.270530+0000","last_clean":"2023-12-11T17:09:49.270530+0000","last_became_active":"2023-12-11T17:09:45.207836+0000","last_became_peered":"2023-12-11T17:09:45.207836+0000","last_unstale":"2023-12-11T17:09:49.270530+0000","last_undegraded":"2023-12-11T17:09:49.270530+0000","last_fullsized":"2023-12-11T17:09:49.270530+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:47:07.513492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.245215+0000","last_change":"2023-12-11T17:09:45.218319+0000","last_active":"2023-12-11T17:09:49.245215+0000","last_peered":"2023-12-11T17:09:49.245215+0000","last_clean":"2023-12-11T17:09:49.245215+0000","last_became_active":"2023-12-11T17:09:45.217465+0000","last_became_peered":"2023-12-11T17:09:45.217465+0000","last_unstale":"2023-12-11T17:09:49.245215+0000","last_undegraded":"2023-12-11T17:09:49.245215+0000","last_fullsized":"2023-12-11T17:09:49.245215+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:11:15.785273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.244369+0000","last_change":"2023-12-11T17:09:45.219120+0000","last_active":"2023-12-11T17:09:49.244369+0000","last_peered":"2023-12-11T17:09:49.244369+0000","last_clean":"2023-12-11T17:09:49.244369+0000","last_became_active":"2023-12-11T17:09:45.216692+0000","last_became_peered":"2023-12-11T17:09:45.216692+0000","last_unstale":"2023-12-11T17:09:49.244369+0000","last_undegraded":"2023-12-11T17:09:49.244369+0000","last_fullsized":"2023-12-11T17:09:49.244369+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:15:05.364711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275330+0000","last_change":"2023-12-11T17:09:45.227610+0000","last_active":"2023-12-11T17:09:49.275330+0000","last_peered":"2023-12-11T17:09:49.275330+0000","last_clean":"2023-12-11T17:09:49.275330+0000","last_became_active":"2023-12-11T17:09:45.220917+0000","last_became_peered":"2023-12-11T17:09:45.220917+0000","last_unstale":"2023-12-11T17:09:49.275330+0000","last_undegraded":"2023-12-11T17:09:49.275330+0000","last_fullsized":"2023-12-11T17:09:49.275330+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:24:41.119712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.241871+0000","last_change":"2023-12-11T17:09:45.213329+0000","last_active":"2023-12-11T17:09:49.241871+0000","last_peered":"2023-12-11T17:09:49.241871+0000","last_clean":"2023-12-11T17:09:49.241871+0000","last_became_active":"2023-12-11T17:09:45.211552+0000","last_became_peered":"2023-12-11T17:09:45.211552+0000","last_unstale":"2023-12-11T17:09:49.241871+0000","last_undegraded":"2023-12-11T17:09:49.241871+0000","last_fullsized":"2023-12-11T17:09:49.241871+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:42:31.915581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.274314+0000","last_change":"2023-12-11T17:09:45.219662+0000","last_active":"2023-12-11T17:09:49.274314+0000","last_peered":"2023-12-11T17:09:49.274314+0000","last_clean":"2023-12-11T17:09:49.274314+0000","last_became_active":"2023-12-11T17:09:45.219315+0000","last_became_peered":"2023-12-11T17:09:45.219315+0000","last_unstale":"2023-12-11T17:09:49.274314+0000","last_undegraded":"2023-12-11T17:09:49.274314+0000","last_fullsized":"2023-12-11T17:09:49.274314+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:17:47.063007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.263442+0000","last_change":"2023-12-11T17:09:45.214165+0000","last_active":"2023-12-11T17:09:49.263442+0000","last_peered":"2023-12-11T17:09:49.263442+0000","last_clean":"2023-12-11T17:09:49.263442+0000","last_became_active":"2023-12-11T17:09:45.211191+0000","last_became_peered":"2023-12-11T17:09:45.211191+0000","last_unstale":"2023-12-11T17:09:49.263442+0000","last_undegraded":"2023-12-11T17:09:49.263442+0000","last_fullsized":"2023-12-11T17:09:49.263442+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:52.152287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275091+0000","last_change":"2023-12-11T17:09:45.210404+0000","last_active":"2023-12-11T17:09:49.275091+0000","last_peered":"2023-12-11T17:09:49.275091+0000","last_clean":"2023-12-11T17:09:49.275091+0000","last_became_active":"2023-12-11T17:09:45.210084+0000","last_became_peered":"2023-12-11T17:09:45.210084+0000","last_unstale":"2023-12-11T17:09:49.275091+0000","last_undegraded":"2023-12-11T17:09:49.275091+0000","last_fullsized":"2023-12-11T17:09:49.275091+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:13:50.995140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.267850+0000","last_change":"2023-12-11T17:09:45.213977+0000","last_active":"2023-12-11T17:09:49.267850+0000","last_peered":"2023-12-11T17:09:49.267850+0000","last_clean":"2023-12-11T17:09:49.267850+0000","last_became_active":"2023-12-11T17:09:45.212551+0000","last_became_peered":"2023-12-11T17:09:45.212551+0000","last_unstale":"2023-12-11T17:09:49.267850+0000","last_undegraded":"2023-12-11T17:09:49.267850+0000","last_fullsized":"2023-12-11T17:09:49.267850+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:17:47.063007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.259640+0000","last_change":"2023-12-11T17:09:45.216618+0000","last_active":"2023-12-11T17:09:49.259640+0000","last_peered":"2023-12-11T17:09:49.259640+0000","last_clean":"2023-12-11T17:09:49.259640+0000","last_became_active":"2023-12-11T17:09:45.209865+0000","last_became_peered":"2023-12-11T17:09:45.209865+0000","last_unstale":"2023-12-11T17:09:49.259640+0000","last_undegraded":"2023-12-11T17:09:49.259640+0000","last_fullsized":"2023-12-11T17:09:49.259640+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:56:34.698264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.241316+0000","last_change":"2023-12-11T17:09:45.208109+0000","last_active":"2023-12-11T17:09:49.241316+0000","last_peered":"2023-12-11T17:09:49.241316+0000","last_clean":"2023-12-11T17:09:49.241316+0000","last_became_active":"2023-12-11T17:09:45.204247+0000","last_became_peered":"2023-12-11T17:09:45.204247+0000","last_unstale":"2023-12-11T17:09:49.241316+0000","last_undegraded":"2023-12-11T17:09:49.241316+0000","last_fullsized":"2023-12-11T17:09:49.241316+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:19:52.152287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":15,"reported_epoch":24,"state":"active+clean","last_fresh":"2023-12-11T17:09:49.275224+0000","last_change":"2023-12-11T17:09:45.225873+0000","last_active":"2023-12-11T17:09:49.275224+0000","last_peered":"2023-12-11T17:09:49.275224+0000","last_clean":"2023-12-11T17:09:49.275224+0000","last_became_active":"2023-12-11T17:09:45.225223+0000","last_became_peered":"2023-12-11T17:09:45.225223+0000","last_unstale":"2023-12-11T17:09:49.275224+0000","last_undegraded":"2023-12-11T17:09:49.275224+0000","last_fullsized":"2023-12-11T17:09:49.275224+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:44.146385+0000","last_clean_scrub_stamp":"2023-12-11T17:09:44.146385+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:01:08.121657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4638,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":49,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9276,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":43,"ondisk_log_size":43,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542154,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27860,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343980,"statfs":{"total":96636764160,"available":96608235520,"internally_reserved":0,"allocated":860160,"data_stored":694037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76500000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.385}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.94999999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0620000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3120000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.538}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.343}]}]},{"osd":6,"up_from":14,"seq":60129542155,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2290000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.046}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.335}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1879999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.2909999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":103177,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.252}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.204}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0720000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.508}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4319999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3049999999999999}]}]},{"osd":4,"up_from":14,"seq":60129542155,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27288,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344552,"statfs":{"total":96636764160,"available":96608821248,"internally_reserved":0,"allocated":274432,"data_stored":103213,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59799999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3080000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1739999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.399}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.357}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4790000000000001}]}]},{"osd":3,"up_from":14,"seq":60129542156,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":268,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":274432,"data_stored":106927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.6339999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.1120000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0820000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8090000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":3.4889999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.327}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8759999999999999}]}]},{"osd":2,"up_from":14,"seq":60129542154,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":262144,"data_stored":103087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.163}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9019999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.8300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.278}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.339}]}]},{"osd":1,"up_from":14,"seq":60129542155,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27284,"kb_used_data":264,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344556,"statfs":{"total":96636764160,"available":96608825344,"internally_reserved":0,"allocated":270336,"data_stored":103247,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1719999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.93500000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.85499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0069999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.272}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1220000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.216}]}]},{"osd":0,"up_from":14,"seq":60129542155,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":848,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":868352,"data_stored":694093,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.0349999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.5660000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.4930000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.127}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3879999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3840,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-11T17:10:21.016 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-11T17:10:21.016 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-11T17:10:21.016 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-11T17:10:21.016 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-11T17:10:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.275+0000 7f7644ae0640 1 Processor -- start 2023-12-11T17:10:21.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.276+0000 7f7644ae0640 1 -- start start 2023-12-11T17:10:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.277+0000 7f7644ae0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7640144860 0x7f764015b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.278+0000 7f7644ae0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7640070660 0x7f76400cf140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.278+0000 7f7644ae0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7640072610 con 0x7f76400cf680 2023-12-11T17:10:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.278+0000 7f7644ae0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76400cfb10 con 0x7f7640070660 2023-12-11T17:10:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.278+0000 7f7644ae0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7640070c20 con 0x7f7640144860 2023-12-11T17:10:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.278+0000 7f7635d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7640070660 0x7f76400cf140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.278+0000 7f7635d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7640070660 0x7f76400cf140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38066/0 (socket says 172.21.15.37:38066) 2023-12-11T17:10:21.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.278+0000 7f7635d9b640 1 -- 172.21.15.37:0/2402944307 learned_addr learned my addr 172.21.15.37:0/2402944307 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.278+0000 7f7635d9b640 1 -- 172.21.15.37:0/2402944307 >> v2:172.21.15.151:3300/0 conn(0x7f7640144860 msgr2=0x7f764015b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.278+0000 7f7635d9b640 1 --2- 172.21.15.37:0/2402944307 >> v2:172.21.15.151:3300/0 conn(0x7f7640144860 0x7f764015b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.278+0000 7f7635d9b640 1 -- 172.21.15.37:0/2402944307 >> v1:172.21.15.151:6789/0 conn(0x7f76400cf680 legacy=0x7f764006c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:21.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.278+0000 7f7635d9b640 1 -- 172.21.15.37:0/2402944307 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7640070f00 con 0x7f7640070660 2023-12-11T17:10:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.280+0000 7f7635d9b640 1 --2- 172.21.15.37:0/2402944307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7640070660 0x7f76400cf140 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f76400b4420 tx=0x7f762802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94fd519ab1fe4c2d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.280+0000 7f763dd9b640 1 -- 172.21.15.37:0/2402944307 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76280317e0 con 0x7f7640070660 2023-12-11T17:10:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.280+0000 7f763dd9b640 1 -- 172.21.15.37:0/2402944307 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7628031940 con 0x7f7640070660 2023-12-11T17:10:21.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.280+0000 7f763dd9b640 1 -- 172.21.15.37:0/2402944307 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7628031cd0 con 0x7f7640070660 2023-12-11T17:10:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.281+0000 7f7644ae0640 1 -- 172.21.15.37:0/2402944307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7640070660 msgr2=0x7f76400cf140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.281+0000 7f7644ae0640 1 --2- 172.21.15.37:0/2402944307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7640070660 0x7f76400cf140 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f76400b4420 tx=0x7f762802b880 comp rx=0 tx=0).stop 2023-12-11T17:10:21.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.282+0000 7f7644ae0640 1 -- 172.21.15.37:0/2402944307 shutdown_connections 2023-12-11T17:10:21.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.282+0000 7f7644ae0640 1 --2- 172.21.15.37:0/2402944307 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7640070660 0x7f76400cf140 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:21.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.282+0000 7f7644ae0640 1 --2- 172.21.15.37:0/2402944307 >> v2:172.21.15.151:3300/0 conn(0x7f7640144860 0x7f764015b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:21.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.282+0000 7f7644ae0640 1 -- 172.21.15.37:0/2402944307 >> 172.21.15.37:0/2402944307 conn(0x7f764006a880 msgr2=0x7f764006ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:21.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.282+0000 7f7644ae0640 1 -- 172.21.15.37:0/2402944307 shutdown_connections 2023-12-11T17:10:21.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.282+0000 7f7644ae0640 1 -- 172.21.15.37:0/2402944307 wait complete. 2023-12-11T17:10:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.284+0000 7f7644ae0640 1 Processor -- start 2023-12-11T17:10:21.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.284+0000 7f7644ae0640 1 -- start start 2023-12-11T17:10:21.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.285+0000 7f7644ae0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7640070660 0x7f7640158c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:21.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.285+0000 7f7644ae0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76400cf680 0x7f76401f65e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:21.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.286+0000 7f7644ae0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7640144860 0x7f76400b1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:21.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.286+0000 7f7644ae0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76401f7060 con 0x7f76400cf680 2023-12-11T17:10:21.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.286+0000 7f7644ae0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76401f7340 con 0x7f7640144860 2023-12-11T17:10:21.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.286+0000 7f7644ae0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764013d8a0 con 0x7f7640070660 2023-12-11T17:10:21.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.286+0000 7f7635d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76400cf680 0x7f76401f65e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:21.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.286+0000 7f7635d9b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76400cf680 0x7f76401f65e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38074/0 (socket says 172.21.15.37:38074) 2023-12-11T17:10:21.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.286+0000 7f7635d9b640 1 -- 172.21.15.37:0/1709923539 learned_addr learned my addr 172.21.15.37:0/1709923539 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:21.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.286+0000 7f763e59c640 1 --2- 172.21.15.37:0/1709923539 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7640070660 0x7f7640158c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:21.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.286+0000 7f7635d9b640 1 -- 172.21.15.37:0/1709923539 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7640070660 msgr2=0x7f7640158c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:21.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.286+0000 7f7635d9b640 1 --2- 172.21.15.37:0/1709923539 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7640070660 0x7f7640158c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:21.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.286+0000 7f7635d9b640 1 -- 172.21.15.37:0/1709923539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7640144860 msgr2=0x7f76400b1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:21.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.286+0000 7f7635d9b640 1 --2- 172.21.15.37:0/1709923539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7640144860 0x7f76400b1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:21.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.286+0000 7f7635d9b640 1 -- 172.21.15.37:0/1709923539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76280094d0 con 0x7f76400cf680 2023-12-11T17:10:21.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.286+0000 7f763e59c640 1 --2- 172.21.15.37:0/1709923539 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7640070660 0x7f7640158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:21.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.287+0000 7f7635d9b640 1 --2- 172.21.15.37:0/1709923539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76400cf680 0x7f76401f65e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f762802b8c0 tx=0x7f76280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:21.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.287+0000 7f76377fe640 1 -- 172.21.15.37:0/1709923539 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76280329c0 con 0x7f76400cf680 2023-12-11T17:10:21.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.287+0000 7f76377fe640 1 -- 172.21.15.37:0/1709923539 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7628032b40 con 0x7f76400cf680 2023-12-11T17:10:21.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.287+0000 7f76377fe640 1 -- 172.21.15.37:0/1709923539 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76280453f0 con 0x7f76400cf680 2023-12-11T17:10:21.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.287+0000 7f7644ae0640 1 -- 172.21.15.37:0/1709923539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764013db80 con 0x7f76400cf680 2023-12-11T17:10:21.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.287+0000 7f7644ae0640 1 -- 172.21.15.37:0/1709923539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76400ad0e0 con 0x7f76400cf680 2023-12-11T17:10:21.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.288+0000 7f7644ae0640 1 -- 172.21.15.37:0/1709923539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f764013dda0 con 0x7f76400cf680 2023-12-11T17:10:21.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.289+0000 7f76377fe640 1 -- 172.21.15.37:0/1709923539 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f762804d3f0 con 0x7f76400cf680 2023-12-11T17:10:21.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.290+0000 7f76377fe640 1 --2- 172.21.15.37:0/1709923539 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f762006ae40 0x7f762006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:21.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.290+0000 7f76377fe640 1 -- 172.21.15.37:0/1709923539 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f76280ab860 con 0x7f76400cf680 2023-12-11T17:10:21.291 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.291+0000 7f763e59c640 1 --2- 172.21.15.37:0/1709923539 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f762006ae40 0x7f762006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:21.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.292+0000 7f763e59c640 1 --2- 172.21.15.37:0/1709923539 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f762006ae40 0x7f762006d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7630007eb0 tx=0x7f76300073c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:21.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.295+0000 7f76377fe640 1 -- 172.21.15.37:0/1709923539 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f76280766c0 con 0x7f76400cf680 2023-12-11T17:10:21.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.518+0000 7f7644ae0640 1 -- 172.21.15.37:0/1709923539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f7640074670 con 0x7f76400cf680 2023-12-11T17:10:21.519 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.518+0000 7f76377fe640 1 -- 172.21.15.37:0/1709923539 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f7628079ce0 con 0x7f76400cf680 2023-12-11T17:10:21.519 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:21.519 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-11T17:10:21.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.521+0000 7f7644ae0640 1 -- 172.21.15.37:0/1709923539 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f762006ae40 msgr2=0x7f762006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:21.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.521+0000 7f7644ae0640 1 --2- 172.21.15.37:0/1709923539 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f762006ae40 0x7f762006d300 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7630007eb0 tx=0x7f76300073c0 comp rx=0 tx=0).stop 2023-12-11T17:10:21.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.521+0000 7f7644ae0640 1 -- 172.21.15.37:0/1709923539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76400cf680 msgr2=0x7f76401f65e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:21.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.521+0000 7f7644ae0640 1 --2- 172.21.15.37:0/1709923539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76400cf680 0x7f76401f65e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f762802b8c0 tx=0x7f76280046c0 comp rx=0 tx=0).stop 2023-12-11T17:10:21.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.521+0000 7f7644ae0640 1 -- 172.21.15.37:0/1709923539 shutdown_connections 2023-12-11T17:10:21.522 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.521+0000 7f7644ae0640 1 --2- 172.21.15.37:0/1709923539 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f762006ae40 0x7f762006d300 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:21.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.521+0000 7f7644ae0640 1 --2- 172.21.15.37:0/1709923539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7640144860 0x7f76400b1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:21.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.521+0000 7f7644ae0640 1 --2- 172.21.15.37:0/1709923539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f76400cf680 0x7f76401f65e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:21.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.521+0000 7f7644ae0640 1 --2- 172.21.15.37:0/1709923539 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7640070660 0x7f7640158c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:21.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.521+0000 7f7644ae0640 1 -- 172.21.15.37:0/1709923539 >> 172.21.15.37:0/1709923539 conn(0x7f764006a880 msgr2=0x7f764006ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:21.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.521+0000 7f7644ae0640 1 -- 172.21.15.37:0/1709923539 shutdown_connections 2023-12-11T17:10:21.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.521+0000 7f7644ae0640 1 -- 172.21.15.37:0/1709923539 wait complete. 2023-12-11T17:10:21.539 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-11T17:10:21.539 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:10:21.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.752+0000 7fa4ef285640 1 Processor -- start 2023-12-11T17:10:21.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.753+0000 7fa4ef285640 1 -- start start 2023-12-11T17:10:21.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.754+0000 7fa4ef285640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa4e80b3e90 0x7fa4e815a3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:21.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.754+0000 7fa4ef285640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa4e806e380 0x7fa4e80b2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:21.755 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.754+0000 7fa4ef285640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4e8070d70 0x7fa4e8071220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:21.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.754+0000 7fa4ef285640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e8071760 con 0x7fa4e806e380 2023-12-11T17:10:21.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.754+0000 7fa4ef285640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e815ad20 con 0x7fa4e80b3e90 2023-12-11T17:10:21.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.754+0000 7fa4ef285640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e815b000 con 0x7fa4e8070d70 2023-12-11T17:10:21.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.755+0000 7fa4ee283640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa4e80b3e90 0x7fa4e815a3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:21.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.755+0000 7fa4eea84640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4e8070d70 0x7fa4e8071220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:21.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.755+0000 7fa4ee283640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa4e80b3e90 0x7fa4e815a3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:58886/0 (socket says 172.21.15.37:58886) 2023-12-11T17:10:21.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.755+0000 7fa4ee283640 1 -- 172.21.15.37:0/681572487 learned_addr learned my addr 172.21.15.37:0/681572487 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:21.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.755+0000 7fa4eda82640 1 --2- 172.21.15.37:0/681572487 >> v2:172.21.15.37:3300/0 conn(0x7fa4e806e380 0x7fa4e80b2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:21.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.756+0000 7fa4ee283640 1 -- 172.21.15.37:0/681572487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4e8070d70 msgr2=0x7fa4e8071220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:21.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.756+0000 7fa4ee283640 1 --2- 172.21.15.37:0/681572487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4e8070d70 0x7fa4e8071220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:21.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.756+0000 7fa4ee283640 1 -- 172.21.15.37:0/681572487 >> v2:172.21.15.37:3300/0 conn(0x7fa4e806e380 msgr2=0x7fa4e80b2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:21.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.756+0000 7fa4ee283640 1 --2- 172.21.15.37:0/681572487 >> v2:172.21.15.37:3300/0 conn(0x7fa4e806e380 0x7fa4e80b2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:21.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.756+0000 7fa4ee283640 1 -- 172.21.15.37:0/681572487 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e815b2e0 con 0x7fa4e80b3e90 2023-12-11T17:10:21.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.756+0000 7fa4eea84640 1 --2- 172.21.15.37:0/681572487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4e8070d70 0x7fa4e8071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:10:21.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.756+0000 7fa4eda82640 1 --2- 172.21.15.37:0/681572487 >> v2:172.21.15.37:3300/0 conn(0x7fa4e806e380 0x7fa4e80b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:10:21.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.757+0000 7fa4ee283640 1 --2- 172.21.15.37:0/681572487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4e80b3e90 0x7fa4e815a3b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80d0510 tx=0x7fa4dc02bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b4c9e74193bc8d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:21.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.758+0000 7fa4ed281640 1 -- 172.21.15.37:0/681572487 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc02ca80 con 0x7fa4e80b3e90 2023-12-11T17:10:21.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.758+0000 7fa4ed281640 1 -- 172.21.15.37:0/681572487 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4dc02cbe0 con 0x7fa4e80b3e90 2023-12-11T17:10:21.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.758+0000 7fa4ed281640 1 -- 172.21.15.37:0/681572487 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc0343f0 con 0x7fa4e80b3e90 2023-12-11T17:10:21.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.758+0000 7fa4ef285640 1 -- 172.21.15.37:0/681572487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4e80b3e90 msgr2=0x7fa4e815a3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:21.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.758+0000 7fa4ef285640 1 --2- 172.21.15.37:0/681572487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4e80b3e90 0x7fa4e815a3b0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fa4e80d0510 tx=0x7fa4dc02bee0 comp rx=0 tx=0).stop 2023-12-11T17:10:21.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.758+0000 7fa4ef285640 1 -- 172.21.15.37:0/681572487 shutdown_connections 2023-12-11T17:10:21.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.758+0000 7fa4ef285640 1 --2- 172.21.15.37:0/681572487 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4e8070d70 0x7fa4e8071220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:21.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.758+0000 7fa4ef285640 1 --2- 172.21.15.37:0/681572487 >> v2:172.21.15.37:3300/0 conn(0x7fa4e806e380 0x7fa4e80b2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:21.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.758+0000 7fa4ef285640 1 --2- 172.21.15.37:0/681572487 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4e80b3e90 0x7fa4e815a3b0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:21.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.759+0000 7fa4ef285640 1 -- 172.21.15.37:0/681572487 >> 172.21.15.37:0/681572487 conn(0x7fa4e80b1540 msgr2=0x7fa4e80b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:21.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.759+0000 7fa4ef285640 1 -- 172.21.15.37:0/681572487 shutdown_connections 2023-12-11T17:10:21.760 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.759+0000 7fa4ef285640 1 -- 172.21.15.37:0/681572487 wait complete. 2023-12-11T17:10:21.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.760+0000 7fa4ef285640 1 Processor -- start 2023-12-11T17:10:21.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.761+0000 7fa4ef285640 1 -- start start 2023-12-11T17:10:21.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.762+0000 7fa4ef285640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e806e380 0x7fa4e8154080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:21.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.762+0000 7fa4ef285640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4e8070d70 0x7fa4e81534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:21.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.762+0000 7fa4ef285640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4e80b3e90 0x7fa4e81e4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:21.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.762+0000 7fa4ef285640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e81e6340 con 0x7fa4e806e380 2023-12-11T17:10:21.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.762+0000 7fa4ef285640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e81539e0 con 0x7fa4e8070d70 2023-12-11T17:10:21.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.762+0000 7fa4ef285640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e81e56c0 con 0x7fa4e80b3e90 2023-12-11T17:10:21.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.762+0000 7fa4ee283640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e806e380 0x7fa4e8154080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:21.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.762+0000 7fa4ee283640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e806e380 0x7fa4e8154080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38096/0 (socket says 172.21.15.37:38096) 2023-12-11T17:10:21.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.762+0000 7fa4ee283640 1 -- 172.21.15.37:0/4044355482 learned_addr learned my addr 172.21.15.37:0/4044355482 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:21.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.762+0000 7fa4eea84640 1 --2- 172.21.15.37:0/4044355482 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4e80b3e90 0x7fa4e81e4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:21.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.762+0000 7fa4eda82640 1 --2- 172.21.15.37:0/4044355482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4e8070d70 0x7fa4e81534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:21.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.762+0000 7fa4ee283640 1 -- 172.21.15.37:0/4044355482 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4e80b3e90 msgr2=0x7fa4e81e4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:21.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.762+0000 7fa4ee283640 1 --2- 172.21.15.37:0/4044355482 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4e80b3e90 0x7fa4e81e4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:21.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.763+0000 7fa4ee283640 1 -- 172.21.15.37:0/4044355482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4e8070d70 msgr2=0x7fa4e81534a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:21.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.763+0000 7fa4ee283640 1 --2- 172.21.15.37:0/4044355482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4e8070d70 0x7fa4e81534a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:21.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.763+0000 7fa4ee283640 1 -- 172.21.15.37:0/4044355482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e0009400 con 0x7fa4e806e380 2023-12-11T17:10:21.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.763+0000 7fa4eda82640 1 --2- 172.21.15.37:0/4044355482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4e8070d70 0x7fa4e81534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:21.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.763+0000 7fa4ee283640 1 --2- 172.21.15.37:0/4044355482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e806e380 0x7fa4e8154080 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc000f80 tx=0x7fa4dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:21.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.763+0000 7fa4e6ffd640 1 -- 172.21.15.37:0/4044355482 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc009510 con 0x7fa4e806e380 2023-12-11T17:10:21.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.763+0000 7fa4e6ffd640 1 -- 172.21.15.37:0/4044355482 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4dc03e450 con 0x7fa4e806e380 2023-12-11T17:10:21.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.763+0000 7fa4e6ffd640 1 -- 172.21.15.37:0/4044355482 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4dc03e7e0 con 0x7fa4e806e380 2023-12-11T17:10:21.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.763+0000 7fa4ef285640 1 -- 172.21.15.37:0/4044355482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4dc009b30 con 0x7fa4e806e380 2023-12-11T17:10:21.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.764+0000 7fa4ef285640 1 -- 172.21.15.37:0/4044355482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e81e5c80 con 0x7fa4e806e380 2023-12-11T17:10:21.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.765+0000 7fa4ef285640 1 -- 172.21.15.37:0/4044355482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e80673f0 con 0x7fa4e806e380 2023-12-11T17:10:21.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.766+0000 7fa4e6ffd640 1 -- 172.21.15.37:0/4044355482 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa4dc02cd50 con 0x7fa4e806e380 2023-12-11T17:10:21.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.766+0000 7fa4e6ffd640 1 --2- 172.21.15.37:0/4044355482 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa4cc06ae40 0x7fa4cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:21.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.767+0000 7fa4e6ffd640 1 -- 172.21.15.37:0/4044355482 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fa4dc0ac6d0 con 0x7fa4e806e380 2023-12-11T17:10:21.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.767+0000 7fa4eda82640 1 --2- 172.21.15.37:0/4044355482 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa4cc06ae40 0x7fa4cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:21.769 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.768+0000 7fa4eda82640 1 --2- 172.21.15.37:0/4044355482 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa4cc06ae40 0x7fa4cc06d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4006fd0 tx=0x7fa4d4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:21.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.770+0000 7fa4e6ffd640 1 -- 172.21.15.37:0/4044355482 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa4dc077400 con 0x7fa4e806e380 2023-12-11T17:10:21.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.963+0000 7fa4ef285640 1 -- 172.21.15.37:0/4044355482 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4e806b960 con 0x7fa4e806e380 2023-12-11T17:10:21.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.966+0000 7fa4e6ffd640 1 -- 172.21.15.37:0/4044355482 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7fa4dc033e80 con 0x7fa4e806e380 2023-12-11T17:10:21.968 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:21.968 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:09:49.715938+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:10:21.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.968+0000 7fa4ef285640 1 -- 172.21.15.37:0/4044355482 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa4cc06ae40 msgr2=0x7fa4cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:21.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.968+0000 7fa4ef285640 1 --2- 172.21.15.37:0/4044355482 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa4cc06ae40 0x7fa4cc06d300 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa4d4006fd0 tx=0x7fa4d4008040 comp rx=0 tx=0).stop 2023-12-11T17:10:21.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.968+0000 7fa4ef285640 1 -- 172.21.15.37:0/4044355482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e806e380 msgr2=0x7fa4e8154080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:21.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.968+0000 7fa4ef285640 1 --2- 172.21.15.37:0/4044355482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e806e380 0x7fa4e8154080 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fa4dc000f80 tx=0x7fa4dc004a40 comp rx=0 tx=0).stop 2023-12-11T17:10:21.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.969+0000 7fa4ef285640 1 -- 172.21.15.37:0/4044355482 shutdown_connections 2023-12-11T17:10:21.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.969+0000 7fa4ef285640 1 --2- 172.21.15.37:0/4044355482 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa4cc06ae40 0x7fa4cc06d300 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:21.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.969+0000 7fa4ef285640 1 --2- 172.21.15.37:0/4044355482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4e8070d70 0x7fa4e81534a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:21.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.969+0000 7fa4ef285640 1 --2- 172.21.15.37:0/4044355482 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4e80b3e90 0x7fa4e81e4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:21.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.969+0000 7fa4ef285640 1 --2- 172.21.15.37:0/4044355482 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa4e806e380 0x7fa4e8154080 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:21.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.969+0000 7fa4ef285640 1 -- 172.21.15.37:0/4044355482 >> 172.21.15.37:0/4044355482 conn(0x7fa4e80b1540 msgr2=0x7fa4e80b0160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:21.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.969+0000 7fa4ef285640 1 -- 172.21.15.37:0/4044355482 shutdown_connections 2023-12-11T17:10:21.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:21.969+0000 7fa4ef285640 1 -- 172.21.15.37:0/4044355482 wait complete. 2023-12-11T17:10:21.987 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T17:09:38.415636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T17:09:42.786774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T17:09:43.660585+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-11T17:09:47.272351+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-11T17:10:21.987 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T17:10:22.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.209+0000 7f2150ae0640 1 Processor -- start 2023-12-11T17:10:22.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.209+0000 7f2150ae0640 1 -- start start 2023-12-11T17:10:22.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.210+0000 7f2150ae0640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f214c0d1a00 0x7f214c0cffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:22.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.210+0000 7f2150ae0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214c0d04f0 con 0x7f214c0999f0 2023-12-11T17:10:22.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.210+0000 7f2150ae0640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f214c0cf1f0 con 0x7f214c06e4d0 2023-12-11T17:10:22.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.210+0000 7f2150ae0640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f214c0cf4d0 con 0x7f214c0d1a00 2023-12-11T17:10:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.210+0000 7f214a59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f214c0999f0 0x7f214c099dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41890/0 (socket says 172.21.15.37:41890) 2023-12-11T17:10:22.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.211+0000 7f214a59c640 1 -- 172.21.15.37:0/2369541191 learned_addr learned my addr 172.21.15.37:0/2369541191 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:22.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.211+0000 7f2149d9b640 1 --2- 172.21.15.37:0/2369541191 >> v2:172.21.15.151:3300/0 conn(0x7f214c0d1a00 0x7f214c0cffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.211+0000 7f214959a640 1 -- 172.21.15.37:0/2369541191 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1270332718 0 0) 0x7f214c0d04f0 con 0x7f214c0999f0 2023-12-11T17:10:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.211+0000 7f214959a640 1 -- 172.21.15.37:0/2369541191 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2138003520 con 0x7f214c0999f0 2023-12-11T17:10:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.211+0000 7f214959a640 1 -- 172.21.15.37:0/2369541191 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3083058170 0 0) 0x7f214c0cf1f0 con 0x7f214c06e4d0 2023-12-11T17:10:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.211+0000 7f214959a640 1 -- 172.21.15.37:0/2369541191 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f214c0d04f0 con 0x7f214c06e4d0 2023-12-11T17:10:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.211+0000 7f214959a640 1 -- 172.21.15.37:0/2369541191 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1107487238 0 0) 0x7f2138003520 con 0x7f214c0999f0 2023-12-11T17:10:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.211+0000 7f214959a640 1 -- 172.21.15.37:0/2369541191 >> v2:172.21.15.151:3300/0 conn(0x7f214c0d1a00 msgr2=0x7f214c0cffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.211+0000 7f214959a640 1 --2- 172.21.15.37:0/2369541191 >> v2:172.21.15.151:3300/0 conn(0x7f214c0d1a00 0x7f214c0cffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.211+0000 7f214959a640 1 -- 172.21.15.37:0/2369541191 >> v1:172.21.15.151:6789/0 conn(0x7f214c06e4d0 legacy=0x7f214c0cb530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.212+0000 7f214959a640 1 -- 172.21.15.37:0/2369541191 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c0cf7b0 con 0x7f214c0999f0 2023-12-11T17:10:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.212+0000 7f214959a640 1 -- 172.21.15.37:0/2369541191 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f213c0019f0 con 0x7f214c0999f0 2023-12-11T17:10:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.212+0000 7f214959a640 1 -- 172.21.15.37:0/2369541191 >> v1:172.21.15.37:6789/0 conn(0x7f214c0999f0 legacy=0x7f214c099dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:22.214 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.212+0000 7f214959a640 1 --2- 172.21.15.37:0/2369541191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2138003b00 0x7f2138003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.212+0000 7f214959a640 1 --2- 172.21.15.37:0/2369541191 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21380047c0 0x7f2138004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.212+0000 7f214959a640 1 --2- 172.21.15.37:0/2369541191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2138005180 0x7f213800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.212+0000 7f214959a640 1 -- 172.21.15.37:0/2369541191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c0cf4d0 con 0x7f2138003b00 2023-12-11T17:10:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.212+0000 7f214959a640 1 -- 172.21.15.37:0/2369541191 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f213800c0b0 con 0x7f2138005180 2023-12-11T17:10:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.212+0000 7f214959a640 1 -- 172.21.15.37:0/2369541191 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f213800c270 con 0x7f21380047c0 2023-12-11T17:10:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.212+0000 7f214a59c640 1 --2- 172.21.15.37:0/2369541191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2138003b00 0x7f2138003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.212+0000 7f214ad9d640 1 --2- 172.21.15.37:0/2369541191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2138005180 0x7f213800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.212+0000 7f2149d9b640 1 --2- 172.21.15.37:0/2369541191 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21380047c0 0x7f2138004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.212+0000 7f214a59c640 1 -- 172.21.15.37:0/2369541191 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21380047c0 msgr2=0x7f2138004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.212+0000 7f214a59c640 1 --2- 172.21.15.37:0/2369541191 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f21380047c0 0x7f2138004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.212+0000 7f214a59c640 1 -- 172.21.15.37:0/2369541191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2138005180 msgr2=0x7f213800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.213+0000 7f214a59c640 1 --2- 172.21.15.37:0/2369541191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2138005180 0x7f213800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.213+0000 7f214a59c640 1 -- 172.21.15.37:0/2369541191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2138003520 con 0x7f2138003b00 2023-12-11T17:10:22.215 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.213+0000 7f214ad9d640 1 -- 172.21.15.37:0/2369541191 reap_dead start 2023-12-11T17:10:22.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.214+0000 7f214a59c640 1 --2- 172.21.15.37:0/2369541191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2138003b00 0x7f2138003f00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f213c00a7c0 tx=0x7f21380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55380833ce66590b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.214+0000 7f214959a640 1 -- 172.21.15.37:0/2369541191 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c034630 con 0x7f2138003b00 2023-12-11T17:10:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.214+0000 7f214959a640 1 -- 172.21.15.37:0/2369541191 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f213c02f070 con 0x7f2138003b00 2023-12-11T17:10:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.214+0000 7f214959a640 1 -- 172.21.15.37:0/2369541191 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f213c034a30 con 0x7f2138003b00 2023-12-11T17:10:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.214+0000 7f2150ae0640 1 -- 172.21.15.37:0/2369541191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2138003b00 msgr2=0x7f2138003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.214+0000 7f2150ae0640 1 --2- 172.21.15.37:0/2369541191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2138003b00 0x7f2138003f00 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f213c00a7c0 tx=0x7f21380057f0 comp rx=0 tx=0).stop 2023-12-11T17:10:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.215+0000 7f2150ae0640 1 -- 172.21.15.37:0/2369541191 shutdown_connections 2023-12-11T17:10:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.215+0000 7f2150ae0640 1 --2- 172.21.15.37:0/2369541191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2138003b00 0x7f2138003f00 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.215+0000 7f2150ae0640 1 -- 172.21.15.37:0/2369541191 >> 172.21.15.37:0/2369541191 conn(0x7f214c0d0ee0 msgr2=0x7f214c0d12f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.215+0000 7f2150ae0640 1 -- 172.21.15.37:0/2369541191 shutdown_connections 2023-12-11T17:10:22.217 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.215+0000 7f2150ae0640 1 -- 172.21.15.37:0/2369541191 wait complete. 2023-12-11T17:10:22.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.217+0000 7f2150ae0640 1 Processor -- start 2023-12-11T17:10:22.218 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.217+0000 7f2150ae0640 1 -- start start 2023-12-11T17:10:22.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.218+0000 7f2150ae0640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2138003b00 0x7f214c0c8210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:22.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.218+0000 7f2150ae0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f214c0c8750 0x7f214c15f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:22.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.218+0000 7f2150ae0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214c15f920 0x7f214c0b3f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:22.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.218+0000 7f2150ae0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c157e20 con 0x7f214c15f920 2023-12-11T17:10:22.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.218+0000 7f2150ae0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f214c0c9ce0 con 0x7f214c0c8750 2023-12-11T17:10:22.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.218+0000 7f2150ae0640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f214c0c8c40 con 0x7f2138003b00 2023-12-11T17:10:22.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.218+0000 7f214ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214c15f920 0x7f214c0b3f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:22.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.218+0000 7f214ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214c15f920 0x7f214c0b3f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38120/0 (socket says 172.21.15.37:38120) 2023-12-11T17:10:22.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.218+0000 7f214ad9d640 1 -- 172.21.15.37:0/865374935 learned_addr learned my addr 172.21.15.37:0/865374935 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:22.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.218+0000 7f214a59c640 1 --2- 172.21.15.37:0/865374935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2138003b00 0x7f214c0c8210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:22.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.218+0000 7f2149d9b640 1 --2- 172.21.15.37:0/865374935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f214c0c8750 0x7f214c15f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:22.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.219+0000 7f214ad9d640 1 -- 172.21.15.37:0/865374935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2138003b00 msgr2=0x7f214c0c8210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:22.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.219+0000 7f214ad9d640 1 --2- 172.21.15.37:0/865374935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2138003b00 0x7f214c0c8210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:22.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.219+0000 7f214ad9d640 1 -- 172.21.15.37:0/865374935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f214c0c8750 msgr2=0x7f214c15f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:22.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.219+0000 7f214ad9d640 1 --2- 172.21.15.37:0/865374935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f214c0c8750 0x7f214c15f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:22.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.219+0000 7f214ad9d640 1 -- 172.21.15.37:0/865374935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f214c0c8f20 con 0x7f214c15f920 2023-12-11T17:10:22.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.219+0000 7f214ad9d640 1 --2- 172.21.15.37:0/865374935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214c15f920 0x7f214c0b3f80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f214c071a90 tx=0x7f214400e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.219+0000 7f2142ffd640 1 -- 172.21.15.37:0/865374935 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144006aa0 con 0x7f214c15f920 2023-12-11T17:10:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.219+0000 7f2142ffd640 1 -- 172.21.15.37:0/865374935 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2144006c20 con 0x7f214c15f920 2023-12-11T17:10:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.219+0000 7f2142ffd640 1 -- 172.21.15.37:0/865374935 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2144005030 con 0x7f214c15f920 2023-12-11T17:10:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.219+0000 7f2150ae0640 1 -- 172.21.15.37:0/865374935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f214c0c9200 con 0x7f214c15f920 2023-12-11T17:10:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.219+0000 7f2150ae0640 1 -- 172.21.15.37:0/865374935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f214c0c97c0 con 0x7f214c15f920 2023-12-11T17:10:22.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.221+0000 7f2150ae0640 1 -- 172.21.15.37:0/865374935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f214c074450 con 0x7f214c15f920 2023-12-11T17:10:22.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.222+0000 7f2142ffd640 1 -- 172.21.15.37:0/865374935 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2144005190 con 0x7f214c15f920 2023-12-11T17:10:22.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.222+0000 7f2142ffd640 1 --2- 172.21.15.37:0/865374935 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f212c06ae40 0x7f212c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:22.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.223+0000 7f2142ffd640 1 -- 172.21.15.37:0/865374935 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f2144089150 con 0x7f214c15f920 2023-12-11T17:10:22.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.223+0000 7f214a59c640 1 --2- 172.21.15.37:0/865374935 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f212c06ae40 0x7f212c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:22.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.224+0000 7f214a59c640 1 --2- 172.21.15.37:0/865374935 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f212c06ae40 0x7f212c06d300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f213c034000 tx=0x7f213c009030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:22.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.227+0000 7f2142ffd640 1 -- 172.21.15.37:0/865374935 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f21440579a0 con 0x7f214c15f920 2023-12-11T17:10:22.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.422+0000 7f2150ae0640 1 -- 172.21.15.37:0/865374935 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f214c0cc590 con 0x7f214c15f920 2023-12-11T17:10:22.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.423+0000 7f2142ffd640 1 -- 172.21.15.37:0/865374935 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2144057530 con 0x7f214c15f920 2023-12-11T17:10:22.424 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-11T17:10:22.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.425+0000 7f2150ae0640 1 -- 172.21.15.37:0/865374935 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f212c06ae40 msgr2=0x7f212c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:22.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.425+0000 7f2150ae0640 1 --2- 172.21.15.37:0/865374935 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f212c06ae40 0x7f212c06d300 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f213c034000 tx=0x7f213c009030 comp rx=0 tx=0).stop 2023-12-11T17:10:22.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.425+0000 7f2150ae0640 1 -- 172.21.15.37:0/865374935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214c15f920 msgr2=0x7f214c0b3f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:22.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.425+0000 7f2150ae0640 1 --2- 172.21.15.37:0/865374935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214c15f920 0x7f214c0b3f80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f214c071a90 tx=0x7f214400e820 comp rx=0 tx=0).stop 2023-12-11T17:10:22.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.425+0000 7f2150ae0640 1 -- 172.21.15.37:0/865374935 shutdown_connections 2023-12-11T17:10:22.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.425+0000 7f2150ae0640 1 --2- 172.21.15.37:0/865374935 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f212c06ae40 0x7f212c06d300 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:22.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.425+0000 7f2150ae0640 1 --2- 172.21.15.37:0/865374935 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f214c0c8750 0x7f214c15f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:22.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.425+0000 7f2150ae0640 1 --2- 172.21.15.37:0/865374935 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f214c15f920 0x7f214c0b3f80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:22.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.425+0000 7f2150ae0640 1 --2- 172.21.15.37:0/865374935 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f2138003b00 0x7f214c0c8210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:22.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.425+0000 7f2150ae0640 1 -- 172.21.15.37:0/865374935 >> 172.21.15.37:0/865374935 conn(0x7f214c0d0ee0 msgr2=0x7f214c0b2020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:22.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.426+0000 7f2150ae0640 1 -- 172.21.15.37:0/865374935 shutdown_connections 2023-12-11T17:10:22.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.426+0000 7f2150ae0640 1 -- 172.21.15.37:0/865374935 wait complete. 2023-12-11T17:10:22.446 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T17:10:22.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.673+0000 7f308b815640 1 Processor -- start 2023-12-11T17:10:22.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.674+0000 7f308b815640 1 -- start start 2023-12-11T17:10:22.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.676+0000 7f308b815640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3084141960 0x7f3084166100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:22.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.676+0000 7f308b815640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f308415b780 con 0x7f308406d770 2023-12-11T17:10:22.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.676+0000 7f308b815640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30840b2510 con 0x7f308406db50 2023-12-11T17:10:22.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.676+0000 7f308b815640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308415b9d0 con 0x7f3084141960 2023-12-11T17:10:22.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.676+0000 7f30895b1640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f308406d770 0x7f30840b1e00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41902/0 (socket says 172.21.15.37:41902) 2023-12-11T17:10:22.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.676+0000 7f30895b1640 1 -- 172.21.15.37:0/2082204947 learned_addr learned my addr 172.21.15.37:0/2082204947 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:22.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.676+0000 7f3089db2640 1 --2- 172.21.15.37:0/2082204947 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3084141960 0x7f3084166100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:22.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.676+0000 7f307bfff640 1 -- 172.21.15.37:0/2082204947 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765945165 0 0) 0x7f308415b780 con 0x7f308406d770 2023-12-11T17:10:22.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.676+0000 7f307bfff640 1 -- 172.21.15.37:0/2082204947 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3070003520 con 0x7f308406d770 2023-12-11T17:10:22.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.677+0000 7f307bfff640 1 -- 172.21.15.37:0/2082204947 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 546782435 0 0) 0x7f3070003520 con 0x7f308406d770 2023-12-11T17:10:22.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.677+0000 7f307bfff640 1 -- 172.21.15.37:0/2082204947 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3084141960 msgr2=0x7f3084166100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:22.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.677+0000 7f307bfff640 1 --2- 172.21.15.37:0/2082204947 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3084141960 0x7f3084166100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:22.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.677+0000 7f307bfff640 1 -- 172.21.15.37:0/2082204947 >> v1:172.21.15.151:6789/0 conn(0x7f308406db50 legacy=0x7f3084141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:22.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.677+0000 7f307bfff640 1 -- 172.21.15.37:0/2082204947 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308415bcb0 con 0x7f308406d770 2023-12-11T17:10:22.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.677+0000 7f307bfff640 1 -- 172.21.15.37:0/2082204947 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f3080001670 con 0x7f308406d770 2023-12-11T17:10:22.681 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.677+0000 7f307bfff640 1 -- 172.21.15.37:0/2082204947 >> v1:172.21.15.37:6789/0 conn(0x7f308406d770 legacy=0x7f30840b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.677+0000 7f307bfff640 1 --2- 172.21.15.37:0/2082204947 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30700039a0 0x7f3070003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.677+0000 7f307bfff640 1 --2- 172.21.15.37:0/2082204947 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3084141960 0x7f30700047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.677+0000 7f307bfff640 1 --2- 172.21.15.37:0/2082204947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3070004d00 0x7f3070005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.677+0000 7f307bfff640 1 -- 172.21.15.37:0/2082204947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308415b9d0 con 0x7f3070004d00 2023-12-11T17:10:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.677+0000 7f307bfff640 1 -- 172.21.15.37:0/2082204947 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f307000ba90 con 0x7f30700039a0 2023-12-11T17:10:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.677+0000 7f307bfff640 1 -- 172.21.15.37:0/2082204947 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f307000bc50 con 0x7f3084141960 2023-12-11T17:10:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.677+0000 7f3089db2640 1 --2- 172.21.15.37:0/2082204947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3070004d00 0x7f3070005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.678+0000 7f30895b1640 1 --2- 172.21.15.37:0/2082204947 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30700039a0 0x7f3070003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.678+0000 7f3088db0640 1 --2- 172.21.15.37:0/2082204947 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3084141960 0x7f30700047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.678+0000 7f3089db2640 1 -- 172.21.15.37:0/2082204947 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3084141960 msgr2=0x7f30700047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.678+0000 7f3089db2640 1 --2- 172.21.15.37:0/2082204947 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3084141960 0x7f30700047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.678+0000 7f3089db2640 1 -- 172.21.15.37:0/2082204947 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30700039a0 msgr2=0x7f3070003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.678+0000 7f3089db2640 1 --2- 172.21.15.37:0/2082204947 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30700039a0 0x7f3070003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:22.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.678+0000 7f3089db2640 1 -- 172.21.15.37:0/2082204947 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3070003520 con 0x7f3070004d00 2023-12-11T17:10:22.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.678+0000 7f3088db0640 1 --2- 172.21.15.37:0/2082204947 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3084141960 0x7f30700047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:22.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.679+0000 7f3089db2640 1 --2- 172.21.15.37:0/2082204947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3070004d00 0x7f3070005180 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f307c009f90 tx=0x7f30700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14d084d3b83f3849 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:22.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.679+0000 7f307bfff640 1 -- 172.21.15.37:0/2082204947 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307c02cbd0 con 0x7f3070004d00 2023-12-11T17:10:22.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.679+0000 7f307bfff640 1 -- 172.21.15.37:0/2082204947 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f307c00f040 con 0x7f3070004d00 2023-12-11T17:10:22.683 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.679+0000 7f307bfff640 1 -- 172.21.15.37:0/2082204947 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f307c034440 con 0x7f3070004d00 2023-12-11T17:10:22.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.680+0000 7f308b815640 1 -- 172.21.15.37:0/2082204947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3070004d00 msgr2=0x7f3070005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:22.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.680+0000 7f308b815640 1 --2- 172.21.15.37:0/2082204947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3070004d00 0x7f3070005180 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f307c009f90 tx=0x7f30700057f0 comp rx=0 tx=0).stop 2023-12-11T17:10:22.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.680+0000 7f3089db2640 1 -- 172.21.15.37:0/2082204947 reap_dead start 2023-12-11T17:10:22.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.680+0000 7f308b815640 1 -- 172.21.15.37:0/2082204947 shutdown_connections 2023-12-11T17:10:22.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.680+0000 7f308b815640 1 -- 172.21.15.37:0/2082204947 >> 172.21.15.37:0/2082204947 conn(0x7f30840cb850 msgr2=0x7f30840cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:22.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.680+0000 7f308b815640 1 -- 172.21.15.37:0/2082204947 shutdown_connections 2023-12-11T17:10:22.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.680+0000 7f308b815640 1 -- 172.21.15.37:0/2082204947 wait complete. 2023-12-11T17:10:22.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.682+0000 7f308b815640 1 Processor -- start 2023-12-11T17:10:22.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.682+0000 7f308b815640 1 -- start start 2023-12-11T17:10:22.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.683+0000 7f308b815640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3070004d00 0x7f308413dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:22.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.683+0000 7f308b815640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f308413f3d0 0x7f308415a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:22.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.683+0000 7f308b815640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f308415ea90 0x7f308415ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:22.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.683+0000 7f308b815640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308415f450 con 0x7f3070004d00 2023-12-11T17:10:22.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.683+0000 7f308b815640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f308415acc0 con 0x7f308415ea90 2023-12-11T17:10:22.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.683+0000 7f308b815640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f308413fb70 con 0x7f308413f3d0 2023-12-11T17:10:22.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.683+0000 7f30895b1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3070004d00 0x7f308413dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:22.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.683+0000 7f30895b1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3070004d00 0x7f308413dcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38140/0 (socket says 172.21.15.37:38140) 2023-12-11T17:10:22.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.683+0000 7f30895b1640 1 -- 172.21.15.37:0/1590942897 learned_addr learned my addr 172.21.15.37:0/1590942897 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:22.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.684+0000 7f3089db2640 1 --2- 172.21.15.37:0/1590942897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f308415ea90 0x7f308415ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:22.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.684+0000 7f3088db0640 1 --2- 172.21.15.37:0/1590942897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f308413f3d0 0x7f308415a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:22.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.684+0000 7f30895b1640 1 -- 172.21.15.37:0/1590942897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f308413f3d0 msgr2=0x7f308415a780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:22.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.684+0000 7f30895b1640 1 --2- 172.21.15.37:0/1590942897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f308413f3d0 0x7f308415a780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:22.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.684+0000 7f30895b1640 1 -- 172.21.15.37:0/1590942897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f308415ea90 msgr2=0x7f308415ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:22.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.684+0000 7f30895b1640 1 --2- 172.21.15.37:0/1590942897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f308415ea90 0x7f308415ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:22.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.684+0000 7f30895b1640 1 -- 172.21.15.37:0/1590942897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f308413fe50 con 0x7f3070004d00 2023-12-11T17:10:22.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.684+0000 7f3088db0640 1 --2- 172.21.15.37:0/1590942897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f308413f3d0 0x7f308415a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:22.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.684+0000 7f30895b1640 1 --2- 172.21.15.37:0/1590942897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3070004d00 0x7f308413dcc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f308000e800 tx=0x7f308000ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:22.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.685+0000 7f3079ffb640 1 -- 172.21.15.37:0/1590942897 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308000c870 con 0x7f3070004d00 2023-12-11T17:10:22.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.685+0000 7f3079ffb640 1 -- 172.21.15.37:0/1590942897 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f308000c9d0 con 0x7f3070004d00 2023-12-11T17:10:22.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.685+0000 7f308b815640 1 -- 172.21.15.37:0/1590942897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3084140130 con 0x7f3070004d00 2023-12-11T17:10:22.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.685+0000 7f3079ffb640 1 -- 172.21.15.37:0/1590942897 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f308000cd80 con 0x7f3070004d00 2023-12-11T17:10:22.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.685+0000 7f308b815640 1 -- 172.21.15.37:0/1590942897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30841f30f0 con 0x7f3070004d00 2023-12-11T17:10:22.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.686+0000 7f308b815640 1 -- 172.21.15.37:0/1590942897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30841f32b0 con 0x7f3070004d00 2023-12-11T17:10:22.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.687+0000 7f3079ffb640 1 -- 172.21.15.37:0/1590942897 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f308001d460 con 0x7f3070004d00 2023-12-11T17:10:22.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.688+0000 7f3079ffb640 1 --2- 172.21.15.37:0/1590942897 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f306806ae70 0x7f306806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:22.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.688+0000 7f3079ffb640 1 -- 172.21.15.37:0/1590942897 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3080089a40 con 0x7f3070004d00 2023-12-11T17:10:22.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.688+0000 7f3088db0640 1 --2- 172.21.15.37:0/1590942897 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f306806ae70 0x7f306806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:22.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.689+0000 7f3088db0640 1 --2- 172.21.15.37:0/1590942897 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f306806ae70 0x7f306806d330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f308413e980 tx=0x7f3074009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:22.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.692+0000 7f3079ffb640 1 -- 172.21.15.37:0/1590942897 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f30800546e0 con 0x7f3070004d00 2023-12-11T17:10:22.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.883+0000 7f308b815640 1 -- 172.21.15.37:0/1590942897 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f30840745d0 con 0x7f3070004d00 2023-12-11T17:10:22.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.884+0000 7f3079ffb640 1 -- 172.21.15.37:0/1590942897 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3080001560 con 0x7f3070004d00 2023-12-11T17:10:22.885 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:10:22.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.886+0000 7f308b815640 1 -- 172.21.15.37:0/1590942897 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f306806ae70 msgr2=0x7f306806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:22.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.886+0000 7f308b815640 1 --2- 172.21.15.37:0/1590942897 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f306806ae70 0x7f306806d330 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f308413e980 tx=0x7f3074009040 comp rx=0 tx=0).stop 2023-12-11T17:10:22.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.886+0000 7f308b815640 1 -- 172.21.15.37:0/1590942897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3070004d00 msgr2=0x7f308413dcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:22.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.886+0000 7f308b815640 1 --2- 172.21.15.37:0/1590942897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3070004d00 0x7f308413dcc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f308000e800 tx=0x7f308000ecc0 comp rx=0 tx=0).stop 2023-12-11T17:10:22.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.886+0000 7f308b815640 1 -- 172.21.15.37:0/1590942897 shutdown_connections 2023-12-11T17:10:22.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.886+0000 7f308b815640 1 --2- 172.21.15.37:0/1590942897 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f306806ae70 0x7f306806d330 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:22.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.886+0000 7f308b815640 1 --2- 172.21.15.37:0/1590942897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f308415ea90 0x7f308415ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:22.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.886+0000 7f308b815640 1 --2- 172.21.15.37:0/1590942897 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f308413f3d0 0x7f308415a780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:22.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.886+0000 7f308b815640 1 --2- 172.21.15.37:0/1590942897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3070004d00 0x7f308413dcc0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:22.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.886+0000 7f308b815640 1 -- 172.21.15.37:0/1590942897 >> 172.21.15.37:0/1590942897 conn(0x7f30840cb850 msgr2=0x7f3084072ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:22.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.887+0000 7f308b815640 1 -- 172.21.15.37:0/1590942897 shutdown_connections 2023-12-11T17:10:22.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:22.887+0000 7f308b815640 1 -- 172.21.15.37:0/1590942897 wait complete. 2023-12-11T17:10:22.905 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T17:10:23.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.122+0000 7f950ffff640 1 Processor -- start 2023-12-11T17:10:23.124 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.123+0000 7f950ffff640 1 -- start start 2023-12-11T17:10:23.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.125+0000 7f950ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95100ce150 0x7f95100ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:23.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.125+0000 7f950ffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95100cedf0 0x7f95100cf250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:23.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.125+0000 7f950ffff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95100cf790 con 0x7f9510155400 2023-12-11T17:10:23.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.125+0000 7f950ffff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f951006c500 con 0x7f95100ce150 2023-12-11T17:10:23.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.125+0000 7f950ffff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951015b4a0 con 0x7f95100cedf0 2023-12-11T17:10:23.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.126+0000 7f950effd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9510155400 0x7f951006bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41912/0 (socket says 172.21.15.37:41912) 2023-12-11T17:10:23.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.126+0000 7f950effd640 1 -- 172.21.15.37:0/614115267 learned_addr learned my addr 172.21.15.37:0/614115267 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:23.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.126+0000 7f9507fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f95100ce150 0x7f95100ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:23.127 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.126+0000 7f950f7fe640 1 --2- 172.21.15.37:0/614115267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95100cedf0 0x7f95100cf250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:23.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.126+0000 7f950e7fc640 1 -- 172.21.15.37:0/614115267 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2384340513 0 0) 0x7f95100cf790 con 0x7f9510155400 2023-12-11T17:10:23.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.126+0000 7f950e7fc640 1 -- 172.21.15.37:0/614115267 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94fc003520 con 0x7f9510155400 2023-12-11T17:10:23.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.126+0000 7f9507fff640 1 -- 172.21.15.37:0/614115267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95100cedf0 msgr2=0x7f95100cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:23.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.126+0000 7f9507fff640 1 --2- 172.21.15.37:0/614115267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95100cedf0 0x7f95100cf250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:23.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.126+0000 7f9507fff640 1 -- 172.21.15.37:0/614115267 >> v1:172.21.15.37:6789/0 conn(0x7f9510155400 legacy=0x7f951006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:23.128 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.126+0000 7f9507fff640 1 -- 172.21.15.37:0/614115267 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95100adbb0 con 0x7f95100ce150 2023-12-11T17:10:23.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.128+0000 7f9507fff640 1 --2- 172.21.15.37:0/614115267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95100ce150 0x7f95100ce5b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f94f80097a0 tx=0x7f94f802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39688c2b182793f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:23.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.128+0000 7f950e7fc640 1 -- 172.21.15.37:0/614115267 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f8031830 con 0x7f95100ce150 2023-12-11T17:10:23.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.128+0000 7f950e7fc640 1 -- 172.21.15.37:0/614115267 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94f8031990 con 0x7f95100ce150 2023-12-11T17:10:23.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.128+0000 7f950e7fc640 1 -- 172.21.15.37:0/614115267 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94f8031d20 con 0x7f95100ce150 2023-12-11T17:10:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.128+0000 7f950ffff640 1 -- 172.21.15.37:0/614115267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95100ce150 msgr2=0x7f95100ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.128+0000 7f950ffff640 1 --2- 172.21.15.37:0/614115267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95100ce150 0x7f95100ce5b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f94f80097a0 tx=0x7f94f802b8d0 comp rx=0 tx=0).stop 2023-12-11T17:10:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.129+0000 7f950ffff640 1 -- 172.21.15.37:0/614115267 shutdown_connections 2023-12-11T17:10:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.129+0000 7f950ffff640 1 --2- 172.21.15.37:0/614115267 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95100cedf0 0x7f95100cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.129+0000 7f950ffff640 1 --2- 172.21.15.37:0/614115267 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f95100ce150 0x7f95100ce5b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.129+0000 7f950ffff640 1 -- 172.21.15.37:0/614115267 >> 172.21.15.37:0/614115267 conn(0x7f951006a640 msgr2=0x7f951006aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.129+0000 7f950ffff640 1 -- 172.21.15.37:0/614115267 shutdown_connections 2023-12-11T17:10:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.129+0000 7f950ffff640 1 -- 172.21.15.37:0/614115267 wait complete. 2023-12-11T17:10:23.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.130+0000 7f950ffff640 1 Processor -- start 2023-12-11T17:10:23.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.131+0000 7f950ffff640 1 -- start start 2023-12-11T17:10:23.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.132+0000 7f950ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95100ce150 0x7f9510150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:23.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.132+0000 7f950ffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95100cedf0 0x7f951014e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:23.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.132+0000 7f950ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9510155400 0x7f9510159f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.132+0000 7f950ffff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951013d2b0 con 0x7f9510155400 2023-12-11T17:10:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.132+0000 7f950ffff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9510151c70 con 0x7f95100ce150 2023-12-11T17:10:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.132+0000 7f950ffff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9510151150 con 0x7f95100cedf0 2023-12-11T17:10:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.132+0000 7f950f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9510155400 0x7f9510159f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.132+0000 7f950f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9510155400 0x7f9510159f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38150/0 (socket says 172.21.15.37:38150) 2023-12-11T17:10:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.132+0000 7f950f7fe640 1 -- 172.21.15.37:0/3072659410 learned_addr learned my addr 172.21.15.37:0/3072659410 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.132+0000 7f950f7fe640 1 -- 172.21.15.37:0/3072659410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95100cedf0 msgr2=0x7f951014e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.132+0000 7f950f7fe640 1 --2- 172.21.15.37:0/3072659410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95100cedf0 0x7f951014e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.132+0000 7f950f7fe640 1 -- 172.21.15.37:0/3072659410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95100ce150 msgr2=0x7f9510150c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.132+0000 7f950effd640 1 --2- 172.21.15.37:0/3072659410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95100ce150 0x7f9510150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.132+0000 7f950f7fe640 1 --2- 172.21.15.37:0/3072659410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95100ce150 0x7f9510150c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.132+0000 7f950f7fe640 1 -- 172.21.15.37:0/3072659410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94f8009400 con 0x7f9510155400 2023-12-11T17:10:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.133+0000 7f950f7fe640 1 --2- 172.21.15.37:0/3072659410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9510155400 0x7f9510159f70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f950800efc0 tx=0x7f950800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:23.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.133+0000 7f95077fe640 1 -- 172.21.15.37:0/3072659410 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9508014480 con 0x7f9510155400 2023-12-11T17:10:23.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.133+0000 7f95077fe640 1 -- 172.21.15.37:0/3072659410 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950800f040 con 0x7f9510155400 2023-12-11T17:10:23.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.133+0000 7f95077fe640 1 -- 172.21.15.37:0/3072659410 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9508014820 con 0x7f9510155400 2023-12-11T17:10:23.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.133+0000 7f950ffff640 1 -- 172.21.15.37:0/3072659410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95101513d0 con 0x7f9510155400 2023-12-11T17:10:23.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.133+0000 7f950ffff640 1 -- 172.21.15.37:0/3072659410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9510151990 con 0x7f9510155400 2023-12-11T17:10:23.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.134+0000 7f950ffff640 1 -- 172.21.15.37:0/3072659410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f951013d3f0 con 0x7f9510155400 2023-12-11T17:10:23.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.135+0000 7f95077fe640 1 -- 172.21.15.37:0/3072659410 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9508014980 con 0x7f9510155400 2023-12-11T17:10:23.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.136+0000 7f95077fe640 1 --2- 172.21.15.37:0/3072659410 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f94f006ae40 0x7f94f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:23.137 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.136+0000 7f95077fe640 1 -- 172.21.15.37:0/3072659410 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f950808a440 con 0x7f9510155400 2023-12-11T17:10:23.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.137+0000 7f950effd640 1 --2- 172.21.15.37:0/3072659410 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f94f006ae40 0x7f94f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:23.139 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.138+0000 7f950effd640 1 --2- 172.21.15.37:0/3072659410 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f94f006ae40 0x7f94f006d300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9500005880 tx=0x7f9500009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:23.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.141+0000 7f95077fe640 1 -- 172.21.15.37:0/3072659410 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f951013d3f0 con 0x7f9510155400 2023-12-11T17:10:23.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.335+0000 7f950ffff640 1 -- 172.21.15.37:0/3072659410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f951013d3f0 con 0x7f9510155400 2023-12-11T17:10:23.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.335+0000 7f95077fe640 1 -- 172.21.15.37:0/3072659410 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f951013d3f0 con 0x7f9510155400 2023-12-11T17:10:23.337 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-11T17:10:23.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.338+0000 7f950ffff640 1 -- 172.21.15.37:0/3072659410 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f94f006ae40 msgr2=0x7f94f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:23.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.338+0000 7f950ffff640 1 --2- 172.21.15.37:0/3072659410 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f94f006ae40 0x7f94f006d300 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f9500005880 tx=0x7f9500009040 comp rx=0 tx=0).stop 2023-12-11T17:10:23.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.338+0000 7f950ffff640 1 -- 172.21.15.37:0/3072659410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9510155400 msgr2=0x7f9510159f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:23.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.338+0000 7f950ffff640 1 --2- 172.21.15.37:0/3072659410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9510155400 0x7f9510159f70 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f950800efc0 tx=0x7f950800c490 comp rx=0 tx=0).stop 2023-12-11T17:10:23.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.338+0000 7f950ffff640 1 -- 172.21.15.37:0/3072659410 shutdown_connections 2023-12-11T17:10:23.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.338+0000 7f950ffff640 1 --2- 172.21.15.37:0/3072659410 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f94f006ae40 0x7f94f006d300 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:23.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.338+0000 7f950ffff640 1 --2- 172.21.15.37:0/3072659410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9510155400 0x7f9510159f70 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:23.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.338+0000 7f950ffff640 1 --2- 172.21.15.37:0/3072659410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f95100cedf0 0x7f951014e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:23.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.338+0000 7f950ffff640 1 --2- 172.21.15.37:0/3072659410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f95100ce150 0x7f9510150c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:23.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.338+0000 7f950ffff640 1 -- 172.21.15.37:0/3072659410 >> 172.21.15.37:0/3072659410 conn(0x7f951006a640 msgr2=0x7f951015d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:23.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.338+0000 7f950ffff640 1 -- 172.21.15.37:0/3072659410 shutdown_connections 2023-12-11T17:10:23.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.338+0000 7f950ffff640 1 -- 172.21.15.37:0/3072659410 wait complete. 2023-12-11T17:10:23.359 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-11T17:10:23.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.581+0000 7f87c6b7a640 1 Processor -- start 2023-12-11T17:10:23.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.582+0000 7f87c6b7a640 1 -- start start 2023-12-11T17:10:23.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.583+0000 7f87c6b7a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f87c015d360 0x7f87c00d3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:23.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.583+0000 7f87c6b7a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87c00d1c40 0x7f87c00b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.583+0000 7f87c6b7a640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87c00cdf20 con 0x7f87c00cece0 2023-12-11T17:10:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.583+0000 7f87c6b7a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87c00ce200 con 0x7f87c015d360 2023-12-11T17:10:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.583+0000 7f87c6b7a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00ce4e0 con 0x7f87c00d1c40 2023-12-11T17:10:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.583+0000 7f87c5b78640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f87c015d360 0x7f87c00d3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.583+0000 7f87c5b78640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f87c015d360 0x7f87c00d3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38162/0 (socket says 172.21.15.37:38162) 2023-12-11T17:10:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.583+0000 7f87c5b78640 1 -- 172.21.15.37:0/559013970 learned_addr learned my addr 172.21.15.37:0/559013970 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.584+0000 7f87c6379640 1 --2- 172.21.15.37:0/559013970 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87c00d1c40 0x7f87c00b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.584+0000 7f87c5b78640 1 -- 172.21.15.37:0/559013970 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87c00d1c40 msgr2=0x7f87c00b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.584+0000 7f87c5b78640 1 --2- 172.21.15.37:0/559013970 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87c00d1c40 0x7f87c00b28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.584+0000 7f87c5b78640 1 -- 172.21.15.37:0/559013970 >> v1:172.21.15.151:6789/0 conn(0x7f87c00cece0 legacy=0x7f87c00d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:23.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.584+0000 7f87c5b78640 1 -- 172.21.15.37:0/559013970 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87c00ce7c0 con 0x7f87c015d360 2023-12-11T17:10:23.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.585+0000 7f87c5b78640 1 --2- 172.21.15.37:0/559013970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87c015d360 0x7f87c00d3660 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f87bc009e50 tx=0x7f87bc02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed5e2fe44fbf8b2b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:23.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.585+0000 7f87c4b76640 1 -- 172.21.15.37:0/559013970 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc02cb00 con 0x7f87c015d360 2023-12-11T17:10:23.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.585+0000 7f87c4b76640 1 -- 172.21.15.37:0/559013970 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87bc02cc60 con 0x7f87c015d360 2023-12-11T17:10:23.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.585+0000 7f87c4b76640 1 -- 172.21.15.37:0/559013970 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87bc0343f0 con 0x7f87c015d360 2023-12-11T17:10:23.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.586+0000 7f87c6b7a640 1 -- 172.21.15.37:0/559013970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87c015d360 msgr2=0x7f87c00d3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:23.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.586+0000 7f87c6b7a640 1 --2- 172.21.15.37:0/559013970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87c015d360 0x7f87c00d3660 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f87bc009e50 tx=0x7f87bc02bf60 comp rx=0 tx=0).stop 2023-12-11T17:10:23.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.586+0000 7f87c6b7a640 1 -- 172.21.15.37:0/559013970 shutdown_connections 2023-12-11T17:10:23.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.586+0000 7f87c6b7a640 1 --2- 172.21.15.37:0/559013970 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87c00d1c40 0x7f87c00b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:23.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.586+0000 7f87c6b7a640 1 --2- 172.21.15.37:0/559013970 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87c015d360 0x7f87c00d3660 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:23.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.586+0000 7f87c6b7a640 1 -- 172.21.15.37:0/559013970 >> 172.21.15.37:0/559013970 conn(0x7f87c009c230 msgr2=0x7f87c00d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:23.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.586+0000 7f87c6b7a640 1 -- 172.21.15.37:0/559013970 shutdown_connections 2023-12-11T17:10:23.589 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.586+0000 7f87c6b7a640 1 -- 172.21.15.37:0/559013970 wait complete. 2023-12-11T17:10:23.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.588+0000 7f87c6b7a640 1 Processor -- start 2023-12-11T17:10:23.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.588+0000 7f87c6b7a640 1 -- start start 2023-12-11T17:10:23.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.589+0000 7f87c6b7a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87c00cece0 0x7f87c00cae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:23.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.589+0000 7f87c6b7a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87c00d1c40 0x7f87c01602c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:23.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.589+0000 7f87c6b7a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87c015d360 0x7f87c00b6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:23.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.589+0000 7f87c6b7a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00cc090 con 0x7f87c00d1c40 2023-12-11T17:10:23.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.589+0000 7f87c6b7a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00b6d60 con 0x7f87c015d360 2023-12-11T17:10:23.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.589+0000 7f87c6b7a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87c00cb480 con 0x7f87c00cece0 2023-12-11T17:10:23.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.589+0000 7f87c5377640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87c00d1c40 0x7f87c01602c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:23.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.589+0000 7f87c5377640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87c00d1c40 0x7f87c01602c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38166/0 (socket says 172.21.15.37:38166) 2023-12-11T17:10:23.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.589+0000 7f87c5377640 1 -- 172.21.15.37:0/2438141329 learned_addr learned my addr 172.21.15.37:0/2438141329 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:23.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.589+0000 7f87c5b78640 1 --2- 172.21.15.37:0/2438141329 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87c00cece0 0x7f87c00cae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:23.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.589+0000 7f87c6379640 1 --2- 172.21.15.37:0/2438141329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87c015d360 0x7f87c00b6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:23.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.590+0000 7f87c5377640 1 -- 172.21.15.37:0/2438141329 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87c00cece0 msgr2=0x7f87c00cae10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:23.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.590+0000 7f87c5377640 1 --2- 172.21.15.37:0/2438141329 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87c00cece0 0x7f87c00cae10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:23.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.590+0000 7f87c5377640 1 -- 172.21.15.37:0/2438141329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87c015d360 msgr2=0x7f87c00b6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:23.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.590+0000 7f87c5377640 1 --2- 172.21.15.37:0/2438141329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87c015d360 0x7f87c00b6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:23.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.590+0000 7f87c5377640 1 -- 172.21.15.37:0/2438141329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87bc009b30 con 0x7f87c00d1c40 2023-12-11T17:10:23.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.590+0000 7f87c5b78640 1 --2- 172.21.15.37:0/2438141329 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87c00cece0 0x7f87c00cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:10:23.593 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.590+0000 7f87c5377640 1 --2- 172.21.15.37:0/2438141329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87c00d1c40 0x7f87c01602c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f87b000c430 tx=0x7f87b000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:23.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.590+0000 7f87b67fc640 1 -- 172.21.15.37:0/2438141329 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b0011790 con 0x7f87c00d1c40 2023-12-11T17:10:23.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.590+0000 7f87b67fc640 1 -- 172.21.15.37:0/2438141329 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87b00118f0 con 0x7f87c00d1c40 2023-12-11T17:10:23.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.590+0000 7f87b67fc640 1 -- 172.21.15.37:0/2438141329 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87b0011ce0 con 0x7f87c00d1c40 2023-12-11T17:10:23.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.590+0000 7f87c6b7a640 1 -- 172.21.15.37:0/2438141329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87c00cb760 con 0x7f87c00d1c40 2023-12-11T17:10:23.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.590+0000 7f87c6b7a640 1 -- 172.21.15.37:0/2438141329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87c00cbd20 con 0x7f87c00d1c40 2023-12-11T17:10:23.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.592+0000 7f87c6b7a640 1 -- 172.21.15.37:0/2438141329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87c00678e0 con 0x7f87c00d1c40 2023-12-11T17:10:23.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.593+0000 7f87b67fc640 1 -- 172.21.15.37:0/2438141329 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f87b001c460 con 0x7f87c00d1c40 2023-12-11T17:10:23.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.594+0000 7f87b67fc640 1 --2- 172.21.15.37:0/2438141329 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f87a406ae40 0x7f87a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:23.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.594+0000 7f87b67fc640 1 -- 172.21.15.37:0/2438141329 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f87b00897c0 con 0x7f87c00d1c40 2023-12-11T17:10:23.595 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.594+0000 7f87c5b78640 1 --2- 172.21.15.37:0/2438141329 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f87a406ae40 0x7f87a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:23.596 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.595+0000 7f87c5b78640 1 --2- 172.21.15.37:0/2438141329 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f87a406ae40 0x7f87a406d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f87bc035000 tx=0x7f87bc030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:23.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.598+0000 7f87b67fc640 1 -- 172.21.15.37:0/2438141329 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f87b0054610 con 0x7f87c00d1c40 2023-12-11T17:10:23.791 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.790+0000 7f87c6b7a640 1 -- 172.21.15.37:0/2438141329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f87c00673f0 con 0x7f87c00d1c40 2023-12-11T17:10:23.792 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.791+0000 7f87b67fc640 1 -- 172.21.15.37:0/2438141329 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7f87b0057c30 con 0x7f87c00d1c40 2023-12-11T17:10:23.793 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:10:23.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.794+0000 7f87c6b7a640 1 -- 172.21.15.37:0/2438141329 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f87a406ae40 msgr2=0x7f87a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:23.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.794+0000 7f87c6b7a640 1 --2- 172.21.15.37:0/2438141329 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f87a406ae40 0x7f87a406d300 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f87bc035000 tx=0x7f87bc030000 comp rx=0 tx=0).stop 2023-12-11T17:10:23.795 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.794+0000 7f87c6b7a640 1 -- 172.21.15.37:0/2438141329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87c00d1c40 msgr2=0x7f87c01602c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:23.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.794+0000 7f87c6b7a640 1 --2- 172.21.15.37:0/2438141329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87c00d1c40 0x7f87c01602c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f87b000c430 tx=0x7f87b000c8f0 comp rx=0 tx=0).stop 2023-12-11T17:10:23.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.794+0000 7f87c6b7a640 1 -- 172.21.15.37:0/2438141329 shutdown_connections 2023-12-11T17:10:23.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.794+0000 7f87c6b7a640 1 --2- 172.21.15.37:0/2438141329 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f87a406ae40 0x7f87a406d300 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:23.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.794+0000 7f87c6b7a640 1 --2- 172.21.15.37:0/2438141329 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87c015d360 0x7f87c00b6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:23.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.794+0000 7f87c6b7a640 1 --2- 172.21.15.37:0/2438141329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f87c00d1c40 0x7f87c01602c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:23.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.794+0000 7f87c6b7a640 1 --2- 172.21.15.37:0/2438141329 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f87c00cece0 0x7f87c00cae10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:23.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.794+0000 7f87c6b7a640 1 -- 172.21.15.37:0/2438141329 >> 172.21.15.37:0/2438141329 conn(0x7f87c009c230 msgr2=0x7f87c00b2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:23.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.794+0000 7f87c6b7a640 1 -- 172.21.15.37:0/2438141329 shutdown_connections 2023-12-11T17:10:23.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:23.794+0000 7f87c6b7a640 1 -- 172.21.15.37:0/2438141329 wait complete. 2023-12-11T17:10:23.812 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T17:10:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.025+0000 7f6adf59e640 1 Processor -- start 2023-12-11T17:10:24.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.025+0000 7f6adf59e640 1 -- start start 2023-12-11T17:10:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.026+0000 7f6adf59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6ae00d13c0 0x7f6ae00ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.026+0000 7f6adf59e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f6ae00d0d70 0x7f6ae00d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.026+0000 7f6adf59e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ae00b2280 con 0x7f6ae00cf6a0 2023-12-11T17:10:24.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.026+0000 7f6adf59e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae00cee70 con 0x7f6ae00d13c0 2023-12-11T17:10:24.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.026+0000 7f6adf59e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae00d11c0 con 0x7f6ae00d0d70 2023-12-11T17:10:24.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.026+0000 7f6ade59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6ae00d13c0 0x7f6ae00ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:24.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.026+0000 7f6ade59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6ae00d13c0 0x7f6ae00ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38168/0 (socket says 172.21.15.37:38168) 2023-12-11T17:10:24.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.026+0000 7f6ade59c640 1 -- 172.21.15.37:0/2865272871 learned_addr learned my addr 172.21.15.37:0/2865272871 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:24.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.027+0000 7f6addd9b640 1 --2- 172.21.15.37:0/2865272871 >> v2:172.21.15.151:3300/0 conn(0x7f6ae00d0d70 0x7f6ae00d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:24.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.027+0000 7f6ade59c640 1 -- 172.21.15.37:0/2865272871 >> v2:172.21.15.151:3300/0 conn(0x7f6ae00d0d70 msgr2=0x7f6ae00d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:24.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.027+0000 7f6ade59c640 1 --2- 172.21.15.37:0/2865272871 >> v2:172.21.15.151:3300/0 conn(0x7f6ae00d0d70 0x7f6ae00d17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.027+0000 7f6ade59c640 1 -- 172.21.15.37:0/2865272871 >> v1:172.21.15.151:6789/0 conn(0x7f6ae00cf6a0 legacy=0x7f6ae00cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.027+0000 7f6ade59c640 1 -- 172.21.15.37:0/2865272871 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae00d1ce0 con 0x7f6ae00d13c0 2023-12-11T17:10:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.028+0000 7f6ade59c640 1 --2- 172.21.15.37:0/2865272871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ae00d13c0 0x7f6ae00ce5b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00cf040 tx=0x7f6ad002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2644b07636280ea9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.028+0000 7f6add59a640 1 -- 172.21.15.37:0/2865272871 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad002c9f0 con 0x7f6ae00d13c0 2023-12-11T17:10:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.028+0000 7f6add59a640 1 -- 172.21.15.37:0/2865272871 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad002cb50 con 0x7f6ae00d13c0 2023-12-11T17:10:24.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.028+0000 7f6add59a640 1 -- 172.21.15.37:0/2865272871 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad00343f0 con 0x7f6ae00d13c0 2023-12-11T17:10:24.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.029+0000 7f6adf59e640 1 -- 172.21.15.37:0/2865272871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ae00d13c0 msgr2=0x7f6ae00ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:24.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.029+0000 7f6adf59e640 1 --2- 172.21.15.37:0/2865272871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ae00d13c0 0x7f6ae00ce5b0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f6ae00cf040 tx=0x7f6ad002be50 comp rx=0 tx=0).stop 2023-12-11T17:10:24.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.029+0000 7f6adf59e640 1 -- 172.21.15.37:0/2865272871 shutdown_connections 2023-12-11T17:10:24.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.029+0000 7f6adf59e640 1 --2- 172.21.15.37:0/2865272871 >> v2:172.21.15.151:3300/0 conn(0x7f6ae00d0d70 0x7f6ae00d17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:24.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.029+0000 7f6adf59e640 1 --2- 172.21.15.37:0/2865272871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ae00d13c0 0x7f6ae00ce5b0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:24.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.029+0000 7f6adf59e640 1 -- 172.21.15.37:0/2865272871 >> 172.21.15.37:0/2865272871 conn(0x7f6ae009c260 msgr2=0x7f6ae00d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:24.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.029+0000 7f6adf59e640 1 -- 172.21.15.37:0/2865272871 shutdown_connections 2023-12-11T17:10:24.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.029+0000 7f6adf59e640 1 -- 172.21.15.37:0/2865272871 wait complete. 2023-12-11T17:10:24.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.031+0000 7f6adf59e640 1 Processor -- start 2023-12-11T17:10:24.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.031+0000 7f6adf59e640 1 -- start start 2023-12-11T17:10:24.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.032+0000 7f6adf59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ae00cf6a0 0x7f6ae00b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:24.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.032+0000 7f6adf59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ae00d0d70 0x7f6ae01587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:24.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.032+0000 7f6adf59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ae00d13c0 0x7f6ae0158d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:24.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.032+0000 7f6adf59e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae0159c70 con 0x7f6ae00d13c0 2023-12-11T17:10:24.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.032+0000 7f6adf59e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae0159250 con 0x7f6ae00d0d70 2023-12-11T17:10:24.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.032+0000 7f6adf59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae00a0810 con 0x7f6ae00cf6a0 2023-12-11T17:10:24.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.032+0000 7f6aded9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ae00d13c0 0x7f6ae0158d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:24.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.032+0000 7f6aded9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ae00d13c0 0x7f6ae0158d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38176/0 (socket says 172.21.15.37:38176) 2023-12-11T17:10:24.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.032+0000 7f6aded9d640 1 -- 172.21.15.37:0/3391747751 learned_addr learned my addr 172.21.15.37:0/3391747751 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:24.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.033+0000 7f6ade59c640 1 --2- 172.21.15.37:0/3391747751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ae00cf6a0 0x7f6ae00b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:24.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.033+0000 7f6addd9b640 1 --2- 172.21.15.37:0/3391747751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ae00d0d70 0x7f6ae01587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:24.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.033+0000 7f6aded9d640 1 -- 172.21.15.37:0/3391747751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ae00cf6a0 msgr2=0x7f6ae00b2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:24.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.033+0000 7f6aded9d640 1 --2- 172.21.15.37:0/3391747751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ae00cf6a0 0x7f6ae00b2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:24.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.033+0000 7f6aded9d640 1 -- 172.21.15.37:0/3391747751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ae00d0d70 msgr2=0x7f6ae01587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:24.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.033+0000 7f6aded9d640 1 --2- 172.21.15.37:0/3391747751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ae00d0d70 0x7f6ae01587d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:24.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.033+0000 7f6aded9d640 1 -- 172.21.15.37:0/3391747751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad0009b30 con 0x7f6ae00d13c0 2023-12-11T17:10:24.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.033+0000 7f6addd9b640 1 --2- 172.21.15.37:0/3391747751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ae00d0d70 0x7f6ae01587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:24.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.033+0000 7f6aded9d640 1 --2- 172.21.15.37:0/3391747751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ae00d13c0 0x7f6ae0158d10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800c440 tx=0x7f6ad800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:24.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.033+0000 7f6ad6ffd640 1 -- 172.21.15.37:0/3391747751 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad80035f0 con 0x7f6ae00d13c0 2023-12-11T17:10:24.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.034+0000 7f6ad6ffd640 1 -- 172.21.15.37:0/3391747751 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad8003770 con 0x7f6ae00d13c0 2023-12-11T17:10:24.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.034+0000 7f6ad6ffd640 1 -- 172.21.15.37:0/3391747751 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad8003b20 con 0x7f6ae00d13c0 2023-12-11T17:10:24.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.034+0000 7f6adf59e640 1 -- 172.21.15.37:0/3391747751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae00cb150 con 0x7f6ae00d13c0 2023-12-11T17:10:24.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.034+0000 7f6adf59e640 1 -- 172.21.15.37:0/3391747751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae00cb710 con 0x7f6ae00d13c0 2023-12-11T17:10:24.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.035+0000 7f6adf59e640 1 -- 172.21.15.37:0/3391747751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae0074450 con 0x7f6ae00d13c0 2023-12-11T17:10:24.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.036+0000 7f6ad6ffd640 1 -- 172.21.15.37:0/3391747751 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6ad8003c80 con 0x7f6ae00d13c0 2023-12-11T17:10:24.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.037+0000 7f6ad6ffd640 1 --2- 172.21.15.37:0/3391747751 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6ac006ae40 0x7f6ac006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:24.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.037+0000 7f6ad6ffd640 1 -- 172.21.15.37:0/3391747751 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6ad8088980 con 0x7f6ae00d13c0 2023-12-11T17:10:24.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.038+0000 7f6ade59c640 1 --2- 172.21.15.37:0/3391747751 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6ac006ae40 0x7f6ac006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:24.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.039+0000 7f6ade59c640 1 --2- 172.21.15.37:0/3391747751 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6ac006ae40 0x7f6ac006d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0035000 tx=0x7f6ad0030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:24.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.042+0000 7f6ad6ffd640 1 -- 172.21.15.37:0/3391747751 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6ad8053730 con 0x7f6ae00d13c0 2023-12-11T17:10:24.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.278+0000 7f6adf59e640 1 -- 172.21.15.37:0/3391747751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ae00cd2c0 con 0x7f6ae00d13c0 2023-12-11T17:10:24.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.279+0000 7f6ad6ffd640 1 -- 172.21.15.37:0/3391747751 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f6ad8056d50 con 0x7f6ae00d13c0 2023-12-11T17:10:24.280 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:24.280 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2395601865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2395601865},{"type":"v1","addr":"172.21.15.151:6835","nonce":2395601865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1535809271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1535809271},{"type":"v1","addr":"172.21.15.151:6837","nonce":1535809271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2590175074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2590175074},{"type":"v1","addr":"172.21.15.37:6833","nonce":2590175074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-11T17:09:44.643511+0000","modified":"2023-12-11T17:10:12.829357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/2348606057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2348606057},{"type":"v1","addr":"172.21.15.37:6835","nonce":2348606057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T17:10:24.281 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-12-11T17:10:24.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.281+0000 7f6adf59e640 1 -- 172.21.15.37:0/3391747751 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6ac006ae40 msgr2=0x7f6ac006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:24.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.281+0000 7f6adf59e640 1 --2- 172.21.15.37:0/3391747751 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6ac006ae40 0x7f6ac006d300 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6ad0035000 tx=0x7f6ad0030000 comp rx=0 tx=0).stop 2023-12-11T17:10:24.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.281+0000 7f6adf59e640 1 -- 172.21.15.37:0/3391747751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ae00d13c0 msgr2=0x7f6ae0158d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:24.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.281+0000 7f6adf59e640 1 --2- 172.21.15.37:0/3391747751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ae00d13c0 0x7f6ae0158d10 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f6ad800c440 tx=0x7f6ad800c900 comp rx=0 tx=0).stop 2023-12-11T17:10:24.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.282+0000 7f6adf59e640 1 -- 172.21.15.37:0/3391747751 shutdown_connections 2023-12-11T17:10:24.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.282+0000 7f6adf59e640 1 --2- 172.21.15.37:0/3391747751 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f6ac006ae40 0x7f6ac006d300 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:24.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.282+0000 7f6adf59e640 1 --2- 172.21.15.37:0/3391747751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ae00d0d70 0x7f6ae01587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:24.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.282+0000 7f6adf59e640 1 --2- 172.21.15.37:0/3391747751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6ae00d13c0 0x7f6ae0158d10 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:24.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.282+0000 7f6adf59e640 1 --2- 172.21.15.37:0/3391747751 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f6ae00cf6a0 0x7f6ae00b2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:24.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.282+0000 7f6adf59e640 1 -- 172.21.15.37:0/3391747751 >> 172.21.15.37:0/3391747751 conn(0x7f6ae009c260 msgr2=0x7f6ae00b6110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:24.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.282+0000 7f6adf59e640 1 -- 172.21.15.37:0/3391747751 shutdown_connections 2023-12-11T17:10:24.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.282+0000 7f6adf59e640 1 -- 172.21.15.37:0/3391747751 wait complete. 2023-12-11T17:10:24.301 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:10:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.525+0000 7f3185e39640 1 Processor -- start 2023-12-11T17:10:24.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.526+0000 7f3185e39640 1 -- start start 2023-12-11T17:10:24.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.527+0000 7f3185e39640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f318015d150 0x7f3180071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:24.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.527+0000 7f3185e39640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f318006dd00 0x7f3180070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:24.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.527+0000 7f3185e39640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31800abd20 con 0x7f31800705b0 2023-12-11T17:10:24.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.527+0000 7f3185e39640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3180070a20 con 0x7f318015d150 2023-12-11T17:10:24.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.527+0000 7f3185e39640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f318015d530 con 0x7f318006dd00 2023-12-11T17:10:24.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.527+0000 7f3185638640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f31800705b0 0x7f3180160cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41920/0 (socket says 172.21.15.37:41920) 2023-12-11T17:10:24.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.527+0000 7f3185638640 1 -- 172.21.15.37:0/938116747 learned_addr learned my addr 172.21.15.37:0/938116747 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:24.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.527+0000 7f3184e37640 1 --2- 172.21.15.37:0/938116747 >> v2:172.21.15.37:3300/0 conn(0x7f318015d150 0x7f3180071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:24.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.528+0000 7f317ffff640 1 --2- 172.21.15.37:0/938116747 >> v2:172.21.15.151:3300/0 conn(0x7f318006dd00 0x7f3180070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:24.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.528+0000 7f3184e37640 1 -- 172.21.15.37:0/938116747 >> v2:172.21.15.151:3300/0 conn(0x7f318006dd00 msgr2=0x7f3180070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:24.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.528+0000 7f3184e37640 1 --2- 172.21.15.37:0/938116747 >> v2:172.21.15.151:3300/0 conn(0x7f318006dd00 0x7f3180070070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:24.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.528+0000 7f3184e37640 1 -- 172.21.15.37:0/938116747 >> v1:172.21.15.37:6789/0 conn(0x7f31800705b0 legacy=0x7f3180160cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:24.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.528+0000 7f3184e37640 1 -- 172.21.15.37:0/938116747 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31800b2950 con 0x7f318015d150 2023-12-11T17:10:24.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.528+0000 7f317f7fe640 1 -- 172.21.15.37:0/938116747 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170494084 0 0) 0x7f31800abd20 con 0x7f31800705b0 2023-12-11T17:10:24.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.529+0000 7f3184e37640 1 --2- 172.21.15.37:0/938116747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f318015d150 0x7f3180071ee0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f318006bb80 tx=0x7f317402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631438f8fd0190da server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:24.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.530+0000 7f317f7fe640 1 -- 172.21.15.37:0/938116747 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3174031830 con 0x7f318015d150 2023-12-11T17:10:24.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.530+0000 7f317f7fe640 1 -- 172.21.15.37:0/938116747 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3174031990 con 0x7f318015d150 2023-12-11T17:10:24.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.530+0000 7f317f7fe640 1 -- 172.21.15.37:0/938116747 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3174031d20 con 0x7f318015d150 2023-12-11T17:10:24.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.530+0000 7f3185e39640 1 -- 172.21.15.37:0/938116747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f318015d150 msgr2=0x7f3180071ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:24.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.530+0000 7f3185e39640 1 --2- 172.21.15.37:0/938116747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f318015d150 0x7f3180071ee0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f318006bb80 tx=0x7f317402b8d0 comp rx=0 tx=0).stop 2023-12-11T17:10:24.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.530+0000 7f3185e39640 1 -- 172.21.15.37:0/938116747 shutdown_connections 2023-12-11T17:10:24.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.530+0000 7f3185e39640 1 --2- 172.21.15.37:0/938116747 >> v2:172.21.15.151:3300/0 conn(0x7f318006dd00 0x7f3180070070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:24.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.530+0000 7f3185e39640 1 --2- 172.21.15.37:0/938116747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f318015d150 0x7f3180071ee0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:24.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.530+0000 7f3185e39640 1 -- 172.21.15.37:0/938116747 >> 172.21.15.37:0/938116747 conn(0x7f31800b0860 msgr2=0x7f31800b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:24.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.530+0000 7f3185e39640 1 -- 172.21.15.37:0/938116747 shutdown_connections 2023-12-11T17:10:24.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.530+0000 7f3185e39640 1 -- 172.21.15.37:0/938116747 wait complete. 2023-12-11T17:10:24.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.532+0000 7f3185e39640 1 Processor -- start 2023-12-11T17:10:24.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.532+0000 7f3185e39640 1 -- start start 2023-12-11T17:10:24.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.533+0000 7f3185e39640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f318006dd00 0x7f318014e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:24.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.533+0000 7f3185e39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31800705b0 0x7f3180147760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:24.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.533+0000 7f3185e39640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f318015d150 0x7f3180147f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:24.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.533+0000 7f3185e39640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3180147ca0 con 0x7f31800705b0 2023-12-11T17:10:24.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.533+0000 7f3185e39640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3180148460 con 0x7f318015d150 2023-12-11T17:10:24.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.533+0000 7f3185e39640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3180148690 con 0x7f318006dd00 2023-12-11T17:10:24.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.533+0000 7f317ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31800705b0 0x7f3180147760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:24.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.534+0000 7f317ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31800705b0 0x7f3180147760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38186/0 (socket says 172.21.15.37:38186) 2023-12-11T17:10:24.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.534+0000 7f317ffff640 1 -- 172.21.15.37:0/253158589 learned_addr learned my addr 172.21.15.37:0/253158589 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:24.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.534+0000 7f3185638640 1 --2- 172.21.15.37:0/253158589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f318015d150 0x7f3180147f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:24.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.534+0000 7f317ffff640 1 -- 172.21.15.37:0/253158589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f318006dd00 msgr2=0x7f318014e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:24.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.534+0000 7f3184e37640 1 --2- 172.21.15.37:0/253158589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f318006dd00 0x7f318014e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:24.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.534+0000 7f317ffff640 1 --2- 172.21.15.37:0/253158589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f318006dd00 0x7f318014e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:24.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.534+0000 7f317ffff640 1 -- 172.21.15.37:0/253158589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f318015d150 msgr2=0x7f3180147f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:24.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.534+0000 7f317ffff640 1 --2- 172.21.15.37:0/253158589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f318015d150 0x7f3180147f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:24.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.534+0000 7f317ffff640 1 -- 172.21.15.37:0/253158589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3174009400 con 0x7f31800705b0 2023-12-11T17:10:24.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.534+0000 7f3185638640 1 --2- 172.21.15.37:0/253158589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f318015d150 0x7f3180147f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:24.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.534+0000 7f317ffff640 1 --2- 172.21.15.37:0/253158589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31800705b0 0x7f3180147760 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f316c00e870 tx=0x7f316c00ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:24.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.535+0000 7f317d7fa640 1 -- 172.21.15.37:0/253158589 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c0094f0 con 0x7f31800705b0 2023-12-11T17:10:24.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.535+0000 7f317d7fa640 1 -- 172.21.15.37:0/253158589 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f316c00c940 con 0x7f31800705b0 2023-12-11T17:10:24.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.535+0000 7f317d7fa640 1 -- 172.21.15.37:0/253158589 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f316c00ccd0 con 0x7f31800705b0 2023-12-11T17:10:24.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.535+0000 7f3185e39640 1 -- 172.21.15.37:0/253158589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3180148970 con 0x7f31800705b0 2023-12-11T17:10:24.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.535+0000 7f3185e39640 1 -- 172.21.15.37:0/253158589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3180148f30 con 0x7f31800705b0 2023-12-11T17:10:24.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.536+0000 7f3185e39640 1 -- 172.21.15.37:0/253158589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3180074450 con 0x7f31800705b0 2023-12-11T17:10:24.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.537+0000 7f317d7fa640 1 -- 172.21.15.37:0/253158589 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f316c013470 con 0x7f31800705b0 2023-12-11T17:10:24.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.538+0000 7f317d7fa640 1 --2- 172.21.15.37:0/253158589 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f316406ae40 0x7f316406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:24.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.538+0000 7f317d7fa640 1 -- 172.21.15.37:0/253158589 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f316c089ac0 con 0x7f31800705b0 2023-12-11T17:10:24.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.539+0000 7f3184e37640 1 --2- 172.21.15.37:0/253158589 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f316406ae40 0x7f316406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:24.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.540+0000 7f3184e37640 1 --2- 172.21.15.37:0/253158589 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f316406ae40 0x7f316406d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3174036000 tx=0x7f3174008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:24.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.542+0000 7f317d7fa640 1 -- 172.21.15.37:0/253158589 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f316c0547e0 con 0x7f31800705b0 2023-12-11T17:10:24.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.739+0000 7f3185e39640 1 -- 172.21.15.37:0/253158589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f318009ce80 con 0x7f31800705b0 2023-12-11T17:10:24.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.743+0000 7f317d7fa640 1 -- 172.21.15.37:0/253158589 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f316c017090 con 0x7f31800705b0 2023-12-11T17:10:24.744 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:24.745 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:09:49.715938+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:10:24.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.745+0000 7f3185e39640 1 -- 172.21.15.37:0/253158589 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f316406ae40 msgr2=0x7f316406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:24.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.745+0000 7f3185e39640 1 --2- 172.21.15.37:0/253158589 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f316406ae40 0x7f316406d300 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f3174036000 tx=0x7f3174008030 comp rx=0 tx=0).stop 2023-12-11T17:10:24.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.745+0000 7f3185e39640 1 -- 172.21.15.37:0/253158589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31800705b0 msgr2=0x7f3180147760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:24.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.745+0000 7f3185e39640 1 --2- 172.21.15.37:0/253158589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31800705b0 0x7f3180147760 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f316c00e870 tx=0x7f316c00ed30 comp rx=0 tx=0).stop 2023-12-11T17:10:24.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.746+0000 7f3185e39640 1 -- 172.21.15.37:0/253158589 shutdown_connections 2023-12-11T17:10:24.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.746+0000 7f3185e39640 1 --2- 172.21.15.37:0/253158589 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f316406ae40 0x7f316406d300 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:24.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.746+0000 7f3185e39640 1 --2- 172.21.15.37:0/253158589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f318015d150 0x7f3180147f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:24.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.746+0000 7f3185e39640 1 --2- 172.21.15.37:0/253158589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31800705b0 0x7f3180147760 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:24.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.746+0000 7f3185e39640 1 --2- 172.21.15.37:0/253158589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f318006dd00 0x7f318014e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:24.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.746+0000 7f3185e39640 1 -- 172.21.15.37:0/253158589 >> 172.21.15.37:0/253158589 conn(0x7f31800b0860 msgr2=0x7f31800ad280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:24.747 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.746+0000 7f3185e39640 1 -- 172.21.15.37:0/253158589 shutdown_connections 2023-12-11T17:10:24.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.746+0000 7f3185e39640 1 -- 172.21.15.37:0/253158589 wait complete. 2023-12-11T17:10:24.768 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T17:09:38.415636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T17:09:42.786774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T17:09:43.660585+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-11T17:09:47.272351+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-11T17:10:24.769 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T17:10:24.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.995+0000 7fd241c7c640 1 Processor -- start 2023-12-11T17:10:24.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.995+0000 7fd241c7c640 1 -- start start 2023-12-11T17:10:24.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.996+0000 7fd241c7c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd23c0d00d0 0x7fd23c0b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:24.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.996+0000 7fd241c7c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd23c0d16d0 0x7fd23c0b3870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:24.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.996+0000 7fd241c7c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd23c0b28e0 con 0x7fd23c15d490 2023-12-11T17:10:24.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.996+0000 7fd241c7c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd23c0b2ea0 con 0x7fd23c0d00d0 2023-12-11T17:10:24.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.996+0000 7fd241c7c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0d1c40 con 0x7fd23c0d16d0 2023-12-11T17:10:24.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.997+0000 7fd23affd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd23c0d00d0 0x7fd23c0b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:24.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.997+0000 7fd23affd640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd23c0d00d0 0x7fd23c0b3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:59018/0 (socket says 172.21.15.37:59018) 2023-12-11T17:10:24.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.997+0000 7fd23affd640 1 -- 172.21.15.37:0/2949271858 learned_addr learned my addr 172.21.15.37:0/2949271858 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:24.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.997+0000 7fd23bfff640 1 --2- 172.21.15.37:0/2949271858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd23c0d16d0 0x7fd23c0b3870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:24.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.997+0000 7fd23affd640 1 -- 172.21.15.37:0/2949271858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd23c0d16d0 msgr2=0x7fd23c0b3870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:24.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.997+0000 7fd23affd640 1 --2- 172.21.15.37:0/2949271858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd23c0d16d0 0x7fd23c0b3870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:24.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.997+0000 7fd23affd640 1 -- 172.21.15.37:0/2949271858 >> v1:172.21.15.151:6789/0 conn(0x7fd23c15d490 legacy=0x7fd23c0cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:24.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.997+0000 7fd23affd640 1 -- 172.21.15.37:0/2949271858 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd23c0d1f20 con 0x7fd23c0d00d0 2023-12-11T17:10:25.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:24.999+0000 7fd23affd640 1 --2- 172.21.15.37:0/2949271858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd23c0d00d0 0x7fd23c0b3330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd224009870 tx=0x7fd22402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=90e4e44182f9df9a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:25.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.000+0000 7fd23a7fc640 1 -- 172.21.15.37:0/2949271858 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd224030840 con 0x7fd23c0d00d0 2023-12-11T17:10:25.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.000+0000 7fd23a7fc640 1 -- 172.21.15.37:0/2949271858 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2240309a0 con 0x7fd23c0d00d0 2023-12-11T17:10:25.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.000+0000 7fd23a7fc640 1 -- 172.21.15.37:0/2949271858 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd224030d30 con 0x7fd23c0d00d0 2023-12-11T17:10:25.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.000+0000 7fd241c7c640 1 -- 172.21.15.37:0/2949271858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd23c0d00d0 msgr2=0x7fd23c0b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:25.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.000+0000 7fd241c7c640 1 --2- 172.21.15.37:0/2949271858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd23c0d00d0 0x7fd23c0b3330 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd224009870 tx=0x7fd22402b980 comp rx=0 tx=0).stop 2023-12-11T17:10:25.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.000+0000 7fd241c7c640 1 -- 172.21.15.37:0/2949271858 shutdown_connections 2023-12-11T17:10:25.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.000+0000 7fd241c7c640 1 --2- 172.21.15.37:0/2949271858 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd23c0d16d0 0x7fd23c0b3870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:25.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.000+0000 7fd241c7c640 1 --2- 172.21.15.37:0/2949271858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd23c0d00d0 0x7fd23c0b3330 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:25.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.000+0000 7fd241c7c640 1 -- 172.21.15.37:0/2949271858 >> 172.21.15.37:0/2949271858 conn(0x7fd23c09c430 msgr2=0x7fd23c0d30f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:25.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.001+0000 7fd241c7c640 1 -- 172.21.15.37:0/2949271858 shutdown_connections 2023-12-11T17:10:25.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.001+0000 7fd241c7c640 1 -- 172.21.15.37:0/2949271858 wait complete. 2023-12-11T17:10:25.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.002+0000 7fd241c7c640 1 Processor -- start 2023-12-11T17:10:25.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.003+0000 7fd241c7c640 1 -- start start 2023-12-11T17:10:25.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.003+0000 7fd241c7c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd23c0d00d0 0x7fd23c0cc4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:25.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.003+0000 7fd241c7c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd23c0d16d0 0x7fd23c15d870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:25.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.003+0000 7fd241c7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd23c15d490 0x7fd23c15b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:25.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.003+0000 7fd241c7c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c15ddb0 con 0x7fd23c15d490 2023-12-11T17:10:25.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.003+0000 7fd241c7c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c15b700 con 0x7fd23c0d00d0 2023-12-11T17:10:25.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.003+0000 7fd241c7c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd23c0b7010 con 0x7fd23c0d16d0 2023-12-11T17:10:25.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.004+0000 7fd23bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd23c15d490 0x7fd23c15b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:25.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.004+0000 7fd23bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd23c15d490 0x7fd23c15b1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38190/0 (socket says 172.21.15.37:38190) 2023-12-11T17:10:25.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.004+0000 7fd23bfff640 1 -- 172.21.15.37:0/511140452 learned_addr learned my addr 172.21.15.37:0/511140452 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:25.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.004+0000 7fd23b7fe640 1 --2- 172.21.15.37:0/511140452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd23c0d00d0 0x7fd23c0cc4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:25.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.004+0000 7fd23bfff640 1 -- 172.21.15.37:0/511140452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd23c0d16d0 msgr2=0x7fd23c15d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:25.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.004+0000 7fd23bfff640 1 --2- 172.21.15.37:0/511140452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd23c0d16d0 0x7fd23c15d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:25.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.004+0000 7fd23bfff640 1 -- 172.21.15.37:0/511140452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd23c0d00d0 msgr2=0x7fd23c0cc4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:25.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.004+0000 7fd23bfff640 1 --2- 172.21.15.37:0/511140452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd23c0d00d0 0x7fd23c0cc4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:25.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.004+0000 7fd23bfff640 1 -- 172.21.15.37:0/511140452 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2240094d0 con 0x7fd23c15d490 2023-12-11T17:10:25.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.004+0000 7fd23b7fe640 1 --2- 172.21.15.37:0/511140452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd23c0d00d0 0x7fd23c0cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:25.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.005+0000 7fd23bfff640 1 --2- 172.21.15.37:0/511140452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd23c15d490 0x7fd23c15b1c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd23400e930 tx=0x7fd23400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:25.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.005+0000 7fd233fff640 1 -- 172.21.15.37:0/511140452 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd234009690 con 0x7fd23c15d490 2023-12-11T17:10:25.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.005+0000 7fd233fff640 1 -- 172.21.15.37:0/511140452 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd23400c980 con 0x7fd23c15d490 2023-12-11T17:10:25.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.005+0000 7fd241c7c640 1 -- 172.21.15.37:0/511140452 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd23c0b72f0 con 0x7fd23c15d490 2023-12-11T17:10:25.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.005+0000 7fd233fff640 1 -- 172.21.15.37:0/511140452 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd23400cd30 con 0x7fd23c15d490 2023-12-11T17:10:25.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.005+0000 7fd241c7c640 1 -- 172.21.15.37:0/511140452 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd23c0b78b0 con 0x7fd23c15d490 2023-12-11T17:10:25.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.006+0000 7fd241c7c640 1 -- 172.21.15.37:0/511140452 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd23c0673f0 con 0x7fd23c15d490 2023-12-11T17:10:25.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.007+0000 7fd233fff640 1 -- 172.21.15.37:0/511140452 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd234013470 con 0x7fd23c15d490 2023-12-11T17:10:25.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.008+0000 7fd233fff640 1 --2- 172.21.15.37:0/511140452 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fd21c06ae40 0x7fd21c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:25.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.008+0000 7fd233fff640 1 -- 172.21.15.37:0/511140452 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fd234089ba0 con 0x7fd23c15d490 2023-12-11T17:10:25.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.009+0000 7fd23b7fe640 1 --2- 172.21.15.37:0/511140452 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fd21c06ae40 0x7fd21c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:25.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.010+0000 7fd23b7fe640 1 --2- 172.21.15.37:0/511140452 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fd21c06ae40 0x7fd21c06d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0012e0 tx=0x7fd22c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:25.014 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.013+0000 7fd233fff640 1 -- 172.21.15.37:0/511140452 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd234054990 con 0x7fd23c15d490 2023-12-11T17:10:25.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.206+0000 7fd241c7c640 1 -- 172.21.15.37:0/511140452 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd23c15cc20 con 0x7fd23c15d490 2023-12-11T17:10:25.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.207+0000 7fd233fff640 1 -- 172.21.15.37:0/511140452 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2340210a0 con 0x7fd23c15d490 2023-12-11T17:10:25.208 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-11T17:10:25.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.210+0000 7fd241c7c640 1 -- 172.21.15.37:0/511140452 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fd21c06ae40 msgr2=0x7fd21c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:25.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.210+0000 7fd241c7c640 1 --2- 172.21.15.37:0/511140452 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fd21c06ae40 0x7fd21c06d300 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fd22c0012e0 tx=0x7fd22c009040 comp rx=0 tx=0).stop 2023-12-11T17:10:25.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.210+0000 7fd241c7c640 1 -- 172.21.15.37:0/511140452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd23c15d490 msgr2=0x7fd23c15b1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:25.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.210+0000 7fd241c7c640 1 --2- 172.21.15.37:0/511140452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd23c15d490 0x7fd23c15b1c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd23400e930 tx=0x7fd23400edf0 comp rx=0 tx=0).stop 2023-12-11T17:10:25.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.210+0000 7fd241c7c640 1 -- 172.21.15.37:0/511140452 shutdown_connections 2023-12-11T17:10:25.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.210+0000 7fd241c7c640 1 --2- 172.21.15.37:0/511140452 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fd21c06ae40 0x7fd21c06d300 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:25.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.210+0000 7fd241c7c640 1 --2- 172.21.15.37:0/511140452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd23c15d490 0x7fd23c15b1c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:25.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.210+0000 7fd241c7c640 1 --2- 172.21.15.37:0/511140452 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd23c0d16d0 0x7fd23c15d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:25.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.210+0000 7fd241c7c640 1 --2- 172.21.15.37:0/511140452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd23c0d00d0 0x7fd23c0cc4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:25.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.210+0000 7fd241c7c640 1 -- 172.21.15.37:0/511140452 >> 172.21.15.37:0/511140452 conn(0x7fd23c09c430 msgr2=0x7fd23c06c030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:25.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.210+0000 7fd241c7c640 1 -- 172.21.15.37:0/511140452 shutdown_connections 2023-12-11T17:10:25.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.210+0000 7fd241c7c640 1 -- 172.21.15.37:0/511140452 wait complete. 2023-12-11T17:10:25.231 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T17:10:25.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.455+0000 7f3ef2078640 1 Processor -- start 2023-12-11T17:10:25.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.455+0000 7f3ef2078640 1 -- start start 2023-12-11T17:10:25.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.457+0000 7f3ef2078640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3eec15d360 0x7f3eec0d3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:25.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.457+0000 7f3ef2078640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eec0cdf20 con 0x7f3eec0d1c40 2023-12-11T17:10:25.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.457+0000 7f3ef2078640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eec0ce200 con 0x7f3eec0cece0 2023-12-11T17:10:25.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.457+0000 7f3ef2078640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eec0ce4e0 con 0x7f3eec15d360 2023-12-11T17:10:25.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.457+0000 7f3ef1877640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3eec0d1c40 0x7f3eec0b28b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41930/0 (socket says 172.21.15.37:41930) 2023-12-11T17:10:25.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.457+0000 7f3ef1877640 1 -- 172.21.15.37:0/2862474086 learned_addr learned my addr 172.21.15.37:0/2862474086 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:25.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.457+0000 7f3ef1076640 1 --2- 172.21.15.37:0/2862474086 >> v2:172.21.15.151:3300/0 conn(0x7f3eec15d360 0x7f3eec0d3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:25.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.458+0000 7f3ee3fff640 1 -- 172.21.15.37:0/2862474086 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3061562886 0 0) 0x7f3eec0cdf20 con 0x7f3eec0d1c40 2023-12-11T17:10:25.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.458+0000 7f3ee3fff640 1 -- 172.21.15.37:0/2862474086 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ed8003520 con 0x7f3eec0d1c40 2023-12-11T17:10:25.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.458+0000 7f3ee3fff640 1 -- 172.21.15.37:0/2862474086 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3939282056 0 0) 0x7f3ed8003520 con 0x7f3eec0d1c40 2023-12-11T17:10:25.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.458+0000 7f3ee3fff640 1 -- 172.21.15.37:0/2862474086 >> v2:172.21.15.151:3300/0 conn(0x7f3eec15d360 msgr2=0x7f3eec0d3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:25.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.458+0000 7f3ee3fff640 1 --2- 172.21.15.37:0/2862474086 >> v2:172.21.15.151:3300/0 conn(0x7f3eec15d360 0x7f3eec0d3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.458+0000 7f3ee3fff640 1 -- 172.21.15.37:0/2862474086 >> v1:172.21.15.151:6789/0 conn(0x7f3eec0cece0 legacy=0x7f3eec0d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.458+0000 7f3ee3fff640 1 -- 172.21.15.37:0/2862474086 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec0ce7c0 con 0x7f3eec0d1c40 2023-12-11T17:10:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.458+0000 7f3ee3fff640 1 -- 172.21.15.37:0/2862474086 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f3ee40019f0 con 0x7f3eec0d1c40 2023-12-11T17:10:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.458+0000 7f3ee3fff640 1 -- 172.21.15.37:0/2862474086 >> v1:172.21.15.37:6789/0 conn(0x7f3eec0d1c40 legacy=0x7f3eec0b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.458+0000 7f3ee3fff640 1 --2- 172.21.15.37:0/2862474086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ed80039c0 0x7f3ed8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.458+0000 7f3ee3fff640 1 --2- 172.21.15.37:0/2862474086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ed80047c0 0x7f3ed8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.458+0000 7f3ee3fff640 1 --2- 172.21.15.37:0/2862474086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ed8005180 0x7f3ed800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.458+0000 7f3ee3fff640 1 -- 172.21.15.37:0/2862474086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0ce4e0 con 0x7f3ed80039c0 2023-12-11T17:10:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.458+0000 7f3ee3fff640 1 -- 172.21.15.37:0/2862474086 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed800c060 con 0x7f3ed80047c0 2023-12-11T17:10:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.458+0000 7f3ee3fff640 1 -- 172.21.15.37:0/2862474086 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed800c220 con 0x7f3ed8005180 2023-12-11T17:10:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.458+0000 7f3ef1076640 1 --2- 172.21.15.37:0/2862474086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ed80039c0 0x7f3ed8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.459+0000 7f3ef0875640 1 --2- 172.21.15.37:0/2862474086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ed80047c0 0x7f3ed8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.459+0000 7f3ef1076640 1 -- 172.21.15.37:0/2862474086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ed8005180 msgr2=0x7f3ed800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.459+0000 7f3ef1076640 1 --2- 172.21.15.37:0/2862474086 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3ed8005180 0x7f3ed800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:25.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.459+0000 7f3ef1076640 1 -- 172.21.15.37:0/2862474086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ed80047c0 msgr2=0x7f3ed8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:25.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.459+0000 7f3ef1076640 1 --2- 172.21.15.37:0/2862474086 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ed80047c0 0x7f3ed8004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:25.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.459+0000 7f3ef1076640 1 -- 172.21.15.37:0/2862474086 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ed8003520 con 0x7f3ed80039c0 2023-12-11T17:10:25.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.459+0000 7f3ef1877640 1 -- 172.21.15.37:0/2862474086 reap_dead start 2023-12-11T17:10:25.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.460+0000 7f3ef1076640 1 --2- 172.21.15.37:0/2862474086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ed80039c0 0x7f3ed8003de0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8009ac0 tx=0x7f3ed80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50238a2ad9fb4a3b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:25.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.460+0000 7f3ee3fff640 1 -- 172.21.15.37:0/2862474086 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee802c6b0 con 0x7f3ed80039c0 2023-12-11T17:10:25.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.460+0000 7f3ee3fff640 1 -- 172.21.15.37:0/2862474086 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee802c810 con 0x7f3ed80039c0 2023-12-11T17:10:25.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.460+0000 7f3ee3fff640 1 -- 172.21.15.37:0/2862474086 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee802cba0 con 0x7f3ed80039c0 2023-12-11T17:10:25.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.461+0000 7f3ef2078640 1 -- 172.21.15.37:0/2862474086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ed80039c0 msgr2=0x7f3ed8003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:25.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.461+0000 7f3ef2078640 1 --2- 172.21.15.37:0/2862474086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ed80039c0 0x7f3ed8003de0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8009ac0 tx=0x7f3ed80057f0 comp rx=0 tx=0).stop 2023-12-11T17:10:25.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.461+0000 7f3ef2078640 1 -- 172.21.15.37:0/2862474086 shutdown_connections 2023-12-11T17:10:25.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.461+0000 7f3ef2078640 1 --2- 172.21.15.37:0/2862474086 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3ed80039c0 0x7f3ed8003de0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:25.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.461+0000 7f3ef2078640 1 -- 172.21.15.37:0/2862474086 >> 172.21.15.37:0/2862474086 conn(0x7f3eec09c230 msgr2=0x7f3eec0d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:25.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.461+0000 7f3ef2078640 1 -- 172.21.15.37:0/2862474086 shutdown_connections 2023-12-11T17:10:25.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.461+0000 7f3ef2078640 1 -- 172.21.15.37:0/2862474086 wait complete. 2023-12-11T17:10:25.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.463+0000 7f3ef2078640 1 Processor -- start 2023-12-11T17:10:25.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.463+0000 7f3ef2078640 1 -- start start 2023-12-11T17:10:25.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.464+0000 7f3ef2078640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ed80039c0 0x7f3eec1576e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:25.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.464+0000 7f3ef2078640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3eec0cbff0 0x7f3eec0cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:25.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.464+0000 7f3ef2078640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec1583c0 0x7f3eec158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:25.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.464+0000 7f3ef2078640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0cce70 con 0x7f3eec1583c0 2023-12-11T17:10:25.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.464+0000 7f3ef2078640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec0cc990 con 0x7f3ed80039c0 2023-12-11T17:10:25.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.464+0000 7f3ef2078640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eec157f30 con 0x7f3eec0cbff0 2023-12-11T17:10:25.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.464+0000 7f3ef1877640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec1583c0 0x7f3eec158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:25.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.464+0000 7f3ef1877640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec1583c0 0x7f3eec158840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38206/0 (socket says 172.21.15.37:38206) 2023-12-11T17:10:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.464+0000 7f3ef1877640 1 -- 172.21.15.37:0/2084423938 learned_addr learned my addr 172.21.15.37:0/2084423938 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.465+0000 7f3ef0875640 1 --2- 172.21.15.37:0/2084423938 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3eec0cbff0 0x7f3eec0cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.465+0000 7f3ef1076640 1 --2- 172.21.15.37:0/2084423938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ed80039c0 0x7f3eec1576e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.465+0000 7f3ef1877640 1 -- 172.21.15.37:0/2084423938 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3eec0cbff0 msgr2=0x7f3eec0cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.465+0000 7f3ef1877640 1 --2- 172.21.15.37:0/2084423938 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3eec0cbff0 0x7f3eec0cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.465+0000 7f3ef1877640 1 -- 172.21.15.37:0/2084423938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ed80039c0 msgr2=0x7f3eec1576e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.465+0000 7f3ef1877640 1 --2- 172.21.15.37:0/2084423938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ed80039c0 0x7f3eec1576e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.465+0000 7f3ef1877640 1 -- 172.21.15.37:0/2084423938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eec0b4c50 con 0x7f3eec1583c0 2023-12-11T17:10:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.465+0000 7f3ef1076640 1 --2- 172.21.15.37:0/2084423938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ed80039c0 0x7f3eec1576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.465+0000 7f3ef1877640 1 --2- 172.21.15.37:0/2084423938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec1583c0 0x7f3eec158840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4001350 tx=0x7f3ee400cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.465+0000 7f3ee1ffb640 1 -- 172.21.15.37:0/2084423938 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee400cea0 con 0x7f3eec1583c0 2023-12-11T17:10:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.465+0000 7f3ee1ffb640 1 -- 172.21.15.37:0/2084423938 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ee400a590 con 0x7f3eec1583c0 2023-12-11T17:10:25.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.465+0000 7f3ee1ffb640 1 -- 172.21.15.37:0/2084423938 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ee400a920 con 0x7f3eec1583c0 2023-12-11T17:10:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.466+0000 7f3ef2078640 1 -- 172.21.15.37:0/2084423938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eec0b4f30 con 0x7f3eec1583c0 2023-12-11T17:10:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.466+0000 7f3ef2078640 1 -- 172.21.15.37:0/2084423938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eec0b54f0 con 0x7f3eec1583c0 2023-12-11T17:10:25.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.467+0000 7f3ef2078640 1 -- 172.21.15.37:0/2084423938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eec1580e0 con 0x7f3eec1583c0 2023-12-11T17:10:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.468+0000 7f3ee1ffb640 1 -- 172.21.15.37:0/2084423938 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3ee400aa80 con 0x7f3eec1583c0 2023-12-11T17:10:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.469+0000 7f3ee1ffb640 1 --2- 172.21.15.37:0/2084423938 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3ed006aec0 0x7f3ed006d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.469+0000 7f3ee1ffb640 1 -- 172.21.15.37:0/2084423938 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f3ee4088f20 con 0x7f3eec1583c0 2023-12-11T17:10:25.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.469+0000 7f3ef1076640 1 --2- 172.21.15.37:0/2084423938 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3ed006aec0 0x7f3ed006d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:25.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.470+0000 7f3ef1076640 1 --2- 172.21.15.37:0/2084423938 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3ed006aec0 0x7f3ed006d380 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8036000 tx=0x7f3ee8030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:25.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.473+0000 7f3ee1ffb640 1 -- 172.21.15.37:0/2084423938 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3eec1580e0 con 0x7f3eec1583c0 2023-12-11T17:10:25.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.666+0000 7f3ef2078640 1 -- 172.21.15.37:0/2084423938 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3eec0678e0 con 0x7f3eec1583c0 2023-12-11T17:10:25.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.667+0000 7f3ee1ffb640 1 -- 172.21.15.37:0/2084423938 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v25) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3ee4053dc0 con 0x7f3eec1583c0 2023-12-11T17:10:25.668 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:10:25.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.669+0000 7f3ef2078640 1 -- 172.21.15.37:0/2084423938 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3ed006aec0 msgr2=0x7f3ed006d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.669+0000 7f3ef2078640 1 --2- 172.21.15.37:0/2084423938 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3ed006aec0 0x7f3ed006d380 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3ee8036000 tx=0x7f3ee8030000 comp rx=0 tx=0).stop 2023-12-11T17:10:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.669+0000 7f3ef2078640 1 -- 172.21.15.37:0/2084423938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec1583c0 msgr2=0x7f3eec158840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.669+0000 7f3ef2078640 1 --2- 172.21.15.37:0/2084423938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec1583c0 0x7f3eec158840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f3ee4001350 tx=0x7f3ee400cc50 comp rx=0 tx=0).stop 2023-12-11T17:10:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.669+0000 7f3ef2078640 1 -- 172.21.15.37:0/2084423938 shutdown_connections 2023-12-11T17:10:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.669+0000 7f3ef2078640 1 --2- 172.21.15.37:0/2084423938 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3ed006aec0 0x7f3ed006d380 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.669+0000 7f3ef2078640 1 --2- 172.21.15.37:0/2084423938 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3eec1583c0 0x7f3eec158840 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.669+0000 7f3ef2078640 1 --2- 172.21.15.37:0/2084423938 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3eec0cbff0 0x7f3eec0cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.669+0000 7f3ef2078640 1 --2- 172.21.15.37:0/2084423938 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ed80039c0 0x7f3eec1576e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.669+0000 7f3ef2078640 1 -- 172.21.15.37:0/2084423938 >> 172.21.15.37:0/2084423938 conn(0x7f3eec09c230 msgr2=0x7f3eec161500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.670+0000 7f3ef2078640 1 -- 172.21.15.37:0/2084423938 shutdown_connections 2023-12-11T17:10:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.670+0000 7f3ef2078640 1 -- 172.21.15.37:0/2084423938 wait complete. 2023-12-11T17:10:25.688 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T17:10:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.912+0000 7f1a2e30c640 1 Processor -- start 2023-12-11T17:10:25.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.913+0000 7f1a2e30c640 1 -- start start 2023-12-11T17:10:25.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.914+0000 7f1a2e30c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a280b3730 0x7f1a280cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:25.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.914+0000 7f1a2e30c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a280c6b80 con 0x7f1a280cfca0 2023-12-11T17:10:25.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.914+0000 7f1a2e30c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a280d00d0 con 0x7f1a280b3350 2023-12-11T17:10:25.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.914+0000 7f1a2e30c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a280d3bf0 con 0x7f1a280b3730 2023-12-11T17:10:25.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.915+0000 7f1a2cb09640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1a280b3730 0x7f1a280cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:25.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.915+0000 7f1a2db0b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1a280cfca0 0x7f1a280cdef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41934/0 (socket says 172.21.15.37:41934) 2023-12-11T17:10:25.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.915+0000 7f1a2db0b640 1 -- 172.21.15.37:0/530382735 learned_addr learned my addr 172.21.15.37:0/530382735 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:25.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.915+0000 7f1a2cb09640 1 -- 172.21.15.37:0/530382735 >> v1:172.21.15.151:6789/0 conn(0x7f1a280b3350 legacy=0x7f1a280b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:25.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.915+0000 7f1a2cb09640 1 -- 172.21.15.37:0/530382735 >> v1:172.21.15.37:6789/0 conn(0x7f1a280cfca0 legacy=0x7f1a280cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:25.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.915+0000 7f1a2cb09640 1 -- 172.21.15.37:0/530382735 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a280d3ed0 con 0x7f1a280b3730 2023-12-11T17:10:25.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.917+0000 7f1a2cb09640 1 --2- 172.21.15.37:0/530382735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a280b3730 0x7f1a280cf760 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1a180097a0 tx=0x7f1a1802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=701dff5cc25a2322 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.917+0000 7f1a1ffff640 1 -- 172.21.15.37:0/530382735 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a18030610 con 0x7f1a280b3730 2023-12-11T17:10:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.917+0000 7f1a1ffff640 1 -- 172.21.15.37:0/530382735 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a18030770 con 0x7f1a280b3730 2023-12-11T17:10:25.918 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.917+0000 7f1a1ffff640 1 -- 172.21.15.37:0/530382735 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a18030b00 con 0x7f1a280b3730 2023-12-11T17:10:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.917+0000 7f1a2e30c640 1 -- 172.21.15.37:0/530382735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a280b3730 msgr2=0x7f1a280cf760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.917+0000 7f1a2e30c640 1 --2- 172.21.15.37:0/530382735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a280b3730 0x7f1a280cf760 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f1a180097a0 tx=0x7f1a1802b960 comp rx=0 tx=0).stop 2023-12-11T17:10:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.918+0000 7f1a2e30c640 1 -- 172.21.15.37:0/530382735 shutdown_connections 2023-12-11T17:10:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.918+0000 7f1a2e30c640 1 --2- 172.21.15.37:0/530382735 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a280b3730 0x7f1a280cf760 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.918+0000 7f1a2e30c640 1 -- 172.21.15.37:0/530382735 >> 172.21.15.37:0/530382735 conn(0x7f1a280d3030 msgr2=0x7f1a280d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.918+0000 7f1a2e30c640 1 -- 172.21.15.37:0/530382735 shutdown_connections 2023-12-11T17:10:25.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.918+0000 7f1a2e30c640 1 -- 172.21.15.37:0/530382735 wait complete. 2023-12-11T17:10:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.919+0000 7f1a2e30c640 1 Processor -- start 2023-12-11T17:10:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.919+0000 7f1a2e30c640 1 -- start start 2023-12-11T17:10:25.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.920+0000 7f1a2e30c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a280b3350 0x7f1a280cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:25.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.920+0000 7f1a2e30c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a280b3730 0x7f1a280cb980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:25.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.920+0000 7f1a2e30c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a280cfca0 0x7f1a280ca100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:25.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.920+0000 7f1a2e30c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a280b6310 con 0x7f1a280b3730 2023-12-11T17:10:25.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.920+0000 7f1a2e30c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a280cbec0 con 0x7f1a280b3350 2023-12-11T17:10:25.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.920+0000 7f1a2e30c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a280ccb70 con 0x7f1a280cfca0 2023-12-11T17:10:25.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.921+0000 7f1a2cb09640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a280b3730 0x7f1a280cb980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:25.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.921+0000 7f1a2cb09640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a280b3730 0x7f1a280cb980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38226/0 (socket says 172.21.15.37:38226) 2023-12-11T17:10:25.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.921+0000 7f1a2cb09640 1 -- 172.21.15.37:0/1789335887 learned_addr learned my addr 172.21.15.37:0/1789335887 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:25.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.921+0000 7f1a2db0b640 1 --2- 172.21.15.37:0/1789335887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a280cfca0 0x7f1a280ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:25.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.921+0000 7f1a2d30a640 1 --2- 172.21.15.37:0/1789335887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a280b3350 0x7f1a280cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:25.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.921+0000 7f1a2cb09640 1 -- 172.21.15.37:0/1789335887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a280cfca0 msgr2=0x7f1a280ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:25.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.921+0000 7f1a2cb09640 1 --2- 172.21.15.37:0/1789335887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a280cfca0 0x7f1a280ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:25.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.921+0000 7f1a2cb09640 1 -- 172.21.15.37:0/1789335887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a280b3350 msgr2=0x7f1a280cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:25.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.921+0000 7f1a2cb09640 1 --2- 172.21.15.37:0/1789335887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a280b3350 0x7f1a280cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:25.923 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.921+0000 7f1a2cb09640 1 -- 172.21.15.37:0/1789335887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a18009400 con 0x7f1a280b3730 2023-12-11T17:10:25.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.922+0000 7f1a2cb09640 1 --2- 172.21.15.37:0/1789335887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a280b3730 0x7f1a280cb980 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1a1802bf70 tx=0x7f1a180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:25.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.922+0000 7f1a1dffb640 1 -- 172.21.15.37:0/1789335887 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a1803e070 con 0x7f1a280b3730 2023-12-11T17:10:25.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.922+0000 7f1a1dffb640 1 -- 172.21.15.37:0/1789335887 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a18039a10 con 0x7f1a280b3730 2023-12-11T17:10:25.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.922+0000 7f1a1dffb640 1 -- 172.21.15.37:0/1789335887 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a18039da0 con 0x7f1a280b3730 2023-12-11T17:10:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.922+0000 7f1a2e30c640 1 -- 172.21.15.37:0/1789335887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a280cce50 con 0x7f1a280b3730 2023-12-11T17:10:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.922+0000 7f1a2e30c640 1 -- 172.21.15.37:0/1789335887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a280b5f30 con 0x7f1a280b3730 2023-12-11T17:10:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.923+0000 7f1a2e30c640 1 -- 172.21.15.37:0/1789335887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a280b6450 con 0x7f1a280b3730 2023-12-11T17:10:25.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.924+0000 7f1a1dffb640 1 -- 172.21.15.37:0/1789335887 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1a1804b400 con 0x7f1a280b3730 2023-12-11T17:10:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.925+0000 7f1a1dffb640 1 --2- 172.21.15.37:0/1789335887 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1a0c06ae40 0x7f1a0c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.925+0000 7f1a1dffb640 1 -- 172.21.15.37:0/1789335887 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f1a180abd10 con 0x7f1a280b3730 2023-12-11T17:10:25.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.926+0000 7f1a2d30a640 1 --2- 172.21.15.37:0/1789335887 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1a0c06ae40 0x7f1a0c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:25.927 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.927+0000 7f1a2d30a640 1 --2- 172.21.15.37:0/1789335887 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1a0c06ae40 0x7f1a0c06d300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1a24000f60 tx=0x7f1a24009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:25.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:25.929+0000 7f1a1dffb640 1 -- 172.21.15.37:0/1789335887 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1a280b6450 con 0x7f1a280b3730 2023-12-11T17:10:26.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.115+0000 7f1a2e30c640 1 -- 172.21.15.37:0/1789335887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1a280b6450 con 0x7f1a280b3730 2023-12-11T17:10:26.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.116+0000 7f1a1dffb640 1 -- 172.21.15.37:0/1789335887 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v25) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1a280b6450 con 0x7f1a280b3730 2023-12-11T17:10:26.117 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-11T17:10:26.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.118+0000 7f1a2e30c640 1 -- 172.21.15.37:0/1789335887 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1a0c06ae40 msgr2=0x7f1a0c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:26.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.118+0000 7f1a2e30c640 1 --2- 172.21.15.37:0/1789335887 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1a0c06ae40 0x7f1a0c06d300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1a24000f60 tx=0x7f1a24009040 comp rx=0 tx=0).stop 2023-12-11T17:10:26.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.118+0000 7f1a2e30c640 1 -- 172.21.15.37:0/1789335887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a280b3730 msgr2=0x7f1a280cb980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:26.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.118+0000 7f1a2e30c640 1 --2- 172.21.15.37:0/1789335887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a280b3730 0x7f1a280cb980 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1a1802bf70 tx=0x7f1a180046c0 comp rx=0 tx=0).stop 2023-12-11T17:10:26.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.118+0000 7f1a2e30c640 1 -- 172.21.15.37:0/1789335887 shutdown_connections 2023-12-11T17:10:26.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.118+0000 7f1a2e30c640 1 --2- 172.21.15.37:0/1789335887 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1a0c06ae40 0x7f1a0c06d300 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:26.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.118+0000 7f1a2e30c640 1 --2- 172.21.15.37:0/1789335887 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1a280cfca0 0x7f1a280ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:26.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.118+0000 7f1a2e30c640 1 --2- 172.21.15.37:0/1789335887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1a280b3730 0x7f1a280cb980 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:26.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.118+0000 7f1a2e30c640 1 --2- 172.21.15.37:0/1789335887 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a280b3350 0x7f1a280cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:26.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.118+0000 7f1a2e30c640 1 -- 172.21.15.37:0/1789335887 >> 172.21.15.37:0/1789335887 conn(0x7f1a280d3030 msgr2=0x7f1a28161190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:26.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.118+0000 7f1a2e30c640 1 -- 172.21.15.37:0/1789335887 shutdown_connections 2023-12-11T17:10:26.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.118+0000 7f1a2e30c640 1 -- 172.21.15.37:0/1789335887 wait complete. 2023-12-11T17:10:26.137 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-11T17:10:26.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.367+0000 7fe95dbed640 1 Processor -- start 2023-12-11T17:10:26.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.367+0000 7fe95dbed640 1 -- start start 2023-12-11T17:10:26.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.368+0000 7fe95dbed640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9580cb5b0 0x7fe95806c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:26.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.369+0000 7fe95dbed640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe9580cb990 0x7fe95815f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:26.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.369+0000 7fe95dbed640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe95806c770 con 0x7fe95815b250 2023-12-11T17:10:26.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.369+0000 7fe95dbed640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe95806ca50 con 0x7fe9580cb990 2023-12-11T17:10:26.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.369+0000 7fe95dbed640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe95806cd30 con 0x7fe9580cb5b0 2023-12-11T17:10:26.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.369+0000 7fe957fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe9580cb990 0x7fe95815f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:26.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.369+0000 7fe95cbeb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9580cb5b0 0x7fe95806c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:26.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.369+0000 7fe95cbeb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9580cb5b0 0x7fe95806c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.37:34370/0 (socket says 172.21.15.37:34370) 2023-12-11T17:10:26.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.369+0000 7fe95cbeb640 1 -- 172.21.15.37:0/1456372619 learned_addr learned my addr 172.21.15.37:0/1456372619 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:26.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.370+0000 7fe95cbeb640 1 -- 172.21.15.37:0/1456372619 >> v2:172.21.15.151:3300/0 conn(0x7fe9580cb990 msgr2=0x7fe95815f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:26.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.370+0000 7fe95cbeb640 1 --2- 172.21.15.37:0/1456372619 >> v2:172.21.15.151:3300/0 conn(0x7fe9580cb990 0x7fe95815f510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:26.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.370+0000 7fe95cbeb640 1 -- 172.21.15.37:0/1456372619 >> v1:172.21.15.151:6789/0 conn(0x7fe95815b250 legacy=0x7fe95815b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:26.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.370+0000 7fe95cbeb640 1 -- 172.21.15.37:0/1456372619 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95806d010 con 0x7fe9580cb5b0 2023-12-11T17:10:26.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.370+0000 7fe957fff640 1 --2- 172.21.15.37:0/1456372619 >> v2:172.21.15.151:3300/0 conn(0x7fe9580cb990 0x7fe95815f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:10:26.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.370+0000 7fe9577fe640 1 -- 172.21.15.37:0/1456372619 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1064406013 0 0) 0x7fe95806c770 con 0x7fe95815b250 2023-12-11T17:10:26.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.372+0000 7fe95cbeb640 1 --2- 172.21.15.37:0/1456372619 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9580cb5b0 0x7fe95806c130 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe948009e50 tx=0x7fe94802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=51a11ae689571475 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:26.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.372+0000 7fe9577fe640 1 -- 172.21.15.37:0/1456372619 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe94802cb00 con 0x7fe9580cb5b0 2023-12-11T17:10:26.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.372+0000 7fe9577fe640 1 -- 172.21.15.37:0/1456372619 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe94802cc60 con 0x7fe9580cb5b0 2023-12-11T17:10:26.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.373+0000 7fe9577fe640 1 -- 172.21.15.37:0/1456372619 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9480343f0 con 0x7fe9580cb5b0 2023-12-11T17:10:26.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.373+0000 7fe95dbed640 1 -- 172.21.15.37:0/1456372619 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9580cb5b0 msgr2=0x7fe95806c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:26.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.373+0000 7fe95dbed640 1 --2- 172.21.15.37:0/1456372619 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9580cb5b0 0x7fe95806c130 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fe948009e50 tx=0x7fe94802bf60 comp rx=0 tx=0).stop 2023-12-11T17:10:26.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.373+0000 7fe95dbed640 1 -- 172.21.15.37:0/1456372619 shutdown_connections 2023-12-11T17:10:26.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.373+0000 7fe95dbed640 1 --2- 172.21.15.37:0/1456372619 >> v2:172.21.15.151:3300/0 conn(0x7fe9580cb990 0x7fe95815f510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:26.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.373+0000 7fe95dbed640 1 --2- 172.21.15.37:0/1456372619 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9580cb5b0 0x7fe95806c130 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:26.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.373+0000 7fe95dbed640 1 -- 172.21.15.37:0/1456372619 >> 172.21.15.37:0/1456372619 conn(0x7fe9580b0940 msgr2=0x7fe9580b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:26.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.373+0000 7fe95dbed640 1 -- 172.21.15.37:0/1456372619 shutdown_connections 2023-12-11T17:10:26.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.373+0000 7fe95dbed640 1 -- 172.21.15.37:0/1456372619 wait complete. 2023-12-11T17:10:26.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.375+0000 7fe95dbed640 1 Processor -- start 2023-12-11T17:10:26.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.375+0000 7fe95dbed640 1 -- start start 2023-12-11T17:10:26.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.376+0000 7fe95dbed640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9580cb5b0 0x7fe95809a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:26.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.376+0000 7fe95dbed640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9580cb990 0x7fe95814b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:26.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.376+0000 7fe95dbed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95815b250 0x7fe958099af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:26.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.376+0000 7fe95dbed640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe95809a9a0 con 0x7fe95815b250 2023-12-11T17:10:26.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.376+0000 7fe95dbed640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe958156fb0 con 0x7fe9580cb990 2023-12-11T17:10:26.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.376+0000 7fe95dbed640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe958157290 con 0x7fe9580cb5b0 2023-12-11T17:10:26.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.376+0000 7fe95d3ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95815b250 0x7fe958099af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:26.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.376+0000 7fe95d3ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95815b250 0x7fe958099af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38228/0 (socket says 172.21.15.37:38228) 2023-12-11T17:10:26.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.376+0000 7fe95d3ec640 1 -- 172.21.15.37:0/3659013266 learned_addr learned my addr 172.21.15.37:0/3659013266 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:26.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.377+0000 7fe95cbeb640 1 --2- 172.21.15.37:0/3659013266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9580cb5b0 0x7fe95809a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:26.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.377+0000 7fe957fff640 1 --2- 172.21.15.37:0/3659013266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9580cb990 0x7fe95814b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:26.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.377+0000 7fe95d3ec640 1 -- 172.21.15.37:0/3659013266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9580cb5b0 msgr2=0x7fe95809a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:26.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.377+0000 7fe95d3ec640 1 --2- 172.21.15.37:0/3659013266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9580cb5b0 0x7fe95809a3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:26.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.377+0000 7fe95d3ec640 1 -- 172.21.15.37:0/3659013266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9580cb990 msgr2=0x7fe95814b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:26.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.377+0000 7fe95d3ec640 1 --2- 172.21.15.37:0/3659013266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9580cb990 0x7fe95814b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:26.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.377+0000 7fe95d3ec640 1 -- 172.21.15.37:0/3659013266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe940009400 con 0x7fe95815b250 2023-12-11T17:10:26.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.377+0000 7fe95d3ec640 1 --2- 172.21.15.37:0/3659013266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95815b250 0x7fe958099af0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe95000c390 tx=0x7fe95000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:26.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.377+0000 7fe9557fa640 1 -- 172.21.15.37:0/3659013266 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9500035f0 con 0x7fe95815b250 2023-12-11T17:10:26.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.377+0000 7fe9557fa640 1 -- 172.21.15.37:0/3659013266 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe950003750 con 0x7fe95815b250 2023-12-11T17:10:26.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.377+0000 7fe9557fa640 1 -- 172.21.15.37:0/3659013266 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe950003b00 con 0x7fe95815b250 2023-12-11T17:10:26.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.378+0000 7fe95dbed640 1 -- 172.21.15.37:0/3659013266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe948009b30 con 0x7fe95815b250 2023-12-11T17:10:26.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.378+0000 7fe95dbed640 1 -- 172.21.15.37:0/3659013266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe958157850 con 0x7fe95815b250 2023-12-11T17:10:26.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.379+0000 7fe95dbed640 1 -- 172.21.15.37:0/3659013266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe958067910 con 0x7fe95815b250 2023-12-11T17:10:26.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.380+0000 7fe9557fa640 1 -- 172.21.15.37:0/3659013266 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe950003c60 con 0x7fe95815b250 2023-12-11T17:10:26.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.381+0000 7fe9557fa640 1 --2- 172.21.15.37:0/3659013266 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe93806ae40 0x7fe93806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:26.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.381+0000 7fe9557fa640 1 -- 172.21.15.37:0/3659013266 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7fe950088f70 con 0x7fe95815b250 2023-12-11T17:10:26.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.381+0000 7fe95cbeb640 1 --2- 172.21.15.37:0/3659013266 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe93806ae40 0x7fe93806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:26.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.382+0000 7fe95cbeb640 1 --2- 172.21.15.37:0/3659013266 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe93806ae40 0x7fe93806d300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe948035000 tx=0x7fe948030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:26.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.385+0000 7fe9557fa640 1 -- 172.21.15.37:0/3659013266 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe950053c90 con 0x7fe95815b250 2023-12-11T17:10:26.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.580+0000 7fe95dbed640 1 -- 172.21.15.37:0/3659013266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fe958157a60 con 0x7fe95815b250 2023-12-11T17:10:26.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.580+0000 7fe9557fa640 1 -- 172.21.15.37:0/3659013266 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v25) v1 ==== 103+0+11 (secure 0 0 0) 0x7fe950017020 con 0x7fe95815b250 2023-12-11T17:10:26.582 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:10:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.583+0000 7fe95dbed640 1 -- 172.21.15.37:0/3659013266 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe93806ae40 msgr2=0x7fe93806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.583+0000 7fe95dbed640 1 --2- 172.21.15.37:0/3659013266 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe93806ae40 0x7fe93806d300 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe948035000 tx=0x7fe948030000 comp rx=0 tx=0).stop 2023-12-11T17:10:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.583+0000 7fe95dbed640 1 -- 172.21.15.37:0/3659013266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95815b250 msgr2=0x7fe958099af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.583+0000 7fe95dbed640 1 --2- 172.21.15.37:0/3659013266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95815b250 0x7fe958099af0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe95000c390 tx=0x7fe95000c850 comp rx=0 tx=0).stop 2023-12-11T17:10:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.583+0000 7fe95dbed640 1 -- 172.21.15.37:0/3659013266 shutdown_connections 2023-12-11T17:10:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.583+0000 7fe95dbed640 1 --2- 172.21.15.37:0/3659013266 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe93806ae40 0x7fe93806d300 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.583+0000 7fe95dbed640 1 --2- 172.21.15.37:0/3659013266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe9580cb990 0x7fe95814b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.583+0000 7fe95dbed640 1 --2- 172.21.15.37:0/3659013266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe95815b250 0x7fe958099af0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.583+0000 7fe95dbed640 1 --2- 172.21.15.37:0/3659013266 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe9580cb5b0 0x7fe95809a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.583+0000 7fe95dbed640 1 -- 172.21.15.37:0/3659013266 >> 172.21.15.37:0/3659013266 conn(0x7fe9580b0940 msgr2=0x7fe9580ad590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.583+0000 7fe95dbed640 1 -- 172.21.15.37:0/3659013266 shutdown_connections 2023-12-11T17:10:26.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.583+0000 7fe95dbed640 1 -- 172.21.15.37:0/3659013266 wait complete. 2023-12-11T17:10:26.605 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T17:10:26.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.822+0000 7f434b89b640 1 Processor -- start 2023-12-11T17:10:26.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.823+0000 7f434b89b640 1 -- start start 2023-12-11T17:10:26.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.824+0000 7f434b89b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4344157a60 0x7f434406c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:26.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.824+0000 7f434b89b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f434406de20 0x7f434415dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:26.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.824+0000 7f434b89b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f434406ca40 con 0x7f434415e0e0 2023-12-11T17:10:26.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.824+0000 7f434b89b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f434415e510 con 0x7f434406de20 2023-12-11T17:10:26.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.824+0000 7f434b89b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4344071cd0 con 0x7f4344157a60 2023-12-11T17:10:26.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.825+0000 7f4349e38640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f434415e0e0 0x7f434415a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41948/0 (socket says 172.21.15.37:41948) 2023-12-11T17:10:26.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.825+0000 7f4349e38640 1 -- 172.21.15.37:0/1769322324 learned_addr learned my addr 172.21.15.37:0/1769322324 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:26.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.825+0000 7f4348e36640 1 --2- 172.21.15.37:0/1769322324 >> v2:172.21.15.37:3300/0 conn(0x7f434406de20 0x7f434415dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:26.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.825+0000 7f4349637640 1 --2- 172.21.15.37:0/1769322324 >> v2:172.21.15.151:3300/0 conn(0x7f4344157a60 0x7f434406c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:26.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.825+0000 7f433bfff640 1 -- 172.21.15.37:0/1769322324 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1666605825 0 0) 0x7f434406ca40 con 0x7f434415e0e0 2023-12-11T17:10:26.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.825+0000 7f433bfff640 1 -- 172.21.15.37:0/1769322324 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4330003520 con 0x7f434415e0e0 2023-12-11T17:10:26.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.825+0000 7f4348e36640 1 -- 172.21.15.37:0/1769322324 >> v2:172.21.15.151:3300/0 conn(0x7f4344157a60 msgr2=0x7f434406c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:26.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.825+0000 7f4348e36640 1 --2- 172.21.15.37:0/1769322324 >> v2:172.21.15.151:3300/0 conn(0x7f4344157a60 0x7f434406c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:26.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.825+0000 7f4348e36640 1 -- 172.21.15.37:0/1769322324 >> v1:172.21.15.37:6789/0 conn(0x7f434415e0e0 legacy=0x7f434415a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:26.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.825+0000 7f4348e36640 1 -- 172.21.15.37:0/1769322324 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4344070f10 con 0x7f434406de20 2023-12-11T17:10:26.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.826+0000 7f4348e36640 1 --2- 172.21.15.37:0/1769322324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f434406de20 0x7f434415dba0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f43440b1710 tx=0x7f433402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=211714e2e05c9636 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:26.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.827+0000 7f433bfff640 1 -- 172.21.15.37:0/1769322324 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f433402e070 con 0x7f434406de20 2023-12-11T17:10:26.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.827+0000 7f433bfff640 1 -- 172.21.15.37:0/1769322324 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43340315a0 con 0x7f434406de20 2023-12-11T17:10:26.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.827+0000 7f433bfff640 1 -- 172.21.15.37:0/1769322324 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4334031930 con 0x7f434406de20 2023-12-11T17:10:26.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.827+0000 7f434b89b640 1 -- 172.21.15.37:0/1769322324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f434406de20 msgr2=0x7f434415dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:26.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.827+0000 7f434b89b640 1 --2- 172.21.15.37:0/1769322324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f434406de20 0x7f434415dba0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f43440b1710 tx=0x7f433402b840 comp rx=0 tx=0).stop 2023-12-11T17:10:26.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.828+0000 7f434b89b640 1 -- 172.21.15.37:0/1769322324 shutdown_connections 2023-12-11T17:10:26.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.828+0000 7f434b89b640 1 --2- 172.21.15.37:0/1769322324 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f434406de20 0x7f434415dba0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:26.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.828+0000 7f434b89b640 1 --2- 172.21.15.37:0/1769322324 >> v2:172.21.15.151:3300/0 conn(0x7f4344157a60 0x7f434406c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:26.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.828+0000 7f434b89b640 1 -- 172.21.15.37:0/1769322324 >> 172.21.15.37:0/1769322324 conn(0x7f43440b0a90 msgr2=0x7f43440b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:26.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.828+0000 7f434b89b640 1 -- 172.21.15.37:0/1769322324 shutdown_connections 2023-12-11T17:10:26.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.828+0000 7f434b89b640 1 -- 172.21.15.37:0/1769322324 wait complete. 2023-12-11T17:10:26.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.829+0000 7f434b89b640 1 Processor -- start 2023-12-11T17:10:26.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.830+0000 7f434b89b640 1 -- start start 2023-12-11T17:10:26.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.831+0000 7f434b89b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f434406de20 0x7f434414ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:26.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.831+0000 7f434b89b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4344157a60 0x7f434415b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:26.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.831+0000 7f434b89b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f434415e0e0 0x7f43440ae6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:26.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.831+0000 7f434b89b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4344155cd0 con 0x7f434406de20 2023-12-11T17:10:26.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.831+0000 7f434b89b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4344155fb0 con 0x7f434415e0e0 2023-12-11T17:10:26.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.831+0000 7f434b89b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4344156290 con 0x7f4344157a60 2023-12-11T17:10:26.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.831+0000 7f4349637640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f434406de20 0x7f434414ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:26.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.831+0000 7f4349637640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f434406de20 0x7f434414ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38246/0 (socket says 172.21.15.37:38246) 2023-12-11T17:10:26.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.831+0000 7f4349637640 1 -- 172.21.15.37:0/4063977667 learned_addr learned my addr 172.21.15.37:0/4063977667 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:26.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.831+0000 7f4349e38640 1 --2- 172.21.15.37:0/4063977667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f434415e0e0 0x7f43440ae6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:26.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.831+0000 7f4348e36640 1 --2- 172.21.15.37:0/4063977667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4344157a60 0x7f434415b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.831+0000 7f4349637640 1 -- 172.21.15.37:0/4063977667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4344157a60 msgr2=0x7f434415b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.831+0000 7f4349637640 1 --2- 172.21.15.37:0/4063977667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4344157a60 0x7f434415b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.832+0000 7f4349637640 1 -- 172.21.15.37:0/4063977667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f434415e0e0 msgr2=0x7f43440ae6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.832+0000 7f4349637640 1 --2- 172.21.15.37:0/4063977667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f434415e0e0 0x7f43440ae6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.832+0000 7f4349637640 1 -- 172.21.15.37:0/4063977667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4334009400 con 0x7f434406de20 2023-12-11T17:10:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.832+0000 7f4349637640 1 --2- 172.21.15.37:0/4063977667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f434406de20 0x7f434414ea40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4340007ef0 tx=0x7f434000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.832+0000 7f4339ffb640 1 -- 172.21.15.37:0/4063977667 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4340014620 con 0x7f434406de20 2023-12-11T17:10:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.832+0000 7f4339ffb640 1 -- 172.21.15.37:0/4063977667 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4340014780 con 0x7f434406de20 2023-12-11T17:10:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.832+0000 7f434b89b640 1 -- 172.21.15.37:0/4063977667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4344156570 con 0x7f434406de20 2023-12-11T17:10:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.832+0000 7f4339ffb640 1 -- 172.21.15.37:0/4063977667 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4340014b30 con 0x7f434406de20 2023-12-11T17:10:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.832+0000 7f434b89b640 1 -- 172.21.15.37:0/4063977667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4344155490 con 0x7f434406de20 2023-12-11T17:10:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.833+0000 7f434b89b640 1 -- 172.21.15.37:0/4063977667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4344155620 con 0x7f434406de20 2023-12-11T17:10:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.834+0000 7f4339ffb640 1 -- 172.21.15.37:0/4063977667 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4340014c90 con 0x7f434406de20 2023-12-11T17:10:26.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.835+0000 7f4339ffb640 1 --2- 172.21.15.37:0/4063977667 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f432806ae70 0x7f432806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:26.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.835+0000 7f4339ffb640 1 -- 172.21.15.37:0/4063977667 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f434008a2f0 con 0x7f434406de20 2023-12-11T17:10:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.836+0000 7f4348e36640 1 --2- 172.21.15.37:0/4063977667 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f432806ae70 0x7f432806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:26.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.837+0000 7f4348e36640 1 --2- 172.21.15.37:0/4063977667 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f432806ae70 0x7f432806d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4334036000 tx=0x7f433403d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:26.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:26.839+0000 7f4339ffb640 1 -- 172.21.15.37:0/4063977667 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f43400550a0 con 0x7f434406de20 2023-12-11T17:10:27.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.061+0000 7f434b89b640 1 -- 172.21.15.37:0/4063977667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f43440745d0 con 0x7f434406de20 2023-12-11T17:10:27.063 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.062+0000 7f4339ffb640 1 -- 172.21.15.37:0/4063977667 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f43400586c0 con 0x7f434406de20 2023-12-11T17:10:27.064 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:27.064 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2395601865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2395601865},{"type":"v1","addr":"172.21.15.151:6835","nonce":2395601865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1535809271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1535809271},{"type":"v1","addr":"172.21.15.151:6837","nonce":1535809271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2590175074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2590175074},{"type":"v1","addr":"172.21.15.37:6833","nonce":2590175074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-11T17:09:44.643511+0000","modified":"2023-12-11T17:10:12.829357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/2348606057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2348606057},{"type":"v1","addr":"172.21.15.37:6835","nonce":2348606057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T17:10:27.064 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-12-11T17:10:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.065+0000 7f434b89b640 1 -- 172.21.15.37:0/4063977667 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f432806ae70 msgr2=0x7f432806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.065+0000 7f434b89b640 1 --2- 172.21.15.37:0/4063977667 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f432806ae70 0x7f432806d330 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f4334036000 tx=0x7f433403d040 comp rx=0 tx=0).stop 2023-12-11T17:10:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.065+0000 7f434b89b640 1 -- 172.21.15.37:0/4063977667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f434406de20 msgr2=0x7f434414ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.065+0000 7f434b89b640 1 --2- 172.21.15.37:0/4063977667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f434406de20 0x7f434414ea40 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f4340007ef0 tx=0x7f434000e4b0 comp rx=0 tx=0).stop 2023-12-11T17:10:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.065+0000 7f434b89b640 1 -- 172.21.15.37:0/4063977667 shutdown_connections 2023-12-11T17:10:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.065+0000 7f434b89b640 1 --2- 172.21.15.37:0/4063977667 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f432806ae70 0x7f432806d330 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.065+0000 7f434b89b640 1 --2- 172.21.15.37:0/4063977667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f434415e0e0 0x7f43440ae6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.065+0000 7f434b89b640 1 --2- 172.21.15.37:0/4063977667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4344157a60 0x7f434415b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:27.066 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.065+0000 7f434b89b640 1 --2- 172.21.15.37:0/4063977667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f434406de20 0x7f434414ea40 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.065+0000 7f434b89b640 1 -- 172.21.15.37:0/4063977667 >> 172.21.15.37:0/4063977667 conn(0x7f43440b0a90 msgr2=0x7f43440b02f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.065+0000 7f434b89b640 1 -- 172.21.15.37:0/4063977667 shutdown_connections 2023-12-11T17:10:27.067 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.065+0000 7f434b89b640 1 -- 172.21.15.37:0/4063977667 wait complete. 2023-12-11T17:10:27.084 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:10:27.306 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.304+0000 7f640ece6640 1 Processor -- start 2023-12-11T17:10:27.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.305+0000 7f640ece6640 1 -- start start 2023-12-11T17:10:27.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.306+0000 7f640ece6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64080d13c0 0x7f64080ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:27.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.306+0000 7f640ece6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f64080d0d70 0x7f64080d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:27.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.306+0000 7f640ece6640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64080b2280 con 0x7f64080cf6a0 2023-12-11T17:10:27.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.306+0000 7f640ece6640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64080cee70 con 0x7f64080d13c0 2023-12-11T17:10:27.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.306+0000 7f640ece6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64080d11c0 con 0x7f64080d0d70 2023-12-11T17:10:27.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.307+0000 7f640dce4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64080d13c0 0x7f64080ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:27.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.307+0000 7f640dce4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64080d13c0 0x7f64080ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38258/0 (socket says 172.21.15.37:38258) 2023-12-11T17:10:27.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.307+0000 7f640dce4640 1 -- 172.21.15.37:0/840828123 learned_addr learned my addr 172.21.15.37:0/840828123 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:27.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.307+0000 7f640d4e3640 1 --2- 172.21.15.37:0/840828123 >> v2:172.21.15.151:3300/0 conn(0x7f64080d0d70 0x7f64080d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:27.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.307+0000 7f640dce4640 1 -- 172.21.15.37:0/840828123 >> v2:172.21.15.151:3300/0 conn(0x7f64080d0d70 msgr2=0x7f64080d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:27.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.307+0000 7f640dce4640 1 --2- 172.21.15.37:0/840828123 >> v2:172.21.15.151:3300/0 conn(0x7f64080d0d70 0x7f64080d17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:27.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.307+0000 7f640dce4640 1 -- 172.21.15.37:0/840828123 >> v1:172.21.15.151:6789/0 conn(0x7f64080cf6a0 legacy=0x7f64080cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:27.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.307+0000 7f640dce4640 1 -- 172.21.15.37:0/840828123 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64080d1ce0 con 0x7f64080d13c0 2023-12-11T17:10:27.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.309+0000 7f640dce4640 1 --2- 172.21.15.37:0/840828123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64080d13c0 0x7f64080ce5b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f64080cf040 tx=0x7f63fc02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8500992bc22173 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:27.312 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.309+0000 7f640cce2640 1 -- 172.21.15.37:0/840828123 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63fc02ca80 con 0x7f64080d13c0 2023-12-11T17:10:27.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.309+0000 7f640cce2640 1 -- 172.21.15.37:0/840828123 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63fc02cbe0 con 0x7f64080d13c0 2023-12-11T17:10:27.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.309+0000 7f640cce2640 1 -- 172.21.15.37:0/840828123 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f63fc0343f0 con 0x7f64080d13c0 2023-12-11T17:10:27.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.310+0000 7f640ece6640 1 -- 172.21.15.37:0/840828123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64080d13c0 msgr2=0x7f64080ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:27.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.310+0000 7f640ece6640 1 --2- 172.21.15.37:0/840828123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64080d13c0 0x7f64080ce5b0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f64080cf040 tx=0x7f63fc02bee0 comp rx=0 tx=0).stop 2023-12-11T17:10:27.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.310+0000 7f640ece6640 1 -- 172.21.15.37:0/840828123 shutdown_connections 2023-12-11T17:10:27.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.310+0000 7f640ece6640 1 --2- 172.21.15.37:0/840828123 >> v2:172.21.15.151:3300/0 conn(0x7f64080d0d70 0x7f64080d17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:27.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.310+0000 7f640ece6640 1 --2- 172.21.15.37:0/840828123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64080d13c0 0x7f64080ce5b0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:27.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.310+0000 7f640ece6640 1 -- 172.21.15.37:0/840828123 >> 172.21.15.37:0/840828123 conn(0x7f640809c260 msgr2=0x7f64080d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:27.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.310+0000 7f640ece6640 1 -- 172.21.15.37:0/840828123 shutdown_connections 2023-12-11T17:10:27.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.310+0000 7f640ece6640 1 -- 172.21.15.37:0/840828123 wait complete. 2023-12-11T17:10:27.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.312+0000 7f640ece6640 1 Processor -- start 2023-12-11T17:10:27.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.312+0000 7f640ece6640 1 -- start start 2023-12-11T17:10:27.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.313+0000 7f640ece6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64080cf6a0 0x7f640809dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:27.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.313+0000 7f640ece6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64080d0d70 0x7f640809f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:27.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.313+0000 7f640ece6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64080d13c0 0x7f64081f6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:27.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.313+0000 7f640ece6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640809ccd0 con 0x7f64080d13c0 2023-12-11T17:10:27.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.313+0000 7f640ece6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f640809d850 con 0x7f64080d0d70 2023-12-11T17:10:27.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.313+0000 7f640ece6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f640809cf20 con 0x7f64080cf6a0 2023-12-11T17:10:27.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.313+0000 7f640e4e5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64080d13c0 0x7f64081f6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:27.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.313+0000 7f640e4e5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64080d13c0 0x7f64081f6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38274/0 (socket says 172.21.15.37:38274) 2023-12-11T17:10:27.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.313+0000 7f640e4e5640 1 -- 172.21.15.37:0/932575893 learned_addr learned my addr 172.21.15.37:0/932575893 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:27.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.314+0000 7f640dce4640 1 --2- 172.21.15.37:0/932575893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64080cf6a0 0x7f640809dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:27.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.314+0000 7f640d4e3640 1 --2- 172.21.15.37:0/932575893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64080d0d70 0x7f640809f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:27.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.314+0000 7f640e4e5640 1 -- 172.21.15.37:0/932575893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64080cf6a0 msgr2=0x7f640809dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:27.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.314+0000 7f640e4e5640 1 --2- 172.21.15.37:0/932575893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64080cf6a0 0x7f640809dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:27.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.314+0000 7f640e4e5640 1 -- 172.21.15.37:0/932575893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64080d0d70 msgr2=0x7f640809f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:27.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.314+0000 7f640e4e5640 1 --2- 172.21.15.37:0/932575893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64080d0d70 0x7f640809f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:27.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.314+0000 7f640e4e5640 1 -- 172.21.15.37:0/932575893 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63fc009b30 con 0x7f64080d13c0 2023-12-11T17:10:27.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.314+0000 7f640e4e5640 1 --2- 172.21.15.37:0/932575893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64080d13c0 0x7f64081f6620 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f640000c3f0 tx=0x7f640000c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:27.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.314+0000 7f64067fc640 1 -- 172.21.15.37:0/932575893 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64000052d0 con 0x7f64080d13c0 2023-12-11T17:10:27.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.315+0000 7f64067fc640 1 -- 172.21.15.37:0/932575893 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6400005430 con 0x7f64080d13c0 2023-12-11T17:10:27.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.315+0000 7f640ece6640 1 -- 172.21.15.37:0/932575893 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f640809d200 con 0x7f64080d13c0 2023-12-11T17:10:27.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.315+0000 7f64067fc640 1 -- 172.21.15.37:0/932575893 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6400003830 con 0x7f64080d13c0 2023-12-11T17:10:27.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.315+0000 7f640ece6640 1 -- 172.21.15.37:0/932575893 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f640809e220 con 0x7f64080d13c0 2023-12-11T17:10:27.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.316+0000 7f640ece6640 1 -- 172.21.15.37:0/932575893 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6408074450 con 0x7f64080d13c0 2023-12-11T17:10:27.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.317+0000 7f64067fc640 1 -- 172.21.15.37:0/932575893 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f6400003990 con 0x7f64080d13c0 2023-12-11T17:10:27.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.318+0000 7f64067fc640 1 --2- 172.21.15.37:0/932575893 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f63ec06ae40 0x7f63ec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:27.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.318+0000 7f64067fc640 1 -- 172.21.15.37:0/932575893 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f6400088dc0 con 0x7f64080d13c0 2023-12-11T17:10:27.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.318+0000 7f640dce4640 1 --2- 172.21.15.37:0/932575893 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f63ec06ae40 0x7f63ec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:27.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.320+0000 7f640dce4640 1 --2- 172.21.15.37:0/932575893 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f63ec06ae40 0x7f63ec06d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f63fc035000 tx=0x7f63fc030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:27.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.322+0000 7f64067fc640 1 -- 172.21.15.37:0/932575893 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f6400053b80 con 0x7f64080d13c0 2023-12-11T17:10:27.523 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.522+0000 7f640ece6640 1 -- 172.21.15.37:0/932575893 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f640809d990 con 0x7f64080d13c0 2023-12-11T17:10:27.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.525+0000 7f64067fc640 1 -- 172.21.15.37:0/932575893 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) v1 ==== 74+0+18346 (secure 0 0 0) 0x7f6400017090 con 0x7f64080d13c0 2023-12-11T17:10:27.527 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:27.527 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":25,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:09:49.715938+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":19,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:10:27.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.528+0000 7f640ece6640 1 -- 172.21.15.37:0/932575893 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f63ec06ae40 msgr2=0x7f63ec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:27.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.528+0000 7f640ece6640 1 --2- 172.21.15.37:0/932575893 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f63ec06ae40 0x7f63ec06d300 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f63fc035000 tx=0x7f63fc030000 comp rx=0 tx=0).stop 2023-12-11T17:10:27.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.528+0000 7f640ece6640 1 -- 172.21.15.37:0/932575893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64080d13c0 msgr2=0x7f64081f6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:27.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.528+0000 7f640ece6640 1 --2- 172.21.15.37:0/932575893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64080d13c0 0x7f64081f6620 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f640000c3f0 tx=0x7f640000c8b0 comp rx=0 tx=0).stop 2023-12-11T17:10:27.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.528+0000 7f640ece6640 1 -- 172.21.15.37:0/932575893 shutdown_connections 2023-12-11T17:10:27.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.528+0000 7f640ece6640 1 --2- 172.21.15.37:0/932575893 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f63ec06ae40 0x7f63ec06d300 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:27.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.528+0000 7f640ece6640 1 --2- 172.21.15.37:0/932575893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64080d0d70 0x7f640809f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:27.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.528+0000 7f640ece6640 1 --2- 172.21.15.37:0/932575893 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64080d13c0 0x7f64081f6620 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:27.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.528+0000 7f640ece6640 1 --2- 172.21.15.37:0/932575893 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64080cf6a0 0x7f640809dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:27.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.528+0000 7f640ece6640 1 -- 172.21.15.37:0/932575893 >> 172.21.15.37:0/932575893 conn(0x7f640809c260 msgr2=0x7f64080b6010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:27.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.528+0000 7f640ece6640 1 -- 172.21.15.37:0/932575893 shutdown_connections 2023-12-11T17:10:27.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.528+0000 7f640ece6640 1 -- 172.21.15.37:0/932575893 wait complete. 2023-12-11T17:10:27.550 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T17:10:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.770+0000 7f8c6ffff640 1 Processor -- start 2023-12-11T17:10:27.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.770+0000 7f8c6ffff640 1 -- start start 2023-12-11T17:10:27.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.772+0000 7f8c6ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8c7015e5d0 0x7f8c7006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:27.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.772+0000 7f8c6ffff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c70071f90 con 0x7f8c70071260 2023-12-11T17:10:27.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.772+0000 7f8c6ffff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c70072270 con 0x7f8c700ae200 2023-12-11T17:10:27.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.772+0000 7f8c6ffff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c70070070 con 0x7f8c7015e5d0 2023-12-11T17:10:27.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.773+0000 7f8c6f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8c70071260 0x7f8c700cded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41950/0 (socket says 172.21.15.37:41950) 2023-12-11T17:10:27.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.773+0000 7f8c6effd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8c7015e5d0 0x7f8c7006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:27.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.773+0000 7f8c6f7fe640 1 -- 172.21.15.37:0/4240979108 learned_addr learned my addr 172.21.15.37:0/4240979108 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:27.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.773+0000 7f8c6e7fc640 1 -- 172.21.15.37:0/4240979108 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 873458635 0 0) 0x7f8c70071f90 con 0x7f8c70071260 2023-12-11T17:10:27.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.773+0000 7f8c6effd640 1 -- 172.21.15.37:0/4240979108 >> v1:172.21.15.151:6789/0 conn(0x7f8c700ae200 legacy=0x7f8c70070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:27.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.773+0000 7f8c6effd640 1 -- 172.21.15.37:0/4240979108 >> v1:172.21.15.37:6789/0 conn(0x7f8c70071260 legacy=0x7f8c700cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:27.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.773+0000 7f8c6effd640 1 -- 172.21.15.37:0/4240979108 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c70070350 con 0x7f8c7015e5d0 2023-12-11T17:10:27.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.775+0000 7f8c6effd640 1 --2- 172.21.15.37:0/4240979108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c7015e5d0 0x7f8c7006bdf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8c600097a0 tx=0x7f8c6002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ab2bec2af4a5100 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:27.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.775+0000 7f8c6e7fc640 1 -- 172.21.15.37:0/4240979108 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c6002e070 con 0x7f8c7015e5d0 2023-12-11T17:10:27.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.775+0000 7f8c6e7fc640 1 -- 172.21.15.37:0/4240979108 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c600315a0 con 0x7f8c7015e5d0 2023-12-11T17:10:27.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.775+0000 7f8c6e7fc640 1 -- 172.21.15.37:0/4240979108 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60031930 con 0x7f8c7015e5d0 2023-12-11T17:10:27.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.775+0000 7f8c6ffff640 1 -- 172.21.15.37:0/4240979108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c7015e5d0 msgr2=0x7f8c7006bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:27.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.775+0000 7f8c6ffff640 1 --2- 172.21.15.37:0/4240979108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c7015e5d0 0x7f8c7006bdf0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8c600097a0 tx=0x7f8c6002b840 comp rx=0 tx=0).stop 2023-12-11T17:10:27.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.776+0000 7f8c6ffff640 1 -- 172.21.15.37:0/4240979108 shutdown_connections 2023-12-11T17:10:27.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.776+0000 7f8c6ffff640 1 --2- 172.21.15.37:0/4240979108 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c7015e5d0 0x7f8c7006bdf0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:27.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.776+0000 7f8c6ffff640 1 -- 172.21.15.37:0/4240979108 >> 172.21.15.37:0/4240979108 conn(0x7f8c700b0860 msgr2=0x7f8c700b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:27.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.776+0000 7f8c6ffff640 1 -- 172.21.15.37:0/4240979108 shutdown_connections 2023-12-11T17:10:27.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.776+0000 7f8c6ffff640 1 -- 172.21.15.37:0/4240979108 wait complete. 2023-12-11T17:10:27.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.777+0000 7f8c6ffff640 1 Processor -- start 2023-12-11T17:10:27.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.778+0000 7f8c6ffff640 1 -- start start 2023-12-11T17:10:27.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.779+0000 7f8c6ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c70071260 0x7f8c7015d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:27.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.779+0000 7f8c6ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c700ae200 0x7f8c70143520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:27.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.779+0000 7f8c6ffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c7015e5d0 0x7f8c7009b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:27.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.779+0000 7f8c6ffff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7015bd00 con 0x7f8c70071260 2023-12-11T17:10:27.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.779+0000 7f8c6ffff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7014b9e0 con 0x7f8c700ae200 2023-12-11T17:10:27.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.779+0000 7f8c6ffff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c7015b400 con 0x7f8c7015e5d0 2023-12-11T17:10:27.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.779+0000 7f8c6effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c70071260 0x7f8c7015d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:27.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.779+0000 7f8c6effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c70071260 0x7f8c7015d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38294/0 (socket says 172.21.15.37:38294) 2023-12-11T17:10:27.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.779+0000 7f8c6effd640 1 -- 172.21.15.37:0/3074006973 learned_addr learned my addr 172.21.15.37:0/3074006973 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:27.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.779+0000 7f8c6f7fe640 1 --2- 172.21.15.37:0/3074006973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c7015e5d0 0x7f8c7009b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:27.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.779+0000 7f8c67fff640 1 --2- 172.21.15.37:0/3074006973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c700ae200 0x7f8c70143520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:27.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.779+0000 7f8c6effd640 1 -- 172.21.15.37:0/3074006973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c7015e5d0 msgr2=0x7f8c7009b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:27.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.780+0000 7f8c6effd640 1 --2- 172.21.15.37:0/3074006973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c7015e5d0 0x7f8c7009b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:27.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.780+0000 7f8c6effd640 1 -- 172.21.15.37:0/3074006973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c700ae200 msgr2=0x7f8c70143520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:27.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.780+0000 7f8c6effd640 1 --2- 172.21.15.37:0/3074006973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c700ae200 0x7f8c70143520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:27.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.780+0000 7f8c6effd640 1 -- 172.21.15.37:0/3074006973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c60009400 con 0x7f8c70071260 2023-12-11T17:10:27.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.780+0000 7f8c6effd640 1 --2- 172.21.15.37:0/3074006973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c70071260 0x7f8c7015d0a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8c600097a0 tx=0x7f8c600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:27.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.780+0000 7f8c677fe640 1 -- 172.21.15.37:0/3074006973 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60032900 con 0x7f8c70071260 2023-12-11T17:10:27.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.780+0000 7f8c677fe640 1 -- 172.21.15.37:0/3074006973 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c60032a60 con 0x7f8c70071260 2023-12-11T17:10:27.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.780+0000 7f8c677fe640 1 -- 172.21.15.37:0/3074006973 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c60032e10 con 0x7f8c70071260 2023-12-11T17:10:27.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.780+0000 7f8c6ffff640 1 -- 172.21.15.37:0/3074006973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c7015d6f0 con 0x7f8c70071260 2023-12-11T17:10:27.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.780+0000 7f8c6ffff640 1 -- 172.21.15.37:0/3074006973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c7015b920 con 0x7f8c70071260 2023-12-11T17:10:27.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.782+0000 7f8c6ffff640 1 -- 172.21.15.37:0/3074006973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c700abd20 con 0x7f8c70071260 2023-12-11T17:10:27.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.782+0000 7f8c677fe640 1 -- 172.21.15.37:0/3074006973 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8c6003b3f0 con 0x7f8c70071260 2023-12-11T17:10:27.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.783+0000 7f8c677fe640 1 --2- 172.21.15.37:0/3074006973 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8c5006ae40 0x7f8c5006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:27.784 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.783+0000 7f8c677fe640 1 -- 172.21.15.37:0/3074006973 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f8c600ab910 con 0x7f8c70071260 2023-12-11T17:10:27.785 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.784+0000 7f8c67fff640 1 --2- 172.21.15.37:0/3074006973 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8c5006ae40 0x7f8c5006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:27.786 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.785+0000 7f8c67fff640 1 --2- 172.21.15.37:0/3074006973 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8c5006ae40 0x7f8c5006d300 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8c70071bf0 tx=0x7f8c58009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:27.789 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:27.788+0000 7f8c677fe640 1 -- 172.21.15.37:0/3074006973 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8c60076760 con 0x7f8c70071260 2023-12-11T17:10:28.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.018+0000 7f8c6ffff640 1 -- 172.21.15.37:0/3074006973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8c70074450 con 0x7f8c70071260 2023-12-11T17:10:28.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.019+0000 7f8c677fe640 1 -- 172.21.15.37:0/3074006973 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f8c60079d80 con 0x7f8c70071260 2023-12-11T17:10:28.021 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:28.021 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2395601865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2395601865},{"type":"v1","addr":"172.21.15.151:6835","nonce":2395601865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1535809271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1535809271},{"type":"v1","addr":"172.21.15.151:6837","nonce":1535809271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2590175074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2590175074},{"type":"v1","addr":"172.21.15.37:6833","nonce":2590175074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-11T17:09:44.643511+0000","modified":"2023-12-11T17:10:12.829357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/2348606057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2348606057},{"type":"v1","addr":"172.21.15.37:6835","nonce":2348606057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T17:10:28.021 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-12-11T17:10:28.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.022+0000 7f8c6ffff640 1 -- 172.21.15.37:0/3074006973 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8c5006ae40 msgr2=0x7f8c5006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:28.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.022+0000 7f8c6ffff640 1 --2- 172.21.15.37:0/3074006973 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8c5006ae40 0x7f8c5006d300 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f8c70071bf0 tx=0x7f8c58009040 comp rx=0 tx=0).stop 2023-12-11T17:10:28.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.022+0000 7f8c6ffff640 1 -- 172.21.15.37:0/3074006973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c70071260 msgr2=0x7f8c7015d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:28.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.022+0000 7f8c6ffff640 1 --2- 172.21.15.37:0/3074006973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c70071260 0x7f8c7015d0a0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8c600097a0 tx=0x7f8c600046c0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.022+0000 7f8c6ffff640 1 -- 172.21.15.37:0/3074006973 shutdown_connections 2023-12-11T17:10:28.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.022+0000 7f8c6ffff640 1 --2- 172.21.15.37:0/3074006973 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8c5006ae40 0x7f8c5006d300 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.022+0000 7f8c6ffff640 1 --2- 172.21.15.37:0/3074006973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8c700ae200 0x7f8c70143520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.022+0000 7f8c6ffff640 1 --2- 172.21.15.37:0/3074006973 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8c7015e5d0 0x7f8c7009b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.022+0000 7f8c6ffff640 1 --2- 172.21.15.37:0/3074006973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c70071260 0x7f8c7015d0a0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.022+0000 7f8c6ffff640 1 -- 172.21.15.37:0/3074006973 >> 172.21.15.37:0/3074006973 conn(0x7f8c700b0860 msgr2=0x7f8c700b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:28.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.022+0000 7f8c6ffff640 1 -- 172.21.15.37:0/3074006973 shutdown_connections 2023-12-11T17:10:28.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.022+0000 7f8c6ffff640 1 -- 172.21.15.37:0/3074006973 wait complete. 2023-12-11T17:10:28.445 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-11T17:09:44.643511+0000', 'modified': '2023-12-11T17:10:12.829357+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4251}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4251': {'gid': 4251, 'name': 'a', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.37:6835/2348606057', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6834', 'nonce': 2348606057}, {'type': 'v1', 'addr': '172.21.15.37:6835', 'nonce': 2348606057}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-11T17:10:28.446 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-11T17:10:28.446 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-11T17:10:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.690+0000 7f93552c9640 1 Processor -- start 2023-12-11T17:10:28.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.690+0000 7f93552c9640 1 -- start start 2023-12-11T17:10:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.692+0000 7f93552c9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f935006c410 0x7f9350166020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:28.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.692+0000 7f93552c9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93500b3bb0 con 0x7f9350143e00 2023-12-11T17:10:28.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.692+0000 7f93552c9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93500b4e60 con 0x7f9350072180 2023-12-11T17:10:28.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.692+0000 7f93552c9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93501441e0 con 0x7f935006c410 2023-12-11T17:10:28.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.692+0000 7f934effd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9350143e00 0x7f93500b4040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41966/0 (socket says 172.21.15.37:41966) 2023-12-11T17:10:28.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.692+0000 7f934effd640 1 -- 172.21.15.37:0/214398589 learned_addr learned my addr 172.21.15.37:0/214398589 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:28.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.693+0000 7f934f7fe640 1 --2- 172.21.15.37:0/214398589 >> v2:172.21.15.151:3300/0 conn(0x7f935006c410 0x7f9350166020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:28.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.693+0000 7f934e7fc640 1 -- 172.21.15.37:0/214398589 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3123994774 0 0) 0x7f93500b3bb0 con 0x7f9350143e00 2023-12-11T17:10:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.693+0000 7f934e7fc640 1 -- 172.21.15.37:0/214398589 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f933c003520 con 0x7f9350143e00 2023-12-11T17:10:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.693+0000 7f934e7fc640 1 -- 172.21.15.37:0/214398589 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2277686995 0 0) 0x7f933c003520 con 0x7f9350143e00 2023-12-11T17:10:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.693+0000 7f934e7fc640 1 -- 172.21.15.37:0/214398589 >> v2:172.21.15.151:3300/0 conn(0x7f935006c410 msgr2=0x7f9350166020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.693+0000 7f934e7fc640 1 --2- 172.21.15.37:0/214398589 >> v2:172.21.15.151:3300/0 conn(0x7f935006c410 0x7f9350166020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.693+0000 7f934e7fc640 1 -- 172.21.15.37:0/214398589 >> v1:172.21.15.151:6789/0 conn(0x7f9350072180 legacy=0x7f93500b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.693+0000 7f934e7fc640 1 -- 172.21.15.37:0/214398589 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9350072680 con 0x7f9350143e00 2023-12-11T17:10:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.693+0000 7f934e7fc640 1 -- 172.21.15.37:0/214398589 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f9340001670 con 0x7f9350143e00 2023-12-11T17:10:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.693+0000 7f934e7fc640 1 -- 172.21.15.37:0/214398589 >> v1:172.21.15.37:6789/0 conn(0x7f9350143e00 legacy=0x7f93500b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:28.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.693+0000 7f934e7fc640 1 --2- 172.21.15.37:0/214398589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f933c0039c0 0x7f933c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:28.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.693+0000 7f934e7fc640 1 --2- 172.21.15.37:0/214398589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f933c0047c0 0x7f933c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:28.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.694+0000 7f934e7fc640 1 --2- 172.21.15.37:0/214398589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f933c0051d0 0x7f933c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:28.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.694+0000 7f934e7fc640 1 -- 172.21.15.37:0/214398589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93501441e0 con 0x7f933c0051d0 2023-12-11T17:10:28.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.694+0000 7f934e7fc640 1 -- 172.21.15.37:0/214398589 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f933c00c120 con 0x7f933c0047c0 2023-12-11T17:10:28.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.694+0000 7f934e7fc640 1 -- 172.21.15.37:0/214398589 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f933c00c2e0 con 0x7f933c0039c0 2023-12-11T17:10:28.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.694+0000 7f934f7fe640 1 --2- 172.21.15.37:0/214398589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f933c0051d0 0x7f933c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:28.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.694+0000 7f934f7fe640 1 -- 172.21.15.37:0/214398589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f933c0039c0 msgr2=0x7f933c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:28.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.694+0000 7f934f7fe640 1 --2- 172.21.15.37:0/214398589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f933c0039c0 0x7f933c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.694+0000 7f934f7fe640 1 -- 172.21.15.37:0/214398589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f933c0047c0 msgr2=0x7f933c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:28.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.694+0000 7f934f7fe640 1 --2- 172.21.15.37:0/214398589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f933c0047c0 0x7f933c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.694+0000 7f934f7fe640 1 -- 172.21.15.37:0/214398589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f933c003520 con 0x7f933c0051d0 2023-12-11T17:10:28.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.695+0000 7f934f7fe640 1 -- 172.21.15.37:0/214398589 reap_dead start 2023-12-11T17:10:28.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.695+0000 7f934f7fe640 1 --2- 172.21.15.37:0/214398589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f933c0051d0 0x7f933c00b980 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9348009f90 tx=0x7f933c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a617fac24b760f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:28.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.696+0000 7f934e7fc640 1 -- 172.21.15.37:0/214398589 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934802cc20 con 0x7f933c0051d0 2023-12-11T17:10:28.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.696+0000 7f934e7fc640 1 -- 172.21.15.37:0/214398589 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934800f040 con 0x7f933c0051d0 2023-12-11T17:10:28.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.696+0000 7f934e7fc640 1 -- 172.21.15.37:0/214398589 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9348003990 con 0x7f933c0051d0 2023-12-11T17:10:28.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.696+0000 7f93552c9640 1 -- 172.21.15.37:0/214398589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f933c0051d0 msgr2=0x7f933c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:28.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.696+0000 7f93552c9640 1 --2- 172.21.15.37:0/214398589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f933c0051d0 0x7f933c00b980 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f9348009f90 tx=0x7f933c0057f0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.696+0000 7f93552c9640 1 -- 172.21.15.37:0/214398589 shutdown_connections 2023-12-11T17:10:28.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.696+0000 7f93552c9640 1 --2- 172.21.15.37:0/214398589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f933c0051d0 0x7f933c00b980 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.696+0000 7f93552c9640 1 -- 172.21.15.37:0/214398589 >> 172.21.15.37:0/214398589 conn(0x7f93500b0a90 msgr2=0x7f93500b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:28.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.696+0000 7f93552c9640 1 -- 172.21.15.37:0/214398589 shutdown_connections 2023-12-11T17:10:28.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.696+0000 7f93552c9640 1 -- 172.21.15.37:0/214398589 wait complete. 2023-12-11T17:10:28.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.698+0000 7f93552c9640 1 Processor -- start 2023-12-11T17:10:28.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.698+0000 7f93552c9640 1 -- start start 2023-12-11T17:10:28.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.699+0000 7f93552c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f933c0051d0 0x7f9350138a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:28.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.699+0000 7f93552c9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f935015abf0 0x7f9350137070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:28.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.699+0000 7f93552c9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f935013a3c0 0x7f93501375b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:28.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.699+0000 7f93552c9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9350139320 con 0x7f933c0051d0 2023-12-11T17:10:28.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.699+0000 7f93552c9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9350139600 con 0x7f935015abf0 2023-12-11T17:10:28.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.699+0000 7f93552c9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93501398e0 con 0x7f935013a3c0 2023-12-11T17:10:28.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.699+0000 7f934effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f933c0051d0 0x7f9350138a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:28.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.699+0000 7f934effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f933c0051d0 0x7f9350138a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38312/0 (socket says 172.21.15.37:38312) 2023-12-11T17:10:28.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.700+0000 7f934effd640 1 -- 172.21.15.37:0/2451307268 learned_addr learned my addr 172.21.15.37:0/2451307268 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:28.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.700+0000 7f934f7fe640 1 --2- 172.21.15.37:0/2451307268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f935013a3c0 0x7f93501375b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:28.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.700+0000 7f934effd640 1 -- 172.21.15.37:0/2451307268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f935013a3c0 msgr2=0x7f93501375b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:28.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.700+0000 7f934effd640 1 --2- 172.21.15.37:0/2451307268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f935013a3c0 0x7f93501375b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.700+0000 7f934effd640 1 -- 172.21.15.37:0/2451307268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f935015abf0 msgr2=0x7f9350137070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:28.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.700+0000 7f9347fff640 1 --2- 172.21.15.37:0/2451307268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f935015abf0 0x7f9350137070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:28.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.700+0000 7f934effd640 1 --2- 172.21.15.37:0/2451307268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f935015abf0 0x7f9350137070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.700+0000 7f934effd640 1 -- 172.21.15.37:0/2451307268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9350139bc0 con 0x7f933c0051d0 2023-12-11T17:10:28.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.700+0000 7f9347fff640 1 --2- 172.21.15.37:0/2451307268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f935015abf0 0x7f9350137070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:28.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.700+0000 7f934effd640 1 --2- 172.21.15.37:0/2451307268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f933c0051d0 0x7f9350138a20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f934000c700 tx=0x7f934000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:28.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.701+0000 7f93477fe640 1 -- 172.21.15.37:0/2451307268 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93400072d0 con 0x7f933c0051d0 2023-12-11T17:10:28.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.701+0000 7f93477fe640 1 -- 172.21.15.37:0/2451307268 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9340007430 con 0x7f933c0051d0 2023-12-11T17:10:28.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.701+0000 7f93477fe640 1 -- 172.21.15.37:0/2451307268 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340004a20 con 0x7f933c0051d0 2023-12-11T17:10:28.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.701+0000 7f93552c9640 1 -- 172.21.15.37:0/2451307268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9350139ea0 con 0x7f933c0051d0 2023-12-11T17:10:28.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.701+0000 7f93552c9640 1 -- 172.21.15.37:0/2451307268 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93501354a0 con 0x7f933c0051d0 2023-12-11T17:10:28.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.703+0000 7f93477fe640 1 -- 172.21.15.37:0/2451307268 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9340004b80 con 0x7f933c0051d0 2023-12-11T17:10:28.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.704+0000 7f93477fe640 1 --2- 172.21.15.37:0/2451307268 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f933006ae70 0x7f933006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:28.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.704+0000 7f93477fe640 1 -- 172.21.15.37:0/2451307268 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9340088cd0 con 0x7f933c0051d0 2023-12-11T17:10:28.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.704+0000 7f9347fff640 1 --2- 172.21.15.37:0/2451307268 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f933006ae70 0x7f933006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:28.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.705+0000 7f9357e5a740 1 Processor -- start 2023-12-11T17:10:28.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.705+0000 7f9357e5a740 1 -- start start 2023-12-11T17:10:28.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.705+0000 7f9347fff640 1 --2- 172.21.15.37:0/2451307268 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f933006ae70 0x7f933006d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f935013eaa0 tx=0x7f9338009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:28.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.706+0000 7f9357e5a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145693b010 0x56145693b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:28.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.706+0000 7f9357e5a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145690b2c0 0x561456938280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:28.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.706+0000 7f9357e5a740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56145690eb90 0x5614569387c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:28.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.706+0000 7f9357e5a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x56145687df40 con 0x56145690b2c0 2023-12-11T17:10:28.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.706+0000 7f9357e5a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56145687b630 con 0x56145693b010 2023-12-11T17:10:28.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.706+0000 7f9357e5a740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x561456876f20 con 0x56145690eb90 2023-12-11T17:10:28.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.706+0000 7f9347fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145690b2c0 0x561456938280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:28.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.706+0000 7f9347fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145690b2c0 0x561456938280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38316/0 (socket says 172.21.15.37:38316) 2023-12-11T17:10:28.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.706+0000 7f9347fff640 1 -- 172.21.15.37:0/308731599 learned_addr learned my addr 172.21.15.37:0/308731599 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:28.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.706+0000 7f934effd640 1 --2- 172.21.15.37:0/308731599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145693b010 0x56145693b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:28.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.706+0000 7f934f7fe640 1 --2- 172.21.15.37:0/308731599 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56145690eb90 0x5614569387c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:28.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.706+0000 7f9347fff640 1 -- 172.21.15.37:0/308731599 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56145690eb90 msgr2=0x5614569387c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:28.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.706+0000 7f9347fff640 1 --2- 172.21.15.37:0/308731599 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56145690eb90 0x5614569387c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.706+0000 7f9347fff640 1 -- 172.21.15.37:0/308731599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145693b010 msgr2=0x56145693b3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:28.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.706+0000 7f9347fff640 1 --2- 172.21.15.37:0/308731599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145693b010 0x56145693b3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.706+0000 7f9347fff640 1 -- 172.21.15.37:0/308731599 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561456839910 con 0x56145690b2c0 2023-12-11T17:10:28.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.706+0000 7f934effd640 1 --2- 172.21.15.37:0/308731599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145693b010 0x56145693b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:28.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.706+0000 7f934f7fe640 1 --2- 172.21.15.37:0/308731599 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56145690eb90 0x5614569387c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:28.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.707+0000 7f9347fff640 1 --2- 172.21.15.37:0/308731599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145690b2c0 0x561456938280 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9338005120 tx=0x7f9338010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8556f1a008f35c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:28.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.707+0000 7f9344ff9640 1 -- 172.21.15.37:0/308731599 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f933801c070 con 0x56145690b2c0 2023-12-11T17:10:28.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.707+0000 7f9344ff9640 1 -- 172.21.15.37:0/308731599 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933800de50 con 0x56145690b2c0 2023-12-11T17:10:28.710 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.707+0000 7f9344ff9640 1 -- 172.21.15.37:0/308731599 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9338003830 con 0x56145690b2c0 2023-12-11T17:10:28.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.707+0000 7f9357e5a740 1 -- 172.21.15.37:0/308731599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145690b2c0 msgr2=0x561456938280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:28.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.707+0000 7f9357e5a740 1 --2- 172.21.15.37:0/308731599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145690b2c0 0x561456938280 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f9338005120 tx=0x7f9338010000 comp rx=0 tx=0).stop 2023-12-11T17:10:28.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.708+0000 7f9357e5a740 1 -- 172.21.15.37:0/308731599 shutdown_connections 2023-12-11T17:10:28.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.708+0000 7f9357e5a740 1 --2- 172.21.15.37:0/308731599 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56145690eb90 0x5614569387c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.708+0000 7f9357e5a740 1 --2- 172.21.15.37:0/308731599 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145690b2c0 0x561456938280 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.708+0000 7f9357e5a740 1 --2- 172.21.15.37:0/308731599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145693b010 0x56145693b3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.708+0000 7f9357e5a740 1 -- 172.21.15.37:0/308731599 >> 172.21.15.37:0/308731599 conn(0x56145690d530 msgr2=0x561456955e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.708+0000 7f9357e5a740 1 -- 172.21.15.37:0/308731599 shutdown_connections 2023-12-11T17:10:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.708+0000 7f9357e5a740 1 -- 172.21.15.37:0/308731599 wait complete. 2023-12-11T17:10:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.708+0000 7f9357e5a740 1 -- start start 2023-12-11T17:10:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.709+0000 7f9357e5a740 1 Processor -- start 2023-12-11T17:10:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.710+0000 7f9357e5a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145690eb90 0x561456966430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.710+0000 7f9357e5a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145693b010 0x561456966970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.710+0000 7f9357e5a740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614569565c0 0x561456930f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.710+0000 7f9357e5a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x5614568132f0 con 0x56145693b010 2023-12-11T17:10:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.710+0000 7f9357e5a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561456830c70 con 0x56145690eb90 2023-12-11T17:10:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.710+0000 7f9357e5a740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5614565d9f20 con 0x5614569565c0 2023-12-11T17:10:28.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.710+0000 7f9357e5a740 10 client.0 _ll_register_callbacks cb 0x5614568353b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T17:10:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.710+0000 7f9347fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145693b010 0x561456966970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.710+0000 7f9347fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145693b010 0x561456966970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38330/0 (socket says 172.21.15.37:38330) 2023-12-11T17:10:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.710+0000 7f9347fff640 1 -- 172.21.15.37:0/1671020550 learned_addr learned my addr 172.21.15.37:0/1671020550 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.710+0000 7f934f7fe640 1 --2- 172.21.15.37:0/1671020550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614569565c0 0x561456930f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.710+0000 7f9347fff640 1 -- 172.21.15.37:0/1671020550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614569565c0 msgr2=0x561456930f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.710+0000 7f9347fff640 1 --2- 172.21.15.37:0/1671020550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614569565c0 0x561456930f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.710+0000 7f934effd640 1 --2- 172.21.15.37:0/1671020550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145690eb90 0x561456966430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.710+0000 7f9347fff640 1 -- 172.21.15.37:0/1671020550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145690eb90 msgr2=0x561456966430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.710+0000 7f9347fff640 1 --2- 172.21.15.37:0/1671020550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145690eb90 0x561456966430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.710+0000 7f9347fff640 1 -- 172.21.15.37:0/1671020550 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93500b4e60 con 0x56145693b010 2023-12-11T17:10:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.711+0000 7f9347fff640 1 --2- 172.21.15.37:0/1671020550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145693b010 0x561456966970 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f933800db10 tx=0x7f9338007950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ca58ba6fe5238e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.711+0000 7f932dffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-12-11T17:10:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.711+0000 7f932dffb640 1 -- 172.21.15.37:0/1671020550 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9338026070 con 0x56145693b010 2023-12-11T17:10:28.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.711+0000 7f932dffb640 1 -- 172.21.15.37:0/1671020550 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f933802cdc0 con 0x56145693b010 2023-12-11T17:10:28.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.711+0000 7f9357e5a740 1 -- 172.21.15.37:0/1671020550 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56145686fdb0 con 0x56145693b010 2023-12-11T17:10:28.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.711+0000 7f932dffb640 1 -- 172.21.15.37:0/1671020550 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9338003e70 con 0x56145693b010 2023-12-11T17:10:28.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.711+0000 7f9357e5a740 10 client.4830 fetch_fsmap learned FSMap version 8 2023-12-11T17:10:28.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.711+0000 7f9357e5a740 1 -- 172.21.15.37:0/1671020550 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x5614568755a0 con 0x56145693b010 2023-12-11T17:10:28.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.712+0000 7f932dffb640 1 -- 172.21.15.37:0/1671020550 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56145686fdb0 con 0x56145693b010 2023-12-11T17:10:28.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.712+0000 7f932dffb640 1 -- 172.21.15.37:0/1671020550 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f933802b420 con 0x56145693b010 2023-12-11T17:10:28.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.712+0000 7f9357e5a740 10 client.4830 fetch_fsmap finished waiting for FSMap version 8 2023-12-11T17:10:28.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.712+0000 7f9357e5a740 10 client.4830 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-11T17:10:28.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.712+0000 7f9357e5a740 20 client.4830 populate_metadata read hostname 'smithi037' 2023-12-11T17:10:28.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.712+0000 7f9357e5a740 1 --2- 172.21.15.37:0/1671020550 >> [v2:172.21.15.37:6834/2348606057,v1:172.21.15.37:6835/2348606057] conn(0x561456933d30 0x561456935130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:28.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.712+0000 7f9357e5a740 4 client.4830 mds_command: new command op to 4251 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T17:10:28.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.712+0000 7f9357e5a740 1 -- 172.21.15.37:0/1671020550 --> [v2:172.21.15.37:6834/2348606057,v1:172.21.15.37:6835/2348606057] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56145686fad0 con 0x561456933d30 2023-12-11T17:10:28.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.712+0000 7f934effd640 1 --2- 172.21.15.37:0/1671020550 >> [v2:172.21.15.37:6834/2348606057,v1:172.21.15.37:6835/2348606057] conn(0x561456933d30 0x561456935130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:28.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.713+0000 7f934effd640 1 --2- 172.21.15.37:0/1671020550 >> [v2:172.21.15.37:6834/2348606057,v1:172.21.15.37:6835/2348606057] conn(0x561456933d30 0x561456935130 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=618ccec740889c5 server_cookie=83d524a32d5e52e3 in_seq=0 out_seq=0 2023-12-11T17:10:28.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.713+0000 7f932dffb640 10 client.4830 ms_handle_connect on v2:172.21.15.37:6834/2348606057 2023-12-11T17:10:28.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.713+0000 7f932dffb640 1 -- 172.21.15.37:0/1671020550 <== mds.0 v2:172.21.15.37:6834/2348606057 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56145686fad0 con 0x561456933d30 2023-12-11T17:10:28.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.713+0000 7f932dffb640 10 client.4830 handle_command_reply: tid=0 2023-12-11T17:10:28.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.713+0000 7f9357e5a740 1 client.4830 shutdown 2023-12-11T17:10:28.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.713+0000 7f9357e5a740 1 -- 172.21.15.37:0/1671020550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145693b010 msgr2=0x561456966970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:28.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.713+0000 7f9357e5a740 1 --2- 172.21.15.37:0/1671020550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145693b010 0x561456966970 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f933800db10 tx=0x7f9338007950 comp rx=0 tx=0).stop 2023-12-11T17:10:28.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.714+0000 7f9357e5a740 1 -- 172.21.15.37:0/1671020550 shutdown_connections 2023-12-11T17:10:28.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.714+0000 7f9357e5a740 1 --2- 172.21.15.37:0/1671020550 >> [v2:172.21.15.37:6834/2348606057,v1:172.21.15.37:6835/2348606057] conn(0x561456933d30 0x561456935130 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.714+0000 7f9357e5a740 1 --2- 172.21.15.37:0/1671020550 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x5614569565c0 0x561456930f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.714+0000 7f9357e5a740 1 --2- 172.21.15.37:0/1671020550 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145693b010 0x561456966970 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.714+0000 7f9357e5a740 1 --2- 172.21.15.37:0/1671020550 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56145690eb90 0x561456966430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.714+0000 7f932dffb640 0 client.4830 ms_handle_reset on v2:172.21.15.37:6834/2348606057 2023-12-11T17:10:28.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.714+0000 7f9357e5a740 1 -- 172.21.15.37:0/1671020550 >> 172.21.15.37:0/1671020550 conn(0x56145690b2c0 msgr2=0x56145690f560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:28.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.714+0000 7f9357e5a740 1 -- 172.21.15.37:0/1671020550 shutdown_connections 2023-12-11T17:10:28.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.714+0000 7f9357e5a740 1 -- 172.21.15.37:0/1671020550 wait complete. 2023-12-11T17:10:28.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.714+0000 7f9357e5a740 20 client.4830 trim_cache size 0 max 16384 2023-12-11T17:10:28.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.731+0000 7f9357e5a740 1 Processor -- start 2023-12-11T17:10:28.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.731+0000 7f9357e5a740 1 -- start start 2023-12-11T17:10:28.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.732+0000 7f9357e5a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145690eb90 0x56145690a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:28.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.732+0000 7f9357e5a740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56145693b010 0x56145690a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.732+0000 7f9357e5a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614569565c0 0x561456967be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.732+0000 7f9357e5a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x561456938830 con 0x56145690eb90 2023-12-11T17:10:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.732+0000 7f9357e5a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561456956ed0 con 0x5614569565c0 2023-12-11T17:10:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.732+0000 7f9357e5a740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x561456968ea0 con 0x56145693b010 2023-12-11T17:10:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.732+0000 7f934effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145690eb90 0x56145690a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.732+0000 7f934effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145690eb90 0x56145690a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38342/0 (socket says 172.21.15.37:38342) 2023-12-11T17:10:28.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.732+0000 7f934effd640 1 -- 172.21.15.37:0/1119308019 learned_addr learned my addr 172.21.15.37:0/1119308019 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.733+0000 7f934f7fe640 1 --2- 172.21.15.37:0/1119308019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614569565c0 0x561456967be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.733+0000 7f9347fff640 1 --2- 172.21.15.37:0/1119308019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56145693b010 0x56145690a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.733+0000 7f934effd640 1 -- 172.21.15.37:0/1119308019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56145693b010 msgr2=0x56145690a820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.733+0000 7f934effd640 1 --2- 172.21.15.37:0/1119308019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56145693b010 0x56145690a820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.733+0000 7f934effd640 1 -- 172.21.15.37:0/1119308019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614569565c0 msgr2=0x561456967be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:28.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.733+0000 7f934effd640 1 --2- 172.21.15.37:0/1119308019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614569565c0 0x561456967be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.733+0000 7f934effd640 1 -- 172.21.15.37:0/1119308019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x561456812b80 con 0x56145690eb90 2023-12-11T17:10:28.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.733+0000 7f934effd640 1 --2- 172.21.15.37:0/1119308019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145690eb90 0x56145690a2e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f934005f480 tx=0x7f9340009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713035c4e375164b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:28.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.733+0000 7f93457fa640 1 -- 172.21.15.37:0/1119308019 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934005f9b0 con 0x56145690eb90 2023-12-11T17:10:28.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.733+0000 7f93457fa640 1 -- 172.21.15.37:0/1119308019 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9340007620 con 0x56145690eb90 2023-12-11T17:10:28.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.733+0000 7f93457fa640 1 -- 172.21.15.37:0/1119308019 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9340055a50 con 0x56145690eb90 2023-12-11T17:10:28.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.734+0000 7f9357e5a740 1 -- 172.21.15.37:0/1119308019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145690eb90 msgr2=0x56145690a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:28.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.734+0000 7f9357e5a740 1 --2- 172.21.15.37:0/1119308019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145690eb90 0x56145690a2e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f934005f480 tx=0x7f9340009040 comp rx=0 tx=0).stop 2023-12-11T17:10:28.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.734+0000 7f9357e5a740 1 -- 172.21.15.37:0/1119308019 shutdown_connections 2023-12-11T17:10:28.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.734+0000 7f9357e5a740 1 --2- 172.21.15.37:0/1119308019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614569565c0 0x561456967be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.734+0000 7f9357e5a740 1 --2- 172.21.15.37:0/1119308019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56145693b010 0x56145690a820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.734+0000 7f9357e5a740 1 --2- 172.21.15.37:0/1119308019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56145690eb90 0x56145690a2e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.734+0000 7f9357e5a740 1 -- 172.21.15.37:0/1119308019 >> 172.21.15.37:0/1119308019 conn(0x56145690b2c0 msgr2=0x56145690f370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:28.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.734+0000 7f9357e5a740 1 -- 172.21.15.37:0/1119308019 shutdown_connections 2023-12-11T17:10:28.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.734+0000 7f9357e5a740 1 -- 172.21.15.37:0/1119308019 wait complete. 2023-12-11T17:10:28.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.735+0000 7f9357e5a740 1 -- start start 2023-12-11T17:10:28.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.735+0000 7f9357e5a740 1 Processor -- start 2023-12-11T17:10:28.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.736+0000 7f9357e5a740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56145693b010 0x5614569c0e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:28.742 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.736+0000 7f9357e5a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614569565c0 0x561456936500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.736+0000 7f9357e5a740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561456966550 0x561456936be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.736+0000 7f9357e5a740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x56145690fae0 con 0x561456966550 2023-12-11T17:10:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.736+0000 7f9357e5a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x561456936a40 con 0x5614569565c0 2023-12-11T17:10:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.736+0000 7f9357e5a740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x5614569c16d0 con 0x56145693b010 2023-12-11T17:10:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.736+0000 7f9357e5a740 10 client.0 _ll_register_callbacks cb 0x7f93380035f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T17:10:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.736+0000 7f934f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561456966550 0x561456936be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.736+0000 7f934f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561456966550 0x561456936be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:38352/0 (socket says 172.21.15.37:38352) 2023-12-11T17:10:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.736+0000 7f934f7fe640 1 -- 172.21.15.37:0/3813772382 learned_addr learned my addr 172.21.15.37:0/3813772382 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.737+0000 7f9347fff640 1 --2- 172.21.15.37:0/3813772382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614569565c0 0x561456936500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.737+0000 7f934effd640 1 --2- 172.21.15.37:0/3813772382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56145693b010 0x5614569c0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.737+0000 7f934f7fe640 1 -- 172.21.15.37:0/3813772382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56145693b010 msgr2=0x5614569c0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.737+0000 7f934f7fe640 1 --2- 172.21.15.37:0/3813772382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56145693b010 0x5614569c0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.737+0000 7f934f7fe640 1 -- 172.21.15.37:0/3813772382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614569565c0 msgr2=0x561456936500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.737+0000 7f934f7fe640 1 --2- 172.21.15.37:0/3813772382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614569565c0 0x561456936500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.737+0000 7f934f7fe640 1 -- 172.21.15.37:0/3813772382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93501354a0 con 0x561456966550 2023-12-11T17:10:28.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.737+0000 7f9347fff640 1 --2- 172.21.15.37:0/3813772382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614569565c0 0x561456936500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:28.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.737+0000 7f934effd640 1 --2- 172.21.15.37:0/3813772382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56145693b010 0x5614569c0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:28.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.737+0000 7f934f7fe640 1 --2- 172.21.15.37:0/3813772382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561456966550 0x561456936be0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f934802c690 tx=0x7f9348004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eece1450fbfb1981 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:28.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.737+0000 7f932dffb640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-12-11T17:10:28.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.737+0000 7f932dffb640 1 -- 172.21.15.37:0/3813772382 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9348003da0 con 0x561456966550 2023-12-11T17:10:28.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.737+0000 7f932dffb640 1 -- 172.21.15.37:0/3813772382 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f9348034770 con 0x561456966550 2023-12-11T17:10:28.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.737+0000 7f9357e5a740 1 -- 172.21.15.37:0/3813772382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f933800de50 con 0x561456966550 2023-12-11T17:10:28.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.738+0000 7f932dffb640 1 -- 172.21.15.37:0/3813772382 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9348034930 con 0x561456966550 2023-12-11T17:10:28.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.738+0000 7f9357e5a740 10 client.4836 fetch_fsmap learned FSMap version 8 2023-12-11T17:10:28.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.738+0000 7f9357e5a740 1 -- 172.21.15.37:0/3813772382 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x561456838170 con 0x561456966550 2023-12-11T17:10:28.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.738+0000 7f932dffb640 1 -- 172.21.15.37:0/3813772382 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f933800de50 con 0x561456966550 2023-12-11T17:10:28.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.738+0000 7f932dffb640 1 -- 172.21.15.37:0/3813772382 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 8) v1 ==== 3302+0+0 (secure 0 0 0) 0x7f9348034a90 con 0x561456966550 2023-12-11T17:10:28.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.738+0000 7f9357e5a740 10 client.4836 fetch_fsmap finished waiting for FSMap version 8 2023-12-11T17:10:28.744 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.738+0000 7f9357e5a740 10 client.4836 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-11T17:10:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.738+0000 7f9357e5a740 20 client.4836 populate_metadata read hostname 'smithi037' 2023-12-11T17:10:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.738+0000 7f9357e5a740 1 --2- 172.21.15.37:0/3813772382 >> [v2:172.21.15.37:6834/2348606057,v1:172.21.15.37:6835/2348606057] conn(0x5614569577c0 0x56145696f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.738+0000 7f9357e5a740 4 client.4836 mds_command: new command op to 4251 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-11T17:10:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.738+0000 7f9357e5a740 1 -- 172.21.15.37:0/3813772382 --> [v2:172.21.15.37:6834/2348606057,v1:172.21.15.37:6835/2348606057] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5614565776c0 con 0x5614569577c0 2023-12-11T17:10:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.738+0000 7f934effd640 1 --2- 172.21.15.37:0/3813772382 >> [v2:172.21.15.37:6834/2348606057,v1:172.21.15.37:6835/2348606057] conn(0x5614569577c0 0x56145696f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.739+0000 7f934effd640 1 --2- 172.21.15.37:0/3813772382 >> [v2:172.21.15.37:6834/2348606057,v1:172.21.15.37:6835/2348606057] conn(0x5614569577c0 0x56145696f6c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3669ff1a782f0846 server_cookie=3aee775f1004de35 in_seq=0 out_seq=0 2023-12-11T17:10:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.739+0000 7f932dffb640 10 client.4836 ms_handle_connect on v2:172.21.15.37:6834/2348606057 2023-12-11T17:10:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.739+0000 7f932dffb640 1 -- 172.21.15.37:0/3813772382 <== mds.0 v2:172.21.15.37:6834/2348606057 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+330 (crc 0 0 0) 0x5614565776c0 con 0x5614569577c0 2023-12-11T17:10:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.739+0000 7f932dffb640 10 client.4836 handle_command_reply: tid=0 2023-12-11T17:10:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.739+0000 7f9357e5a740 1 client.4836 shutdown 2023-12-11T17:10:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.739+0000 7f9357e5a740 1 -- 172.21.15.37:0/3813772382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561456966550 msgr2=0x561456936be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.739+0000 7f9357e5a740 1 --2- 172.21.15.37:0/3813772382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561456966550 0x561456936be0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f934802c690 tx=0x7f9348004ab0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.739+0000 7f9357e5a740 1 -- 172.21.15.37:0/3813772382 shutdown_connections 2023-12-11T17:10:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.739+0000 7f9357e5a740 1 --2- 172.21.15.37:0/3813772382 >> [v2:172.21.15.37:6834/2348606057,v1:172.21.15.37:6835/2348606057] conn(0x5614569577c0 0x56145696f6c0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.745 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.739+0000 7f9357e5a740 1 --2- 172.21.15.37:0/3813772382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5614569565c0 0x561456936500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.739+0000 7f9357e5a740 1 --2- 172.21.15.37:0/3813772382 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561456966550 0x561456936be0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.739+0000 7f9357e5a740 1 --2- 172.21.15.37:0/3813772382 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56145693b010 0x5614569c0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.739+0000 7f9357e5a740 1 -- 172.21.15.37:0/3813772382 >> 172.21.15.37:0/3813772382 conn(0x56145690b2c0 msgr2=0x561456959330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.739+0000 7f932dffb640 0 client.4836 ms_handle_reset on v2:172.21.15.37:6834/2348606057 2023-12-11T17:10:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.740+0000 7f9357e5a740 1 -- 172.21.15.37:0/3813772382 shutdown_connections 2023-12-11T17:10:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.740+0000 7f9357e5a740 1 -- 172.21.15.37:0/3813772382 wait complete. 2023-12-11T17:10:28.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.740+0000 7f9357e5a740 20 client.4836 trim_cache size 0 max 16384 2023-12-11T17:10:28.746 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-12-11T17:10:28.746 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "349792a4-57b1-4c92-9cc0-0c9ba4325d41", 2023-12-11T17:10:28.746 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-12-11T17:10:28.746 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 4251, 2023-12-11T17:10:28.747 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-12-11T17:10:28.747 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-12-11T17:10:28.747 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-12-11T17:10:28.747 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 43.569784372999997, 2023-12-11T17:10:28.747 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 8, 2023-12-11T17:10:28.747 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 25, 2023-12-11T17:10:28.747 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 25, 2023-12-11T17:10:28.747 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 51.102304396000001 2023-12-11T17:10:28.747 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-12-11T17:10:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.740+0000 7f93552c9640 1 -- 172.21.15.37:0/2451307268 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f933006ae70 msgr2=0x7f933006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.740+0000 7f93552c9640 1 --2- 172.21.15.37:0/2451307268 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f933006ae70 0x7f933006d330 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f935013eaa0 tx=0x7f9338009040 comp rx=0 tx=0).stop 2023-12-11T17:10:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.740+0000 7f93552c9640 1 -- 172.21.15.37:0/2451307268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f933c0051d0 msgr2=0x7f9350138a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:28.748 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.740+0000 7f93552c9640 1 --2- 172.21.15.37:0/2451307268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f933c0051d0 0x7f9350138a20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f934000c700 tx=0x7f934000cbc0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.740+0000 7f93552c9640 1 -- 172.21.15.37:0/2451307268 shutdown_connections 2023-12-11T17:10:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.740+0000 7f93552c9640 1 --2- 172.21.15.37:0/2451307268 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f933006ae70 0x7f933006d330 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.740+0000 7f93552c9640 1 --2- 172.21.15.37:0/2451307268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f935015abf0 0x7f9350137070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.740+0000 7f93552c9640 1 --2- 172.21.15.37:0/2451307268 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f935013a3c0 0x7f93501375b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.740+0000 7f93552c9640 1 --2- 172.21.15.37:0/2451307268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f933c0051d0 0x7f9350138a20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.740+0000 7f93552c9640 1 -- 172.21.15.37:0/2451307268 >> 172.21.15.37:0/2451307268 conn(0x7f93500b0a90 msgr2=0x7f9350072ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:28.749 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.741+0000 7f93552c9640 1 -- 172.21.15.37:0/2451307268 shutdown_connections 2023-12-11T17:10:28.750 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:28.741+0000 7f93552c9640 1 -- 172.21.15.37:0/2451307268 wait complete. 2023-12-11T17:10:28.762 INFO:teuthology.run_tasks:Running task kclient... 2023-12-11T17:10:28.779 INFO:tasks.kclient:Mounting kernel clients... 2023-12-11T17:10:28.779 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-12-11T17:10:28.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:28.779 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-12-11T17:10:28.838 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2023-12-11T17:10:28.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:28.840 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2023-12-11T17:10:28.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:28.938 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2023-12-11T17:10:29.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:29.070 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-12-11T17:10:29.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:29.119 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link delete ceph-brx 2023-12-11T17:10:29.270 INFO:teuthology.orchestra.run.smithi037.stderr:Cannot find device "ceph-brx" 2023-12-11T17:10:29.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-11T17:10:29.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:29.275 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-11T17:10:29.337 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:29.337 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2023-12-11T17:10:29.433 INFO:teuthology.orchestra.run.smithi151.stderr:Cannot find device "ceph-brx" 2023-12-11T17:10:29.436 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-11T17:10:29.437 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:29.437 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-11T17:10:29.488 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:29.488 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link delete ceph-brx 2023-12-11T17:10:29.581 INFO:teuthology.orchestra.run.smithi151.stderr:Cannot find device "ceph-brx" 2023-12-11T17:10:29.584 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-11T17:10:29.584 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-12-11T17:10:29.585 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-11T17:10:29.585 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-11T17:10:29.585 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-11T17:10:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.817+0000 7f816f790640 1 Processor -- start 2023-12-11T17:10:29.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.817+0000 7f816f790640 1 -- start start 2023-12-11T17:10:29.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.818+0000 7f816f790640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f81680cdeb0 0x7f81680cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.818+0000 7f816f790640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f81680ccb80 0x7f81680adc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.818+0000 7f816f790640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81680cc6f0 con 0x7f816815b3a0 2023-12-11T17:10:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.818+0000 7f816f790640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81680cff80 con 0x7f81680cdeb0 2023-12-11T17:10:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.818+0000 7f816f790640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81680cbdc0 con 0x7f81680ccb80 2023-12-11T17:10:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.819+0000 7f816cd2b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f81680cdeb0 0x7f81680cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.819+0000 7f816d52c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f816815b3a0 0x7f81680cd7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:58866/0 (socket says 172.21.15.37:58866) 2023-12-11T17:10:29.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.819+0000 7f816d52c640 1 -- 172.21.15.37:0/3722992366 learned_addr learned my addr 172.21.15.37:0/3722992366 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.819+0000 7f816dd2d640 1 --2- 172.21.15.37:0/3722992366 >> v2:172.21.15.151:3300/0 conn(0x7f81680ccb80 0x7f81680adc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.819+0000 7f816cd2b640 1 -- 172.21.15.37:0/3722992366 >> v2:172.21.15.151:3300/0 conn(0x7f81680ccb80 msgr2=0x7f81680adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.819+0000 7f816cd2b640 1 --2- 172.21.15.37:0/3722992366 >> v2:172.21.15.151:3300/0 conn(0x7f81680ccb80 0x7f81680adc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.819+0000 7f816cd2b640 1 -- 172.21.15.37:0/3722992366 >> v1:172.21.15.37:6789/0 conn(0x7f816815b3a0 legacy=0x7f81680cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:29.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.819+0000 7f816cd2b640 1 -- 172.21.15.37:0/3722992366 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81680cc0a0 con 0x7f81680cdeb0 2023-12-11T17:10:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.820+0000 7f816cd2b640 1 --2- 172.21.15.37:0/3722992366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81680cdeb0 0x7f81680cfa40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8168072160 tx=0x7f815c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16514e848eaed858 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.821+0000 7f8167fff640 1 -- 172.21.15.37:0/3722992366 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c031830 con 0x7f81680cdeb0 2023-12-11T17:10:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.821+0000 7f8167fff640 1 -- 172.21.15.37:0/3722992366 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815c031990 con 0x7f81680cdeb0 2023-12-11T17:10:29.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.821+0000 7f8167fff640 1 -- 172.21.15.37:0/3722992366 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815c031d20 con 0x7f81680cdeb0 2023-12-11T17:10:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.821+0000 7f816f790640 1 -- 172.21.15.37:0/3722992366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81680cdeb0 msgr2=0x7f81680cfa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.821+0000 7f816f790640 1 --2- 172.21.15.37:0/3722992366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81680cdeb0 0x7f81680cfa40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8168072160 tx=0x7f815c02b8d0 comp rx=0 tx=0).stop 2023-12-11T17:10:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.821+0000 7f816f790640 1 -- 172.21.15.37:0/3722992366 shutdown_connections 2023-12-11T17:10:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.821+0000 7f816f790640 1 --2- 172.21.15.37:0/3722992366 >> v2:172.21.15.151:3300/0 conn(0x7f81680ccb80 0x7f81680adc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.821+0000 7f816f790640 1 --2- 172.21.15.37:0/3722992366 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81680cdeb0 0x7f81680cfa40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.821+0000 7f816f790640 1 -- 172.21.15.37:0/3722992366 >> 172.21.15.37:0/3722992366 conn(0x7f81680d0ed0 msgr2=0x7f81680d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.821+0000 7f816f790640 1 -- 172.21.15.37:0/3722992366 shutdown_connections 2023-12-11T17:10:29.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.821+0000 7f816f790640 1 -- 172.21.15.37:0/3722992366 wait complete. 2023-12-11T17:10:29.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.823+0000 7f816f790640 1 Processor -- start 2023-12-11T17:10:29.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.823+0000 7f816f790640 1 -- start start 2023-12-11T17:10:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.824+0000 7f816f790640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81680ccb80 0x7f81680c6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.824+0000 7f816f790640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81680cdeb0 0x7f8168142650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.824+0000 7f816f790640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f816815b3a0 0x7f8168142b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.824+0000 7f816f790640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81681423c0 con 0x7f81680ccb80 2023-12-11T17:10:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.824+0000 7f816f790640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81680c5a40 con 0x7f81680cdeb0 2023-12-11T17:10:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.824+0000 7f816f790640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81680c5ce0 con 0x7f816815b3a0 2023-12-11T17:10:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.825+0000 7f816d52c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81680ccb80 0x7f81680c6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.825+0000 7f816d52c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81680ccb80 0x7f81680c6aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39892/0 (socket says 172.21.15.37:39892) 2023-12-11T17:10:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.825+0000 7f816d52c640 1 -- 172.21.15.37:0/469564020 learned_addr learned my addr 172.21.15.37:0/469564020 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:29.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.825+0000 7f816d52c640 1 -- 172.21.15.37:0/469564020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f816815b3a0 msgr2=0x7f8168142b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.825+0000 7f816d52c640 1 --2- 172.21.15.37:0/469564020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f816815b3a0 0x7f8168142b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.825+0000 7f816d52c640 1 -- 172.21.15.37:0/469564020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81680cdeb0 msgr2=0x7f8168142650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.825+0000 7f816d52c640 1 --2- 172.21.15.37:0/469564020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81680cdeb0 0x7f8168142650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:29.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.825+0000 7f816d52c640 1 -- 172.21.15.37:0/469564020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f815c009400 con 0x7f81680ccb80 2023-12-11T17:10:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.825+0000 7f816d52c640 1 --2- 172.21.15.37:0/469564020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81680ccb80 0x7f81680c6aa0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f815800cbc0 tx=0x7f815800a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.826+0000 7f8165ffb640 1 -- 172.21.15.37:0/469564020 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f815800aca0 con 0x7f81680ccb80 2023-12-11T17:10:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.826+0000 7f8165ffb640 1 -- 172.21.15.37:0/469564020 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f815800ae00 con 0x7f81680ccb80 2023-12-11T17:10:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.826+0000 7f8165ffb640 1 -- 172.21.15.37:0/469564020 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8158012600 con 0x7f81680ccb80 2023-12-11T17:10:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.826+0000 7f816f790640 1 -- 172.21.15.37:0/469564020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81680c5fc0 con 0x7f81680ccb80 2023-12-11T17:10:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.826+0000 7f816f790640 1 -- 172.21.15.37:0/469564020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81680c6580 con 0x7f81680ccb80 2023-12-11T17:10:29.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.827+0000 7f816f790640 1 -- 172.21.15.37:0/469564020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81680745d0 con 0x7f81680ccb80 2023-12-11T17:10:29.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.828+0000 7f8165ffb640 1 -- 172.21.15.37:0/469564020 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8158007070 con 0x7f81680ccb80 2023-12-11T17:10:29.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.829+0000 7f8165ffb640 1 --2- 172.21.15.37:0/469564020 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f815406ae40 0x7f815406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:29.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.829+0000 7f8165ffb640 1 -- 172.21.15.37:0/469564020 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 6460+0+0 (secure 0 0 0) 0x7f81580896b0 con 0x7f81680ccb80 2023-12-11T17:10:29.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.830+0000 7f816cd2b640 1 --2- 172.21.15.37:0/469564020 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f815406ae40 0x7f815406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:29.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.831+0000 7f816cd2b640 1 --2- 172.21.15.37:0/469564020 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f815406ae40 0x7f815406d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f815c036000 tx=0x7f815c030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:29.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:29.834+0000 7f8165ffb640 1 -- 172.21.15.37:0/469564020 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f81580545b0 con 0x7f81680ccb80 2023-12-11T17:10:30.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:30.069+0000 7f816f790640 1 -- 172.21.15.37:0/469564020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f81680cfa40 con 0x7f81680ccb80 2023-12-11T17:10:30.070 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:30.070+0000 7f8165ffb640 1 -- 172.21.15.37:0/469564020 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f8158017070 con 0x7f81680ccb80 2023-12-11T17:10:30.071 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-11T17:10:30.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:30.072+0000 7f816f790640 1 -- 172.21.15.37:0/469564020 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f815406ae40 msgr2=0x7f815406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:30.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:30.072+0000 7f816f790640 1 --2- 172.21.15.37:0/469564020 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f815406ae40 0x7f815406d300 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f815c036000 tx=0x7f815c030000 comp rx=0 tx=0).stop 2023-12-11T17:10:30.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:30.072+0000 7f816f790640 1 -- 172.21.15.37:0/469564020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81680ccb80 msgr2=0x7f81680c6aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:30.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:30.072+0000 7f816f790640 1 --2- 172.21.15.37:0/469564020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81680ccb80 0x7f81680c6aa0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f815800cbc0 tx=0x7f815800a060 comp rx=0 tx=0).stop 2023-12-11T17:10:30.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:30.072+0000 7f816f790640 1 -- 172.21.15.37:0/469564020 shutdown_connections 2023-12-11T17:10:30.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:30.072+0000 7f816f790640 1 --2- 172.21.15.37:0/469564020 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f815406ae40 0x7f815406d300 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:30.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:30.072+0000 7f816f790640 1 --2- 172.21.15.37:0/469564020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f81680cdeb0 0x7f8168142650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:30.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:30.072+0000 7f816f790640 1 --2- 172.21.15.37:0/469564020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f816815b3a0 0x7f8168142b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:30.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:30.072+0000 7f816f790640 1 --2- 172.21.15.37:0/469564020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f81680ccb80 0x7f81680c6aa0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:30.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:30.072+0000 7f816f790640 1 -- 172.21.15.37:0/469564020 >> 172.21.15.37:0/469564020 conn(0x7f81680d0ed0 msgr2=0x7f816815b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:30.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:30.072+0000 7f816f790640 1 -- 172.21.15.37:0/469564020 shutdown_connections 2023-12-11T17:10:30.074 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:30.072+0000 7f816f790640 1 -- 172.21.15.37:0/469564020 wait complete. 2023-12-11T17:10:30.094 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-11T17:10:30.094 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-11T17:10:30.094 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-12-11T17:10:30.094 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-11T17:10:30.094 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-11T17:10:30.094 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-11T17:10:30.094 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-11T17:10:30.094 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-11T17:10:30.094 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-11T17:10:30.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:30.095 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-12-11T17:10:30.149 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-11T17:10:30.149 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-11T17:10:30.150 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-12-11T17:10:30.150 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:30.150 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-12-11T17:10:30.150 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:30.150 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-11T17:10:30.150 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-12-11T17:10:30.150 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-12-11T17:10:30.150 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-11T17:10:30.150 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-12-11T17:10:30.150 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-12-11T17:10:30.150 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-11T17:10:30.150 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-12-11T17:10:30.151 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-12-11T17:10:30.151 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-11T17:10:30.151 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42345sec preferred_lft 42345sec 2023-12-11T17:10:30.151 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2023-12-11T17:10:30.151 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:30.151 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-11T17:10:30.151 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-12-11T17:10:30.151 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-12-11T17:10:30.151 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-11T17:10:30.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:30.151 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-12-11T17:10:30.152 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-12-11T17:10:30.152 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add name ceph-brx type bridge 2023-12-11T17:10:30.152 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr flush dev ceph-brx 2023-12-11T17:10:30.152 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set ceph-brx up 2023-12-11T17:10:30.152 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-11T17:10:30.152 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-12-11T17:10:30.396 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:30.396 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-11T17:10:30.482 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-12-11T17:10:30.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:30.487 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-12-11T17:10:30.544 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-12-11T17:10:30.544 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-11T17:10:30.544 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-11T17:10:30.544 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-11T17:10:30.544 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-11T17:10:30.545 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:30.545 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-12-11T17:10:30.545 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-12-11T17:10:30.545 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-11T17:10:30.545 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-11T17:10:30.545 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-11T17:10:30.545 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-12-11T17:10:30.740 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:30.740 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-12-11T17:10:30.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:30.797 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2023-12-11T17:10:30.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:30.852 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-12-11T17:10:30.852 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-12-11T17:10:30.852 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-11T17:10:30.852 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-11T17:10:30.852 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-12-11T17:10:31.005 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-11T17:10:31.005 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:31.005 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-12-11T17:10:31.005 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-12-11T17:10:31.005 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-11T17:10:31.006 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-11T17:10:31.006 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-11T17:10:31.006 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-11T17:10:31.006 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-11T17:10:31.006 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-12-11T17:10:31.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:31.270 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-12-11T17:10:31.271 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-12-11T17:10:31.271 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-12-11T17:10:31.271 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.0 master ceph-brx 2023-12-11T17:10:31.271 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-12-11T17:10:31.435 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-11T17:10:31.435 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-11T17:10:31.485 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-11T17:10:31.486 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-11T17:10:31.486 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-11T17:10:31.539 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-11T17:10:31.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:31.540 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-11T17:10:31.679 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-11T17:10:31.679 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-11T17:10:31.679 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-12-11T17:10:32.160 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-11T17:10:32.161 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-11T17:10:32.161 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-12-11T17:10:32.161 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-11T17:10:32.161 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-11T17:10:32.193 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-11T17:10:32.193 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-11T17:10:32.193 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-12-11T17:10:32.193 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-11T17:10:32.193 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-11T17:10:32.193 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.151:6789,172.21.15.151:6790" 2023-12-11T17:10:32.193 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.151:6789,172.21.15.151:6790:/ 2023-12-11T17:10:32.193 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=349792a4-57b1-4c92-9cc0-0c9ba4325d41" will pass to kernel 2023-12-11T17:10:32.199 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-11T17:10:32.199 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2023-12-11T17:10:32.199 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-11T17:10:32.199 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2023-12-11T17:10:32.200 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-11T17:10:32.204 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-11T17:10:32.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:32.205 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-11T17:10:32.299 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:32.299 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-11T17:10:32.359 INFO:teuthology.orchestra.run.smithi037.stdout:client4708 2023-12-11T17:10:32.360 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:10:32.360 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-11T17:10:32.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:32.402 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-11T17:10:32.505 INFO:teuthology.orchestra.run.smithi037.stdout:client4708 2023-12-11T17:10:32.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:32.505 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-11T17:10:32.556 INFO:teuthology.orchestra.run.smithi037.stdout:client4708 2023-12-11T17:10:32.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:32.557 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/349792a4-57b1-4c92-9cc0-0c9ba4325d41.client4708/status') 2023-12-11T17:10:32.652 INFO:teuthology.orchestra.run.smithi037.stdout:instance: client.4708 (3)172.21.15.37:0/1277484187 2023-12-11T17:10:32.652 INFO:teuthology.orchestra.run.smithi037.stdout:blocklisted: false 2023-12-11T17:10:32.652 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records in 2023-12-11T17:10:32.652 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records out 2023-12-11T17:10:32.652 INFO:teuthology.orchestra.run.smithi037.stderr:70 bytes copied, 7.6892e-05 s, 910 kB/s 2023-12-11T17:10:32.656 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-12-11T17:10:32.656 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-11T17:10:32.656 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-11T17:10:32.656 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-11T17:10:32.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.883+0000 7f93afa4f640 1 Processor -- start 2023-12-11T17:10:32.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.884+0000 7f93afa4f640 1 -- start start 2023-12-11T17:10:32.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.886+0000 7f93afa4f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f93a80cdec0 0x7f93a81441c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:32.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.886+0000 7f93afa4f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a806a460 0x7f93a806a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:32.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.886+0000 7f93afa4f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a806d520 con 0x7f93a8143990 2023-12-11T17:10:32.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.886+0000 7f93afa4f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a806ae30 con 0x7f93a80cdec0 2023-12-11T17:10:32.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.886+0000 7f93afa4f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a80ce320 con 0x7f93a806a460 2023-12-11T17:10:32.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.886+0000 7f93acfea640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f93a80cdec0 0x7f93a81441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:32.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.886+0000 7f93adfec640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a806a460 0x7f93a806a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:32.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.886+0000 7f93acfea640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f93a80cdec0 0x7f93a81441c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:52264/0 (socket says 172.21.15.37:52264) 2023-12-11T17:10:32.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.886+0000 7f93adfec640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a806a460 0x7f93a806a8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.37:55908/0 (socket says 172.21.15.37:55908) 2023-12-11T17:10:32.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.886+0000 7f93acfea640 1 -- 172.21.15.37:0/2212851648 learned_addr learned my addr 172.21.15.37:0/2212851648 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:32.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.887+0000 7f93adfec640 1 -- 172.21.15.37:0/2212851648 >> v2:172.21.15.151:3300/0 conn(0x7f93a80cdec0 msgr2=0x7f93a81441c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:32.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.887+0000 7f93adfec640 1 --2- 172.21.15.37:0/2212851648 >> v2:172.21.15.151:3300/0 conn(0x7f93a80cdec0 0x7f93a81441c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:32.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.887+0000 7f93adfec640 1 -- 172.21.15.37:0/2212851648 >> v1:172.21.15.151:6789/0 conn(0x7f93a8143990 legacy=0x7f93a8071be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:32.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.887+0000 7f93adfec640 1 -- 172.21.15.37:0/2212851648 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a8143d70 con 0x7f93a806a460 2023-12-11T17:10:32.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.887+0000 7f93acfea640 1 --2- 172.21.15.37:0/2212851648 >> v2:172.21.15.151:3300/0 conn(0x7f93a80cdec0 0x7f93a81441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:10:32.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.890+0000 7f93adfec640 1 --2- 172.21.15.37:0/2212851648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a806a460 0x7f93a806a8f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f93a00097a0 tx=0x7f93a002b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=10e0e52876464a2c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:32.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.890+0000 7f93a7fff640 1 -- 172.21.15.37:0/2212851648 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a002d040 con 0x7f93a806a460 2023-12-11T17:10:32.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.890+0000 7f93a7fff640 1 -- 172.21.15.37:0/2212851648 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a0031810 con 0x7f93a806a460 2023-12-11T17:10:32.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.890+0000 7f93a7fff640 1 -- 172.21.15.37:0/2212851648 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a0031ba0 con 0x7f93a806a460 2023-12-11T17:10:32.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.890+0000 7f93afa4f640 1 -- 172.21.15.37:0/2212851648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a806a460 msgr2=0x7f93a806a8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:32.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.890+0000 7f93afa4f640 1 --2- 172.21.15.37:0/2212851648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a806a460 0x7f93a806a8f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f93a00097a0 tx=0x7f93a002b8b0 comp rx=0 tx=0).stop 2023-12-11T17:10:32.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.890+0000 7f93afa4f640 1 -- 172.21.15.37:0/2212851648 shutdown_connections 2023-12-11T17:10:32.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.890+0000 7f93afa4f640 1 --2- 172.21.15.37:0/2212851648 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a806a460 0x7f93a806a8f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:32.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.890+0000 7f93afa4f640 1 --2- 172.21.15.37:0/2212851648 >> v2:172.21.15.151:3300/0 conn(0x7f93a80cdec0 0x7f93a81441c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:32.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.890+0000 7f93afa4f640 1 -- 172.21.15.37:0/2212851648 >> 172.21.15.37:0/2212851648 conn(0x7f93a80cfe30 msgr2=0x7f93a80d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:32.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.890+0000 7f93afa4f640 1 -- 172.21.15.37:0/2212851648 shutdown_connections 2023-12-11T17:10:32.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.890+0000 7f93afa4f640 1 -- 172.21.15.37:0/2212851648 wait complete. 2023-12-11T17:10:32.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.893+0000 7f93afa4f640 1 Processor -- start 2023-12-11T17:10:32.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.893+0000 7f93afa4f640 1 -- start start 2023-12-11T17:10:32.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.895+0000 7f93afa4f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a806a460 0x7f93a815c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.895+0000 7f93afa4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93a80cdec0 0x7f93a8146540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.895+0000 7f93afa4f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93a8143990 0x7f93a8146a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.895+0000 7f93afa4f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a8144d70 con 0x7f93a80cdec0 2023-12-11T17:10:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.895+0000 7f93afa4f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a8145050 con 0x7f93a8143990 2023-12-11T17:10:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.895+0000 7f93afa4f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a8145330 con 0x7f93a806a460 2023-12-11T17:10:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.895+0000 7f93acfea640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93a80cdec0 0x7f93a8146540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.896+0000 7f93acfea640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93a80cdec0 0x7f93a8146540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39904/0 (socket says 172.21.15.37:39904) 2023-12-11T17:10:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.896+0000 7f93acfea640 1 -- 172.21.15.37:0/1523906378 learned_addr learned my addr 172.21.15.37:0/1523906378 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:32.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.896+0000 7f93adfec640 1 --2- 172.21.15.37:0/1523906378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93a8143990 0x7f93a8146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:32.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.896+0000 7f93ad7eb640 1 --2- 172.21.15.37:0/1523906378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a806a460 0x7f93a815c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:32.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.896+0000 7f93acfea640 1 -- 172.21.15.37:0/1523906378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a806a460 msgr2=0x7f93a815c9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:32.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.896+0000 7f93acfea640 1 --2- 172.21.15.37:0/1523906378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a806a460 0x7f93a815c9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:32.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.896+0000 7f93acfea640 1 -- 172.21.15.37:0/1523906378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93a8143990 msgr2=0x7f93a8146a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:32.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.896+0000 7f93acfea640 1 --2- 172.21.15.37:0/1523906378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93a8143990 0x7f93a8146a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:32.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.896+0000 7f93acfea640 1 -- 172.21.15.37:0/1523906378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f939c0094d0 con 0x7f93a80cdec0 2023-12-11T17:10:32.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.896+0000 7f93acfea640 1 --2- 172.21.15.37:0/1523906378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93a80cdec0 0x7f93a8146540 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f939c00e9d0 tx=0x7f939c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:32.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.896+0000 7f93a5ffb640 1 -- 172.21.15.37:0/1523906378 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c00ca60 con 0x7f93a80cdec0 2023-12-11T17:10:32.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.896+0000 7f93a5ffb640 1 -- 172.21.15.37:0/1523906378 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f939c00cbc0 con 0x7f93a80cdec0 2023-12-11T17:10:32.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.896+0000 7f93a5ffb640 1 -- 172.21.15.37:0/1523906378 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f939c013470 con 0x7f93a80cdec0 2023-12-11T17:10:32.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.896+0000 7f93afa4f640 1 -- 172.21.15.37:0/1523906378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a0009400 con 0x7f93a80cdec0 2023-12-11T17:10:32.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.896+0000 7f93afa4f640 1 -- 172.21.15.37:0/1523906378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a81458f0 con 0x7f93a80cdec0 2023-12-11T17:10:32.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.898+0000 7f93afa4f640 1 -- 172.21.15.37:0/1523906378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a80745d0 con 0x7f93a80cdec0 2023-12-11T17:10:32.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.898+0000 7f93a5ffb640 1 -- 172.21.15.37:0/1523906378 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f939c0135d0 con 0x7f93a80cdec0 2023-12-11T17:10:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.900+0000 7f93a5ffb640 1 --2- 172.21.15.37:0/1523906378 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f939406ae40 0x7f939406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.900+0000 7f93a5ffb640 1 -- 172.21.15.37:0/1523906378 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f939c089d90 con 0x7f93a80cdec0 2023-12-11T17:10:32.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.900+0000 7f93ad7eb640 1 --2- 172.21.15.37:0/1523906378 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f939406ae40 0x7f939406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:32.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.901+0000 7f93ad7eb640 1 --2- 172.21.15.37:0/1523906378 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f939406ae40 0x7f939406d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9398001ca0 tx=0x7f9398009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:32.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:32.905+0000 7f93a5ffb640 1 -- 172.21.15.37:0/1523906378 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f939c0549d0 con 0x7f93a80cdec0 2023-12-11T17:10:33.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:33.144+0000 7f93afa4f640 1 -- 172.21.15.37:0/1523906378 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f93a806b060 con 0x7f93a80cdec0 2023-12-11T17:10:33.146 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:33.146+0000 7f93a5ffb640 1 -- 172.21.15.37:0/1523906378 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f939c057ff0 con 0x7f93a80cdec0 2023-12-11T17:10:33.146 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-11T17:10:33.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:33.148+0000 7f93afa4f640 1 -- 172.21.15.37:0/1523906378 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f939406ae40 msgr2=0x7f939406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:33.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:33.148+0000 7f93afa4f640 1 --2- 172.21.15.37:0/1523906378 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f939406ae40 0x7f939406d300 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f9398001ca0 tx=0x7f9398009040 comp rx=0 tx=0).stop 2023-12-11T17:10:33.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:33.148+0000 7f93afa4f640 1 -- 172.21.15.37:0/1523906378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93a80cdec0 msgr2=0x7f93a8146540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:33.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:33.148+0000 7f93afa4f640 1 --2- 172.21.15.37:0/1523906378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93a80cdec0 0x7f93a8146540 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f939c00e9d0 tx=0x7f939c00ee90 comp rx=0 tx=0).stop 2023-12-11T17:10:33.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:33.149+0000 7f93afa4f640 1 -- 172.21.15.37:0/1523906378 shutdown_connections 2023-12-11T17:10:33.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:33.149+0000 7f93afa4f640 1 --2- 172.21.15.37:0/1523906378 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f939406ae40 0x7f939406d300 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:33.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:33.149+0000 7f93afa4f640 1 --2- 172.21.15.37:0/1523906378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f93a8143990 0x7f93a8146a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:33.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:33.149+0000 7f93afa4f640 1 --2- 172.21.15.37:0/1523906378 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93a80cdec0 0x7f93a8146540 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:33.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:33.149+0000 7f93afa4f640 1 --2- 172.21.15.37:0/1523906378 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f93a806a460 0x7f93a815c9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:33.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:33.149+0000 7f93afa4f640 1 -- 172.21.15.37:0/1523906378 >> 172.21.15.37:0/1523906378 conn(0x7f93a80cfe30 msgr2=0x7f93a806df70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:33.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:33.149+0000 7f93afa4f640 1 -- 172.21.15.37:0/1523906378 shutdown_connections 2023-12-11T17:10:33.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:33.149+0000 7f93afa4f640 1 -- 172.21.15.37:0/1523906378 wait complete. 2023-12-11T17:10:33.168 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-11T17:10:33.168 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-11T17:10:33.168 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-12-11T17:10:33.168 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-12-11T17:10:33.168 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-11T17:10:33.168 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-11T17:10:33.168 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-11T17:10:33.169 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-11T17:10:33.169 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-12-11T17:10:33.169 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:33.169 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-12-11T17:10:33.224 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-11T17:10:33.224 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-11T17:10:33.224 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-12-11T17:10:33.225 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:33.225 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-12-11T17:10:33.225 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:33.225 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-11T17:10:33.225 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-12-11T17:10:33.225 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-12-11T17:10:33.225 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-11T17:10:33.225 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-12-11T17:10:33.225 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-12-11T17:10:33.226 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-11T17:10:33.226 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-12-11T17:10:33.226 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-12-11T17:10:33.226 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-11T17:10:33.226 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42342sec preferred_lft 42342sec 2023-12-11T17:10:33.226 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2023-12-11T17:10:33.226 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:33.226 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-11T17:10:33.226 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-12-11T17:10:33.226 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-12-11T17:10:33.226 INFO:teuthology.orchestra.run.smithi037.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-11T17:10:33.226 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 7e:b3:ed:4d:89:cf brd ff:ff:ff:ff:ff:ff 2023-12-11T17:10:33.227 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-11T17:10:33.227 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:33.227 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::40bb:10ff:feaf:ff3f/64 scope link 2023-12-11T17:10:33.227 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:33.227 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-11T17:10:33.227 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 7e:b3:ed:4d:89:cf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-11T17:10:33.227 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::7cb3:edff:fe4d:89cf/64 scope link 2023-12-11T17:10:33.227 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:33.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:33.228 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-11T17:10:33.320 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-12-11T17:10:33.325 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:33.326 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-12-11T17:10:33.379 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-12-11T17:10:33.379 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-11T17:10:33.379 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-11T17:10:33.379 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-11T17:10:33.379 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-11T17:10:33.380 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:33.380 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-12-11T17:10:33.380 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-12-11T17:10:33.380 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-11T17:10:33.380 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-11T17:10:33.380 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-11T17:10:33.380 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-12-11T17:10:33.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:33.572 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-12-11T17:10:33.626 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-11T17:10:33.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:33.628 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list-id 2023-12-11T17:10:33.682 INFO:teuthology.orchestra.run.smithi037.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-12-11T17:10:33.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:33.683 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-12-11T17:10:33.683 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-12-11T17:10:33.683 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-11T17:10:33.684 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-12-11T17:10:33.684 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-12-11T17:10:33.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:33.839 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-11T17:10:33.941 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-11T17:10:33.941 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-11T17:10:33.941 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-12-11T17:10:33.941 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:33.942 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-12-11T17:10:33.942 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:33.942 INFO:teuthology.orchestra.run.smithi037.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-11T17:10:33.942 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 32:c0:db:2c:bc:df brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-11T17:10:33.942 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-11T17:10:33.942 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:33.942 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::30c0:dbff:fe2c:bcdf/64 scope link 2023-12-11T17:10:33.942 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:33.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:33.947 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-11T17:10:34.051 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-11T17:10:34.051 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-11T17:10:34.051 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-12-11T17:10:34.051 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:34.051 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-12-11T17:10:34.052 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:34.052 INFO:teuthology.orchestra.run.smithi037.stdout:2: veth0@if9: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-11T17:10:34.052 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 32:c0:db:2c:bc:df brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-11T17:10:34.052 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-11T17:10:34.052 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:34.052 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::30c0:dbff:fe2c:bcdf/64 scope link 2023-12-11T17:10:34.052 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:34.057 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-12-11T17:10:34.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:34.057 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-12-11T17:10:34.057 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-12-11T17:10:34.057 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-12-11T17:10:34.057 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-11T17:10:34.058 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-12-11T17:10:34.058 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-12-11T17:10:34.058 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-12-11T17:10:34.058 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-12-11T17:10:34.356 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:34.356 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-12-11T17:10:34.356 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-12-11T17:10:34.357 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.1 up 2023-12-11T17:10:34.357 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set dev brx.1 master ceph-brx 2023-12-11T17:10:34.357 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-12-11T17:10:34.532 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-11T17:10:34.532 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-12-11T17:10:34.582 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-12-11T17:10:34.582 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-11T17:10:34.582 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-12-11T17:10:34.634 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-11T17:10:34.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:34.634 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-12-11T17:10:34.783 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-12-11T17:10:34.784 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-12-11T17:10:34.784 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-12-11T17:10:34.806 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-12-11T17:10:34.806 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-12-11T17:10:34.806 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-12-11T17:10:34.806 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-11T17:10:34.806 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-11T17:10:34.836 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-12-11T17:10:34.836 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-12-11T17:10:34.836 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-12-11T17:10:34.836 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-11T17:10:34.836 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-11T17:10:34.836 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.151:6789,172.21.15.151:6790" 2023-12-11T17:10:34.837 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.151:6789,172.21.15.151:6790:/ 2023-12-11T17:10:34.837 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=349792a4-57b1-4c92-9cc0-0c9ba4325d41" will pass to kernel 2023-12-11T17:10:34.838 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.2 does not contain SELinux labels. 2023-12-11T17:10:34.838 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2023-12-11T17:10:34.838 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-11T17:10:34.838 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2023-12-11T17:10:34.838 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-11T17:10:34.842 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-11T17:10:34.842 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:34.842 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-12-11T17:10:34.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:34.929 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-11T17:10:34.990 INFO:teuthology.orchestra.run.smithi037.stdout:client4717 2023-12-11T17:10:34.991 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:10:34.991 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-11T17:10:35.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:35.049 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-11T17:10:35.108 INFO:teuthology.orchestra.run.smithi037.stdout:client4717 2023-12-11T17:10:35.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:35.109 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-11T17:10:35.172 INFO:teuthology.orchestra.run.smithi037.stdout:client4717 2023-12-11T17:10:35.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:35.173 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.2 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/349792a4-57b1-4c92-9cc0-0c9ba4325d41.client4717/status') 2023-12-11T17:10:35.274 INFO:teuthology.orchestra.run.smithi037.stdout:instance: client.4717 (3)172.21.15.37:0/1510114433 2023-12-11T17:10:35.274 INFO:teuthology.orchestra.run.smithi037.stdout:blocklisted: false 2023-12-11T17:10:35.275 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records in 2023-12-11T17:10:35.275 INFO:teuthology.orchestra.run.smithi037.stderr:0+1 records out 2023-12-11T17:10:35.275 INFO:teuthology.orchestra.run.smithi037.stderr:70 bytes copied, 7.1869e-05 s, 974 kB/s 2023-12-11T17:10:35.279 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-12-11T17:10:35.279 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-11T17:10:35.279 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-11T17:10:35.279 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-11T17:10:35.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.502+0000 7fa409c1a640 1 Processor -- start 2023-12-11T17:10:35.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.502+0000 7fa409c1a640 1 -- start start 2023-12-11T17:10:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.503+0000 7fa409c1a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4040af3b0 0x7fa40406ed00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.503+0000 7fa409c1a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa40406a460 0x7fa40406a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.504+0000 7fa409c1a640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4040ad8c0 con 0x7fa40415af40 2023-12-11T17:10:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.504+0000 7fa409c1a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa40406fc10 con 0x7fa40406a460 2023-12-11T17:10:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.504+0000 7fa409c1a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa40415ba30 con 0x7fa4040af3b0 2023-12-11T17:10:35.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.504+0000 7fa403fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4040af3b0 0x7fa40406ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:35.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.505+0000 7fa403fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4040af3b0 0x7fa40406ed00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.37:55914/0 (socket says 172.21.15.37:55914) 2023-12-11T17:10:35.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.505+0000 7fa403fff640 1 -- 172.21.15.37:0/1555846952 learned_addr learned my addr 172.21.15.37:0/1555846952 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:35.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.505+0000 7fa409419640 1 --2- 172.21.15.37:0/1555846952 >> v2:172.21.15.151:3300/0 conn(0x7fa40406a460 0x7fa40406a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:35.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.505+0000 7fa4037fe640 1 -- 172.21.15.37:0/1555846952 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2111354446 0 0) 0x7fa4040ad8c0 con 0x7fa40415af40 2023-12-11T17:10:35.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.505+0000 7fa4037fe640 1 -- 172.21.15.37:0/1555846952 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3ec003520 con 0x7fa40415af40 2023-12-11T17:10:35.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.505+0000 7fa403fff640 1 -- 172.21.15.37:0/1555846952 >> v2:172.21.15.151:3300/0 conn(0x7fa40406a460 msgr2=0x7fa40406a8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:35.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.506+0000 7fa403fff640 1 --2- 172.21.15.37:0/1555846952 >> v2:172.21.15.151:3300/0 conn(0x7fa40406a460 0x7fa40406a8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:35.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.506+0000 7fa403fff640 1 -- 172.21.15.37:0/1555846952 >> v1:172.21.15.151:6789/0 conn(0x7fa40415af40 legacy=0x7fa40415b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:35.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.506+0000 7fa403fff640 1 -- 172.21.15.37:0/1555846952 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40406f650 con 0x7fa4040af3b0 2023-12-11T17:10:35.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.507+0000 7fa403fff640 1 --2- 172.21.15.37:0/1555846952 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4040af3b0 0x7fa40406ed00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009870 tx=0x7fa3f802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77b7678a75019094 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:35.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.507+0000 7fa4037fe640 1 -- 172.21.15.37:0/1555846952 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8031640 con 0x7fa4040af3b0 2023-12-11T17:10:35.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.507+0000 7fa4037fe640 1 -- 172.21.15.37:0/1555846952 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3f80317a0 con 0x7fa4040af3b0 2023-12-11T17:10:35.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.507+0000 7fa4037fe640 1 -- 172.21.15.37:0/1555846952 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3f8031b30 con 0x7fa4040af3b0 2023-12-11T17:10:35.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.508+0000 7fa409c1a640 1 -- 172.21.15.37:0/1555846952 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4040af3b0 msgr2=0x7fa40406ed00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:35.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.508+0000 7fa409c1a640 1 --2- 172.21.15.37:0/1555846952 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4040af3b0 0x7fa40406ed00 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fa3f8009870 tx=0x7fa3f802b8f0 comp rx=0 tx=0).stop 2023-12-11T17:10:35.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.508+0000 7fa409c1a640 1 -- 172.21.15.37:0/1555846952 shutdown_connections 2023-12-11T17:10:35.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.508+0000 7fa409c1a640 1 --2- 172.21.15.37:0/1555846952 >> v2:172.21.15.151:3300/0 conn(0x7fa40406a460 0x7fa40406a8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:35.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.508+0000 7fa409c1a640 1 --2- 172.21.15.37:0/1555846952 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa4040af3b0 0x7fa40406ed00 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:35.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.508+0000 7fa409c1a640 1 -- 172.21.15.37:0/1555846952 >> 172.21.15.37:0/1555846952 conn(0x7fa40406bfd0 msgr2=0x7fa4040b1970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:35.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.508+0000 7fa409c1a640 1 -- 172.21.15.37:0/1555846952 shutdown_connections 2023-12-11T17:10:35.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.508+0000 7fa409c1a640 1 -- 172.21.15.37:0/1555846952 wait complete. 2023-12-11T17:10:35.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.510+0000 7fa409c1a640 1 Processor -- start 2023-12-11T17:10:35.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.510+0000 7fa409c1a640 1 -- start start 2023-12-11T17:10:35.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.511+0000 7fa409c1a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa40406a460 0x7fa404145710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:35.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.511+0000 7fa409c1a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4040af3b0 0x7fa4041e50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:35.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.511+0000 7fa409c1a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa40415af40 0x7fa404152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:35.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.511+0000 7fa409c1a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4040b3e20 con 0x7fa40415af40 2023-12-11T17:10:35.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.511+0000 7fa409c1a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4040b4100 con 0x7fa4040af3b0 2023-12-11T17:10:35.512 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.511+0000 7fa409c1a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4040b43e0 con 0x7fa40406a460 2023-12-11T17:10:35.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.512+0000 7fa409419640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa40415af40 0x7fa404152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:35.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.512+0000 7fa409419640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa40415af40 0x7fa404152cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:39920/0 (socket says 172.21.15.37:39920) 2023-12-11T17:10:35.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.512+0000 7fa409419640 1 -- 172.21.15.37:0/2497272535 learned_addr learned my addr 172.21.15.37:0/2497272535 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:35.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.512+0000 7fa408c18640 1 --2- 172.21.15.37:0/2497272535 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa40406a460 0x7fa404145710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:35.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.512+0000 7fa403fff640 1 --2- 172.21.15.37:0/2497272535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4040af3b0 0x7fa4041e50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:35.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.512+0000 7fa409419640 1 -- 172.21.15.37:0/2497272535 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa40406a460 msgr2=0x7fa404145710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:35.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.512+0000 7fa409419640 1 --2- 172.21.15.37:0/2497272535 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa40406a460 0x7fa404145710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:35.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.512+0000 7fa409419640 1 -- 172.21.15.37:0/2497272535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4040af3b0 msgr2=0x7fa4041e50b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:35.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.512+0000 7fa409419640 1 --2- 172.21.15.37:0/2497272535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4040af3b0 0x7fa4041e50b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:35.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.512+0000 7fa409419640 1 -- 172.21.15.37:0/2497272535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f80094d0 con 0x7fa40415af40 2023-12-11T17:10:35.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.512+0000 7fa408c18640 1 --2- 172.21.15.37:0/2497272535 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa40406a460 0x7fa404145710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:10:35.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.513+0000 7fa409419640 1 --2- 172.21.15.37:0/2497272535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa40415af40 0x7fa404152cf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00e930 tx=0x7fa3fc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:35.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.513+0000 7fa4017fa640 1 -- 172.21.15.37:0/2497272535 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc009690 con 0x7fa40415af40 2023-12-11T17:10:35.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.513+0000 7fa4017fa640 1 -- 172.21.15.37:0/2497272535 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3fc00c980 con 0x7fa40415af40 2023-12-11T17:10:35.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.513+0000 7fa4017fa640 1 -- 172.21.15.37:0/2497272535 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc00cd30 con 0x7fa40415af40 2023-12-11T17:10:35.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.513+0000 7fa409c1a640 1 -- 172.21.15.37:0/2497272535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4040b46c0 con 0x7fa40415af40 2023-12-11T17:10:35.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.513+0000 7fa409c1a640 1 -- 172.21.15.37:0/2497272535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa404145e30 con 0x7fa40415af40 2023-12-11T17:10:35.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.514+0000 7fa409c1a640 1 -- 172.21.15.37:0/2497272535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4041e2ab0 con 0x7fa40415af40 2023-12-11T17:10:35.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.515+0000 7fa4017fa640 1 -- 172.21.15.37:0/2497272535 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa3fc013470 con 0x7fa40415af40 2023-12-11T17:10:35.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.516+0000 7fa4017fa640 1 --2- 172.21.15.37:0/2497272535 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa3f006ae40 0x7fa3f006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:35.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.516+0000 7fa4017fa640 1 -- 172.21.15.37:0/2497272535 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fa3fc089ca0 con 0x7fa40415af40 2023-12-11T17:10:35.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.517+0000 7fa408c18640 1 --2- 172.21.15.37:0/2497272535 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa3f006ae40 0x7fa3f006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:35.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.518+0000 7fa408c18640 1 --2- 172.21.15.37:0/2497272535 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa3f006ae40 0x7fa3f006d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4007ec0 tx=0x7fa3f4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:35.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.521+0000 7fa4017fa640 1 -- 172.21.15.37:0/2497272535 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa4041e2ab0 con 0x7fa40415af40 2023-12-11T17:10:35.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.754+0000 7fa409c1a640 1 -- 172.21.15.37:0/2497272535 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa4041e2ab0 con 0x7fa40415af40 2023-12-11T17:10:35.754 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.755+0000 7fa4017fa640 1 -- 172.21.15.37:0/2497272535 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7fa3fc021070 con 0x7fa40415af40 2023-12-11T17:10:35.755 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-11T17:10:35.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.757+0000 7fa409c1a640 1 -- 172.21.15.37:0/2497272535 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa3f006ae40 msgr2=0x7fa3f006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.757+0000 7fa409c1a640 1 --2- 172.21.15.37:0/2497272535 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa3f006ae40 0x7fa3f006d300 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fa3f4007ec0 tx=0x7fa3f4009040 comp rx=0 tx=0).stop 2023-12-11T17:10:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.757+0000 7fa409c1a640 1 -- 172.21.15.37:0/2497272535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa40415af40 msgr2=0x7fa404152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.757+0000 7fa409c1a640 1 --2- 172.21.15.37:0/2497272535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa40415af40 0x7fa404152cf0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc00e930 tx=0x7fa3fc00edf0 comp rx=0 tx=0).stop 2023-12-11T17:10:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.757+0000 7fa409c1a640 1 -- 172.21.15.37:0/2497272535 shutdown_connections 2023-12-11T17:10:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.757+0000 7fa409c1a640 1 --2- 172.21.15.37:0/2497272535 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa3f006ae40 0x7fa3f006d300 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.757+0000 7fa409c1a640 1 --2- 172.21.15.37:0/2497272535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa4040af3b0 0x7fa4041e50b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.757+0000 7fa409c1a640 1 --2- 172.21.15.37:0/2497272535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa40415af40 0x7fa404152cf0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.757+0000 7fa409c1a640 1 --2- 172.21.15.37:0/2497272535 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa40406a460 0x7fa404145710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.757+0000 7fa409c1a640 1 -- 172.21.15.37:0/2497272535 >> 172.21.15.37:0/2497272535 conn(0x7fa40406bfd0 msgr2=0x7fa40415a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.758+0000 7fa409c1a640 1 -- 172.21.15.37:0/2497272535 shutdown_connections 2023-12-11T17:10:35.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:35.758+0000 7fa409c1a640 1 -- 172.21.15.37:0/2497272535 wait complete. 2023-12-11T17:10:35.778 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-11T17:10:35.778 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-11T17:10:35.778 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-12-11T17:10:35.778 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-11T17:10:35.778 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-11T17:10:35.778 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-11T17:10:35.778 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-11T17:10:35.778 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-11T17:10:35.778 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-11T17:10:35.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:35.779 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-12-11T17:10:35.840 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-11T17:10:35.841 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-11T17:10:35.841 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-12-11T17:10:35.841 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:35.841 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-12-11T17:10:35.841 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:35.841 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-11T17:10:35.841 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-11T17:10:35.841 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-12-11T17:10:35.841 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-11T17:10:35.841 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-11T17:10:35.841 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-12-11T17:10:35.841 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-11T17:10:35.842 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-12-11T17:10:35.842 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-11T17:10:35.842 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-12-11T17:10:35.842 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-11T17:10:35.842 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42282sec preferred_lft 42282sec 2023-12-11T17:10:35.842 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-12-11T17:10:35.842 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:35.843 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-11T17:10:35.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:35.843 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-11T17:10:35.843 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-11T17:10:35.843 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add name ceph-brx type bridge 2023-12-11T17:10:35.844 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr flush dev ceph-brx 2023-12-11T17:10:35.844 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set ceph-brx up 2023-12-11T17:10:35.844 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-11T17:10:35.844 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-11T17:10:36.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:36.303 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-11T17:10:36.383 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-12-11T17:10:36.387 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:36.387 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-12-11T17:10:36.443 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-12-11T17:10:36.444 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-11T17:10:36.444 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-11T17:10:36.444 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-11T17:10:36.444 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-11T17:10:36.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:36.444 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-11T17:10:36.444 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-11T17:10:36.444 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-11T17:10:36.444 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-11T17:10:36.445 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-11T17:10:36.445 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-11T17:10:37.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:37.211 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-11T17:10:37.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:37.271 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list-id 2023-12-11T17:10:37.324 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:37.324 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-11T17:10:37.324 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-11T17:10:37.324 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-11T17:10:37.324 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-11T17:10:37.325 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-11T17:10:37.465 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-11T17:10:37.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:37.466 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-11T17:10:37.466 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-11T17:10:37.466 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-11T17:10:37.466 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-11T17:10:37.466 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-11T17:10:37.466 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-11T17:10:37.466 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-11T17:10:37.466 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-11T17:10:37.751 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:37.751 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-11T17:10:37.751 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-11T17:10:37.751 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.0 up 2023-12-11T17:10:37.751 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set dev brx.0 master ceph-brx 2023-12-11T17:10:37.751 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-11T17:10:37.917 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-11T17:10:37.917 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-11T17:10:37.964 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-11T17:10:37.964 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-11T17:10:37.965 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-11T17:10:38.063 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-11T17:10:38.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:38.064 DEBUG:teuthology.orchestra.run.smithi151:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-11T17:10:38.222 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-11T17:10:38.223 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-11T17:10:38.223 INFO:teuthology.orchestra.run.smithi151.stdout:invalid new device string format 2023-12-11T17:10:38.654 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-11T17:10:38.654 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-11T17:10:38.654 INFO:teuthology.orchestra.run.smithi151.stdout:invalid new device string format 2023-12-11T17:10:38.654 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-11T17:10:38.654 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-11T17:10:38.689 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-12-11T17:10:38.689 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-12-11T17:10:38.689 INFO:teuthology.orchestra.run.smithi151.stdout:invalid new device string format 2023-12-11T17:10:38.689 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-11T17:10:38.689 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-11T17:10:38.689 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.151:6789,172.21.15.151:6790" 2023-12-11T17:10:38.689 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.151:6789,172.21.15.151:6790:/ 2023-12-11T17:10:38.689 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=349792a4-57b1-4c92-9cc0-0c9ba4325d41" will pass to kernel 2023-12-11T17:10:38.693 INFO:teuthology.orchestra.run.smithi151.stdout:mount: /home/ubuntu/cephtest/mnt.1 does not contain SELinux labels. 2023-12-11T17:10:38.694 INFO:teuthology.orchestra.run.smithi151.stdout: You just mounted a file system that supports labels which does not 2023-12-11T17:10:38.694 INFO:teuthology.orchestra.run.smithi151.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-11T17:10:38.694 INFO:teuthology.orchestra.run.smithi151.stdout: applications will generate AVC messages and not be allowed access to 2023-12-11T17:10:38.694 INFO:teuthology.orchestra.run.smithi151.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-11T17:10:38.699 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-11T17:10:38.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:38.700 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-11T17:10:38.792 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:38.793 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-11T17:10:38.850 INFO:teuthology.orchestra.run.smithi151.stdout:client4517 2023-12-11T17:10:38.851 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:10:38.851 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-11T17:10:38.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:38.909 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-11T17:10:38.967 INFO:teuthology.orchestra.run.smithi151.stdout:client4517 2023-12-11T17:10:38.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:38.968 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-11T17:10:39.028 INFO:teuthology.orchestra.run.smithi151.stdout:client4517 2023-12-11T17:10:39.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:39.029 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.1 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/349792a4-57b1-4c92-9cc0-0c9ba4325d41.client4517/status') 2023-12-11T17:10:39.124 INFO:teuthology.orchestra.run.smithi151.stdout:instance: client.4517 (3)192.168.0.1:0/4182612875 2023-12-11T17:10:39.124 INFO:teuthology.orchestra.run.smithi151.stdout:blocklisted: false 2023-12-11T17:10:39.124 INFO:teuthology.orchestra.run.smithi151.stderr:0+1 records in 2023-12-11T17:10:39.124 INFO:teuthology.orchestra.run.smithi151.stderr:0+1 records out 2023-12-11T17:10:39.124 INFO:teuthology.orchestra.run.smithi151.stderr:69 bytes copied, 0.00012186 s, 566 kB/s 2023-12-11T17:10:39.128 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-12-11T17:10:39.128 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-11T17:10:39.128 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-11T17:10:39.128 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-11T17:10:39.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.362+0000 7f378ef48640 1 Processor -- start 2023-12-11T17:10:39.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.362+0000 7f378ef48640 1 -- start start 2023-12-11T17:10:39.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.364+0000 7f378ef48640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3788157a60 0x7f378806c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:39.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.364+0000 7f378ef48640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f378806de20 0x7f378815dba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:39.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.364+0000 7f378ef48640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f378806ca40 con 0x7f378815e0e0 2023-12-11T17:10:39.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.364+0000 7f378ef48640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f378815e510 con 0x7f378806de20 2023-12-11T17:10:39.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.364+0000 7f378ef48640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3788071cd0 con 0x7f3788157a60 2023-12-11T17:10:39.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.365+0000 7f378d4e5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f378815e0e0 0x7f378815a5b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60632/0 (socket says 172.21.15.37:60632) 2023-12-11T17:10:39.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.365+0000 7f378d4e5640 1 -- 172.21.15.37:0/460842746 learned_addr learned my addr 172.21.15.37:0/460842746 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:39.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.365+0000 7f3787fff640 1 --2- 172.21.15.37:0/460842746 >> v2:172.21.15.37:3300/0 conn(0x7f378806de20 0x7f378815dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:39.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.365+0000 7f378cce4640 1 --2- 172.21.15.37:0/460842746 >> v2:172.21.15.151:3300/0 conn(0x7f3788157a60 0x7f378806c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:39.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.365+0000 7f37877fe640 1 -- 172.21.15.37:0/460842746 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2899563543 0 0) 0x7f378806ca40 con 0x7f378815e0e0 2023-12-11T17:10:39.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.365+0000 7f37877fe640 1 -- 172.21.15.37:0/460842746 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3770003520 con 0x7f378815e0e0 2023-12-11T17:10:39.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.365+0000 7f3787fff640 1 -- 172.21.15.37:0/460842746 >> v2:172.21.15.151:3300/0 conn(0x7f3788157a60 msgr2=0x7f378806c410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:39.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.365+0000 7f3787fff640 1 --2- 172.21.15.37:0/460842746 >> v2:172.21.15.151:3300/0 conn(0x7f3788157a60 0x7f378806c410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:39.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.365+0000 7f3787fff640 1 -- 172.21.15.37:0/460842746 >> v1:172.21.15.37:6789/0 conn(0x7f378815e0e0 legacy=0x7f378815a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:39.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.365+0000 7f3787fff640 1 -- 172.21.15.37:0/460842746 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3788070f10 con 0x7f378806de20 2023-12-11T17:10:39.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.367+0000 7f3787fff640 1 --2- 172.21.15.37:0/460842746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f378806de20 0x7f378815dba0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f37880b1710 tx=0x7f377802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65d762afa7c405f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:39.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.367+0000 7f37877fe640 1 -- 172.21.15.37:0/460842746 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f377802e070 con 0x7f378806de20 2023-12-11T17:10:39.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.367+0000 7f37877fe640 1 -- 172.21.15.37:0/460842746 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37780315a0 con 0x7f378806de20 2023-12-11T17:10:39.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.367+0000 7f37877fe640 1 -- 172.21.15.37:0/460842746 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3778031930 con 0x7f378806de20 2023-12-11T17:10:39.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.367+0000 7f378ef48640 1 -- 172.21.15.37:0/460842746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f378806de20 msgr2=0x7f378815dba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:39.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.367+0000 7f378ef48640 1 --2- 172.21.15.37:0/460842746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f378806de20 0x7f378815dba0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f37880b1710 tx=0x7f377802b840 comp rx=0 tx=0).stop 2023-12-11T17:10:39.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.367+0000 7f378ef48640 1 -- 172.21.15.37:0/460842746 shutdown_connections 2023-12-11T17:10:39.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.367+0000 7f378ef48640 1 --2- 172.21.15.37:0/460842746 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f378806de20 0x7f378815dba0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:39.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.367+0000 7f378ef48640 1 --2- 172.21.15.37:0/460842746 >> v2:172.21.15.151:3300/0 conn(0x7f3788157a60 0x7f378806c410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:39.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.367+0000 7f378ef48640 1 -- 172.21.15.37:0/460842746 >> 172.21.15.37:0/460842746 conn(0x7f37880b0a90 msgr2=0x7f37880b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:39.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.368+0000 7f378ef48640 1 -- 172.21.15.37:0/460842746 shutdown_connections 2023-12-11T17:10:39.370 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.368+0000 7f378ef48640 1 -- 172.21.15.37:0/460842746 wait complete. 2023-12-11T17:10:39.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.369+0000 7f378ef48640 1 Processor -- start 2023-12-11T17:10:39.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.369+0000 7f378ef48640 1 -- start start 2023-12-11T17:10:39.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.370+0000 7f378ef48640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f378806de20 0x7f3788148bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:39.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.370+0000 7f378ef48640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3788157a60 0x7f378814b630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:39.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.370+0000 7f378ef48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f378815e0e0 0x7f378814bb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:39.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.370+0000 7f378ef48640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37881490f0 con 0x7f378815e0e0 2023-12-11T17:10:39.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.370+0000 7f378ef48640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3788149580 con 0x7f378806de20 2023-12-11T17:10:39.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.371+0000 7f378ef48640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f378814c160 con 0x7f3788157a60 2023-12-11T17:10:39.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.371+0000 7f378d4e5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f378815e0e0 0x7f378814bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.371+0000 7f378d4e5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f378815e0e0 0x7f378814bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58638/0 (socket says 172.21.15.37:58638) 2023-12-11T17:10:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.371+0000 7f378d4e5640 1 -- 172.21.15.37:0/3901910229 learned_addr learned my addr 172.21.15.37:0/3901910229 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.371+0000 7f3787fff640 1 --2- 172.21.15.37:0/3901910229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3788157a60 0x7f378814b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.371+0000 7f378cce4640 1 --2- 172.21.15.37:0/3901910229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f378806de20 0x7f3788148bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.371+0000 7f378d4e5640 1 -- 172.21.15.37:0/3901910229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3788157a60 msgr2=0x7f378814b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.371+0000 7f378d4e5640 1 --2- 172.21.15.37:0/3901910229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3788157a60 0x7f378814b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.371+0000 7f378d4e5640 1 -- 172.21.15.37:0/3901910229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f378806de20 msgr2=0x7f3788148bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:39.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.371+0000 7f378d4e5640 1 --2- 172.21.15.37:0/3901910229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f378806de20 0x7f3788148bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:39.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.371+0000 7f378d4e5640 1 -- 172.21.15.37:0/3901910229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3778009400 con 0x7f378815e0e0 2023-12-11T17:10:39.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.372+0000 7f378d4e5640 1 --2- 172.21.15.37:0/3901910229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f378815e0e0 0x7f378814bb70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f378000caa0 tx=0x7f378000cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:39.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.372+0000 7f37857fa640 1 -- 172.21.15.37:0/3901910229 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f378000ac00 con 0x7f378815e0e0 2023-12-11T17:10:39.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.372+0000 7f37857fa640 1 -- 172.21.15.37:0/3901910229 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f378000ad60 con 0x7f378815e0e0 2023-12-11T17:10:39.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.372+0000 7f378ef48640 1 -- 172.21.15.37:0/3901910229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f378814c440 con 0x7f378815e0e0 2023-12-11T17:10:39.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.372+0000 7f37857fa640 1 -- 172.21.15.37:0/3901910229 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3780012620 con 0x7f378815e0e0 2023-12-11T17:10:39.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.372+0000 7f378ef48640 1 -- 172.21.15.37:0/3901910229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3788149a70 con 0x7f378815e0e0 2023-12-11T17:10:39.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.373+0000 7f378ef48640 1 -- 172.21.15.37:0/3901910229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3788149c60 con 0x7f378815e0e0 2023-12-11T17:10:39.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.374+0000 7f37857fa640 1 -- 172.21.15.37:0/3901910229 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3780007070 con 0x7f378815e0e0 2023-12-11T17:10:39.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.375+0000 7f37857fa640 1 --2- 172.21.15.37:0/3901910229 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f377406ae40 0x7f377406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:39.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.375+0000 7f37857fa640 1 -- 172.21.15.37:0/3901910229 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f37800899f0 con 0x7f378815e0e0 2023-12-11T17:10:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.376+0000 7f378cce4640 1 --2- 172.21.15.37:0/3901910229 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f377406ae40 0x7f377406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:39.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.377+0000 7f378cce4640 1 --2- 172.21.15.37:0/3901910229 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f377406ae40 0x7f377406d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f377c006fd0 tx=0x7f377c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:39.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.379+0000 7f37857fa640 1 -- 172.21.15.37:0/3901910229 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f37800546b0 con 0x7f378815e0e0 2023-12-11T17:10:39.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.614+0000 7f378ef48640 1 -- 172.21.15.37:0/3901910229 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f37880745d0 con 0x7f378815e0e0 2023-12-11T17:10:39.615 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.615+0000 7f37857fa640 1 -- 172.21.15.37:0/3901910229 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+88 (secure 0 0 0) 0x7f3780017070 con 0x7f378815e0e0 2023-12-11T17:10:39.616 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2023-12-11T17:10:39.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.618+0000 7f378ef48640 1 -- 172.21.15.37:0/3901910229 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f377406ae40 msgr2=0x7f377406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:39.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.618+0000 7f378ef48640 1 --2- 172.21.15.37:0/3901910229 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f377406ae40 0x7f377406d300 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f377c006fd0 tx=0x7f377c008040 comp rx=0 tx=0).stop 2023-12-11T17:10:39.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.618+0000 7f378ef48640 1 -- 172.21.15.37:0/3901910229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f378815e0e0 msgr2=0x7f378814bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:39.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.618+0000 7f378ef48640 1 --2- 172.21.15.37:0/3901910229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f378815e0e0 0x7f378814bb70 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f378000caa0 tx=0x7f378000cf60 comp rx=0 tx=0).stop 2023-12-11T17:10:39.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.618+0000 7f378ef48640 1 -- 172.21.15.37:0/3901910229 shutdown_connections 2023-12-11T17:10:39.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.618+0000 7f378ef48640 1 --2- 172.21.15.37:0/3901910229 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f377406ae40 0x7f377406d300 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:39.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.618+0000 7f378ef48640 1 --2- 172.21.15.37:0/3901910229 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f378815e0e0 0x7f378814bb70 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:39.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.618+0000 7f378ef48640 1 --2- 172.21.15.37:0/3901910229 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3788157a60 0x7f378814b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:39.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.618+0000 7f378ef48640 1 --2- 172.21.15.37:0/3901910229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f378806de20 0x7f3788148bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:39.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.618+0000 7f378ef48640 1 -- 172.21.15.37:0/3901910229 >> 172.21.15.37:0/3901910229 conn(0x7f37880b0a90 msgr2=0x7f37880cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:39.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.618+0000 7f378ef48640 1 -- 172.21.15.37:0/3901910229 shutdown_connections 2023-12-11T17:10:39.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:39.618+0000 7f378ef48640 1 -- 172.21.15.37:0/3901910229 wait complete. 2023-12-11T17:10:39.636 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-11T17:10:39.636 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-11T17:10:39.636 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi151.front.sepia.ceph.com 2023-12-11T17:10:39.636 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-12-11T17:10:39.636 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-11T17:10:39.637 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-11T17:10:39.637 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-11T17:10:39.637 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-11T17:10:39.637 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-12-11T17:10:39.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:39.637 DEBUG:teuthology.orchestra.run.smithi151:> ip addr 2023-12-11T17:10:39.698 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-11T17:10:39.698 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-11T17:10:39.698 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-12-11T17:10:39.699 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:39.699 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-12-11T17:10:39.699 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:39.699 INFO:teuthology.orchestra.run.smithi151.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-11T17:10:39.699 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0c brd ff:ff:ff:ff:ff:ff 2023-12-11T17:10:39.699 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f0 2023-12-11T17:10:39.699 INFO:teuthology.orchestra.run.smithi151.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-11T17:10:39.699 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:da:6e:0d brd ff:ff:ff:ff:ff:ff 2023-12-11T17:10:39.699 INFO:teuthology.orchestra.run.smithi151.stdout: altname enp7s0f1 2023-12-11T17:10:39.699 INFO:teuthology.orchestra.run.smithi151.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-11T17:10:39.699 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:62 brd ff:ff:ff:ff:ff:ff 2023-12-11T17:10:39.699 INFO:teuthology.orchestra.run.smithi151.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-11T17:10:39.700 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 0c:c4:7a:88:6f:63 brd ff:ff:ff:ff:ff:ff 2023-12-11T17:10:39.700 INFO:teuthology.orchestra.run.smithi151.stdout: inet 172.21.15.151/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-11T17:10:39.700 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft 42278sec preferred_lft 42278sec 2023-12-11T17:10:39.700 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::ec4:7aff:fe88:6f63/64 scope link 2023-12-11T17:10:39.700 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:39.700 INFO:teuthology.orchestra.run.smithi151.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-11T17:10:39.700 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether d2:75:76:c3:fd:12 brd ff:ff:ff:ff:ff:ff 2023-12-11T17:10:39.700 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-11T17:10:39.700 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:39.700 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::486d:acff:fe76:9600/64 scope link 2023-12-11T17:10:39.700 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:39.701 INFO:teuthology.orchestra.run.smithi151.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-11T17:10:39.701 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether d2:75:76:c3:fd:12 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-11T17:10:39.701 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::d075:76ff:fec3:fd12/64 scope link 2023-12-11T17:10:39.701 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:39.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:39.702 DEBUG:teuthology.orchestra.run.smithi151:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-11T17:10:39.794 INFO:teuthology.orchestra.run.smithi151.stdout:1 2023-12-11T17:10:39.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:39.798 DEBUG:teuthology.orchestra.run.smithi151:> route 2023-12-11T17:10:39.854 INFO:teuthology.orchestra.run.smithi151.stdout:Kernel IP routing table 2023-12-11T17:10:39.854 INFO:teuthology.orchestra.run.smithi151.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-11T17:10:39.854 INFO:teuthology.orchestra.run.smithi151.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-11T17:10:39.854 INFO:teuthology.orchestra.run.smithi151.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-11T17:10:39.854 INFO:teuthology.orchestra.run.smithi151.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-11T17:10:39.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:39.855 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-11T17:10:39.856 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-11T17:10:39.856 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-11T17:10:39.856 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-11T17:10:39.856 DEBUG:teuthology.orchestra.run.smithi151:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-11T17:10:39.856 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-11T17:10:40.041 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:40.041 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list 2023-12-11T17:10:40.083 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:10:40.092 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:10:40.093 INFO:teuthology.orchestra.run.smithi151.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-11T17:10:40.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:40.098 DEBUG:teuthology.orchestra.run.smithi151:> ip netns list-id 2023-12-11T17:10:40.183 INFO:teuthology.orchestra.run.smithi151.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-12-11T17:10:40.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:40.183 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-11T17:10:40.183 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-11T17:10:40.183 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-11T17:10:40.183 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-12-11T17:10:40.183 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-11T17:10:40.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:40.366 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-11T17:10:40.449 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-11T17:10:40.449 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-11T17:10:40.449 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-12-11T17:10:40.449 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:40.449 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-12-11T17:10:40.449 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:40.449 INFO:teuthology.orchestra.run.smithi151.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-11T17:10:40.449 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 52:23:91:bc:b3:c6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-11T17:10:40.449 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-11T17:10:40.449 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:40.450 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::5023:91ff:febc:b3c6/64 scope link 2023-12-11T17:10:40.450 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:40.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:40.452 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-11T17:10:40.540 INFO:teuthology.orchestra.run.smithi151.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-11T17:10:40.540 INFO:teuthology.orchestra.run.smithi151.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-11T17:10:40.540 INFO:teuthology.orchestra.run.smithi151.stdout: inet 127.0.0.1/8 scope host lo 2023-12-11T17:10:40.540 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:40.540 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 ::1/128 scope host 2023-12-11T17:10:40.540 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:40.540 INFO:teuthology.orchestra.run.smithi151.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-11T17:10:40.540 INFO:teuthology.orchestra.run.smithi151.stdout: link/ether 52:23:91:bc:b3:c6 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-11T17:10:40.541 INFO:teuthology.orchestra.run.smithi151.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-11T17:10:40.541 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:40.541 INFO:teuthology.orchestra.run.smithi151.stdout: inet6 fe80::5023:91ff:febc:b3c6/64 scope link 2023-12-11T17:10:40.541 INFO:teuthology.orchestra.run.smithi151.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:10:40.544 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-12-11T17:10:40.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:40.544 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-11T17:10:40.544 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-11T17:10:40.544 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-12-11T17:10:40.544 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-11T17:10:40.544 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-12-11T17:10:40.544 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-12-11T17:10:40.545 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-12-11T17:10:40.545 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-11T17:10:40.811 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:40.811 DEBUG:teuthology.orchestra.run.smithi151:> (cd / && exec bash -c ' 2023-12-11T17:10:40.812 DEBUG:teuthology.orchestra.run.smithi151:> set -e 2023-12-11T17:10:40.812 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set brx.1 up 2023-12-11T17:10:40.812 DEBUG:teuthology.orchestra.run.smithi151:> sudo ip link set dev brx.1 master ceph-brx 2023-12-11T17:10:40.812 DEBUG:teuthology.orchestra.run.smithi151:> ') 2023-12-11T17:10:40.975 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-11T17:10:40.975 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-12-11T17:10:41.025 INFO:teuthology.orchestra.run.smithi151.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-12-11T17:10:41.025 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-11T17:10:41.025 DEBUG:teuthology.orchestra.run.smithi151:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-12-11T17:10:41.076 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-11T17:10:41.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:41.076 DEBUG:teuthology.orchestra.run.smithi151:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-12-11T17:10:41.212 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-12-11T17:10:41.212 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-12-11T17:10:41.212 INFO:teuthology.orchestra.run.smithi151.stdout:invalid new device string format 2023-12-11T17:10:41.235 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-12-11T17:10:41.235 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-12-11T17:10:41.235 INFO:teuthology.orchestra.run.smithi151.stdout:invalid new device string format 2023-12-11T17:10:41.235 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-11T17:10:41.235 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-11T17:10:41.264 INFO:teuthology.orchestra.run.smithi151.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-12-11T17:10:41.264 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-12-11T17:10:41.264 INFO:teuthology.orchestra.run.smithi151.stdout:invalid new device string format 2023-12-11T17:10:41.264 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-11T17:10:41.264 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-11T17:10:41.264 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.151:6789,172.21.15.151:6790" 2023-12-11T17:10:41.265 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.151:6789,172.21.15.151:6790:/ 2023-12-11T17:10:41.265 INFO:teuthology.orchestra.run.smithi151.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=349792a4-57b1-4c92-9cc0-0c9ba4325d41" will pass to kernel 2023-12-11T17:10:41.266 INFO:teuthology.orchestra.run.smithi151.stdout:mount: /home/ubuntu/cephtest/mnt.3 does not contain SELinux labels. 2023-12-11T17:10:41.266 INFO:teuthology.orchestra.run.smithi151.stdout: You just mounted a file system that supports labels which does not 2023-12-11T17:10:41.266 INFO:teuthology.orchestra.run.smithi151.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-11T17:10:41.266 INFO:teuthology.orchestra.run.smithi151.stdout: applications will generate AVC messages and not be allowed access to 2023-12-11T17:10:41.266 INFO:teuthology.orchestra.run.smithi151.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-11T17:10:41.273 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-11T17:10:41.273 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:41.273 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-12-11T17:10:41.355 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:41.355 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-11T17:10:41.414 INFO:teuthology.orchestra.run.smithi151.stdout:client4732 2023-12-11T17:10:41.415 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:10:41.415 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-11T17:10:41.466 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:41.467 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-11T17:10:41.571 INFO:teuthology.orchestra.run.smithi151.stdout:client4732 2023-12-11T17:10:41.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:41.571 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-11T17:10:41.631 INFO:teuthology.orchestra.run.smithi151.stdout:client4732 2023-12-11T17:10:41.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:41.632 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest/mnt.3 && exec bash -c 'sudo dd if=/sys/kernel/debug/ceph/349792a4-57b1-4c92-9cc0-0c9ba4325d41.client4732/status') 2023-12-11T17:10:41.725 INFO:teuthology.orchestra.run.smithi151.stdout:instance: client.4732 (3)192.168.0.2:0/2396870273 2023-12-11T17:10:41.726 INFO:teuthology.orchestra.run.smithi151.stdout:blocklisted: false 2023-12-11T17:10:41.726 INFO:teuthology.orchestra.run.smithi151.stderr:0+1 records in 2023-12-11T17:10:41.726 INFO:teuthology.orchestra.run.smithi151.stderr:0+1 records out 2023-12-11T17:10:41.726 INFO:teuthology.orchestra.run.smithi151.stderr:69 bytes copied, 6.6658e-05 s, 1.0 MB/s 2023-12-11T17:10:41.730 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-11T17:10:41.751 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:10:41.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.980+0000 7f0192f8a640 1 Processor -- start 2023-12-11T17:10:41.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.980+0000 7f0192f8a640 1 -- start start 2023-12-11T17:10:41.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.981+0000 7f0192f8a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c0ae200 0x7f018c070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:41.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.981+0000 7f0192f8a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f018c0abd20 0x7f018c071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:41.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.981+0000 7f0192f8a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f018c071f90 con 0x7f018c15e5d0 2023-12-11T17:10:41.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.982+0000 7f0192f8a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f018c072270 con 0x7f018c0abd20 2023-12-11T17:10:41.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.982+0000 7f0192f8a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018c070070 con 0x7f018c0ae200 2023-12-11T17:10:41.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.982+0000 7f0191f88640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f018c15e5d0 0x7f018c06bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60634/0 (socket says 172.21.15.37:60634) 2023-12-11T17:10:41.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.982+0000 7f0191f88640 1 -- 172.21.15.37:0/3807231747 learned_addr learned my addr 172.21.15.37:0/3807231747 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:41.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.982+0000 7f0192789640 1 --2- 172.21.15.37:0/3807231747 >> v2:172.21.15.37:3300/0 conn(0x7f018c0abd20 0x7f018c071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:41.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.982+0000 7f0191787640 1 --2- 172.21.15.37:0/3807231747 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c0ae200 0x7f018c070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:41.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.982+0000 7f0190f86640 1 -- 172.21.15.37:0/3807231747 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1174785354 0 0) 0x7f018c071f90 con 0x7f018c15e5d0 2023-12-11T17:10:41.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.982+0000 7f0190f86640 1 -- 172.21.15.37:0/3807231747 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0178003520 con 0x7f018c15e5d0 2023-12-11T17:10:41.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.982+0000 7f0192789640 1 -- 172.21.15.37:0/3807231747 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c0ae200 msgr2=0x7f018c070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:41.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.982+0000 7f0192789640 1 --2- 172.21.15.37:0/3807231747 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c0ae200 0x7f018c070b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:41.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.983+0000 7f0192789640 1 -- 172.21.15.37:0/3807231747 >> v1:172.21.15.37:6789/0 conn(0x7f018c15e5d0 legacy=0x7f018c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:41.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.983+0000 7f0192789640 1 -- 172.21.15.37:0/3807231747 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f018c070350 con 0x7f018c0abd20 2023-12-11T17:10:41.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.984+0000 7f0192789640 1 --2- 172.21.15.37:0/3807231747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f018c0abd20 0x7f018c071090 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0184009d90 tx=0x7f018402bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb67f2bd5d46f74b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:41.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.984+0000 7f0190f86640 1 -- 172.21.15.37:0/3807231747 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018402cb30 con 0x7f018c0abd20 2023-12-11T17:10:41.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.984+0000 7f0190f86640 1 -- 172.21.15.37:0/3807231747 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018402cc90 con 0x7f018c0abd20 2023-12-11T17:10:41.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.984+0000 7f0190f86640 1 -- 172.21.15.37:0/3807231747 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0184034440 con 0x7f018c0abd20 2023-12-11T17:10:41.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.985+0000 7f0192f8a640 1 -- 172.21.15.37:0/3807231747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f018c0abd20 msgr2=0x7f018c071090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:41.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.985+0000 7f0192f8a640 1 --2- 172.21.15.37:0/3807231747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f018c0abd20 0x7f018c071090 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f0184009d90 tx=0x7f018402bd80 comp rx=0 tx=0).stop 2023-12-11T17:10:41.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.985+0000 7f0192f8a640 1 -- 172.21.15.37:0/3807231747 shutdown_connections 2023-12-11T17:10:41.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.985+0000 7f0192f8a640 1 --2- 172.21.15.37:0/3807231747 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f018c0abd20 0x7f018c071090 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:41.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.985+0000 7f0192f8a640 1 --2- 172.21.15.37:0/3807231747 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c0ae200 0x7f018c070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:41.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.985+0000 7f0192f8a640 1 -- 172.21.15.37:0/3807231747 >> 172.21.15.37:0/3807231747 conn(0x7f018c0b0860 msgr2=0x7f018c0b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:41.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.985+0000 7f0192f8a640 1 -- 172.21.15.37:0/3807231747 shutdown_connections 2023-12-11T17:10:41.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.985+0000 7f0192f8a640 1 -- 172.21.15.37:0/3807231747 wait complete. 2023-12-11T17:10:41.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.987+0000 7f0192f8a640 1 Processor -- start 2023-12-11T17:10:41.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.987+0000 7f0192f8a640 1 -- start start 2023-12-11T17:10:41.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.988+0000 7f0192f8a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f018c0abd20 0x7f018c14f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:41.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.988+0000 7f0192f8a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c0ae200 0x7f018c0aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:41.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.988+0000 7f0192f8a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f018c15e5d0 0x7f018c0af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:41.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.988+0000 7f0192f8a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018c1f2800 con 0x7f018c15e5d0 2023-12-11T17:10:41.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.988+0000 7f0192f8a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f018c15a320 con 0x7f018c0abd20 2023-12-11T17:10:41.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.988+0000 7f0192f8a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f018c15c2d0 con 0x7f018c0ae200 2023-12-11T17:10:41.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.988+0000 7f0192789640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f018c15e5d0 0x7f018c0af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:41.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.988+0000 7f0192789640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f018c15e5d0 0x7f018c0af2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58652/0 (socket says 172.21.15.37:58652) 2023-12-11T17:10:41.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.988+0000 7f0192789640 1 -- 172.21.15.37:0/2903147905 learned_addr learned my addr 172.21.15.37:0/2903147905 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:41.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.988+0000 7f0191f88640 1 --2- 172.21.15.37:0/2903147905 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f018c0abd20 0x7f018c14f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:41.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.988+0000 7f0191787640 1 --2- 172.21.15.37:0/2903147905 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c0ae200 0x7f018c0aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:41.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.989+0000 7f0192789640 1 -- 172.21.15.37:0/2903147905 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c0ae200 msgr2=0x7f018c0aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.989+0000 7f0192789640 1 --2- 172.21.15.37:0/2903147905 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c0ae200 0x7f018c0aed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.989+0000 7f0192789640 1 -- 172.21.15.37:0/2903147905 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f018c0abd20 msgr2=0x7f018c14f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.989+0000 7f0192789640 1 --2- 172.21.15.37:0/2903147905 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f018c0abd20 0x7f018c14f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.989+0000 7f0192789640 1 -- 172.21.15.37:0/2903147905 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0184009a70 con 0x7f018c15e5d0 2023-12-11T17:10:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.989+0000 7f0191f88640 1 --2- 172.21.15.37:0/2903147905 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f018c0abd20 0x7f018c14f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.989+0000 7f0192789640 1 --2- 172.21.15.37:0/2903147905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f018c15e5d0 0x7f018c0af2d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0184009d90 tx=0x7f0184004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.989+0000 7f01827fc640 1 -- 172.21.15.37:0/2903147905 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018403e410 con 0x7f018c15e5d0 2023-12-11T17:10:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.989+0000 7f01827fc640 1 -- 172.21.15.37:0/2903147905 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f018403e590 con 0x7f018c15e5d0 2023-12-11T17:10:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.989+0000 7f0192f8a640 1 -- 172.21.15.37:0/2903147905 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f018c06c680 con 0x7f018c15e5d0 2023-12-11T17:10:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.989+0000 7f01827fc640 1 -- 172.21.15.37:0/2903147905 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018403e940 con 0x7f018c15e5d0 2023-12-11T17:10:41.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.989+0000 7f0192f8a640 1 -- 172.21.15.37:0/2903147905 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f018c15a850 con 0x7f018c15e5d0 2023-12-11T17:10:41.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.991+0000 7f0192f8a640 1 -- 172.21.15.37:0/2903147905 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f018c15c4d0 con 0x7f018c15e5d0 2023-12-11T17:10:41.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.992+0000 7f01827fc640 1 -- 172.21.15.37:0/2903147905 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f018403b050 con 0x7f018c15e5d0 2023-12-11T17:10:41.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.993+0000 7f01827fc640 1 --2- 172.21.15.37:0/2903147905 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f017006ae40 0x7f017006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:41.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.993+0000 7f01827fc640 1 -- 172.21.15.37:0/2903147905 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f01840ac230 con 0x7f018c15e5d0 2023-12-11T17:10:41.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.993+0000 7f0191f88640 1 --2- 172.21.15.37:0/2903147905 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f017006ae40 0x7f017006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:41.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.994+0000 7f0191f88640 1 --2- 172.21.15.37:0/2903147905 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f017006ae40 0x7f017006d300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f01880011e0 tx=0x7f0188009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:41.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:41.997+0000 7f01827fc640 1 -- 172.21.15.37:0/2903147905 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f018c15c4d0 con 0x7f018c15e5d0 2023-12-11T17:10:42.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.192+0000 7f0192f8a640 1 -- 172.21.15.37:0/2903147905 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f018c15c4d0 con 0x7f018c15e5d0 2023-12-11T17:10:42.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.193+0000 7f01827fc640 1 -- 172.21.15.37:0/2903147905 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18779 (secure 0 0 0) 0x7f018c15c4d0 con 0x7f018c15e5d0 2023-12-11T17:10:42.194 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:42.194 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:10:32.309274+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:10:42.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.196+0000 7f0192f8a640 1 -- 172.21.15.37:0/2903147905 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f017006ae40 msgr2=0x7f017006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:42.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.196+0000 7f0192f8a640 1 --2- 172.21.15.37:0/2903147905 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f017006ae40 0x7f017006d300 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f01880011e0 tx=0x7f0188009040 comp rx=0 tx=0).stop 2023-12-11T17:10:42.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.196+0000 7f0192f8a640 1 -- 172.21.15.37:0/2903147905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f018c15e5d0 msgr2=0x7f018c0af2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:42.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.196+0000 7f0192f8a640 1 --2- 172.21.15.37:0/2903147905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f018c15e5d0 0x7f018c0af2d0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f0184009d90 tx=0x7f0184004a40 comp rx=0 tx=0).stop 2023-12-11T17:10:42.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.196+0000 7f0192f8a640 1 -- 172.21.15.37:0/2903147905 shutdown_connections 2023-12-11T17:10:42.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.196+0000 7f0192f8a640 1 --2- 172.21.15.37:0/2903147905 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f017006ae40 0x7f017006d300 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:42.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.196+0000 7f0192f8a640 1 --2- 172.21.15.37:0/2903147905 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f018c15e5d0 0x7f018c0af2d0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:42.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.196+0000 7f0192f8a640 1 --2- 172.21.15.37:0/2903147905 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f018c0ae200 0x7f018c0aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:42.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.196+0000 7f0192f8a640 1 --2- 172.21.15.37:0/2903147905 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f018c0abd20 0x7f018c14f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:42.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.196+0000 7f0192f8a640 1 -- 172.21.15.37:0/2903147905 >> 172.21.15.37:0/2903147905 conn(0x7f018c0b0860 msgr2=0x7f018c06bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:42.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.196+0000 7f0192f8a640 1 -- 172.21.15.37:0/2903147905 shutdown_connections 2023-12-11T17:10:42.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.197+0000 7f0192f8a640 1 -- 172.21.15.37:0/2903147905 wait complete. 2023-12-11T17:10:42.215 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T17:09:38.415636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T17:09:42.786774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T17:09:43.660585+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-11T17:09:47.272351+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-11T17:10:42.215 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T17:10:42.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.446+0000 7f643909b640 1 Processor -- start 2023-12-11T17:10:42.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.446+0000 7f643909b640 1 -- start start 2023-12-11T17:10:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.448+0000 7f643909b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64340ce7e0 0x7f643415ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.448+0000 7f643909b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6434071cd0 con 0x7f643406a460 2023-12-11T17:10:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.448+0000 7f643909b640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64340719f0 con 0x7f643415af50 2023-12-11T17:10:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.448+0000 7f643909b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64340717e0 con 0x7f64340ce7e0 2023-12-11T17:10:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.448+0000 7f643359e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f643406a460 0x7f64340ccc20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60650/0 (socket says 172.21.15.37:60650) 2023-12-11T17:10:42.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.448+0000 7f643359e640 1 -- 172.21.15.37:0/2892568223 learned_addr learned my addr 172.21.15.37:0/2892568223 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:42.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.448+0000 7f642a59c640 1 --2- 172.21.15.37:0/2892568223 >> v2:172.21.15.37:3300/0 conn(0x7f64340ce7e0 0x7f643415ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:42.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.449+0000 7f642a59c640 1 -- 172.21.15.37:0/2892568223 >> v1:172.21.15.151:6789/0 conn(0x7f643415af50 legacy=0x7f643406c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:42.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.449+0000 7f642a59c640 1 -- 172.21.15.37:0/2892568223 >> v1:172.21.15.37:6789/0 conn(0x7f643406a460 legacy=0x7f64340ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:42.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.449+0000 7f642a59c640 1 -- 172.21.15.37:0/2892568223 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6434071ff0 con 0x7f64340ce7e0 2023-12-11T17:10:42.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.449+0000 7f643259c640 1 -- 172.21.15.37:0/2892568223 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375239357 0 0) 0x7f6434071cd0 con 0x7f643406a460 2023-12-11T17:10:42.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.450+0000 7f642a59c640 1 --2- 172.21.15.37:0/2892568223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64340ce7e0 0x7f643415ec00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f641c0097a0 tx=0x7f641c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ce8bf2e15284a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:42.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.450+0000 7f643259c640 1 -- 172.21.15.37:0/2892568223 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c02e070 con 0x7f64340ce7e0 2023-12-11T17:10:42.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.450+0000 7f643259c640 1 -- 172.21.15.37:0/2892568223 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f641c0315a0 con 0x7f64340ce7e0 2023-12-11T17:10:42.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.450+0000 7f643259c640 1 -- 172.21.15.37:0/2892568223 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f641c031930 con 0x7f64340ce7e0 2023-12-11T17:10:42.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.451+0000 7f643909b640 1 -- 172.21.15.37:0/2892568223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64340ce7e0 msgr2=0x7f643415ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:42.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.451+0000 7f643909b640 1 --2- 172.21.15.37:0/2892568223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64340ce7e0 0x7f643415ec00 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f641c0097a0 tx=0x7f641c02b840 comp rx=0 tx=0).stop 2023-12-11T17:10:42.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.451+0000 7f643909b640 1 -- 172.21.15.37:0/2892568223 shutdown_connections 2023-12-11T17:10:42.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.451+0000 7f643909b640 1 --2- 172.21.15.37:0/2892568223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64340ce7e0 0x7f643415ec00 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:42.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.451+0000 7f643909b640 1 -- 172.21.15.37:0/2892568223 >> 172.21.15.37:0/2892568223 conn(0x7f64340cee70 msgr2=0x7f64340cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:42.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.451+0000 7f643909b640 1 -- 172.21.15.37:0/2892568223 shutdown_connections 2023-12-11T17:10:42.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.451+0000 7f643909b640 1 -- 172.21.15.37:0/2892568223 wait complete. 2023-12-11T17:10:42.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.453+0000 7f643909b640 1 Processor -- start 2023-12-11T17:10:42.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.453+0000 7f643909b640 1 -- start start 2023-12-11T17:10:42.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.454+0000 7f643909b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f643406a460 0x7f6434156070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:42.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.454+0000 7f643909b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64340ce7e0 0x7f643409bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:42.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.454+0000 7f643909b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643415af50 0x7f643409c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:42.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.454+0000 7f643909b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64340c6b50 con 0x7f643415af50 2023-12-11T17:10:42.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.454+0000 7f643909b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64340c9e40 con 0x7f643406a460 2023-12-11T17:10:42.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.454+0000 7f643909b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64340c91c0 con 0x7f64340ce7e0 2023-12-11T17:10:42.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.454+0000 7f643359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643415af50 0x7f643409c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:42.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.454+0000 7f643359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643415af50 0x7f643409c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58674/0 (socket says 172.21.15.37:58674) 2023-12-11T17:10:42.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.454+0000 7f643359e640 1 -- 172.21.15.37:0/3435585313 learned_addr learned my addr 172.21.15.37:0/3435585313 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:42.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.454+0000 7f6432d9d640 1 --2- 172.21.15.37:0/3435585313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f643406a460 0x7f6434156070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:42.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.455+0000 7f642a59c640 1 --2- 172.21.15.37:0/3435585313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64340ce7e0 0x7f643409bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:42.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.455+0000 7f643359e640 1 -- 172.21.15.37:0/3435585313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64340ce7e0 msgr2=0x7f643409bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:42.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.455+0000 7f643359e640 1 --2- 172.21.15.37:0/3435585313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64340ce7e0 0x7f643409bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:42.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.455+0000 7f643359e640 1 -- 172.21.15.37:0/3435585313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f643406a460 msgr2=0x7f6434156070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:42.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.455+0000 7f643359e640 1 --2- 172.21.15.37:0/3435585313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f643406a460 0x7f6434156070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:42.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.455+0000 7f643359e640 1 -- 172.21.15.37:0/3435585313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f641c009400 con 0x7f643415af50 2023-12-11T17:10:42.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.455+0000 7f643359e640 1 --2- 172.21.15.37:0/3435585313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643415af50 0x7f643409c100 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f642c001eb0 tx=0x7f642c00c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:42.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.455+0000 7f642bfff640 1 -- 172.21.15.37:0/3435585313 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c0074e0 con 0x7f643415af50 2023-12-11T17:10:42.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.455+0000 7f642bfff640 1 -- 172.21.15.37:0/3435585313 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f642c007640 con 0x7f643415af50 2023-12-11T17:10:42.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.455+0000 7f642bfff640 1 -- 172.21.15.37:0/3435585313 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f642c004a00 con 0x7f643415af50 2023-12-11T17:10:42.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.455+0000 7f643909b640 1 -- 172.21.15.37:0/3435585313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64340c94a0 con 0x7f643415af50 2023-12-11T17:10:42.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.456+0000 7f643909b640 1 -- 172.21.15.37:0/3435585313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64340c9a60 con 0x7f643415af50 2023-12-11T17:10:42.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.457+0000 7f643909b640 1 -- 172.21.15.37:0/3435585313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64340c9f80 con 0x7f643415af50 2023-12-11T17:10:42.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.458+0000 7f642bfff640 1 -- 172.21.15.37:0/3435585313 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f642c004b60 con 0x7f643415af50 2023-12-11T17:10:42.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.458+0000 7f642bfff640 1 --2- 172.21.15.37:0/3435585313 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f641406ae40 0x7f641406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:42.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.459+0000 7f642bfff640 1 -- 172.21.15.37:0/3435585313 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f642c089920 con 0x7f643415af50 2023-12-11T17:10:42.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.459+0000 7f6432d9d640 1 --2- 172.21.15.37:0/3435585313 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f641406ae40 0x7f641406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:42.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.460+0000 7f6432d9d640 1 --2- 172.21.15.37:0/3435585313 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f641406ae40 0x7f641406d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f643406e3e0 tx=0x7f6424009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:42.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.463+0000 7f642bfff640 1 -- 172.21.15.37:0/3435585313 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f642c054550 con 0x7f643415af50 2023-12-11T17:10:42.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.654+0000 7f643909b640 1 -- 172.21.15.37:0/3435585313 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6434074450 con 0x7f643415af50 2023-12-11T17:10:42.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.655+0000 7f642bfff640 1 -- 172.21.15.37:0/3435585313 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f642c057b70 con 0x7f643415af50 2023-12-11T17:10:42.655 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-11T17:10:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.657+0000 7f643909b640 1 -- 172.21.15.37:0/3435585313 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f641406ae40 msgr2=0x7f641406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.657+0000 7f643909b640 1 --2- 172.21.15.37:0/3435585313 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f641406ae40 0x7f641406d300 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f643406e3e0 tx=0x7f6424009040 comp rx=0 tx=0).stop 2023-12-11T17:10:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.657+0000 7f643909b640 1 -- 172.21.15.37:0/3435585313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643415af50 msgr2=0x7f643409c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.657+0000 7f643909b640 1 --2- 172.21.15.37:0/3435585313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643415af50 0x7f643409c100 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f642c001eb0 tx=0x7f642c00c870 comp rx=0 tx=0).stop 2023-12-11T17:10:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.658+0000 7f643909b640 1 -- 172.21.15.37:0/3435585313 shutdown_connections 2023-12-11T17:10:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.658+0000 7f643909b640 1 --2- 172.21.15.37:0/3435585313 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f641406ae40 0x7f641406d300 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.658+0000 7f643909b640 1 --2- 172.21.15.37:0/3435585313 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f643415af50 0x7f643409c100 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.658+0000 7f643909b640 1 --2- 172.21.15.37:0/3435585313 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64340ce7e0 0x7f643409bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:42.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.658+0000 7f643909b640 1 --2- 172.21.15.37:0/3435585313 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f643406a460 0x7f6434156070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:42.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.658+0000 7f643909b640 1 -- 172.21.15.37:0/3435585313 >> 172.21.15.37:0/3435585313 conn(0x7f64340cee70 msgr2=0x7f64340cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:42.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.658+0000 7f643909b640 1 -- 172.21.15.37:0/3435585313 shutdown_connections 2023-12-11T17:10:42.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.658+0000 7f643909b640 1 -- 172.21.15.37:0/3435585313 wait complete. 2023-12-11T17:10:42.675 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T17:10:42.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.902+0000 7f8332bfb640 1 Processor -- start 2023-12-11T17:10:42.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.902+0000 7f8332bfb640 1 -- start start 2023-12-11T17:10:42.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.904+0000 7f8332bfb640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f832c0cb5b0 0x7f832c06c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:42.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.904+0000 7f8332bfb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f832c0cb990 0x7f832c15f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:42.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.904+0000 7f8332bfb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f832c06c770 con 0x7f832c15b250 2023-12-11T17:10:42.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.904+0000 7f8332bfb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832c06ca50 con 0x7f832c0cb990 2023-12-11T17:10:42.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.904+0000 7f8332bfb640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f832c06cd30 con 0x7f832c0cb5b0 2023-12-11T17:10:42.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.904+0000 7f83323fa640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f832c15b250 0x7f832c15b700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60652/0 (socket says 172.21.15.37:60652) 2023-12-11T17:10:42.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.904+0000 7f83323fa640 1 -- 172.21.15.37:0/486266952 learned_addr learned my addr 172.21.15.37:0/486266952 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:42.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.904+0000 7f83313f8640 1 --2- 172.21.15.37:0/486266952 >> v2:172.21.15.37:3300/0 conn(0x7f832c0cb990 0x7f832c15f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:42.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.905+0000 7f8330bf7640 1 -- 172.21.15.37:0/486266952 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1825562780 0 0) 0x7f832c06c770 con 0x7f832c15b250 2023-12-11T17:10:42.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.905+0000 7f83313f8640 1 -- 172.21.15.37:0/486266952 >> v2:172.21.15.151:3300/0 conn(0x7f832c0cb5b0 msgr2=0x7f832c06c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:42.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.905+0000 7f83313f8640 1 --2- 172.21.15.37:0/486266952 >> v2:172.21.15.151:3300/0 conn(0x7f832c0cb5b0 0x7f832c06c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:42.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.905+0000 7f83313f8640 1 -- 172.21.15.37:0/486266952 >> v1:172.21.15.37:6789/0 conn(0x7f832c15b250 legacy=0x7f832c15b700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:42.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.905+0000 7f83313f8640 1 -- 172.21.15.37:0/486266952 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f832c06d010 con 0x7f832c0cb990 2023-12-11T17:10:42.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.906+0000 7f83313f8640 1 --2- 172.21.15.37:0/486266952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832c0cb990 0x7f832c15f510 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f832c0cfba0 tx=0x7f831c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b50dfa4a7d2204f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:42.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.906+0000 7f8330bf7640 1 -- 172.21.15.37:0/486266952 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c031830 con 0x7f832c0cb990 2023-12-11T17:10:42.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.907+0000 7f8330bf7640 1 -- 172.21.15.37:0/486266952 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f831c031990 con 0x7f832c0cb990 2023-12-11T17:10:42.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.907+0000 7f8330bf7640 1 -- 172.21.15.37:0/486266952 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f831c031d20 con 0x7f832c0cb990 2023-12-11T17:10:42.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.907+0000 7f8332bfb640 1 -- 172.21.15.37:0/486266952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832c0cb990 msgr2=0x7f832c15f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:42.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.907+0000 7f8332bfb640 1 --2- 172.21.15.37:0/486266952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832c0cb990 0x7f832c15f510 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f832c0cfba0 tx=0x7f831c02b8d0 comp rx=0 tx=0).stop 2023-12-11T17:10:42.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.907+0000 7f8332bfb640 1 -- 172.21.15.37:0/486266952 shutdown_connections 2023-12-11T17:10:42.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.907+0000 7f8332bfb640 1 --2- 172.21.15.37:0/486266952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832c0cb990 0x7f832c15f510 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:42.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.907+0000 7f8332bfb640 1 --2- 172.21.15.37:0/486266952 >> v2:172.21.15.151:3300/0 conn(0x7f832c0cb5b0 0x7f832c06c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:42.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.907+0000 7f8332bfb640 1 -- 172.21.15.37:0/486266952 >> 172.21.15.37:0/486266952 conn(0x7f832c0b0940 msgr2=0x7f832c0b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:42.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.907+0000 7f8332bfb640 1 -- 172.21.15.37:0/486266952 shutdown_connections 2023-12-11T17:10:42.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.907+0000 7f8332bfb640 1 -- 172.21.15.37:0/486266952 wait complete. 2023-12-11T17:10:42.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.909+0000 7f8332bfb640 1 Processor -- start 2023-12-11T17:10:42.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.909+0000 7f8332bfb640 1 -- start start 2023-12-11T17:10:42.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.910+0000 7f8332bfb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f832c0cb5b0 0x7f832c0aee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:42.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.910+0000 7f8332bfb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f832c0cb990 0x7f832c159b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:42.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.910+0000 7f8332bfb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832c15b250 0x7f832c09b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:42.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.910+0000 7f8332bfb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c14fb30 con 0x7f832c15b250 2023-12-11T17:10:42.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.910+0000 7f8332bfb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f832c09bcb0 con 0x7f832c0cb5b0 2023-12-11T17:10:42.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.910+0000 7f8332bfb640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f832c0ae0a0 con 0x7f832c0cb990 2023-12-11T17:10:42.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.911+0000 7f83323fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832c15b250 0x7f832c09b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:42.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.911+0000 7f83323fa640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832c15b250 0x7f832c09b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58702/0 (socket says 172.21.15.37:58702) 2023-12-11T17:10:42.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.911+0000 7f83323fa640 1 -- 172.21.15.37:0/3017482589 learned_addr learned my addr 172.21.15.37:0/3017482589 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:42.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.911+0000 7f8331bf9640 1 --2- 172.21.15.37:0/3017482589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f832c0cb5b0 0x7f832c0aee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:42.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.911+0000 7f83313f8640 1 --2- 172.21.15.37:0/3017482589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f832c0cb990 0x7f832c159b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:42.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.911+0000 7f83323fa640 1 -- 172.21.15.37:0/3017482589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f832c0cb990 msgr2=0x7f832c159b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:42.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.911+0000 7f83323fa640 1 --2- 172.21.15.37:0/3017482589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f832c0cb990 0x7f832c159b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:42.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.911+0000 7f83323fa640 1 -- 172.21.15.37:0/3017482589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f832c0cb5b0 msgr2=0x7f832c0aee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:42.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.911+0000 7f83323fa640 1 --2- 172.21.15.37:0/3017482589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f832c0cb5b0 0x7f832c0aee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:42.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.911+0000 7f83323fa640 1 -- 172.21.15.37:0/3017482589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f831c009400 con 0x7f832c15b250 2023-12-11T17:10:42.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.911+0000 7f83313f8640 1 --2- 172.21.15.37:0/3017482589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f832c0cb990 0x7f832c159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:42.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.912+0000 7f83323fa640 1 --2- 172.21.15.37:0/3017482589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832c15b250 0x7f832c09b0d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f832400c700 tx=0x7f832400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:42.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.912+0000 7f83227fc640 1 -- 172.21.15.37:0/3017482589 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832400ce10 con 0x7f832c15b250 2023-12-11T17:10:42.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.912+0000 7f83227fc640 1 -- 172.21.15.37:0/3017482589 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832400a640 con 0x7f832c15b250 2023-12-11T17:10:42.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.912+0000 7f83227fc640 1 -- 172.21.15.37:0/3017482589 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832400aa70 con 0x7f832c15b250 2023-12-11T17:10:42.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.912+0000 7f8332bfb640 1 -- 172.21.15.37:0/3017482589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f832c0ae380 con 0x7f832c15b250 2023-12-11T17:10:42.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.912+0000 7f8332bfb640 1 -- 172.21.15.37:0/3017482589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832c0ae940 con 0x7f832c15b250 2023-12-11T17:10:42.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.913+0000 7f8332bfb640 1 -- 172.21.15.37:0/3017482589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f832c067910 con 0x7f832c15b250 2023-12-11T17:10:42.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.914+0000 7f83227fc640 1 -- 172.21.15.37:0/3017482589 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f832400abd0 con 0x7f832c15b250 2023-12-11T17:10:42.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.915+0000 7f83227fc640 1 --2- 172.21.15.37:0/3017482589 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f831006ae40 0x7f831006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:42.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.915+0000 7f83227fc640 1 -- 172.21.15.37:0/3017482589 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f8324088fb0 con 0x7f832c15b250 2023-12-11T17:10:42.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.916+0000 7f8331bf9640 1 --2- 172.21.15.37:0/3017482589 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f831006ae40 0x7f831006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:42.917 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.917+0000 7f8331bf9640 1 --2- 172.21.15.37:0/3017482589 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f831006ae40 0x7f831006d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8328009890 tx=0x7f8328008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:42.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:42.919+0000 7f83227fc640 1 -- 172.21.15.37:0/3017482589 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8324053be0 con 0x7f832c15b250 2023-12-11T17:10:43.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.114+0000 7f8332bfb640 1 -- 172.21.15.37:0/3017482589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f832c0aeb30 con 0x7f832c15b250 2023-12-11T17:10:43.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.115+0000 7f83227fc640 1 -- 172.21.15.37:0/3017482589 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8324018020 con 0x7f832c15b250 2023-12-11T17:10:43.115 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:10:43.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.118+0000 7f8332bfb640 1 -- 172.21.15.37:0/3017482589 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f831006ae40 msgr2=0x7f831006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:43.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.118+0000 7f8332bfb640 1 --2- 172.21.15.37:0/3017482589 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f831006ae40 0x7f831006d300 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f8328009890 tx=0x7f8328008040 comp rx=0 tx=0).stop 2023-12-11T17:10:43.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.118+0000 7f8332bfb640 1 -- 172.21.15.37:0/3017482589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832c15b250 msgr2=0x7f832c09b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:43.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.118+0000 7f8332bfb640 1 --2- 172.21.15.37:0/3017482589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832c15b250 0x7f832c09b0d0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f832400c700 tx=0x7f832400cbc0 comp rx=0 tx=0).stop 2023-12-11T17:10:43.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.118+0000 7f8332bfb640 1 -- 172.21.15.37:0/3017482589 shutdown_connections 2023-12-11T17:10:43.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.118+0000 7f8332bfb640 1 --2- 172.21.15.37:0/3017482589 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f831006ae40 0x7f831006d300 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:43.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.118+0000 7f8332bfb640 1 --2- 172.21.15.37:0/3017482589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f832c15b250 0x7f832c09b0d0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:43.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.118+0000 7f8332bfb640 1 --2- 172.21.15.37:0/3017482589 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f832c0cb990 0x7f832c159b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:43.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.118+0000 7f8332bfb640 1 --2- 172.21.15.37:0/3017482589 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f832c0cb5b0 0x7f832c0aee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:43.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.118+0000 7f8332bfb640 1 -- 172.21.15.37:0/3017482589 >> 172.21.15.37:0/3017482589 conn(0x7f832c0b0940 msgr2=0x7f832c15ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:43.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.118+0000 7f8332bfb640 1 -- 172.21.15.37:0/3017482589 shutdown_connections 2023-12-11T17:10:43.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.118+0000 7f8332bfb640 1 -- 172.21.15.37:0/3017482589 wait complete. 2023-12-11T17:10:43.136 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T17:10:43.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.352+0000 7fc61551a640 1 Processor -- start 2023-12-11T17:10:43.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.352+0000 7fc61551a640 1 -- start start 2023-12-11T17:10:43.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.353+0000 7fc61551a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc610160ad0 0x7fc6100d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:43.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.353+0000 7fc61551a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc6100b1f80 0x7fc6100d15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:43.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.354+0000 7fc61551a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc6100d1b30 0x7fc6100cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:43.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.354+0000 7fc61551a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6100d3fb0 con 0x7fc6100d1b30 2023-12-11T17:10:43.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.354+0000 7fc61551a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6100d1f80 con 0x7fc6100b1f80 2023-12-11T17:10:43.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.354+0000 7fc61551a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6100d3cd0 con 0x7fc610160ad0 2023-12-11T17:10:43.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.354+0000 7fc614d19640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc6100d1b30 0x7fc6100cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:43.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.354+0000 7fc614d19640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc6100d1b30 0x7fc6100cdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58716/0 (socket says 172.21.15.37:58716) 2023-12-11T17:10:43.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.354+0000 7fc614d19640 1 -- 172.21.15.37:0/1314571181 learned_addr learned my addr 172.21.15.37:0/1314571181 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:43.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.354+0000 7fc60ffff640 1 --2- 172.21.15.37:0/1314571181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc610160ad0 0x7fc6100d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:43.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.354+0000 7fc60f7fe640 1 --2- 172.21.15.37:0/1314571181 >> v2:172.21.15.151:3300/0 conn(0x7fc6100b1f80 0x7fc6100d15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:43.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.354+0000 7fc614d19640 1 -- 172.21.15.37:0/1314571181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc610160ad0 msgr2=0x7fc6100d0df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:43.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.354+0000 7fc614d19640 1 --2- 172.21.15.37:0/1314571181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc610160ad0 0x7fc6100d0df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:43.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.354+0000 7fc614d19640 1 -- 172.21.15.37:0/1314571181 >> v2:172.21.15.151:3300/0 conn(0x7fc6100b1f80 msgr2=0x7fc6100d15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:43.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.354+0000 7fc614d19640 1 --2- 172.21.15.37:0/1314571181 >> v2:172.21.15.151:3300/0 conn(0x7fc6100b1f80 0x7fc6100d15f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:43.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.354+0000 7fc614d19640 1 -- 172.21.15.37:0/1314571181 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6100afde0 con 0x7fc6100d1b30 2023-12-11T17:10:43.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.354+0000 7fc60f7fe640 1 --2- 172.21.15.37:0/1314571181 >> v2:172.21.15.151:3300/0 conn(0x7fc6100b1f80 0x7fc6100d15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:43.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.356+0000 7fc614d19640 1 --2- 172.21.15.37:0/1314571181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6100d1b30 0x7fc6100cdc20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc61008c950 tx=0x7fc60802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c17890c29f16ec5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:43.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.356+0000 7fc60effd640 1 -- 172.21.15.37:0/1314571181 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6080317e0 con 0x7fc6100d1b30 2023-12-11T17:10:43.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.356+0000 7fc60effd640 1 -- 172.21.15.37:0/1314571181 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc608031940 con 0x7fc6100d1b30 2023-12-11T17:10:43.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.356+0000 7fc60effd640 1 -- 172.21.15.37:0/1314571181 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608031cd0 con 0x7fc6100d1b30 2023-12-11T17:10:43.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.356+0000 7fc61551a640 1 -- 172.21.15.37:0/1314571181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6100d1b30 msgr2=0x7fc6100cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:43.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.356+0000 7fc61551a640 1 --2- 172.21.15.37:0/1314571181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6100d1b30 0x7fc6100cdc20 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fc61008c950 tx=0x7fc60802b880 comp rx=0 tx=0).stop 2023-12-11T17:10:43.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.357+0000 7fc61551a640 1 -- 172.21.15.37:0/1314571181 shutdown_connections 2023-12-11T17:10:43.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.357+0000 7fc61551a640 1 --2- 172.21.15.37:0/1314571181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc6100d1b30 0x7fc6100cdc20 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:43.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.357+0000 7fc61551a640 1 --2- 172.21.15.37:0/1314571181 >> v2:172.21.15.151:3300/0 conn(0x7fc6100b1f80 0x7fc6100d15f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:43.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.357+0000 7fc61551a640 1 --2- 172.21.15.37:0/1314571181 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc610160ad0 0x7fc6100d0df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:43.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.357+0000 7fc61551a640 1 -- 172.21.15.37:0/1314571181 >> 172.21.15.37:0/1314571181 conn(0x7fc6100d3010 msgr2=0x7fc6100d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:43.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.357+0000 7fc61551a640 1 -- 172.21.15.37:0/1314571181 shutdown_connections 2023-12-11T17:10:43.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.357+0000 7fc61551a640 1 -- 172.21.15.37:0/1314571181 wait complete. 2023-12-11T17:10:43.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.359+0000 7fc61551a640 1 Processor -- start 2023-12-11T17:10:43.359 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.359+0000 7fc61551a640 1 -- start start 2023-12-11T17:10:43.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.360+0000 7fc61551a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6100b1f80 0x7fc6100cac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:43.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.360+0000 7fc61551a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6100d1b30 0x7fc6100b65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:43.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.360+0000 7fc61551a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc610160ad0 0x7fc610158b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:43.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.360+0000 7fc61551a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6100b6b00 con 0x7fc610160ad0 2023-12-11T17:10:43.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.360+0000 7fc61551a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6100cb720 con 0x7fc6100b1f80 2023-12-11T17:10:43.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.360+0000 7fc61551a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6100b6d30 con 0x7fc6100d1b30 2023-12-11T17:10:43.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.360+0000 7fc614d19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc610160ad0 0x7fc610158b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:43.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.360+0000 7fc614d19640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc610160ad0 0x7fc610158b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58726/0 (socket says 172.21.15.37:58726) 2023-12-11T17:10:43.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.360+0000 7fc614d19640 1 -- 172.21.15.37:0/931429185 learned_addr learned my addr 172.21.15.37:0/931429185 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:43.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.360+0000 7fc60f7fe640 1 --2- 172.21.15.37:0/931429185 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6100d1b30 0x7fc6100b65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:43.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.361+0000 7fc614d19640 1 -- 172.21.15.37:0/931429185 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6100d1b30 msgr2=0x7fc6100b65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:43.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.361+0000 7fc614d19640 1 --2- 172.21.15.37:0/931429185 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6100d1b30 0x7fc6100b65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:43.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.361+0000 7fc60ffff640 1 --2- 172.21.15.37:0/931429185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6100b1f80 0x7fc6100cac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:43.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.361+0000 7fc614d19640 1 -- 172.21.15.37:0/931429185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6100b1f80 msgr2=0x7fc6100cac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:43.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.361+0000 7fc614d19640 1 --2- 172.21.15.37:0/931429185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6100b1f80 0x7fc6100cac10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:43.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.361+0000 7fc614d19640 1 -- 172.21.15.37:0/931429185 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6080094d0 con 0x7fc610160ad0 2023-12-11T17:10:43.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.361+0000 7fc614d19640 1 --2- 172.21.15.37:0/931429185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc610160ad0 0x7fc610158b50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc6080090b0 tx=0x7fc6080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:43.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.361+0000 7fc60cff9640 1 -- 172.21.15.37:0/931429185 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608032880 con 0x7fc610160ad0 2023-12-11T17:10:43.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.361+0000 7fc60cff9640 1 -- 172.21.15.37:0/931429185 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc608032a20 con 0x7fc610160ad0 2023-12-11T17:10:43.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.361+0000 7fc61551a640 1 -- 172.21.15.37:0/931429185 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6100b7010 con 0x7fc610160ad0 2023-12-11T17:10:43.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.361+0000 7fc60cff9640 1 -- 172.21.15.37:0/931429185 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc608032dd0 con 0x7fc610160ad0 2023-12-11T17:10:43.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.362+0000 7fc61551a640 1 -- 172.21.15.37:0/931429185 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc610159090 con 0x7fc610160ad0 2023-12-11T17:10:43.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.363+0000 7fc61551a640 1 -- 172.21.15.37:0/931429185 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6100b8b50 con 0x7fc610160ad0 2023-12-11T17:10:43.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.364+0000 7fc60cff9640 1 -- 172.21.15.37:0/931429185 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc60804e450 con 0x7fc610160ad0 2023-12-11T17:10:43.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.365+0000 7fc60cff9640 1 --2- 172.21.15.37:0/931429185 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc5fc06ae40 0x7fc5fc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:43.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.365+0000 7fc60cff9640 1 -- 172.21.15.37:0/931429185 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fc6080aba90 con 0x7fc610160ad0 2023-12-11T17:10:43.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.366+0000 7fc60ffff640 1 --2- 172.21.15.37:0/931429185 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc5fc06ae40 0x7fc5fc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:43.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.367+0000 7fc60ffff640 1 --2- 172.21.15.37:0/931429185 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc5fc06ae40 0x7fc5fc06d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc600009e90 tx=0x7fc60000b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:43.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.370+0000 7fc60cff9640 1 -- 172.21.15.37:0/931429185 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc608076880 con 0x7fc610160ad0 2023-12-11T17:10:43.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.561+0000 7fc61551a640 1 -- 172.21.15.37:0/931429185 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc6100cb8e0 con 0x7fc610160ad0 2023-12-11T17:10:43.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.562+0000 7fc60cff9640 1 -- 172.21.15.37:0/931429185 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc608079ea0 con 0x7fc610160ad0 2023-12-11T17:10:43.562 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-11T17:10:43.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.564+0000 7fc61551a640 1 -- 172.21.15.37:0/931429185 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc5fc06ae40 msgr2=0x7fc5fc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:43.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.564+0000 7fc61551a640 1 --2- 172.21.15.37:0/931429185 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc5fc06ae40 0x7fc5fc06d300 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fc600009e90 tx=0x7fc60000b040 comp rx=0 tx=0).stop 2023-12-11T17:10:43.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.564+0000 7fc61551a640 1 -- 172.21.15.37:0/931429185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc610160ad0 msgr2=0x7fc610158b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:43.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.564+0000 7fc61551a640 1 --2- 172.21.15.37:0/931429185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc610160ad0 0x7fc610158b50 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7fc6080090b0 tx=0x7fc6080046c0 comp rx=0 tx=0).stop 2023-12-11T17:10:43.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.564+0000 7fc61551a640 1 -- 172.21.15.37:0/931429185 shutdown_connections 2023-12-11T17:10:43.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.564+0000 7fc61551a640 1 --2- 172.21.15.37:0/931429185 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc5fc06ae40 0x7fc5fc06d300 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:43.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.564+0000 7fc61551a640 1 --2- 172.21.15.37:0/931429185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc610160ad0 0x7fc610158b50 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:43.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.564+0000 7fc61551a640 1 --2- 172.21.15.37:0/931429185 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc6100d1b30 0x7fc6100b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:43.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.564+0000 7fc61551a640 1 --2- 172.21.15.37:0/931429185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc6100b1f80 0x7fc6100cac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:43.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.564+0000 7fc61551a640 1 -- 172.21.15.37:0/931429185 >> 172.21.15.37:0/931429185 conn(0x7fc6100d3010 msgr2=0x7fc61006be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:43.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.565+0000 7fc61551a640 1 -- 172.21.15.37:0/931429185 shutdown_connections 2023-12-11T17:10:43.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.565+0000 7fc61551a640 1 -- 172.21.15.37:0/931429185 wait complete. 2023-12-11T17:10:43.583 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-11T17:10:43.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.796+0000 7ff2ccb54640 1 Processor -- start 2023-12-11T17:10:43.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.796+0000 7ff2ccb54640 1 -- start start 2023-12-11T17:10:43.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.798+0000 7ff2ccb54640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff2c815ba90 0x7ff2c806d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:43.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.798+0000 7ff2ccb54640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c806d950 con 0x7ff2c80b2aa0 2023-12-11T17:10:43.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.798+0000 7ff2ccb54640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2c80cc720 con 0x7ff2c80cc2f0 2023-12-11T17:10:43.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.798+0000 7ff2ccb54640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2c80b3fe0 con 0x7ff2c815ba90 2023-12-11T17:10:43.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.798+0000 7ff2bffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff2c80b2aa0 0x7ff2c80cbbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60668/0 (socket says 172.21.15.37:60668) 2023-12-11T17:10:43.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.798+0000 7ff2bffff640 1 -- 172.21.15.37:0/1418017284 learned_addr learned my addr 172.21.15.37:0/1418017284 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:43.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.798+0000 7ff2c77fe640 1 --2- 172.21.15.37:0/1418017284 >> v2:172.21.15.37:3300/0 conn(0x7ff2c815ba90 0x7ff2c806d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:43.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.799+0000 7ff2c6ffd640 1 -- 172.21.15.37:0/1418017284 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2032574889 0 0) 0x7ff2c806d950 con 0x7ff2c80b2aa0 2023-12-11T17:10:43.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.799+0000 7ff2c6ffd640 1 -- 172.21.15.37:0/1418017284 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff2b4003520 con 0x7ff2c80b2aa0 2023-12-11T17:10:43.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.799+0000 7ff2c77fe640 1 -- 172.21.15.37:0/1418017284 >> v1:172.21.15.151:6789/0 conn(0x7ff2c80cc2f0 legacy=0x7ff2c8161a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:43.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.799+0000 7ff2c77fe640 1 -- 172.21.15.37:0/1418017284 >> v1:172.21.15.37:6789/0 conn(0x7ff2c80b2aa0 legacy=0x7ff2c80cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:43.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.799+0000 7ff2c77fe640 1 -- 172.21.15.37:0/1418017284 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c806c0b0 con 0x7ff2c815ba90 2023-12-11T17:10:43.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.800+0000 7ff2c77fe640 1 --2- 172.21.15.37:0/1418017284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2c815ba90 0x7ff2c806d370 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80097a0 tx=0x7ff2b802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b4ba861fb32690 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:43.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.800+0000 7ff2c6ffd640 1 -- 172.21.15.37:0/1418017284 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b802e070 con 0x7ff2c815ba90 2023-12-11T17:10:43.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.800+0000 7ff2c6ffd640 1 -- 172.21.15.37:0/1418017284 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2b80315a0 con 0x7ff2c815ba90 2023-12-11T17:10:43.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.800+0000 7ff2c6ffd640 1 -- 172.21.15.37:0/1418017284 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2b8031930 con 0x7ff2c815ba90 2023-12-11T17:10:43.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.801+0000 7ff2ccb54640 1 -- 172.21.15.37:0/1418017284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2c815ba90 msgr2=0x7ff2c806d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:43.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.801+0000 7ff2ccb54640 1 --2- 172.21.15.37:0/1418017284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2c815ba90 0x7ff2c806d370 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7ff2b80097a0 tx=0x7ff2b802b840 comp rx=0 tx=0).stop 2023-12-11T17:10:43.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.801+0000 7ff2ccb54640 1 -- 172.21.15.37:0/1418017284 shutdown_connections 2023-12-11T17:10:43.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.801+0000 7ff2ccb54640 1 --2- 172.21.15.37:0/1418017284 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2c815ba90 0x7ff2c806d370 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:43.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.801+0000 7ff2ccb54640 1 -- 172.21.15.37:0/1418017284 >> 172.21.15.37:0/1418017284 conn(0x7ff2c80b0940 msgr2=0x7ff2c80b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:43.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.801+0000 7ff2ccb54640 1 -- 172.21.15.37:0/1418017284 shutdown_connections 2023-12-11T17:10:43.801 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.801+0000 7ff2ccb54640 1 -- 172.21.15.37:0/1418017284 wait complete. 2023-12-11T17:10:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.803+0000 7ff2ccb54640 1 Processor -- start 2023-12-11T17:10:43.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.803+0000 7ff2ccb54640 1 -- start start 2023-12-11T17:10:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.804+0000 7ff2ccb54640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2c80b2aa0 0x7ff2c8140b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.804+0000 7ff2ccb54640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2c80cc2f0 0x7ff2c80cccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.804+0000 7ff2ccb54640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2c815ba90 0x7ff2c8142b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.804+0000 7ff2ccb54640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c80abd20 con 0x7ff2c815ba90 2023-12-11T17:10:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.804+0000 7ff2ccb54640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c80ac580 con 0x7ff2c80cc2f0 2023-12-11T17:10:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.804+0000 7ff2ccb54640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2c80cf810 con 0x7ff2c80b2aa0 2023-12-11T17:10:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.804+0000 7ff2c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2c815ba90 0x7ff2c8142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.804+0000 7ff2c7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2c815ba90 0x7ff2c8142b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58746/0 (socket says 172.21.15.37:58746) 2023-12-11T17:10:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.804+0000 7ff2c7fff640 1 -- 172.21.15.37:0/1723965434 learned_addr learned my addr 172.21.15.37:0/1723965434 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.805+0000 7ff2bffff640 1 --2- 172.21.15.37:0/1723965434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2c80cc2f0 0x7ff2c80cccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.805+0000 7ff2c77fe640 1 --2- 172.21.15.37:0/1723965434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2c80b2aa0 0x7ff2c8140b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:43.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.805+0000 7ff2c7fff640 1 -- 172.21.15.37:0/1723965434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2c80b2aa0 msgr2=0x7ff2c8140b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.805+0000 7ff2c7fff640 1 --2- 172.21.15.37:0/1723965434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2c80b2aa0 0x7ff2c8140b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.805+0000 7ff2c7fff640 1 -- 172.21.15.37:0/1723965434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2c80cc2f0 msgr2=0x7ff2c80cccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.805+0000 7ff2c7fff640 1 --2- 172.21.15.37:0/1723965434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2c80cc2f0 0x7ff2c80cccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.805+0000 7ff2c7fff640 1 -- 172.21.15.37:0/1723965434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b8009400 con 0x7ff2c815ba90 2023-12-11T17:10:43.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.805+0000 7ff2c7fff640 1 --2- 172.21.15.37:0/1723965434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2c815ba90 0x7ff2c8142b50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000c780 tx=0x7ff2c000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:43.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.805+0000 7ff2c4ff9640 1 -- 172.21.15.37:0/1723965434 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c0004b60 con 0x7ff2c815ba90 2023-12-11T17:10:43.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.805+0000 7ff2c4ff9640 1 -- 172.21.15.37:0/1723965434 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c000ce90 con 0x7ff2c815ba90 2023-12-11T17:10:43.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.805+0000 7ff2c4ff9640 1 -- 172.21.15.37:0/1723965434 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c000a7f0 con 0x7ff2c815ba90 2023-12-11T17:10:43.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.805+0000 7ff2ccb54640 1 -- 172.21.15.37:0/1723965434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2c80abf30 con 0x7ff2c815ba90 2023-12-11T17:10:43.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.806+0000 7ff2ccb54640 1 -- 172.21.15.37:0/1723965434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2c80cd200 con 0x7ff2c815ba90 2023-12-11T17:10:43.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.807+0000 7ff2ccb54640 1 -- 172.21.15.37:0/1723965434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2c80cd480 con 0x7ff2c815ba90 2023-12-11T17:10:43.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.807+0000 7ff2c4ff9640 1 -- 172.21.15.37:0/1723965434 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff2c000a950 con 0x7ff2c815ba90 2023-12-11T17:10:43.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.808+0000 7ff2c4ff9640 1 --2- 172.21.15.37:0/1723965434 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff2a806ae40 0x7ff2a806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:43.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.808+0000 7ff2c4ff9640 1 -- 172.21.15.37:0/1723965434 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff2c0089c00 con 0x7ff2c815ba90 2023-12-11T17:10:43.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.809+0000 7ff2c77fe640 1 --2- 172.21.15.37:0/1723965434 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff2a806ae40 0x7ff2a806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:43.810 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.810+0000 7ff2c77fe640 1 --2- 172.21.15.37:0/1723965434 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff2a806ae40 0x7ff2a806d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8036000 tx=0x7ff2b803d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:43.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:43.812+0000 7ff2c4ff9640 1 -- 172.21.15.37:0/1723965434 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff2c0054830 con 0x7ff2c815ba90 2023-12-11T17:10:44.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.006+0000 7ff2ccb54640 1 -- 172.21.15.37:0/1723965434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7ff2c8067910 con 0x7ff2c815ba90 2023-12-11T17:10:44.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.006+0000 7ff2c4ff9640 1 -- 172.21.15.37:0/1723965434 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7ff2c0057e50 con 0x7ff2c815ba90 2023-12-11T17:10:44.007 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:10:44.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.009+0000 7ff2ccb54640 1 -- 172.21.15.37:0/1723965434 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff2a806ae40 msgr2=0x7ff2a806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:44.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.009+0000 7ff2ccb54640 1 --2- 172.21.15.37:0/1723965434 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff2a806ae40 0x7ff2a806d300 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8036000 tx=0x7ff2b803d040 comp rx=0 tx=0).stop 2023-12-11T17:10:44.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.009+0000 7ff2ccb54640 1 -- 172.21.15.37:0/1723965434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2c815ba90 msgr2=0x7ff2c8142b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:44.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.009+0000 7ff2ccb54640 1 --2- 172.21.15.37:0/1723965434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2c815ba90 0x7ff2c8142b50 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7ff2c000c780 tx=0x7ff2c000cc40 comp rx=0 tx=0).stop 2023-12-11T17:10:44.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.009+0000 7ff2ccb54640 1 -- 172.21.15.37:0/1723965434 shutdown_connections 2023-12-11T17:10:44.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.009+0000 7ff2ccb54640 1 --2- 172.21.15.37:0/1723965434 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff2a806ae40 0x7ff2a806d300 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.009+0000 7ff2ccb54640 1 --2- 172.21.15.37:0/1723965434 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2c80cc2f0 0x7ff2c80cccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.009+0000 7ff2ccb54640 1 --2- 172.21.15.37:0/1723965434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff2c815ba90 0x7ff2c8142b50 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.009+0000 7ff2ccb54640 1 --2- 172.21.15.37:0/1723965434 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff2c80b2aa0 0x7ff2c8140b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.009+0000 7ff2ccb54640 1 -- 172.21.15.37:0/1723965434 >> 172.21.15.37:0/1723965434 conn(0x7ff2c80b0940 msgr2=0x7ff2c8071990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:44.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.009+0000 7ff2ccb54640 1 -- 172.21.15.37:0/1723965434 shutdown_connections 2023-12-11T17:10:44.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.009+0000 7ff2ccb54640 1 -- 172.21.15.37:0/1723965434 wait complete. 2023-12-11T17:10:44.028 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:10:44.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.252+0000 7faab097a640 1 Processor -- start 2023-12-11T17:10:44.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.253+0000 7faab097a640 1 -- start start 2023-12-11T17:10:44.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.254+0000 7faab097a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7faaac0d13c0 0x7faaac0ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:44.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.254+0000 7faab097a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaac0b2280 con 0x7faaac0d0d70 2023-12-11T17:10:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.254+0000 7faab097a640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaac0cee70 con 0x7faaac0b0760 2023-12-11T17:10:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.254+0000 7faab097a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaac0d11c0 con 0x7faaac0d13c0 2023-12-11T17:10:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.255+0000 7faaaaffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7faaac0d0d70 0x7faaac0d17a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60672/0 (socket says 172.21.15.37:60672) 2023-12-11T17:10:44.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.255+0000 7faaaaffd640 1 -- 172.21.15.37:0/3661906194 learned_addr learned my addr 172.21.15.37:0/3661906194 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:44.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.255+0000 7faaab7fe640 1 --2- 172.21.15.37:0/3661906194 >> v2:172.21.15.151:3300/0 conn(0x7faaac0d13c0 0x7faaac0ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:44.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.255+0000 7faaaa7fc640 1 -- 172.21.15.37:0/3661906194 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3828633724 0 0) 0x7faaac0b2280 con 0x7faaac0d0d70 2023-12-11T17:10:44.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.255+0000 7faaaa7fc640 1 -- 172.21.15.37:0/3661906194 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa98003520 con 0x7faaac0d0d70 2023-12-11T17:10:44.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.256+0000 7faaaa7fc640 1 -- 172.21.15.37:0/3661906194 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 301114971 0 0) 0x7faa98003520 con 0x7faaac0d0d70 2023-12-11T17:10:44.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.256+0000 7faaaa7fc640 1 -- 172.21.15.37:0/3661906194 >> v2:172.21.15.151:3300/0 conn(0x7faaac0d13c0 msgr2=0x7faaac0ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:44.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.256+0000 7faaaa7fc640 1 --2- 172.21.15.37:0/3661906194 >> v2:172.21.15.151:3300/0 conn(0x7faaac0d13c0 0x7faaac0ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.256+0000 7faaaa7fc640 1 -- 172.21.15.37:0/3661906194 >> v1:172.21.15.151:6789/0 conn(0x7faaac0b0760 legacy=0x7faaac0b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.256+0000 7faaaa7fc640 1 -- 172.21.15.37:0/3661906194 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac0ceb90 con 0x7faaac0d0d70 2023-12-11T17:10:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.256+0000 7faaaa7fc640 1 -- 172.21.15.37:0/3661906194 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7faa94001670 con 0x7faaac0d0d70 2023-12-11T17:10:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.256+0000 7faaaa7fc640 1 -- 172.21.15.37:0/3661906194 >> v1:172.21.15.37:6789/0 conn(0x7faaac0d0d70 legacy=0x7faaac0d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.256+0000 7faaaa7fc640 1 --2- 172.21.15.37:0/3661906194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa980039c0 0x7faa98003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.256+0000 7faaaa7fc640 1 --2- 172.21.15.37:0/3661906194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa980047c0 0x7faa98004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.256+0000 7faaaa7fc640 1 --2- 172.21.15.37:0/3661906194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa980051d0 0x7faa9800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.256+0000 7faaaa7fc640 1 -- 172.21.15.37:0/3661906194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac0d11c0 con 0x7faa980051d0 2023-12-11T17:10:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.256+0000 7faaaa7fc640 1 -- 172.21.15.37:0/3661906194 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9800c120 con 0x7faa980039c0 2023-12-11T17:10:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.256+0000 7faaaa7fc640 1 -- 172.21.15.37:0/3661906194 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa9800c2e0 con 0x7faa980047c0 2023-12-11T17:10:44.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.256+0000 7faaabfff640 1 --2- 172.21.15.37:0/3661906194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa980051d0 0x7faa9800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:44.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.257+0000 7faaab7fe640 1 --2- 172.21.15.37:0/3661906194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa980039c0 0x7faa98003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:44.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.257+0000 7faaabfff640 1 -- 172.21.15.37:0/3661906194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa980047c0 msgr2=0x7faa98004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:44.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.257+0000 7faaabfff640 1 --2- 172.21.15.37:0/3661906194 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faa980047c0 0x7faa98004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.257+0000 7faaabfff640 1 -- 172.21.15.37:0/3661906194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa980039c0 msgr2=0x7faa98003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:44.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.257+0000 7faaabfff640 1 --2- 172.21.15.37:0/3661906194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa980039c0 0x7faa98003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.257+0000 7faaabfff640 1 -- 172.21.15.37:0/3661906194 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa98003520 con 0x7faa980051d0 2023-12-11T17:10:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.258+0000 7faaabfff640 1 -- 172.21.15.37:0/3661906194 reap_dead start 2023-12-11T17:10:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.258+0000 7faaabfff640 1 --2- 172.21.15.37:0/3661906194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa980051d0 0x7faa9800b980 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faaa4001720 tx=0x7faa980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17e23d1dace9a8d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.258+0000 7faaaa7fc640 1 -- 172.21.15.37:0/3661906194 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa40052d0 con 0x7faa980051d0 2023-12-11T17:10:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.258+0000 7faaaa7fc640 1 -- 172.21.15.37:0/3661906194 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa402e050 con 0x7faa980051d0 2023-12-11T17:10:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.258+0000 7faaaa7fc640 1 -- 172.21.15.37:0/3661906194 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa40035f0 con 0x7faa980051d0 2023-12-11T17:10:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.259+0000 7faab097a640 1 -- 172.21.15.37:0/3661906194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa980051d0 msgr2=0x7faa9800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.259+0000 7faab097a640 1 --2- 172.21.15.37:0/3661906194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa980051d0 0x7faa9800b980 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7faaa4001720 tx=0x7faa980057f0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.259+0000 7faab097a640 1 -- 172.21.15.37:0/3661906194 shutdown_connections 2023-12-11T17:10:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.259+0000 7faab097a640 1 --2- 172.21.15.37:0/3661906194 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faa980051d0 0x7faa9800b980 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.259+0000 7faab097a640 1 -- 172.21.15.37:0/3661906194 >> 172.21.15.37:0/3661906194 conn(0x7faaac09c260 msgr2=0x7faaac0d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.259+0000 7faab097a640 1 -- 172.21.15.37:0/3661906194 shutdown_connections 2023-12-11T17:10:44.260 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.259+0000 7faab097a640 1 -- 172.21.15.37:0/3661906194 wait complete. 2023-12-11T17:10:44.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.261+0000 7faab097a640 1 Processor -- start 2023-12-11T17:10:44.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.261+0000 7faab097a640 1 -- start start 2023-12-11T17:10:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.262+0000 7faab097a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa980051d0 0x7faaac0b30e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.262+0000 7faab097a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaac15c8e0 0x7faaac1e4c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.262+0000 7faab097a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaac1e51a0 0x7faaac0b3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.262+0000 7faab097a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac0ccfa0 con 0x7faaac15c8e0 2023-12-11T17:10:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.262+0000 7faab097a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac1e5650 con 0x7faa980051d0 2023-12-11T17:10:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.262+0000 7faab097a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaac0cc320 con 0x7faaac1e51a0 2023-12-11T17:10:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.263+0000 7faaaaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaac15c8e0 0x7faaac1e4c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.263+0000 7faaaaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaac15c8e0 0x7faaac1e4c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58774/0 (socket says 172.21.15.37:58774) 2023-12-11T17:10:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.263+0000 7faaaaffd640 1 -- 172.21.15.37:0/3168982989 learned_addr learned my addr 172.21.15.37:0/3168982989 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:44.264 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.263+0000 7faaaaffd640 1 -- 172.21.15.37:0/3168982989 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaac1e51a0 msgr2=0x7faaac0b3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:44.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.263+0000 7faaaaffd640 1 --2- 172.21.15.37:0/3168982989 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaac1e51a0 0x7faaac0b3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.263+0000 7faaaaffd640 1 -- 172.21.15.37:0/3168982989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa980051d0 msgr2=0x7faaac0b30e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:44.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.263+0000 7faaaaffd640 1 --2- 172.21.15.37:0/3168982989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa980051d0 0x7faaac0b30e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.263+0000 7faaaaffd640 1 -- 172.21.15.37:0/3168982989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac0cc600 con 0x7faaac15c8e0 2023-12-11T17:10:44.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.263+0000 7faaaaffd640 1 --2- 172.21.15.37:0/3168982989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaac15c8e0 0x7faaac1e4c60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7faa9400c650 tx=0x7faa9400cb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:44.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.264+0000 7faaa3fff640 1 -- 172.21.15.37:0/3168982989 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa940072d0 con 0x7faaac15c8e0 2023-12-11T17:10:44.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.264+0000 7faaa3fff640 1 -- 172.21.15.37:0/3168982989 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa94007430 con 0x7faaac15c8e0 2023-12-11T17:10:44.265 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.264+0000 7faaa3fff640 1 -- 172.21.15.37:0/3168982989 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa940047e0 con 0x7faaac15c8e0 2023-12-11T17:10:44.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.264+0000 7faab097a640 1 -- 172.21.15.37:0/3168982989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaac0cc8e0 con 0x7faaac15c8e0 2023-12-11T17:10:44.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.264+0000 7faab097a640 1 -- 172.21.15.37:0/3168982989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaac0b3620 con 0x7faaac15c8e0 2023-12-11T17:10:44.266 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.265+0000 7faab097a640 1 -- 172.21.15.37:0/3168982989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaac0b59c0 con 0x7faaac15c8e0 2023-12-11T17:10:44.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.266+0000 7faaa3fff640 1 -- 172.21.15.37:0/3168982989 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7faa94004940 con 0x7faaac15c8e0 2023-12-11T17:10:44.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.267+0000 7faaa3fff640 1 --2- 172.21.15.37:0/3168982989 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7faa8c06aea0 0x7faa8c06d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:44.267 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.267+0000 7faaa3fff640 1 -- 172.21.15.37:0/3168982989 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7faa94088d90 con 0x7faaac15c8e0 2023-12-11T17:10:44.268 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.268+0000 7faaab7fe640 1 --2- 172.21.15.37:0/3168982989 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7faa8c06aea0 0x7faa8c06d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:44.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.269+0000 7faaab7fe640 1 --2- 172.21.15.37:0/3168982989 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7faa8c06aea0 0x7faa8c06d360 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faa9c007440 tx=0x7faa9c009750 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:44.271 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.272+0000 7faaa3fff640 1 -- 172.21.15.37:0/3168982989 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7faa940539d0 con 0x7faaac15c8e0 2023-12-11T17:10:44.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.467+0000 7faab097a640 1 -- 172.21.15.37:0/3168982989 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faaac1e6c50 con 0x7faaac15c8e0 2023-12-11T17:10:44.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.470+0000 7faaa3fff640 1 -- 172.21.15.37:0/3168982989 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18779 (secure 0 0 0) 0x7faa94018070 con 0x7faaac15c8e0 2023-12-11T17:10:44.470 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:44.471 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:10:32.309274+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:10:44.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.473+0000 7faab097a640 1 -- 172.21.15.37:0/3168982989 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7faa8c06aea0 msgr2=0x7faa8c06d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:44.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.473+0000 7faab097a640 1 --2- 172.21.15.37:0/3168982989 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7faa8c06aea0 0x7faa8c06d360 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7faa9c007440 tx=0x7faa9c009750 comp rx=0 tx=0).stop 2023-12-11T17:10:44.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.473+0000 7faab097a640 1 -- 172.21.15.37:0/3168982989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaac15c8e0 msgr2=0x7faaac1e4c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:44.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.473+0000 7faab097a640 1 --2- 172.21.15.37:0/3168982989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaac15c8e0 0x7faaac1e4c60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7faa9400c650 tx=0x7faa9400cb10 comp rx=0 tx=0).stop 2023-12-11T17:10:44.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.473+0000 7faab097a640 1 -- 172.21.15.37:0/3168982989 shutdown_connections 2023-12-11T17:10:44.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.473+0000 7faab097a640 1 --2- 172.21.15.37:0/3168982989 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7faa8c06aea0 0x7faa8c06d360 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.473+0000 7faab097a640 1 --2- 172.21.15.37:0/3168982989 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7faaac1e51a0 0x7faaac0b3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.473+0000 7faab097a640 1 --2- 172.21.15.37:0/3168982989 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7faaac15c8e0 0x7faaac1e4c60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.473+0000 7faab097a640 1 --2- 172.21.15.37:0/3168982989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7faa980051d0 0x7faaac0b30e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.473+0000 7faab097a640 1 -- 172.21.15.37:0/3168982989 >> 172.21.15.37:0/3168982989 conn(0x7faaac09c260 msgr2=0x7faaac0d03a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:44.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.473+0000 7faab097a640 1 -- 172.21.15.37:0/3168982989 shutdown_connections 2023-12-11T17:10:44.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.473+0000 7faab097a640 1 -- 172.21.15.37:0/3168982989 wait complete. 2023-12-11T17:10:44.493 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T17:09:38.415636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T17:09:42.786774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T17:09:43.660585+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-11T17:09:47.272351+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-11T17:10:44.494 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T17:10:44.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.714+0000 7fe686a27640 1 Processor -- start 2023-12-11T17:10:44.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.715+0000 7fe686a27640 1 -- start start 2023-12-11T17:10:44.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.716+0000 7fe686a27640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe680155400 0x7fe68006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:44.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.716+0000 7fe686a27640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe6800ce150 0x7fe6800ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:44.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.716+0000 7fe686a27640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe68015b4a0 con 0x7fe6800cedf0 2023-12-11T17:10:44.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.716+0000 7fe686a27640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6800adbb0 con 0x7fe680155400 2023-12-11T17:10:44.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.716+0000 7fe686a27640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6800ade90 con 0x7fe6800ce150 2023-12-11T17:10:44.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.717+0000 7fe685a25640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe680155400 0x7fe68006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:44.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.717+0000 7fe685a25640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe680155400 0x7fe68006bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58790/0 (socket says 172.21.15.37:58790) 2023-12-11T17:10:44.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.717+0000 7fe685a25640 1 -- 172.21.15.37:0/1526257445 learned_addr learned my addr 172.21.15.37:0/1526257445 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.717+0000 7fe685224640 1 --2- 172.21.15.37:0/1526257445 >> v2:172.21.15.151:3300/0 conn(0x7fe6800ce150 0x7fe6800ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.717+0000 7fe685a25640 1 -- 172.21.15.37:0/1526257445 >> v2:172.21.15.151:3300/0 conn(0x7fe6800ce150 msgr2=0x7fe6800ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.717+0000 7fe685a25640 1 --2- 172.21.15.37:0/1526257445 >> v2:172.21.15.151:3300/0 conn(0x7fe6800ce150 0x7fe6800ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.717+0000 7fe685a25640 1 -- 172.21.15.37:0/1526257445 >> v1:172.21.15.151:6789/0 conn(0x7fe6800cedf0 legacy=0x7fe68015b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.717+0000 7fe685a25640 1 -- 172.21.15.37:0/1526257445 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6800ae170 con 0x7fe680155400 2023-12-11T17:10:44.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.717+0000 7fe685224640 1 --2- 172.21.15.37:0/1526257445 >> v2:172.21.15.151:3300/0 conn(0x7fe6800ce150 0x7fe6800ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:44.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.718+0000 7fe685a25640 1 --2- 172.21.15.37:0/1526257445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe680155400 0x7fe68006bdf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe680070020 tx=0x7fe67c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61f08cce6797ca40 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:44.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.719+0000 7fe684a23640 1 -- 172.21.15.37:0/1526257445 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c02ca80 con 0x7fe680155400 2023-12-11T17:10:44.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.719+0000 7fe684a23640 1 -- 172.21.15.37:0/1526257445 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe67c02cbe0 con 0x7fe680155400 2023-12-11T17:10:44.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.719+0000 7fe684a23640 1 -- 172.21.15.37:0/1526257445 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe67c0343f0 con 0x7fe680155400 2023-12-11T17:10:44.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.720+0000 7fe686a27640 1 -- 172.21.15.37:0/1526257445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe680155400 msgr2=0x7fe68006bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:44.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.720+0000 7fe686a27640 1 --2- 172.21.15.37:0/1526257445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe680155400 0x7fe68006bdf0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fe680070020 tx=0x7fe67c02bee0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.720+0000 7fe686a27640 1 -- 172.21.15.37:0/1526257445 shutdown_connections 2023-12-11T17:10:44.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.720+0000 7fe686a27640 1 --2- 172.21.15.37:0/1526257445 >> v2:172.21.15.151:3300/0 conn(0x7fe6800ce150 0x7fe6800ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.720+0000 7fe686a27640 1 --2- 172.21.15.37:0/1526257445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe680155400 0x7fe68006bdf0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.720+0000 7fe686a27640 1 -- 172.21.15.37:0/1526257445 >> 172.21.15.37:0/1526257445 conn(0x7fe68006a640 msgr2=0x7fe68006aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:44.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.720+0000 7fe686a27640 1 -- 172.21.15.37:0/1526257445 shutdown_connections 2023-12-11T17:10:44.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.720+0000 7fe686a27640 1 -- 172.21.15.37:0/1526257445 wait complete. 2023-12-11T17:10:44.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.722+0000 7fe686a27640 1 Processor -- start 2023-12-11T17:10:44.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.722+0000 7fe686a27640 1 -- start start 2023-12-11T17:10:44.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.724+0000 7fe686a27640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6800ce150 0x7fe6800999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:44.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.724+0000 7fe686a27640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6800cedf0 0x7fe68014fa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:44.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.724+0000 7fe686a27640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe680155400 0x7fe680070f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:44.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.724+0000 7fe686a27640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68009afb0 con 0x7fe680155400 2023-12-11T17:10:44.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.724+0000 7fe686a27640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe680099f30 con 0x7fe6800cedf0 2023-12-11T17:10:44.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.724+0000 7fe686a27640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68014ffa0 con 0x7fe6800ce150 2023-12-11T17:10:44.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.724+0000 7fe686226640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe680155400 0x7fe680070f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:44.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.724+0000 7fe686226640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe680155400 0x7fe680070f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58806/0 (socket says 172.21.15.37:58806) 2023-12-11T17:10:44.725 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.724+0000 7fe686226640 1 -- 172.21.15.37:0/4183644480 learned_addr learned my addr 172.21.15.37:0/4183644480 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:44.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.725+0000 7fe685a25640 1 --2- 172.21.15.37:0/4183644480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6800ce150 0x7fe6800999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:44.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.725+0000 7fe685224640 1 --2- 172.21.15.37:0/4183644480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6800cedf0 0x7fe68014fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:44.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.725+0000 7fe686226640 1 -- 172.21.15.37:0/4183644480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6800ce150 msgr2=0x7fe6800999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:44.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.725+0000 7fe686226640 1 --2- 172.21.15.37:0/4183644480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6800ce150 0x7fe6800999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.725+0000 7fe686226640 1 -- 172.21.15.37:0/4183644480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6800cedf0 msgr2=0x7fe68014fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:44.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.725+0000 7fe686226640 1 --2- 172.21.15.37:0/4183644480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6800cedf0 0x7fe68014fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.725+0000 7fe686226640 1 -- 172.21.15.37:0/4183644480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe67c009b30 con 0x7fe680155400 2023-12-11T17:10:44.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.725+0000 7fe685224640 1 --2- 172.21.15.37:0/4183644480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6800cedf0 0x7fe68014fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:44.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.725+0000 7fe686226640 1 --2- 172.21.15.37:0/4183644480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe680155400 0x7fe680070f00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe67800c390 tx=0x7fe67800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:44.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.725+0000 7fe6767fc640 1 -- 172.21.15.37:0/4183644480 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6780035f0 con 0x7fe680155400 2023-12-11T17:10:44.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.725+0000 7fe6767fc640 1 -- 172.21.15.37:0/4183644480 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe678003750 con 0x7fe680155400 2023-12-11T17:10:44.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.725+0000 7fe686a27640 1 -- 172.21.15.37:0/4183644480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe68009a200 con 0x7fe680155400 2023-12-11T17:10:44.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.725+0000 7fe6767fc640 1 -- 172.21.15.37:0/4183644480 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe678003b00 con 0x7fe680155400 2023-12-11T17:10:44.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.726+0000 7fe686a27640 1 -- 172.21.15.37:0/4183644480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe68009a7c0 con 0x7fe680155400 2023-12-11T17:10:44.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.727+0000 7fe686a27640 1 -- 172.21.15.37:0/4183644480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6800b17a0 con 0x7fe680155400 2023-12-11T17:10:44.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.728+0000 7fe6767fc640 1 -- 172.21.15.37:0/4183644480 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe678003c60 con 0x7fe680155400 2023-12-11T17:10:44.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.729+0000 7fe6767fc640 1 --2- 172.21.15.37:0/4183644480 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe66406ae40 0x7fe66406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:44.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.729+0000 7fe6767fc640 1 -- 172.21.15.37:0/4183644480 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe678088ff0 con 0x7fe680155400 2023-12-11T17:10:44.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.730+0000 7fe685a25640 1 --2- 172.21.15.37:0/4183644480 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe66406ae40 0x7fe66406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:44.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.731+0000 7fe685a25640 1 --2- 172.21.15.37:0/4183644480 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe66406ae40 0x7fe66406d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe67c035000 tx=0x7fe67c030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:44.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.733+0000 7fe6767fc640 1 -- 172.21.15.37:0/4183644480 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe678053c80 con 0x7fe680155400 2023-12-11T17:10:44.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.931+0000 7fe686a27640 1 -- 172.21.15.37:0/4183644480 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe680074450 con 0x7fe680155400 2023-12-11T17:10:44.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.932+0000 7fe6767fc640 1 -- 172.21.15.37:0/4183644480 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe6780170a0 con 0x7fe680155400 2023-12-11T17:10:44.932 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-11T17:10:44.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.935+0000 7fe686a27640 1 -- 172.21.15.37:0/4183644480 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe66406ae40 msgr2=0x7fe66406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:44.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.935+0000 7fe686a27640 1 --2- 172.21.15.37:0/4183644480 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe66406ae40 0x7fe66406d300 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fe67c035000 tx=0x7fe67c030000 comp rx=0 tx=0).stop 2023-12-11T17:10:44.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.935+0000 7fe686a27640 1 -- 172.21.15.37:0/4183644480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe680155400 msgr2=0x7fe680070f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:44.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.935+0000 7fe686a27640 1 --2- 172.21.15.37:0/4183644480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe680155400 0x7fe680070f00 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fe67800c390 tx=0x7fe67800c850 comp rx=0 tx=0).stop 2023-12-11T17:10:44.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.935+0000 7fe686a27640 1 -- 172.21.15.37:0/4183644480 shutdown_connections 2023-12-11T17:10:44.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.935+0000 7fe686a27640 1 --2- 172.21.15.37:0/4183644480 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe66406ae40 0x7fe66406d300 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.935+0000 7fe686a27640 1 --2- 172.21.15.37:0/4183644480 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6800cedf0 0x7fe68014fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.935+0000 7fe686a27640 1 --2- 172.21.15.37:0/4183644480 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe680155400 0x7fe680070f00 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.935+0000 7fe686a27640 1 --2- 172.21.15.37:0/4183644480 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe6800ce150 0x7fe6800999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:44.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.935+0000 7fe686a27640 1 -- 172.21.15.37:0/4183644480 >> 172.21.15.37:0/4183644480 conn(0x7fe68006a640 msgr2=0x7fe6800cf230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:44.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.935+0000 7fe686a27640 1 -- 172.21.15.37:0/4183644480 shutdown_connections 2023-12-11T17:10:44.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:44.935+0000 7fe686a27640 1 -- 172.21.15.37:0/4183644480 wait complete. 2023-12-11T17:10:44.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T17:10:45.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.185+0000 7ff726567640 1 Processor -- start 2023-12-11T17:10:45.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.186+0000 7ff726567640 1 -- start start 2023-12-11T17:10:45.187 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.187+0000 7ff726567640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff72015d360 0x7ff7200d3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:45.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.187+0000 7ff726567640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff7200d1c40 0x7ff7200b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:45.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.187+0000 7ff726567640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7200cdf20 con 0x7ff7200cece0 2023-12-11T17:10:45.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.188+0000 7ff726567640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7200ce200 con 0x7ff7200d1c40 2023-12-11T17:10:45.188 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.188+0000 7ff726567640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7200ce4e0 con 0x7ff72015d360 2023-12-11T17:10:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.188+0000 7ff725d66640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff7200d1c40 0x7ff7200b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.188+0000 7ff724d64640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff7200cece0 0x7ff7200d1530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60688/0 (socket says 172.21.15.37:60688) 2023-12-11T17:10:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.188+0000 7ff724d64640 1 -- 172.21.15.37:0/2294966413 learned_addr learned my addr 172.21.15.37:0/2294966413 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.188+0000 7ff725565640 1 --2- 172.21.15.37:0/2294966413 >> v2:172.21.15.151:3300/0 conn(0x7ff72015d360 0x7ff7200d3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.189+0000 7ff725d66640 1 -- 172.21.15.37:0/2294966413 >> v2:172.21.15.151:3300/0 conn(0x7ff72015d360 msgr2=0x7ff7200d3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.189+0000 7ff725d66640 1 --2- 172.21.15.37:0/2294966413 >> v2:172.21.15.151:3300/0 conn(0x7ff72015d360 0x7ff7200d3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.189+0000 7ff725d66640 1 -- 172.21.15.37:0/2294966413 >> v1:172.21.15.37:6789/0 conn(0x7ff7200cece0 legacy=0x7ff7200d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.189+0000 7ff725d66640 1 -- 172.21.15.37:0/2294966413 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7200ce7c0 con 0x7ff7200d1c40 2023-12-11T17:10:45.189 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.190+0000 7ff725d66640 1 --2- 172.21.15.37:0/2294966413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7200d1c40 0x7ff7200b28b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff7200d2eb0 tx=0x7ff71802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d6b7df102862116 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:45.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.190+0000 7ff717fff640 1 -- 172.21.15.37:0/2294966413 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff718030610 con 0x7ff7200d1c40 2023-12-11T17:10:45.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.190+0000 7ff717fff640 1 -- 172.21.15.37:0/2294966413 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff718030770 con 0x7ff7200d1c40 2023-12-11T17:10:45.190 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.190+0000 7ff717fff640 1 -- 172.21.15.37:0/2294966413 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff718030b00 con 0x7ff7200d1c40 2023-12-11T17:10:45.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.191+0000 7ff726567640 1 -- 172.21.15.37:0/2294966413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7200d1c40 msgr2=0x7ff7200b28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:45.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.191+0000 7ff726567640 1 --2- 172.21.15.37:0/2294966413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7200d1c40 0x7ff7200b28b0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff7200d2eb0 tx=0x7ff71802b960 comp rx=0 tx=0).stop 2023-12-11T17:10:45.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.191+0000 7ff726567640 1 -- 172.21.15.37:0/2294966413 shutdown_connections 2023-12-11T17:10:45.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.191+0000 7ff726567640 1 --2- 172.21.15.37:0/2294966413 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7200d1c40 0x7ff7200b28b0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:45.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.191+0000 7ff726567640 1 --2- 172.21.15.37:0/2294966413 >> v2:172.21.15.151:3300/0 conn(0x7ff72015d360 0x7ff7200d3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:45.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.191+0000 7ff726567640 1 -- 172.21.15.37:0/2294966413 >> 172.21.15.37:0/2294966413 conn(0x7ff72009c230 msgr2=0x7ff7200d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:45.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.191+0000 7ff726567640 1 -- 172.21.15.37:0/2294966413 shutdown_connections 2023-12-11T17:10:45.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.191+0000 7ff726567640 1 -- 172.21.15.37:0/2294966413 wait complete. 2023-12-11T17:10:45.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.193+0000 7ff726567640 1 Processor -- start 2023-12-11T17:10:45.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.193+0000 7ff726567640 1 -- start start 2023-12-11T17:10:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.194+0000 7ff726567640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7200cece0 0x7ff72014a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.194+0000 7ff726567640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7200d1c40 0x7ff7200ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.194+0000 7ff726567640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff72015d360 0x7ff72014c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.194+0000 7ff726567640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72014a6c0 con 0x7ff7200cece0 2023-12-11T17:10:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.194+0000 7ff726567640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff72015ea90 con 0x7ff72015d360 2023-12-11T17:10:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.194+0000 7ff726567640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7200b6720 con 0x7ff7200d1c40 2023-12-11T17:10:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.194+0000 7ff725565640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7200cece0 0x7ff72014a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.194+0000 7ff725565640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7200cece0 0x7ff72014a180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58810/0 (socket says 172.21.15.37:58810) 2023-12-11T17:10:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.194+0000 7ff725565640 1 -- 172.21.15.37:0/2884436013 learned_addr learned my addr 172.21.15.37:0/2884436013 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.195+0000 7ff725d66640 1 --2- 172.21.15.37:0/2884436013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff72015d360 0x7ff72014c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.195+0000 7ff725565640 1 -- 172.21.15.37:0/2884436013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7200d1c40 msgr2=0x7ff7200ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.195+0000 7ff725565640 1 --2- 172.21.15.37:0/2884436013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7200d1c40 0x7ff7200ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:45.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.195+0000 7ff725565640 1 -- 172.21.15.37:0/2884436013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff72015d360 msgr2=0x7ff72014c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:45.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.195+0000 7ff725565640 1 --2- 172.21.15.37:0/2884436013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff72015d360 0x7ff72014c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:45.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.195+0000 7ff725565640 1 -- 172.21.15.37:0/2884436013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff718009400 con 0x7ff7200cece0 2023-12-11T17:10:45.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.195+0000 7ff725d66640 1 --2- 172.21.15.37:0/2884436013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff72015d360 0x7ff72014c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:45.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.195+0000 7ff725565640 1 --2- 172.21.15.37:0/2884436013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7200cece0 0x7ff72014a180 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00efc0 tx=0x7ff71c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:45.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.195+0000 7ff715ffb640 1 -- 172.21.15.37:0/2884436013 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c014480 con 0x7ff7200cece0 2023-12-11T17:10:45.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.195+0000 7ff715ffb640 1 -- 172.21.15.37:0/2884436013 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff71c00f040 con 0x7ff7200cece0 2023-12-11T17:10:45.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.195+0000 7ff715ffb640 1 -- 172.21.15.37:0/2884436013 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff71c014800 con 0x7ff7200cece0 2023-12-11T17:10:45.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.195+0000 7ff726567640 1 -- 172.21.15.37:0/2884436013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72015ed30 con 0x7ff7200cece0 2023-12-11T17:10:45.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.195+0000 7ff726567640 1 -- 172.21.15.37:0/2884436013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72015f2f0 con 0x7ff7200cece0 2023-12-11T17:10:45.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.196+0000 7ff726567640 1 -- 172.21.15.37:0/2884436013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7200678e0 con 0x7ff7200cece0 2023-12-11T17:10:45.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.198+0000 7ff715ffb640 1 -- 172.21.15.37:0/2884436013 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff71c014960 con 0x7ff7200cece0 2023-12-11T17:10:45.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.198+0000 7ff715ffb640 1 --2- 172.21.15.37:0/2884436013 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff70406ae40 0x7ff70406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:45.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.199+0000 7ff715ffb640 1 -- 172.21.15.37:0/2884436013 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff71c08a8b0 con 0x7ff7200cece0 2023-12-11T17:10:45.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.199+0000 7ff724d64640 1 --2- 172.21.15.37:0/2884436013 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff70406ae40 0x7ff70406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:45.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.200+0000 7ff724d64640 1 --2- 172.21.15.37:0/2884436013 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff70406ae40 0x7ff70406d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff7200b19b0 tx=0x7ff710007a40 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:45.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.203+0000 7ff715ffb640 1 -- 172.21.15.37:0/2884436013 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff71c055580 con 0x7ff7200cece0 2023-12-11T17:10:45.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.406+0000 7ff726567640 1 -- 172.21.15.37:0/2884436013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff7200d21f0 con 0x7ff7200cece0 2023-12-11T17:10:45.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.407+0000 7ff715ffb640 1 -- 172.21.15.37:0/2884436013 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff71c058ba0 con 0x7ff7200cece0 2023-12-11T17:10:45.407 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:10:45.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.410+0000 7ff726567640 1 -- 172.21.15.37:0/2884436013 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff70406ae40 msgr2=0x7ff70406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:45.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.410+0000 7ff726567640 1 --2- 172.21.15.37:0/2884436013 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff70406ae40 0x7ff70406d300 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7ff7200b19b0 tx=0x7ff710007a40 comp rx=0 tx=0).stop 2023-12-11T17:10:45.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.410+0000 7ff726567640 1 -- 172.21.15.37:0/2884436013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7200cece0 msgr2=0x7ff72014a180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.410+0000 7ff726567640 1 --2- 172.21.15.37:0/2884436013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7200cece0 0x7ff72014a180 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff71c00efc0 tx=0x7ff71c00c490 comp rx=0 tx=0).stop 2023-12-11T17:10:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.410+0000 7ff726567640 1 -- 172.21.15.37:0/2884436013 shutdown_connections 2023-12-11T17:10:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.410+0000 7ff726567640 1 --2- 172.21.15.37:0/2884436013 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff70406ae40 0x7ff70406d300 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.410+0000 7ff726567640 1 --2- 172.21.15.37:0/2884436013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff72015d360 0x7ff72014c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.410+0000 7ff726567640 1 --2- 172.21.15.37:0/2884436013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff7200d1c40 0x7ff7200ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.410+0000 7ff726567640 1 --2- 172.21.15.37:0/2884436013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff7200cece0 0x7ff72014a180 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.410+0000 7ff726567640 1 -- 172.21.15.37:0/2884436013 >> 172.21.15.37:0/2884436013 conn(0x7ff72009c230 msgr2=0x7ff7200b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.410+0000 7ff726567640 1 -- 172.21.15.37:0/2884436013 shutdown_connections 2023-12-11T17:10:45.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.410+0000 7ff726567640 1 -- 172.21.15.37:0/2884436013 wait complete. 2023-12-11T17:10:45.431 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T17:10:45.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.655+0000 7f54a5a13640 1 Processor -- start 2023-12-11T17:10:45.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.655+0000 7f54a5a13640 1 -- start start 2023-12-11T17:10:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.657+0000 7f54a5a13640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54a00d1160 0x7f54a00cba20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.657+0000 7f54a5a13640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f54a00cbf60 0x7f54a00c49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:45.657 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.657+0000 7f54a5a13640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a00cd340 con 0x7f54a015b230 2023-12-11T17:10:45.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.657+0000 7f54a5a13640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a015b610 con 0x7f54a00cbf60 2023-12-11T17:10:45.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.657+0000 7f54a5a13640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a00cc730 con 0x7f54a00d1160 2023-12-11T17:10:45.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.657+0000 7f54a5212640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f54a00cbf60 0x7f54a00c49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:45.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.657+0000 7f54a5212640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f54a00cbf60 0x7f54a00c49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58818/0 (socket says 172.21.15.37:58818) 2023-12-11T17:10:45.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.657+0000 7f54a5212640 1 -- 172.21.15.37:0/4026425514 learned_addr learned my addr 172.21.15.37:0/4026425514 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:45.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.657+0000 7f5497fff640 1 --2- 172.21.15.37:0/4026425514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54a00d1160 0x7f54a00cba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:45.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.658+0000 7f54a5212640 1 -- 172.21.15.37:0/4026425514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54a00d1160 msgr2=0x7f54a00cba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:45.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.658+0000 7f54a5212640 1 --2- 172.21.15.37:0/4026425514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54a00d1160 0x7f54a00cba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:45.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.658+0000 7f54a5212640 1 -- 172.21.15.37:0/4026425514 >> v1:172.21.15.151:6789/0 conn(0x7f54a015b230 legacy=0x7f54a00d0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:45.658 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.658+0000 7f54a5212640 1 -- 172.21.15.37:0/4026425514 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a00cca10 con 0x7f54a00cbf60 2023-12-11T17:10:45.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.659+0000 7f54a5212640 1 --2- 172.21.15.37:0/4026425514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a00cbf60 0x7f54a00c49f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5498009870 tx=0x7f549802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf4cf1f24c106cba server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:45.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.659+0000 7f54977fe640 1 -- 172.21.15.37:0/4026425514 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5498031640 con 0x7f54a00cbf60 2023-12-11T17:10:45.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.659+0000 7f54977fe640 1 -- 172.21.15.37:0/4026425514 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54980317a0 con 0x7f54a00cbf60 2023-12-11T17:10:45.659 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.659+0000 7f54977fe640 1 -- 172.21.15.37:0/4026425514 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5498031b30 con 0x7f54a00cbf60 2023-12-11T17:10:45.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.660+0000 7f54a5a13640 1 -- 172.21.15.37:0/4026425514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a00cbf60 msgr2=0x7f54a00c49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:45.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.660+0000 7f54a5a13640 1 --2- 172.21.15.37:0/4026425514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a00cbf60 0x7f54a00c49f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f5498009870 tx=0x7f549802b8f0 comp rx=0 tx=0).stop 2023-12-11T17:10:45.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.660+0000 7f54a5a13640 1 -- 172.21.15.37:0/4026425514 shutdown_connections 2023-12-11T17:10:45.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.660+0000 7f54a5a13640 1 --2- 172.21.15.37:0/4026425514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a00cbf60 0x7f54a00c49f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:45.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.660+0000 7f54a5a13640 1 --2- 172.21.15.37:0/4026425514 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54a00d1160 0x7f54a00cba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:45.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.660+0000 7f54a5a13640 1 -- 172.21.15.37:0/4026425514 >> 172.21.15.37:0/4026425514 conn(0x7f54a00999f0 msgr2=0x7f54a0099e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:45.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.660+0000 7f54a5a13640 1 -- 172.21.15.37:0/4026425514 shutdown_connections 2023-12-11T17:10:45.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.660+0000 7f54a5a13640 1 -- 172.21.15.37:0/4026425514 wait complete. 2023-12-11T17:10:45.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.662+0000 7f54a5a13640 1 Processor -- start 2023-12-11T17:10:45.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.662+0000 7f54a5a13640 1 -- start start 2023-12-11T17:10:45.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.663+0000 7f54a5a13640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54a00cbf60 0x7f54a0159980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:45.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.663+0000 7f54a5a13640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54a00d1160 0x7f54a01f2970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:45.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.663+0000 7f54a5a13640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a015b230 0x7f54a0154370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:45.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.663+0000 7f54a5a13640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a01548b0 con 0x7f54a015b230 2023-12-11T17:10:45.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.663+0000 7f54a5a13640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a0158280 con 0x7f54a00d1160 2023-12-11T17:10:45.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.663+0000 7f54a5a13640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a01f2fc0 con 0x7f54a00cbf60 2023-12-11T17:10:45.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.663+0000 7f54a5212640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a015b230 0x7f54a0154370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:45.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.663+0000 7f54a5212640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a015b230 0x7f54a0154370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58824/0 (socket says 172.21.15.37:58824) 2023-12-11T17:10:45.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.663+0000 7f54a5212640 1 -- 172.21.15.37:0/3769756561 learned_addr learned my addr 172.21.15.37:0/3769756561 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:45.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.664+0000 7f5497fff640 1 --2- 172.21.15.37:0/3769756561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54a00d1160 0x7f54a01f2970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:45.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.664+0000 7f54a4a11640 1 --2- 172.21.15.37:0/3769756561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54a00cbf60 0x7f54a0159980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:45.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.664+0000 7f54a5212640 1 -- 172.21.15.37:0/3769756561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54a00cbf60 msgr2=0x7f54a0159980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:45.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.664+0000 7f54a5212640 1 --2- 172.21.15.37:0/3769756561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54a00cbf60 0x7f54a0159980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:45.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.664+0000 7f54a5212640 1 -- 172.21.15.37:0/3769756561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54a00d1160 msgr2=0x7f54a01f2970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:45.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.664+0000 7f54a5212640 1 --2- 172.21.15.37:0/3769756561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54a00d1160 0x7f54a01f2970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:45.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.664+0000 7f54a5212640 1 -- 172.21.15.37:0/3769756561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54980094d0 con 0x7f54a015b230 2023-12-11T17:10:45.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.664+0000 7f5497fff640 1 --2- 172.21.15.37:0/3769756561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54a00d1160 0x7f54a01f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:45.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.664+0000 7f54a5212640 1 --2- 172.21.15.37:0/3769756561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a015b230 0x7f54a0154370 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5498009870 tx=0x7f54980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:45.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.664+0000 7f54957fa640 1 -- 172.21.15.37:0/3769756561 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549803ac60 con 0x7f54a015b230 2023-12-11T17:10:45.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.664+0000 7f54957fa640 1 -- 172.21.15.37:0/3769756561 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549803adc0 con 0x7f54a015b230 2023-12-11T17:10:45.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.664+0000 7f54a5a13640 1 -- 172.21.15.37:0/3769756561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a01f32a0 con 0x7f54a015b230 2023-12-11T17:10:45.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.664+0000 7f54957fa640 1 -- 172.21.15.37:0/3769756561 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5498044630 con 0x7f54a015b230 2023-12-11T17:10:45.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.665+0000 7f54a5a13640 1 -- 172.21.15.37:0/3769756561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a01568f0 con 0x7f54a015b230 2023-12-11T17:10:45.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.666+0000 7f54a5a13640 1 -- 172.21.15.37:0/3769756561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a0158410 con 0x7f54a015b230 2023-12-11T17:10:45.666 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.667+0000 7f54957fa640 1 -- 172.21.15.37:0/3769756561 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f549802f050 con 0x7f54a015b230 2023-12-11T17:10:45.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.668+0000 7f54957fa640 1 --2- 172.21.15.37:0/3769756561 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f548c06ae70 0x7f548c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:45.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.668+0000 7f54957fa640 1 -- 172.21.15.37:0/3769756561 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f54980ab910 con 0x7f54a015b230 2023-12-11T17:10:45.668 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.668+0000 7f54a4a11640 1 --2- 172.21.15.37:0/3769756561 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f548c06ae70 0x7f548c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:45.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.670+0000 7f54a4a11640 1 --2- 172.21.15.37:0/3769756561 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f548c06ae70 0x7f548c06d330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f549c007bf0 tx=0x7f549c007240 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:45.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.672+0000 7f54957fa640 1 -- 172.21.15.37:0/3769756561 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f54980765d0 con 0x7f54a015b230 2023-12-11T17:10:45.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.865+0000 7f54a5a13640 1 -- 172.21.15.37:0/3769756561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f54a00673f0 con 0x7f54a015b230 2023-12-11T17:10:45.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.866+0000 7f54957fa640 1 -- 172.21.15.37:0/3769756561 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f5498079bf0 con 0x7f54a015b230 2023-12-11T17:10:45.866 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-11T17:10:45.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.869+0000 7f54a5a13640 1 -- 172.21.15.37:0/3769756561 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f548c06ae70 msgr2=0x7f548c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:45.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.869+0000 7f54a5a13640 1 --2- 172.21.15.37:0/3769756561 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f548c06ae70 0x7f548c06d330 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f549c007bf0 tx=0x7f549c007240 comp rx=0 tx=0).stop 2023-12-11T17:10:45.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.869+0000 7f54a5a13640 1 -- 172.21.15.37:0/3769756561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a015b230 msgr2=0x7f54a0154370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:45.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.869+0000 7f54a5a13640 1 --2- 172.21.15.37:0/3769756561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a015b230 0x7f54a0154370 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f5498009870 tx=0x7f54980046c0 comp rx=0 tx=0).stop 2023-12-11T17:10:45.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.869+0000 7f54a5a13640 1 -- 172.21.15.37:0/3769756561 shutdown_connections 2023-12-11T17:10:45.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.869+0000 7f54a5a13640 1 --2- 172.21.15.37:0/3769756561 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f548c06ae70 0x7f548c06d330 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:45.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.869+0000 7f54a5a13640 1 --2- 172.21.15.37:0/3769756561 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f54a00d1160 0x7f54a01f2970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:45.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.869+0000 7f54a5a13640 1 --2- 172.21.15.37:0/3769756561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f54a015b230 0x7f54a0154370 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:45.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.869+0000 7f54a5a13640 1 --2- 172.21.15.37:0/3769756561 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f54a00cbf60 0x7f54a0159980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:45.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.869+0000 7f54a5a13640 1 -- 172.21.15.37:0/3769756561 >> 172.21.15.37:0/3769756561 conn(0x7f54a00999f0 msgr2=0x7f54a00d0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:45.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.869+0000 7f54a5a13640 1 -- 172.21.15.37:0/3769756561 shutdown_connections 2023-12-11T17:10:45.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:45.869+0000 7f54a5a13640 1 -- 172.21.15.37:0/3769756561 wait complete. 2023-12-11T17:10:45.887 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-11T17:10:46.102 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.102+0000 7fbebb400640 1 Processor -- start 2023-12-11T17:10:46.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.103+0000 7fbebb400640 1 -- start start 2023-12-11T17:10:46.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.104+0000 7fbebb400640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbeb4142de0 0x7fbeb40cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:46.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.104+0000 7fbebb400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbeb41432b0 0x7fbeb406d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:46.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.104+0000 7fbebb400640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbeb40b4980 con 0x7fbeb406da40 2023-12-11T17:10:46.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.105+0000 7fbebb400640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbeb406ded0 con 0x7fbeb4142de0 2023-12-11T17:10:46.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.105+0000 7fbebb400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb40ce2a0 con 0x7fbeb41432b0 2023-12-11T17:10:46.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.105+0000 7fbeb919c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbeb4142de0 0x7fbeb40cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:46.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.105+0000 7fbeb999d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbeb406da40 0x7fbeb415dbe0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60690/0 (socket says 172.21.15.37:60690) 2023-12-11T17:10:46.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.105+0000 7fbeb919c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbeb4142de0 0x7fbeb40cdd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58830/0 (socket says 172.21.15.37:58830) 2023-12-11T17:10:46.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.105+0000 7fbeb999d640 1 -- 172.21.15.37:0/3049998662 learned_addr learned my addr 172.21.15.37:0/3049998662 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:46.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.105+0000 7fbeb899b640 1 --2- 172.21.15.37:0/3049998662 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbeb41432b0 0x7fbeb406d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:46.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.105+0000 7fbeb919c640 1 -- 172.21.15.37:0/3049998662 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbeb41432b0 msgr2=0x7fbeb406d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:46.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.105+0000 7fbeb919c640 1 --2- 172.21.15.37:0/3049998662 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbeb41432b0 0x7fbeb406d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:46.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.105+0000 7fbeb919c640 1 -- 172.21.15.37:0/3049998662 >> v1:172.21.15.37:6789/0 conn(0x7fbeb406da40 legacy=0x7fbeb415dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:46.106 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.105+0000 7fbeb919c640 1 -- 172.21.15.37:0/3049998662 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb4071260 con 0x7fbeb4142de0 2023-12-11T17:10:46.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.107+0000 7fbeb919c640 1 --2- 172.21.15.37:0/3049998662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbeb4142de0 0x7fbeb40cdd60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009d90 tx=0x7fbea402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1682a0f75cf5b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:46.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.107+0000 7fbeb3fff640 1 -- 172.21.15.37:0/3049998662 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea402cbd0 con 0x7fbeb4142de0 2023-12-11T17:10:46.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.107+0000 7fbeb3fff640 1 -- 172.21.15.37:0/3049998662 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea402cd30 con 0x7fbeb4142de0 2023-12-11T17:10:46.107 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.107+0000 7fbeb3fff640 1 -- 172.21.15.37:0/3049998662 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea402cea0 con 0x7fbeb4142de0 2023-12-11T17:10:46.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.108+0000 7fbebb400640 1 -- 172.21.15.37:0/3049998662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbeb4142de0 msgr2=0x7fbeb40cdd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:46.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.108+0000 7fbebb400640 1 --2- 172.21.15.37:0/3049998662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbeb4142de0 0x7fbeb40cdd60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fbea4009d90 tx=0x7fbea402be20 comp rx=0 tx=0).stop 2023-12-11T17:10:46.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.108+0000 7fbebb400640 1 -- 172.21.15.37:0/3049998662 shutdown_connections 2023-12-11T17:10:46.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.108+0000 7fbebb400640 1 --2- 172.21.15.37:0/3049998662 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbeb41432b0 0x7fbeb406d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:46.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.108+0000 7fbebb400640 1 --2- 172.21.15.37:0/3049998662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbeb4142de0 0x7fbeb40cdd60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:46.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.108+0000 7fbebb400640 1 -- 172.21.15.37:0/3049998662 >> 172.21.15.37:0/3049998662 conn(0x7fbeb40cb850 msgr2=0x7fbeb40cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:46.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.108+0000 7fbebb400640 1 -- 172.21.15.37:0/3049998662 shutdown_connections 2023-12-11T17:10:46.108 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.108+0000 7fbebb400640 1 -- 172.21.15.37:0/3049998662 wait complete. 2023-12-11T17:10:46.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.110+0000 7fbebb400640 1 Processor -- start 2023-12-11T17:10:46.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.110+0000 7fbebb400640 1 -- start start 2023-12-11T17:10:46.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.111+0000 7fbebb400640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbeb406da40 0x7fbeb406cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:46.112 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.111+0000 7fbebb400640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbeb4142de0 0x7fbeb4159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:46.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.111+0000 7fbebb400640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbeb41432b0 0x7fbeb4159880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:46.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.111+0000 7fbebb400640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb415d8a0 con 0x7fbeb4142de0 2023-12-11T17:10:46.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.111+0000 7fbebb400640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb4140130 con 0x7fbeb41432b0 2023-12-11T17:10:46.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.111+0000 7fbebb400640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbeb415d2e0 con 0x7fbeb406da40 2023-12-11T17:10:46.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.111+0000 7fbeb899b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbeb4142de0 0x7fbeb4159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:46.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.111+0000 7fbeb899b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbeb4142de0 0x7fbeb4159340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58846/0 (socket says 172.21.15.37:58846) 2023-12-11T17:10:46.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.111+0000 7fbeb899b640 1 -- 172.21.15.37:0/2970553375 learned_addr learned my addr 172.21.15.37:0/2970553375 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:46.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.111+0000 7fbeb999d640 1 --2- 172.21.15.37:0/2970553375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbeb41432b0 0x7fbeb4159880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:46.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.111+0000 7fbeb899b640 1 -- 172.21.15.37:0/2970553375 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbeb406da40 msgr2=0x7fbeb406cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:46.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.111+0000 7fbeb899b640 1 --2- 172.21.15.37:0/2970553375 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbeb406da40 0x7fbeb406cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:46.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.111+0000 7fbeb899b640 1 -- 172.21.15.37:0/2970553375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbeb41432b0 msgr2=0x7fbeb4159880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:46.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.111+0000 7fbeb899b640 1 --2- 172.21.15.37:0/2970553375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbeb41432b0 0x7fbeb4159880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:46.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.111+0000 7fbeb899b640 1 -- 172.21.15.37:0/2970553375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea4009a70 con 0x7fbeb4142de0 2023-12-11T17:10:46.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.111+0000 7fbeb999d640 1 --2- 172.21.15.37:0/2970553375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbeb41432b0 0x7fbeb4159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:46.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.112+0000 7fbeb899b640 1 --2- 172.21.15.37:0/2970553375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbeb4142de0 0x7fbeb4159340 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbea800d800 tx=0x7fbea800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:46.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.112+0000 7fbeb1ffb640 1 -- 172.21.15.37:0/2970553375 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea800b6c0 con 0x7fbeb4142de0 2023-12-11T17:10:46.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.112+0000 7fbeb1ffb640 1 -- 172.21.15.37:0/2970553375 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea800b820 con 0x7fbeb4142de0 2023-12-11T17:10:46.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.112+0000 7fbebb400640 1 -- 172.21.15.37:0/2970553375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbeb415d5c0 con 0x7fbeb4142de0 2023-12-11T17:10:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.112+0000 7fbeb1ffb640 1 -- 172.21.15.37:0/2970553375 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea800bbb0 con 0x7fbeb4142de0 2023-12-11T17:10:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.112+0000 7fbebb400640 1 -- 172.21.15.37:0/2970553375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbeb41406b0 con 0x7fbeb4142de0 2023-12-11T17:10:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.113+0000 7fbebb400640 1 -- 172.21.15.37:0/2970553375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbeb40745d0 con 0x7fbeb4142de0 2023-12-11T17:10:46.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.114+0000 7fbeb1ffb640 1 -- 172.21.15.37:0/2970553375 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbea800bd10 con 0x7fbeb4142de0 2023-12-11T17:10:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.116+0000 7fbeb1ffb640 1 --2- 172.21.15.37:0/2970553375 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbea006ae40 0x7fbea006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.116+0000 7fbeb1ffb640 1 -- 172.21.15.37:0/2970553375 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fbea8089ff0 con 0x7fbeb4142de0 2023-12-11T17:10:46.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.116+0000 7fbeb919c640 1 --2- 172.21.15.37:0/2970553375 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbea006ae40 0x7fbea006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:46.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.117+0000 7fbeb919c640 1 --2- 172.21.15.37:0/2970553375 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbea006ae40 0x7fbea006d300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbea4036000 tx=0x7fbea402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:46.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.121+0000 7fbeb1ffb640 1 -- 172.21.15.37:0/2970553375 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbea80bce90 con 0x7fbeb4142de0 2023-12-11T17:10:46.310 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.310+0000 7fbebb400640 1 -- 172.21.15.37:0/2970553375 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fbeb40cc650 con 0x7fbeb4142de0 2023-12-11T17:10:46.311 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.311+0000 7fbeb1ffb640 1 -- 172.21.15.37:0/2970553375 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fbea8054c60 con 0x7fbeb4142de0 2023-12-11T17:10:46.311 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:10:46.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.313+0000 7fbebb400640 1 -- 172.21.15.37:0/2970553375 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbea006ae40 msgr2=0x7fbea006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:46.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.313+0000 7fbebb400640 1 --2- 172.21.15.37:0/2970553375 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbea006ae40 0x7fbea006d300 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fbea4036000 tx=0x7fbea402e000 comp rx=0 tx=0).stop 2023-12-11T17:10:46.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.313+0000 7fbebb400640 1 -- 172.21.15.37:0/2970553375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbeb4142de0 msgr2=0x7fbeb4159340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:46.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.313+0000 7fbebb400640 1 --2- 172.21.15.37:0/2970553375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbeb4142de0 0x7fbeb4159340 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7fbea800d800 tx=0x7fbea800dcc0 comp rx=0 tx=0).stop 2023-12-11T17:10:46.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.314+0000 7fbebb400640 1 -- 172.21.15.37:0/2970553375 shutdown_connections 2023-12-11T17:10:46.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.314+0000 7fbebb400640 1 --2- 172.21.15.37:0/2970553375 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbea006ae40 0x7fbea006d300 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:46.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.314+0000 7fbebb400640 1 --2- 172.21.15.37:0/2970553375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbeb41432b0 0x7fbeb4159880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:46.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.314+0000 7fbebb400640 1 --2- 172.21.15.37:0/2970553375 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbeb4142de0 0x7fbeb4159340 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:46.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.314+0000 7fbebb400640 1 --2- 172.21.15.37:0/2970553375 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbeb406da40 0x7fbeb406cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:46.314 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.314+0000 7fbebb400640 1 -- 172.21.15.37:0/2970553375 >> 172.21.15.37:0/2970553375 conn(0x7fbeb40cb850 msgr2=0x7fbeb413c530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:46.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.314+0000 7fbebb400640 1 -- 172.21.15.37:0/2970553375 shutdown_connections 2023-12-11T17:10:46.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.314+0000 7fbebb400640 1 -- 172.21.15.37:0/2970553375 wait complete. 2023-12-11T17:10:46.333 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:10:46.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.547+0000 7f311ae1a640 1 Processor -- start 2023-12-11T17:10:46.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.547+0000 7f311ae1a640 1 -- start start 2023-12-11T17:10:46.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.548+0000 7f311ae1a640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f31140d13c0 0x7f31140ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:46.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.548+0000 7f311ae1a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31140b2280 con 0x7f31140b0760 2023-12-11T17:10:46.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.548+0000 7f311ae1a640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31140cee70 con 0x7f31140d0d70 2023-12-11T17:10:46.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.548+0000 7f311ae1a640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31140d11c0 con 0x7f31140d13c0 2023-12-11T17:10:46.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.549+0000 7f311a619640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f31140b0760 0x7f31140b0bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60700/0 (socket says 172.21.15.37:60700) 2023-12-11T17:10:46.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.549+0000 7f311a619640 1 -- 172.21.15.37:0/3479733106 learned_addr learned my addr 172.21.15.37:0/3479733106 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:46.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.549+0000 7f3119e18640 1 --2- 172.21.15.37:0/3479733106 >> v2:172.21.15.151:3300/0 conn(0x7f31140d13c0 0x7f31140ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:46.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.549+0000 7f3118e16640 1 -- 172.21.15.37:0/3479733106 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1366292333 0 0) 0x7f31140b2280 con 0x7f31140b0760 2023-12-11T17:10:46.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.549+0000 7f3118e16640 1 -- 172.21.15.37:0/3479733106 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3100003520 con 0x7f31140b0760 2023-12-11T17:10:46.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.550+0000 7f3118e16640 1 -- 172.21.15.37:0/3479733106 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2053408760 0 0) 0x7f3100003520 con 0x7f31140b0760 2023-12-11T17:10:46.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.550+0000 7f3118e16640 1 -- 172.21.15.37:0/3479733106 >> v2:172.21.15.151:3300/0 conn(0x7f31140d13c0 msgr2=0x7f31140ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:46.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.550+0000 7f3118e16640 1 --2- 172.21.15.37:0/3479733106 >> v2:172.21.15.151:3300/0 conn(0x7f31140d13c0 0x7f31140ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:46.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.550+0000 7f3118e16640 1 -- 172.21.15.37:0/3479733106 >> v1:172.21.15.151:6789/0 conn(0x7f31140d0d70 legacy=0x7f31140d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:46.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.550+0000 7f3118e16640 1 -- 172.21.15.37:0/3479733106 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31140ceb90 con 0x7f31140b0760 2023-12-11T17:10:46.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.550+0000 7f3118e16640 1 -- 172.21.15.37:0/3479733106 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f310c0019f0 con 0x7f31140b0760 2023-12-11T17:10:46.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.550+0000 7f3118e16640 1 -- 172.21.15.37:0/3479733106 >> v1:172.21.15.37:6789/0 conn(0x7f31140b0760 legacy=0x7f31140b0bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:46.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.550+0000 7f3118e16640 1 --2- 172.21.15.37:0/3479733106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31000039c0 0x7f3100003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:46.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.550+0000 7f3118e16640 1 --2- 172.21.15.37:0/3479733106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31000047c0 0x7f3100004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:46.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.550+0000 7f3118e16640 1 --2- 172.21.15.37:0/3479733106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31000051d0 0x7f310000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:46.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.550+0000 7f3118e16640 1 -- 172.21.15.37:0/3479733106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31140d11c0 con 0x7f31000039c0 2023-12-11T17:10:46.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.550+0000 7f3118e16640 1 -- 172.21.15.37:0/3479733106 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f310000c120 con 0x7f31000051d0 2023-12-11T17:10:46.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.550+0000 7f3118e16640 1 -- 172.21.15.37:0/3479733106 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f310000c2e0 con 0x7f31000047c0 2023-12-11T17:10:46.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.550+0000 7f3119e18640 1 --2- 172.21.15.37:0/3479733106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31000039c0 0x7f3100003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:46.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.551+0000 7f3119e18640 1 -- 172.21.15.37:0/3479733106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31000047c0 msgr2=0x7f3100004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:46.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.551+0000 7f3119e18640 1 --2- 172.21.15.37:0/3479733106 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31000047c0 0x7f3100004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:46.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.551+0000 7f311a619640 1 --2- 172.21.15.37:0/3479733106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31000051d0 0x7f310000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:46.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.551+0000 7f3119e18640 1 -- 172.21.15.37:0/3479733106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31000051d0 msgr2=0x7f310000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:46.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.551+0000 7f3119e18640 1 --2- 172.21.15.37:0/3479733106 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31000051d0 0x7f310000b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:46.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.551+0000 7f311a619640 1 -- 172.21.15.37:0/3479733106 reap_dead start 2023-12-11T17:10:46.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.551+0000 7f3119e18640 1 -- 172.21.15.37:0/3479733106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3100003520 con 0x7f31000039c0 2023-12-11T17:10:46.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.552+0000 7f3119e18640 1 --2- 172.21.15.37:0/3479733106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31000039c0 0x7f3100003de0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3110009a90 tx=0x7f31000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7995f153dfd7833e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:46.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.552+0000 7f3118e16640 1 -- 172.21.15.37:0/3479733106 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311002c680 con 0x7f31000039c0 2023-12-11T17:10:46.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.552+0000 7f3118e16640 1 -- 172.21.15.37:0/3479733106 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f311002c7e0 con 0x7f31000039c0 2023-12-11T17:10:46.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.552+0000 7f3118e16640 1 -- 172.21.15.37:0/3479733106 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f311002cb70 con 0x7f31000039c0 2023-12-11T17:10:46.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.553+0000 7f311ae1a640 1 -- 172.21.15.37:0/3479733106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31000039c0 msgr2=0x7f3100003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:46.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.553+0000 7f311ae1a640 1 --2- 172.21.15.37:0/3479733106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31000039c0 0x7f3100003de0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3110009a90 tx=0x7f31000057f0 comp rx=0 tx=0).stop 2023-12-11T17:10:46.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.553+0000 7f311ae1a640 1 -- 172.21.15.37:0/3479733106 shutdown_connections 2023-12-11T17:10:46.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.553+0000 7f311ae1a640 1 --2- 172.21.15.37:0/3479733106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31000039c0 0x7f3100003de0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:46.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.553+0000 7f311ae1a640 1 -- 172.21.15.37:0/3479733106 >> 172.21.15.37:0/3479733106 conn(0x7f311409c260 msgr2=0x7f31140d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:46.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.553+0000 7f311ae1a640 1 -- 172.21.15.37:0/3479733106 shutdown_connections 2023-12-11T17:10:46.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.553+0000 7f311ae1a640 1 -- 172.21.15.37:0/3479733106 wait complete. 2023-12-11T17:10:46.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.555+0000 7f311ae1a640 1 Processor -- start 2023-12-11T17:10:46.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.555+0000 7f311ae1a640 1 -- start start 2023-12-11T17:10:46.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.556+0000 7f311ae1a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31000039c0 0x7f31140c81b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:46.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.556+0000 7f311ae1a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31140b36b0 0x7f311406c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:46.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.556+0000 7f311ae1a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3114153d80 0x7f3114154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:46.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.556+0000 7f311ae1a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31140b4fa0 con 0x7f31000039c0 2023-12-11T17:10:46.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.556+0000 7f311ae1a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31140b3f00 con 0x7f3114153d80 2023-12-11T17:10:46.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.556+0000 7f311ae1a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31140b41e0 con 0x7f31140b36b0 2023-12-11T17:10:46.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.556+0000 7f3119e18640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31000039c0 0x7f31140c81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:46.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.556+0000 7f3119e18640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31000039c0 0x7f31140c81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58862/0 (socket says 172.21.15.37:58862) 2023-12-11T17:10:46.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.556+0000 7f3119e18640 1 -- 172.21.15.37:0/286429654 learned_addr learned my addr 172.21.15.37:0/286429654 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:46.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.557+0000 7f311a619640 1 --2- 172.21.15.37:0/286429654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3114153d80 0x7f3114154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:46.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.557+0000 7f3119e18640 1 -- 172.21.15.37:0/286429654 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31140b36b0 msgr2=0x7f311406c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:46.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.557+0000 7f3119617640 1 --2- 172.21.15.37:0/286429654 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31140b36b0 0x7f311406c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:46.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.557+0000 7f3119e18640 1 --2- 172.21.15.37:0/286429654 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31140b36b0 0x7f311406c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:46.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.557+0000 7f3119e18640 1 -- 172.21.15.37:0/286429654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3114153d80 msgr2=0x7f3114154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:46.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.557+0000 7f3119e18640 1 --2- 172.21.15.37:0/286429654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3114153d80 0x7f3114154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:46.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.557+0000 7f3119e18640 1 -- 172.21.15.37:0/286429654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31140b44c0 con 0x7f31000039c0 2023-12-11T17:10:46.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.557+0000 7f3119e18640 1 --2- 172.21.15.37:0/286429654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31000039c0 0x7f31140c81b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3110009a90 tx=0x7f3110004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:46.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.557+0000 7f310a7fc640 1 -- 172.21.15.37:0/286429654 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3110003810 con 0x7f31000039c0 2023-12-11T17:10:46.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.558+0000 7f310a7fc640 1 -- 172.21.15.37:0/286429654 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3110003970 con 0x7f31000039c0 2023-12-11T17:10:46.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.558+0000 7f310a7fc640 1 -- 172.21.15.37:0/286429654 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3110003d00 con 0x7f31000039c0 2023-12-11T17:10:46.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.558+0000 7f311ae1a640 1 -- 172.21.15.37:0/286429654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31140b47a0 con 0x7f31000039c0 2023-12-11T17:10:46.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.558+0000 7f311ae1a640 1 -- 172.21.15.37:0/286429654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3114154750 con 0x7f31000039c0 2023-12-11T17:10:46.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.559+0000 7f311ae1a640 1 -- 172.21.15.37:0/286429654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3114074450 con 0x7f31000039c0 2023-12-11T17:10:46.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.560+0000 7f310a7fc640 1 -- 172.21.15.37:0/286429654 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3110040450 con 0x7f31000039c0 2023-12-11T17:10:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.561+0000 7f310a7fc640 1 --2- 172.21.15.37:0/286429654 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f30f806ae40 0x7f30f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:46.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.561+0000 7f310a7fc640 1 -- 172.21.15.37:0/286429654 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f31100ab920 con 0x7f31000039c0 2023-12-11T17:10:46.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.562+0000 7f3119617640 1 --2- 172.21.15.37:0/286429654 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f30f806ae40 0x7f30f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:46.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.563+0000 7f3119617640 1 --2- 172.21.15.37:0/286429654 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f30f806ae40 0x7f30f806d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3104001570 tx=0x7f3104009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:46.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.565+0000 7f310a7fc640 1 -- 172.21.15.37:0/286429654 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f31100765e0 con 0x7f31000039c0 2023-12-11T17:10:46.751 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.751+0000 7f311ae1a640 1 -- 172.21.15.37:0/286429654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31140d2d70 con 0x7f31000039c0 2023-12-11T17:10:46.753 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.753+0000 7f310a7fc640 1 -- 172.21.15.37:0/286429654 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18779 (secure 0 0 0) 0x7f3110003e60 con 0x7f31000039c0 2023-12-11T17:10:46.754 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:46.754 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:10:32.309274+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:10:46.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.756+0000 7f311ae1a640 1 -- 172.21.15.37:0/286429654 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f30f806ae40 msgr2=0x7f30f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.756+0000 7f311ae1a640 1 --2- 172.21.15.37:0/286429654 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f30f806ae40 0x7f30f806d300 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f3104001570 tx=0x7f3104009040 comp rx=0 tx=0).stop 2023-12-11T17:10:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.756+0000 7f311ae1a640 1 -- 172.21.15.37:0/286429654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31000039c0 msgr2=0x7f31140c81b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.756+0000 7f311ae1a640 1 --2- 172.21.15.37:0/286429654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31000039c0 0x7f31140c81b0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f3110009a90 tx=0x7f3110004730 comp rx=0 tx=0).stop 2023-12-11T17:10:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.756+0000 7f311ae1a640 1 -- 172.21.15.37:0/286429654 shutdown_connections 2023-12-11T17:10:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.756+0000 7f311ae1a640 1 --2- 172.21.15.37:0/286429654 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f30f806ae40 0x7f30f806d300 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.756+0000 7f311ae1a640 1 --2- 172.21.15.37:0/286429654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3114153d80 0x7f3114154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.756+0000 7f311ae1a640 1 --2- 172.21.15.37:0/286429654 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f31140b36b0 0x7f311406c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.756+0000 7f311ae1a640 1 --2- 172.21.15.37:0/286429654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f31000039c0 0x7f31140c81b0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.756+0000 7f311ae1a640 1 -- 172.21.15.37:0/286429654 >> 172.21.15.37:0/286429654 conn(0x7f311409c260 msgr2=0x7f31140b5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.757+0000 7f311ae1a640 1 -- 172.21.15.37:0/286429654 shutdown_connections 2023-12-11T17:10:46.757 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.757+0000 7f311ae1a640 1 -- 172.21.15.37:0/286429654 wait complete. 2023-12-11T17:10:46.776 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T17:09:38.415636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T17:09:42.786774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T17:09:43.660585+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-11T17:09:47.272351+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-11T17:10:46.777 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T17:10:46.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.996+0000 7f14b3154640 1 Processor -- start 2023-12-11T17:10:46.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.996+0000 7f14b3154640 1 -- start start 2023-12-11T17:10:46.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.998+0000 7f14b3154640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14ac0ce150 0x7f14ac0ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:46.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.998+0000 7f14b3154640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ac06c500 con 0x7f14ac0cedf0 2023-12-11T17:10:46.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.998+0000 7f14b3154640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14ac15b4a0 con 0x7f14ac155400 2023-12-11T17:10:46.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.998+0000 7f14b3154640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac0adbb0 con 0x7f14ac0ce150 2023-12-11T17:10:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.999+0000 7f14b2953640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f14ac0cedf0 0x7f14ac15b9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60704/0 (socket says 172.21.15.37:60704) 2023-12-11T17:10:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.999+0000 7f14b2953640 1 -- 172.21.15.37:0/1913754722 learned_addr learned my addr 172.21.15.37:0/1913754722 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:46.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.999+0000 7f14b1951640 1 --2- 172.21.15.37:0/1913754722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14ac0ce150 0x7f14ac0ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:47.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.999+0000 7f14b1150640 1 -- 172.21.15.37:0/1913754722 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2639017132 0 0) 0x7f14ac06c500 con 0x7f14ac0cedf0 2023-12-11T17:10:47.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:46.999+0000 7f14b1150640 1 -- 172.21.15.37:0/1913754722 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1498003520 con 0x7f14ac0cedf0 2023-12-11T17:10:47.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.000+0000 7f14b1150640 1 -- 172.21.15.37:0/1913754722 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2128001863 0 0) 0x7f14ac15b4a0 con 0x7f14ac155400 2023-12-11T17:10:47.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.000+0000 7f14b1150640 1 -- 172.21.15.37:0/1913754722 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f14ac06c500 con 0x7f14ac155400 2023-12-11T17:10:47.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.000+0000 7f14b1951640 1 -- 172.21.15.37:0/1913754722 >> v1:172.21.15.151:6789/0 conn(0x7f14ac155400 legacy=0x7f14ac06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:47.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.000+0000 7f14b1951640 1 -- 172.21.15.37:0/1913754722 >> v1:172.21.15.37:6789/0 conn(0x7f14ac0cedf0 legacy=0x7f14ac15b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:47.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.000+0000 7f14b1951640 1 -- 172.21.15.37:0/1913754722 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ac0ade90 con 0x7f14ac0ce150 2023-12-11T17:10:47.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.001+0000 7f14b1951640 1 --2- 172.21.15.37:0/1913754722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14ac0ce150 0x7f14ac0ce5b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f149c0097d0 tx=0x7f149c02b940 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4e7c9e30f4fa2445 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:47.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.001+0000 7f14b1150640 1 -- 172.21.15.37:0/1913754722 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c030800 con 0x7f14ac0ce150 2023-12-11T17:10:47.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.001+0000 7f14b1150640 1 -- 172.21.15.37:0/1913754722 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f149c030960 con 0x7f14ac0ce150 2023-12-11T17:10:47.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.002+0000 7f14b1150640 1 -- 172.21.15.37:0/1913754722 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f149c030cf0 con 0x7f14ac0ce150 2023-12-11T17:10:47.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.002+0000 7f14b3154640 1 -- 172.21.15.37:0/1913754722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14ac0ce150 msgr2=0x7f14ac0ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:47.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.002+0000 7f14b3154640 1 --2- 172.21.15.37:0/1913754722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14ac0ce150 0x7f14ac0ce5b0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f149c0097d0 tx=0x7f149c02b940 comp rx=0 tx=0).stop 2023-12-11T17:10:47.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.002+0000 7f14b3154640 1 -- 172.21.15.37:0/1913754722 shutdown_connections 2023-12-11T17:10:47.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.002+0000 7f14b3154640 1 --2- 172.21.15.37:0/1913754722 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14ac0ce150 0x7f14ac0ce5b0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:47.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.002+0000 7f14b3154640 1 -- 172.21.15.37:0/1913754722 >> 172.21.15.37:0/1913754722 conn(0x7f14ac06a640 msgr2=0x7f14ac06aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:47.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.002+0000 7f14b3154640 1 -- 172.21.15.37:0/1913754722 shutdown_connections 2023-12-11T17:10:47.003 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.002+0000 7f14b3154640 1 -- 172.21.15.37:0/1913754722 wait complete. 2023-12-11T17:10:47.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.005+0000 7f14b3154640 1 Processor -- start 2023-12-11T17:10:47.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.005+0000 7f14b3154640 1 -- start start 2023-12-11T17:10:47.006 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.006+0000 7f14b3154640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14ac0ce150 0x7f14ac14f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:47.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.006+0000 7f14b3154640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14ac0cedf0 0x7f14ac139f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:47.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.006+0000 7f14b3154640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14ac155400 0x7f14ac14c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:47.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.006+0000 7f14b3154640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac14ec80 con 0x7f14ac155400 2023-12-11T17:10:47.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.006+0000 7f14b3154640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac14e320 con 0x7f14ac0ce150 2023-12-11T17:10:47.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.006+0000 7f14b3154640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14ac14e5c0 con 0x7f14ac0cedf0 2023-12-11T17:10:47.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.007+0000 7f14b2953640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14ac155400 0x7f14ac14c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:47.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.007+0000 7f14b2953640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14ac155400 0x7f14ac14c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58866/0 (socket says 172.21.15.37:58866) 2023-12-11T17:10:47.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.007+0000 7f14b2953640 1 -- 172.21.15.37:0/1734878174 learned_addr learned my addr 172.21.15.37:0/1734878174 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:47.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.007+0000 7f14b2152640 1 --2- 172.21.15.37:0/1734878174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14ac0ce150 0x7f14ac14f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:47.007 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.007+0000 7f14b1951640 1 --2- 172.21.15.37:0/1734878174 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14ac0cedf0 0x7f14ac139f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:47.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.007+0000 7f14b2953640 1 -- 172.21.15.37:0/1734878174 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14ac0cedf0 msgr2=0x7f14ac139f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:47.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.007+0000 7f14b2953640 1 --2- 172.21.15.37:0/1734878174 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14ac0cedf0 0x7f14ac139f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:47.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.007+0000 7f14b2953640 1 -- 172.21.15.37:0/1734878174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14ac0ce150 msgr2=0x7f14ac14f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:47.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.007+0000 7f14b2953640 1 --2- 172.21.15.37:0/1734878174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14ac0ce150 0x7f14ac14f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:47.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.007+0000 7f14b2953640 1 -- 172.21.15.37:0/1734878174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f149c009400 con 0x7f14ac155400 2023-12-11T17:10:47.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.008+0000 7f14b2953640 1 --2- 172.21.15.37:0/1734878174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14ac155400 0x7f14ac14c190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f14a400cba0 tx=0x7f14a400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:47.008 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.008+0000 7f14a2ffd640 1 -- 172.21.15.37:0/1734878174 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a400ace0 con 0x7f14ac155400 2023-12-11T17:10:47.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.008+0000 7f14a2ffd640 1 -- 172.21.15.37:0/1734878174 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14a400ae40 con 0x7f14ac155400 2023-12-11T17:10:47.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.008+0000 7f14a2ffd640 1 -- 172.21.15.37:0/1734878174 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14a4012620 con 0x7f14ac155400 2023-12-11T17:10:47.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.008+0000 7f14b3154640 1 -- 172.21.15.37:0/1734878174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14ac14e8a0 con 0x7f14ac155400 2023-12-11T17:10:47.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.008+0000 7f14b3154640 1 -- 172.21.15.37:0/1734878174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14ac14cbe0 con 0x7f14ac155400 2023-12-11T17:10:47.009 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.009+0000 7f14b3154640 1 -- 172.21.15.37:0/1734878174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14ac14edc0 con 0x7f14ac155400 2023-12-11T17:10:47.010 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.010+0000 7f14a2ffd640 1 -- 172.21.15.37:0/1734878174 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f14a4007070 con 0x7f14ac155400 2023-12-11T17:10:47.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.011+0000 7f14a2ffd640 1 --2- 172.21.15.37:0/1734878174 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f149006ae40 0x7f149006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:47.011 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.012+0000 7f14a2ffd640 1 -- 172.21.15.37:0/1734878174 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f14a4089b20 con 0x7f14ac155400 2023-12-11T17:10:47.012 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.012+0000 7f14b2152640 1 --2- 172.21.15.37:0/1734878174 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f149006ae40 0x7f149006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:47.013 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.013+0000 7f14b2152640 1 --2- 172.21.15.37:0/1734878174 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f149006ae40 0x7f149006d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f14a80011e0 tx=0x7f14a8009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:47.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.016+0000 7f14a2ffd640 1 -- 172.21.15.37:0/1734878174 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f14ac14edc0 con 0x7f14ac155400 2023-12-11T17:10:47.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.208+0000 7f14b3154640 1 -- 172.21.15.37:0/1734878174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f14ac14edc0 con 0x7f14ac155400 2023-12-11T17:10:47.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.209+0000 7f14a2ffd640 1 -- 172.21.15.37:0/1734878174 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f14ac14edc0 con 0x7f14ac155400 2023-12-11T17:10:47.210 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-11T17:10:47.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.212+0000 7f14b3154640 1 -- 172.21.15.37:0/1734878174 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f149006ae40 msgr2=0x7f149006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:47.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.212+0000 7f14b3154640 1 --2- 172.21.15.37:0/1734878174 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f149006ae40 0x7f149006d300 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f14a80011e0 tx=0x7f14a8009040 comp rx=0 tx=0).stop 2023-12-11T17:10:47.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.212+0000 7f14b3154640 1 -- 172.21.15.37:0/1734878174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14ac155400 msgr2=0x7f14ac14c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:47.212 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.212+0000 7f14b3154640 1 --2- 172.21.15.37:0/1734878174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14ac155400 0x7f14ac14c190 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f14a400cba0 tx=0x7f14a400a430 comp rx=0 tx=0).stop 2023-12-11T17:10:47.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.212+0000 7f14b3154640 1 -- 172.21.15.37:0/1734878174 shutdown_connections 2023-12-11T17:10:47.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.212+0000 7f14b3154640 1 --2- 172.21.15.37:0/1734878174 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f149006ae40 0x7f149006d300 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:47.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.212+0000 7f14b3154640 1 --2- 172.21.15.37:0/1734878174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f14ac155400 0x7f14ac14c190 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:47.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.212+0000 7f14b3154640 1 --2- 172.21.15.37:0/1734878174 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f14ac0cedf0 0x7f14ac139f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:47.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.212+0000 7f14b3154640 1 --2- 172.21.15.37:0/1734878174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14ac0ce150 0x7f14ac14f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:47.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.213+0000 7f14b3154640 1 -- 172.21.15.37:0/1734878174 >> 172.21.15.37:0/1734878174 conn(0x7f14ac06a640 msgr2=0x7f14ac15d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:47.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.213+0000 7f14b3154640 1 -- 172.21.15.37:0/1734878174 shutdown_connections 2023-12-11T17:10:47.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.213+0000 7f14b3154640 1 -- 172.21.15.37:0/1734878174 wait complete. 2023-12-11T17:10:47.232 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T17:10:47.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.459+0000 7ff48bb73640 1 Processor -- start 2023-12-11T17:10:47.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.460+0000 7ff48bb73640 1 -- start start 2023-12-11T17:10:47.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.461+0000 7ff48bb73640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4841432b0 0x7ff48406d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:47.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.461+0000 7ff48bb73640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff48406da40 0x7ff484070250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:47.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.461+0000 7ff48bb73640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4840b4980 con 0x7ff484142de0 2023-12-11T17:10:47.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.462+0000 7ff48bb73640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff48406ded0 con 0x7ff4841432b0 2023-12-11T17:10:47.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.462+0000 7ff48bb73640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4840b4050 con 0x7ff48406da40 2023-12-11T17:10:47.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.462+0000 7ff48990f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff484142de0 0x7ff4840cdd60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:60708/0 (socket says 172.21.15.37:60708) 2023-12-11T17:10:47.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.462+0000 7ff48910e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff4841432b0 0x7ff48406d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:47.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.462+0000 7ff48990f640 1 -- 172.21.15.37:0/1117617964 learned_addr learned my addr 172.21.15.37:0/1117617964 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:47.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.462+0000 7ff48a110640 1 --2- 172.21.15.37:0/1117617964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff48406da40 0x7ff484070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:47.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.463+0000 7ff48910e640 1 -- 172.21.15.37:0/1117617964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff48406da40 msgr2=0x7ff484070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:47.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.463+0000 7ff48910e640 1 --2- 172.21.15.37:0/1117617964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff48406da40 0x7ff484070250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:47.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.463+0000 7ff48910e640 1 -- 172.21.15.37:0/1117617964 >> v1:172.21.15.37:6789/0 conn(0x7ff484142de0 legacy=0x7ff4840cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:47.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.463+0000 7ff48910e640 1 -- 172.21.15.37:0/1117617964 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4840b4330 con 0x7ff4841432b0 2023-12-11T17:10:47.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.463+0000 7ff48890d640 1 -- 172.21.15.37:0/1117617964 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758802941 0 0) 0x7ff4840b4980 con 0x7ff484142de0 2023-12-11T17:10:47.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.464+0000 7ff48910e640 1 --2- 172.21.15.37:0/1117617964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4841432b0 0x7ff48406d500 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff4740097a0 tx=0x7ff47402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c83b480837143ba server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:47.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.464+0000 7ff48890d640 1 -- 172.21.15.37:0/1117617964 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47402e070 con 0x7ff4841432b0 2023-12-11T17:10:47.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.464+0000 7ff48890d640 1 -- 172.21.15.37:0/1117617964 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4740315a0 con 0x7ff4841432b0 2023-12-11T17:10:47.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.464+0000 7ff48890d640 1 -- 172.21.15.37:0/1117617964 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff474031930 con 0x7ff4841432b0 2023-12-11T17:10:47.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.464+0000 7ff48bb73640 1 -- 172.21.15.37:0/1117617964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4841432b0 msgr2=0x7ff48406d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:47.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.465+0000 7ff48bb73640 1 --2- 172.21.15.37:0/1117617964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4841432b0 0x7ff48406d500 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7ff4740097a0 tx=0x7ff47402b840 comp rx=0 tx=0).stop 2023-12-11T17:10:47.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.465+0000 7ff48bb73640 1 -- 172.21.15.37:0/1117617964 shutdown_connections 2023-12-11T17:10:47.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.465+0000 7ff48bb73640 1 --2- 172.21.15.37:0/1117617964 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff48406da40 0x7ff484070250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:47.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.465+0000 7ff48bb73640 1 --2- 172.21.15.37:0/1117617964 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4841432b0 0x7ff48406d500 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:47.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.465+0000 7ff48bb73640 1 -- 172.21.15.37:0/1117617964 >> 172.21.15.37:0/1117617964 conn(0x7ff4840cb850 msgr2=0x7ff4840cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:47.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.465+0000 7ff48bb73640 1 -- 172.21.15.37:0/1117617964 shutdown_connections 2023-12-11T17:10:47.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.465+0000 7ff48bb73640 1 -- 172.21.15.37:0/1117617964 wait complete. 2023-12-11T17:10:47.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.466+0000 7ff48bb73640 1 Processor -- start 2023-12-11T17:10:47.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.467+0000 7ff48bb73640 1 -- start start 2023-12-11T17:10:47.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.467+0000 7ff48bb73640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff48406da40 0x7ff484131030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:47.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.468+0000 7ff48bb73640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff484142de0 0x7ff484131ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:47.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.468+0000 7ff48bb73640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4841432b0 0x7ff4841f0210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:47.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.468+0000 7ff48bb73640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff48412e5e0 con 0x7ff4841432b0 2023-12-11T17:10:47.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.468+0000 7ff48bb73640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff484131570 con 0x7ff484142de0 2023-12-11T17:10:47.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.468+0000 7ff48bb73640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff48412e880 con 0x7ff48406da40 2023-12-11T17:10:47.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.468+0000 7ff48a110640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4841432b0 0x7ff4841f0210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:47.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.468+0000 7ff48a110640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4841432b0 0x7ff4841f0210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58882/0 (socket says 172.21.15.37:58882) 2023-12-11T17:10:47.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.468+0000 7ff48a110640 1 -- 172.21.15.37:0/479154774 learned_addr learned my addr 172.21.15.37:0/479154774 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:47.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.468+0000 7ff48a110640 1 -- 172.21.15.37:0/479154774 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff48406da40 msgr2=0x7ff484131030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:47.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.468+0000 7ff48a110640 1 --2- 172.21.15.37:0/479154774 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff48406da40 0x7ff484131030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:47.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.468+0000 7ff48a110640 1 -- 172.21.15.37:0/479154774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff484142de0 msgr2=0x7ff484131ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:47.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.468+0000 7ff48a110640 1 --2- 172.21.15.37:0/479154774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff484142de0 0x7ff484131ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:47.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.468+0000 7ff48a110640 1 -- 172.21.15.37:0/479154774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff474009400 con 0x7ff4841432b0 2023-12-11T17:10:47.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.469+0000 7ff48a110640 1 --2- 172.21.15.37:0/479154774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4841432b0 0x7ff4841f0210 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff47c007e40 tx=0x7ff47c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:47.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.469+0000 7ff47a7fc640 1 -- 172.21.15.37:0/479154774 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c014620 con 0x7ff4841432b0 2023-12-11T17:10:47.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.469+0000 7ff47a7fc640 1 -- 172.21.15.37:0/479154774 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff47c00ee90 con 0x7ff4841432b0 2023-12-11T17:10:47.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.469+0000 7ff47a7fc640 1 -- 172.21.15.37:0/479154774 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff47c0149e0 con 0x7ff4841432b0 2023-12-11T17:10:47.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.469+0000 7ff48bb73640 1 -- 172.21.15.37:0/479154774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff48412eb60 con 0x7ff4841432b0 2023-12-11T17:10:47.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.469+0000 7ff48bb73640 1 -- 172.21.15.37:0/479154774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff48412f120 con 0x7ff4841432b0 2023-12-11T17:10:47.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.470+0000 7ff48bb73640 1 -- 172.21.15.37:0/479154774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4840745d0 con 0x7ff4841432b0 2023-12-11T17:10:47.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.471+0000 7ff47a7fc640 1 -- 172.21.15.37:0/479154774 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff47c014b40 con 0x7ff4841432b0 2023-12-11T17:10:47.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.472+0000 7ff47a7fc640 1 --2- 172.21.15.37:0/479154774 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff46806ae40 0x7ff46806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:47.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.472+0000 7ff47a7fc640 1 -- 172.21.15.37:0/479154774 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff47c08a4b0 con 0x7ff4841432b0 2023-12-11T17:10:47.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.473+0000 7ff48990f640 1 --2- 172.21.15.37:0/479154774 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff46806ae40 0x7ff46806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:47.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.474+0000 7ff48990f640 1 --2- 172.21.15.37:0/479154774 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff46806ae40 0x7ff46806d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff480007fd0 tx=0x7ff480007920 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:47.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.476+0000 7ff47a7fc640 1 -- 172.21.15.37:0/479154774 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff47c0550e0 con 0x7ff4841432b0 2023-12-11T17:10:47.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.661+0000 7ff48bb73640 1 -- 172.21.15.37:0/479154774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff4840cc650 con 0x7ff4841432b0 2023-12-11T17:10:47.661 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.662+0000 7ff47a7fc640 1 -- 172.21.15.37:0/479154774 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff47c058700 con 0x7ff4841432b0 2023-12-11T17:10:47.662 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:10:47.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.664+0000 7ff48bb73640 1 -- 172.21.15.37:0/479154774 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff46806ae40 msgr2=0x7ff46806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:47.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.664+0000 7ff48bb73640 1 --2- 172.21.15.37:0/479154774 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff46806ae40 0x7ff46806d300 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ff480007fd0 tx=0x7ff480007920 comp rx=0 tx=0).stop 2023-12-11T17:10:47.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.664+0000 7ff48bb73640 1 -- 172.21.15.37:0/479154774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4841432b0 msgr2=0x7ff4841f0210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:47.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.664+0000 7ff48bb73640 1 --2- 172.21.15.37:0/479154774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4841432b0 0x7ff4841f0210 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff47c007e40 tx=0x7ff47c00e4b0 comp rx=0 tx=0).stop 2023-12-11T17:10:47.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.664+0000 7ff48bb73640 1 -- 172.21.15.37:0/479154774 shutdown_connections 2023-12-11T17:10:47.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.664+0000 7ff48bb73640 1 --2- 172.21.15.37:0/479154774 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff46806ae40 0x7ff46806d300 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:47.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.664+0000 7ff48bb73640 1 --2- 172.21.15.37:0/479154774 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff484142de0 0x7ff484131ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:47.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.664+0000 7ff48bb73640 1 --2- 172.21.15.37:0/479154774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff4841432b0 0x7ff4841f0210 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:47.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.664+0000 7ff48bb73640 1 --2- 172.21.15.37:0/479154774 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff48406da40 0x7ff484131030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:47.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.664+0000 7ff48bb73640 1 -- 172.21.15.37:0/479154774 >> 172.21.15.37:0/479154774 conn(0x7ff4840cb850 msgr2=0x7ff484071560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:47.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.665+0000 7ff48bb73640 1 -- 172.21.15.37:0/479154774 shutdown_connections 2023-12-11T17:10:47.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.665+0000 7ff48bb73640 1 -- 172.21.15.37:0/479154774 wait complete. 2023-12-11T17:10:47.682 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T17:10:47.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.908+0000 7ff9eeb54640 1 Processor -- start 2023-12-11T17:10:48.275 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.908+0000 7ff9eeb54640 1 -- start start 2023-12-11T17:10:48.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.909+0000 7ff9eeb54640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff9e80d1d00 0x7ff9e80d0df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:48.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.909+0000 7ff9eeb54640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9e80b1f80 0x7ff9e80b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:48.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.909+0000 7ff9eeb54640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9e80d3cd0 con 0x7ff9e8160ad0 2023-12-11T17:10:48.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.909+0000 7ff9eeb54640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e80d3fb0 con 0x7ff9e80d1d00 2023-12-11T17:10:48.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.909+0000 7ff9eeb54640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e80afde0 con 0x7ff9e80b1f80 2023-12-11T17:10:48.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.910+0000 7ff9ed351640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff9e80d1d00 0x7ff9e80d0df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:48.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.910+0000 7ff9ed351640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff9e80d1d00 0x7ff9e80d0df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:39696/0 (socket says 172.21.15.37:39696) 2023-12-11T17:10:48.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.910+0000 7ff9ee353640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9e80b1f80 0x7ff9e80b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:48.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.910+0000 7ff9ed351640 1 -- 172.21.15.37:0/2162514996 learned_addr learned my addr 172.21.15.37:0/2162514996 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:48.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.911+0000 7ff9ed351640 1 -- 172.21.15.37:0/2162514996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9e80b1f80 msgr2=0x7ff9e80b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:48.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.911+0000 7ff9ed351640 1 --2- 172.21.15.37:0/2162514996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9e80b1f80 0x7ff9e80b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.911+0000 7ff9ed351640 1 -- 172.21.15.37:0/2162514996 >> v1:172.21.15.151:6789/0 conn(0x7ff9e8160ad0 legacy=0x7ff9e80d15f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:48.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.911+0000 7ff9ed351640 1 -- 172.21.15.37:0/2162514996 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e80b00c0 con 0x7ff9e80d1d00 2023-12-11T17:10:48.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.912+0000 7ff9ed351640 1 --2- 172.21.15.37:0/2162514996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9e80d1d00 0x7ff9e80d0df0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8009870 tx=0x7ff9d802b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=46d59369c42ce840 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:48.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.913+0000 7ff9ecb50640 1 -- 172.21.15.37:0/2162514996 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d80317c0 con 0x7ff9e80d1d00 2023-12-11T17:10:48.280 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.913+0000 7ff9ecb50640 1 -- 172.21.15.37:0/2162514996 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d8031920 con 0x7ff9e80d1d00 2023-12-11T17:10:48.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.913+0000 7ff9ecb50640 1 -- 172.21.15.37:0/2162514996 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8031cb0 con 0x7ff9e80d1d00 2023-12-11T17:10:48.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.913+0000 7ff9eeb54640 1 -- 172.21.15.37:0/2162514996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9e80d1d00 msgr2=0x7ff9e80d0df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:48.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.913+0000 7ff9eeb54640 1 --2- 172.21.15.37:0/2162514996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9e80d1d00 0x7ff9e80d0df0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff9d8009870 tx=0x7ff9d802b860 comp rx=0 tx=0).stop 2023-12-11T17:10:48.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.914+0000 7ff9eeb54640 1 -- 172.21.15.37:0/2162514996 shutdown_connections 2023-12-11T17:10:48.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.914+0000 7ff9eeb54640 1 --2- 172.21.15.37:0/2162514996 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9e80b1f80 0x7ff9e80b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.914+0000 7ff9eeb54640 1 --2- 172.21.15.37:0/2162514996 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9e80d1d00 0x7ff9e80d0df0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.914+0000 7ff9eeb54640 1 -- 172.21.15.37:0/2162514996 >> 172.21.15.37:0/2162514996 conn(0x7ff9e80d3010 msgr2=0x7ff9e80d3420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:48.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.914+0000 7ff9eeb54640 1 -- 172.21.15.37:0/2162514996 shutdown_connections 2023-12-11T17:10:48.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.914+0000 7ff9eeb54640 1 -- 172.21.15.37:0/2162514996 wait complete. 2023-12-11T17:10:48.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.916+0000 7ff9eeb54640 1 Processor -- start 2023-12-11T17:10:48.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.916+0000 7ff9eeb54640 1 -- start start 2023-12-11T17:10:48.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.917+0000 7ff9eeb54640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9e80b1f80 0x7ff9e814d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:48.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.917+0000 7ff9eeb54640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e80d1d00 0x7ff9e814d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:48.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.917+0000 7ff9eeb54640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9e8160ad0 0x7ff9e80cc060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:48.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.917+0000 7ff9eeb54640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e80cbbd0 con 0x7ff9e80d1d00 2023-12-11T17:10:48.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.917+0000 7ff9eeb54640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e80b6140 con 0x7ff9e80b1f80 2023-12-11T17:10:48.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.917+0000 7ff9eeb54640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e80b8b30 con 0x7ff9e8160ad0 2023-12-11T17:10:48.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.917+0000 7ff9ed351640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e80d1d00 0x7ff9e814d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:48.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.917+0000 7ff9ed351640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e80d1d00 0x7ff9e814d970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58892/0 (socket says 172.21.15.37:58892) 2023-12-11T17:10:48.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.917+0000 7ff9ed351640 1 -- 172.21.15.37:0/32069962 learned_addr learned my addr 172.21.15.37:0/32069962 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:48.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.917+0000 7ff9edb52640 1 --2- 172.21.15.37:0/32069962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9e80b1f80 0x7ff9e814d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:48.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.917+0000 7ff9ee353640 1 --2- 172.21.15.37:0/32069962 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9e8160ad0 0x7ff9e80cc060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:48.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.918+0000 7ff9ed351640 1 -- 172.21.15.37:0/32069962 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9e8160ad0 msgr2=0x7ff9e80cc060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:48.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.918+0000 7ff9ed351640 1 --2- 172.21.15.37:0/32069962 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9e8160ad0 0x7ff9e80cc060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.918+0000 7ff9ed351640 1 -- 172.21.15.37:0/32069962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9e80b1f80 msgr2=0x7ff9e814d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:48.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.918+0000 7ff9ed351640 1 --2- 172.21.15.37:0/32069962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9e80b1f80 0x7ff9e814d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.918+0000 7ff9ed351640 1 -- 172.21.15.37:0/32069962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d80094d0 con 0x7ff9e80d1d00 2023-12-11T17:10:48.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.918+0000 7ff9edb52640 1 --2- 172.21.15.37:0/32069962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9e80b1f80 0x7ff9e814d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:10:48.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.918+0000 7ff9ed351640 1 --2- 172.21.15.37:0/32069962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e80d1d00 0x7ff9e814d970 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff9d802b8a0 tx=0x7ff9d80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:48.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.918+0000 7ff9de7fc640 1 -- 172.21.15.37:0/32069962 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8032860 con 0x7ff9e80d1d00 2023-12-11T17:10:48.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.918+0000 7ff9de7fc640 1 -- 172.21.15.37:0/32069962 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d80329c0 con 0x7ff9e80d1d00 2023-12-11T17:10:48.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.918+0000 7ff9de7fc640 1 -- 172.21.15.37:0/32069962 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d8032d70 con 0x7ff9e80d1d00 2023-12-11T17:10:48.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.918+0000 7ff9eeb54640 1 -- 172.21.15.37:0/32069962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e80b8e10 con 0x7ff9e80d1d00 2023-12-11T17:10:48.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.919+0000 7ff9eeb54640 1 -- 172.21.15.37:0/32069962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e814d5d0 con 0x7ff9e80d1d00 2023-12-11T17:10:48.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.920+0000 7ff9eeb54640 1 -- 172.21.15.37:0/32069962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e808d070 con 0x7ff9e80d1d00 2023-12-11T17:10:48.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.921+0000 7ff9de7fc640 1 -- 172.21.15.37:0/32069962 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff9d804e450 con 0x7ff9e80d1d00 2023-12-11T17:10:48.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.922+0000 7ff9de7fc640 1 --2- 172.21.15.37:0/32069962 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff9cc06ae40 0x7ff9cc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:48.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.922+0000 7ff9de7fc640 1 -- 172.21.15.37:0/32069962 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff9d80abc10 con 0x7ff9e80d1d00 2023-12-11T17:10:48.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.923+0000 7ff9edb52640 1 --2- 172.21.15.37:0/32069962 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff9cc06ae40 0x7ff9cc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:48.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.924+0000 7ff9edb52640 1 --2- 172.21.15.37:0/32069962 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff9cc06ae40 0x7ff9cc06d300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4001660 tx=0x7ff9e4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:48.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:47.926+0000 7ff9de7fc640 1 -- 172.21.15.37:0/32069962 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff9d8076840 con 0x7ff9e80d1d00 2023-12-11T17:10:48.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.123+0000 7ff9eeb54640 1 -- 172.21.15.37:0/32069962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff9e8074450 con 0x7ff9e80d1d00 2023-12-11T17:10:48.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.124+0000 7ff9de7fc640 1 -- 172.21.15.37:0/32069962 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff9d8079e60 con 0x7ff9e80d1d00 2023-12-11T17:10:48.284 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-11T17:10:48.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.127+0000 7ff9eeb54640 1 -- 172.21.15.37:0/32069962 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff9cc06ae40 msgr2=0x7ff9cc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:48.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.127+0000 7ff9eeb54640 1 --2- 172.21.15.37:0/32069962 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff9cc06ae40 0x7ff9cc06d300 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7ff9e4001660 tx=0x7ff9e4009040 comp rx=0 tx=0).stop 2023-12-11T17:10:48.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.127+0000 7ff9eeb54640 1 -- 172.21.15.37:0/32069962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e80d1d00 msgr2=0x7ff9e814d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:48.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.127+0000 7ff9eeb54640 1 --2- 172.21.15.37:0/32069962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e80d1d00 0x7ff9e814d970 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff9d802b8a0 tx=0x7ff9d80046c0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.127+0000 7ff9eeb54640 1 -- 172.21.15.37:0/32069962 shutdown_connections 2023-12-11T17:10:48.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.127+0000 7ff9eeb54640 1 --2- 172.21.15.37:0/32069962 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff9cc06ae40 0x7ff9cc06d300 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.127+0000 7ff9eeb54640 1 --2- 172.21.15.37:0/32069962 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff9e8160ad0 0x7ff9e80cc060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.127+0000 7ff9eeb54640 1 --2- 172.21.15.37:0/32069962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e80d1d00 0x7ff9e814d970 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.127+0000 7ff9eeb54640 1 --2- 172.21.15.37:0/32069962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9e80b1f80 0x7ff9e814d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.127+0000 7ff9eeb54640 1 -- 172.21.15.37:0/32069962 >> 172.21.15.37:0/32069962 conn(0x7ff9e80d3010 msgr2=0x7ff9e80b1560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:48.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.128+0000 7ff9eeb54640 1 -- 172.21.15.37:0/32069962 shutdown_connections 2023-12-11T17:10:48.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.128+0000 7ff9eeb54640 1 -- 172.21.15.37:0/32069962 wait complete. 2023-12-11T17:10:48.286 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-11T17:10:48.525 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.525+0000 7f5fdef53640 1 Processor -- start 2023-12-11T17:10:48.526 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.525+0000 7f5fdef53640 1 -- start start 2023-12-11T17:10:48.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.527+0000 7f5fdef53640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fd806d770 0x7f5fd80b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:48.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.527+0000 7f5fdef53640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5fd8141960 0x7f5fd80cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:48.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.527+0000 7f5fdef53640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5fd815b780 con 0x7f5fd806db50 2023-12-11T17:10:48.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.527+0000 7f5fdef53640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5fd815b9d0 con 0x7f5fd8141960 2023-12-11T17:10:48.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.527+0000 7f5fdef53640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd815bcb0 con 0x7f5fd806d770 2023-12-11T17:10:48.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.528+0000 7f5fdd4f0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5fd8141960 0x7f5fd80cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:48.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.528+0000 7f5fdd4f0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5fd8141960 0x7f5fd80cce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58896/0 (socket says 172.21.15.37:58896) 2023-12-11T17:10:48.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.528+0000 7f5fdd4f0640 1 -- 172.21.15.37:0/3025554498 learned_addr learned my addr 172.21.15.37:0/3025554498 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:48.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.528+0000 7f5fdd4f0640 1 -- 172.21.15.37:0/3025554498 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fd806d770 msgr2=0x7f5fd80b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:48.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.528+0000 7f5fdd4f0640 1 --2- 172.21.15.37:0/3025554498 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fd806d770 0x7f5fd80b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.528+0000 7f5fdd4f0640 1 -- 172.21.15.37:0/3025554498 >> v1:172.21.15.151:6789/0 conn(0x7f5fd806db50 legacy=0x7f5fd8141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:48.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.528+0000 7f5fdd4f0640 1 -- 172.21.15.37:0/3025554498 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd815bf90 con 0x7f5fd8141960 2023-12-11T17:10:48.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.529+0000 7f5fdd4f0640 1 --2- 172.21.15.37:0/3025554498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fd8141960 0x7f5fd80cce00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009e50 tx=0x7f5fd002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b3a17c99937767 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:48.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.530+0000 7f5fd77fe640 1 -- 172.21.15.37:0/3025554498 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd002ca70 con 0x7f5fd8141960 2023-12-11T17:10:48.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.530+0000 7f5fd77fe640 1 -- 172.21.15.37:0/3025554498 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fd002cbd0 con 0x7f5fd8141960 2023-12-11T17:10:48.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.530+0000 7f5fd77fe640 1 -- 172.21.15.37:0/3025554498 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fd00343f0 con 0x7f5fd8141960 2023-12-11T17:10:48.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.530+0000 7f5fdef53640 1 -- 172.21.15.37:0/3025554498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fd8141960 msgr2=0x7f5fd80cce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:48.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.530+0000 7f5fdef53640 1 --2- 172.21.15.37:0/3025554498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fd8141960 0x7f5fd80cce00 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f5fd0009e50 tx=0x7f5fd002bed0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.530+0000 7f5fdef53640 1 -- 172.21.15.37:0/3025554498 shutdown_connections 2023-12-11T17:10:48.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.530+0000 7f5fdef53640 1 --2- 172.21.15.37:0/3025554498 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fd8141960 0x7f5fd80cce00 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.530+0000 7f5fdef53640 1 --2- 172.21.15.37:0/3025554498 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fd806d770 0x7f5fd80b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.530+0000 7f5fdef53640 1 -- 172.21.15.37:0/3025554498 >> 172.21.15.37:0/3025554498 conn(0x7f5fd80cb850 msgr2=0x7f5fd80cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:48.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.531+0000 7f5fdef53640 1 -- 172.21.15.37:0/3025554498 shutdown_connections 2023-12-11T17:10:48.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.531+0000 7f5fdef53640 1 -- 172.21.15.37:0/3025554498 wait complete. 2023-12-11T17:10:48.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.532+0000 7f5fdef53640 1 Processor -- start 2023-12-11T17:10:48.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.533+0000 7f5fdef53640 1 -- start start 2023-12-11T17:10:48.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.534+0000 7f5fdef53640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fd806d770 0x7f5fd80ca110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:48.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.534+0000 7f5fdef53640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fd806db50 0x7f5fd8134780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:48.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.534+0000 7f5fdef53640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fd8141960 0x7f5fd815a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:48.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.534+0000 7f5fdef53640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd8134cc0 con 0x7f5fd806d770 2023-12-11T17:10:48.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.534+0000 7f5fdef53640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd80ca780 con 0x7f5fd806db50 2023-12-11T17:10:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.534+0000 7f5fdef53640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5fd80caa60 con 0x7f5fd8141960 2023-12-11T17:10:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.534+0000 7f5fdccef640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fd806d770 0x7f5fd80ca110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.534+0000 7f5fdccef640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fd806d770 0x7f5fd80ca110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:58900/0 (socket says 172.21.15.37:58900) 2023-12-11T17:10:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.534+0000 7f5fdccef640 1 -- 172.21.15.37:0/4178664275 learned_addr learned my addr 172.21.15.37:0/4178664275 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.534+0000 7f5fdccef640 1 -- 172.21.15.37:0/4178664275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fd8141960 msgr2=0x7f5fd815a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.534+0000 7f5fdccef640 1 --2- 172.21.15.37:0/4178664275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fd8141960 0x7f5fd815a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.534+0000 7f5fd7fff640 1 --2- 172.21.15.37:0/4178664275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fd806db50 0x7f5fd8134780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.534+0000 7f5fdccef640 1 -- 172.21.15.37:0/4178664275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fd806db50 msgr2=0x7f5fd8134780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.534+0000 7f5fdccef640 1 --2- 172.21.15.37:0/4178664275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fd806db50 0x7f5fd8134780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.534+0000 7f5fdccef640 1 -- 172.21.15.37:0/4178664275 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5fd0009b30 con 0x7f5fd806d770 2023-12-11T17:10:48.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.534+0000 7f5fd7fff640 1 --2- 172.21.15.37:0/4178664275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fd806db50 0x7f5fd8134780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:48.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.535+0000 7f5fdccef640 1 --2- 172.21.15.37:0/4178664275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fd806d770 0x7f5fd80ca110 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00b4a0 tx=0x7f5fcc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:48.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.535+0000 7f5fd57fa640 1 -- 172.21.15.37:0/4178664275 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc010610 con 0x7f5fd806d770 2023-12-11T17:10:48.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.535+0000 7f5fd57fa640 1 -- 172.21.15.37:0/4178664275 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5fcc010770 con 0x7f5fd806d770 2023-12-11T17:10:48.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.535+0000 7f5fdef53640 1 -- 172.21.15.37:0/4178664275 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5fd80b3940 con 0x7f5fd806d770 2023-12-11T17:10:48.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.535+0000 7f5fd57fa640 1 -- 172.21.15.37:0/4178664275 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5fcc010b20 con 0x7f5fd806d770 2023-12-11T17:10:48.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.535+0000 7f5fdef53640 1 -- 172.21.15.37:0/4178664275 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5fd80cb020 con 0x7f5fd806d770 2023-12-11T17:10:48.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.537+0000 7f5fdef53640 1 -- 172.21.15.37:0/4178664275 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5fd80745d0 con 0x7f5fd806d770 2023-12-11T17:10:48.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.537+0000 7f5fd57fa640 1 -- 172.21.15.37:0/4178664275 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5fcc010c80 con 0x7f5fd806d770 2023-12-11T17:10:48.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.538+0000 7f5fd57fa640 1 --2- 172.21.15.37:0/4178664275 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5fbc06ae40 0x7f5fbc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:48.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.539+0000 7f5fd57fa640 1 -- 172.21.15.37:0/4178664275 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5fcc0895f0 con 0x7f5fd806d770 2023-12-11T17:10:48.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.539+0000 7f5fd7fff640 1 --2- 172.21.15.37:0/4178664275 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5fbc06ae40 0x7f5fbc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:48.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.540+0000 7f5fd7fff640 1 --2- 172.21.15.37:0/4178664275 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5fbc06ae40 0x7f5fbc06d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4007fd0 tx=0x7f5fc4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:48.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.543+0000 7f5fd57fa640 1 -- 172.21.15.37:0/4178664275 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5fcc0542c0 con 0x7f5fd806d770 2023-12-11T17:10:48.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.736+0000 7f5fdef53640 1 -- 172.21.15.37:0/4178664275 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5fd8072770 con 0x7f5fd806d770 2023-12-11T17:10:48.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.737+0000 7f5fd57fa640 1 -- 172.21.15.37:0/4178664275 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5fcc0578e0 con 0x7f5fd806d770 2023-12-11T17:10:48.737 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:10:48.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.740+0000 7f5fdef53640 1 -- 172.21.15.37:0/4178664275 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5fbc06ae40 msgr2=0x7f5fbc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:48.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.740+0000 7f5fdef53640 1 --2- 172.21.15.37:0/4178664275 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5fbc06ae40 0x7f5fbc06d300 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f5fc4007fd0 tx=0x7f5fc4009040 comp rx=0 tx=0).stop 2023-12-11T17:10:48.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.740+0000 7f5fdef53640 1 -- 172.21.15.37:0/4178664275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fd806d770 msgr2=0x7f5fd80ca110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:48.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.740+0000 7f5fdef53640 1 --2- 172.21.15.37:0/4178664275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fd806d770 0x7f5fd80ca110 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f5fcc00b4a0 tx=0x7f5fcc00b960 comp rx=0 tx=0).stop 2023-12-11T17:10:48.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.740+0000 7f5fdef53640 1 -- 172.21.15.37:0/4178664275 shutdown_connections 2023-12-11T17:10:48.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.740+0000 7f5fdef53640 1 --2- 172.21.15.37:0/4178664275 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5fbc06ae40 0x7f5fbc06d300 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.740+0000 7f5fdef53640 1 --2- 172.21.15.37:0/4178664275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5fd806db50 0x7f5fd8134780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.740+0000 7f5fdef53640 1 --2- 172.21.15.37:0/4178664275 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5fd8141960 0x7f5fd815a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.740+0000 7f5fdef53640 1 --2- 172.21.15.37:0/4178664275 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5fd806d770 0x7f5fd80ca110 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.740+0000 7f5fdef53640 1 -- 172.21.15.37:0/4178664275 >> 172.21.15.37:0/4178664275 conn(0x7f5fd80cb850 msgr2=0x7f5fd80b2460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:48.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.740+0000 7f5fdef53640 1 -- 172.21.15.37:0/4178664275 shutdown_connections 2023-12-11T17:10:48.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.740+0000 7f5fdef53640 1 -- 172.21.15.37:0/4178664275 wait complete. 2023-12-11T17:10:48.759 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:10:48.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.983+0000 7f200b59e640 1 Processor -- start 2023-12-11T17:10:48.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.984+0000 7f200b59e640 1 -- start start 2023-12-11T17:10:48.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.985+0000 7f200b59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f200c0ce5b0 0x7f200c0d0d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:48.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.985+0000 7f200b59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f200c0b0760 0x7f200c0b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:48.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.985+0000 7f200b59e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f200c0b2280 con 0x7f200c0d13c0 2023-12-11T17:10:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.985+0000 7f200b59e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f200c0cee70 con 0x7f200c0b0760 2023-12-11T17:10:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.985+0000 7f200b59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f200c0ceb90 con 0x7f200c0ce5b0 2023-12-11T17:10:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.986+0000 7f200ad9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f200c0b0760 0x7f200c0b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.986+0000 7f200ad9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f200c0b0760 0x7f200c0b0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60004/0 (socket says 172.21.15.37:60004) 2023-12-11T17:10:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.986+0000 7f200ad9d640 1 -- 172.21.15.37:0/1157705574 learned_addr learned my addr 172.21.15.37:0/1157705574 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.986+0000 7f200a59c640 1 --1- 172.21.15.37:0/1157705574 >> v1:172.21.15.37:6789/0 conn(0x7f200c0d13c0 0x7f200c0d17a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56440/0 (socket says 172.21.15.37:56440) 2023-12-11T17:10:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.986+0000 7f2003fff640 1 --2- 172.21.15.37:0/1157705574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f200c0ce5b0 0x7f200c0d0d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.986+0000 7f200ad9d640 1 -- 172.21.15.37:0/1157705574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f200c0ce5b0 msgr2=0x7f200c0d0d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.986+0000 7f200ad9d640 1 --2- 172.21.15.37:0/1157705574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f200c0ce5b0 0x7f200c0d0d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.986+0000 7f200ad9d640 1 -- 172.21.15.37:0/1157705574 >> v1:172.21.15.37:6789/0 conn(0x7f200c0d13c0 legacy=0x7f200c0d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.986+0000 7f200ad9d640 1 -- 172.21.15.37:0/1157705574 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f200c0afc80 con 0x7f200c0b0760 2023-12-11T17:10:48.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.986+0000 7f2003fff640 1 --2- 172.21.15.37:0/1157705574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f200c0ce5b0 0x7f200c0d0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:48.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.987+0000 7f200ad9d640 1 --2- 172.21.15.37:0/1157705574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f200c0b0760 0x7f200c0b0bf0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2004009e50 tx=0x7f200402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90453ded22b68d09 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:48.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.987+0000 7f2009d9b640 1 -- 172.21.15.37:0/1157705574 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f200402ca80 con 0x7f200c0b0760 2023-12-11T17:10:48.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.988+0000 7f2009d9b640 1 -- 172.21.15.37:0/1157705574 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f200402cbe0 con 0x7f200c0b0760 2023-12-11T17:10:48.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.988+0000 7f2009d9b640 1 -- 172.21.15.37:0/1157705574 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20040343f0 con 0x7f200c0b0760 2023-12-11T17:10:48.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.988+0000 7f200b59e640 1 -- 172.21.15.37:0/1157705574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f200c0b0760 msgr2=0x7f200c0b0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:48.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.988+0000 7f200b59e640 1 --2- 172.21.15.37:0/1157705574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f200c0b0760 0x7f200c0b0bf0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f2004009e50 tx=0x7f200402bee0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.988+0000 7f200b59e640 1 -- 172.21.15.37:0/1157705574 shutdown_connections 2023-12-11T17:10:48.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.988+0000 7f200b59e640 1 --2- 172.21.15.37:0/1157705574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f200c0b0760 0x7f200c0b0bf0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.988+0000 7f200b59e640 1 --2- 172.21.15.37:0/1157705574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f200c0ce5b0 0x7f200c0d0d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.988+0000 7f200b59e640 1 -- 172.21.15.37:0/1157705574 >> 172.21.15.37:0/1157705574 conn(0x7f200c09c260 msgr2=0x7f200c0d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:48.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.988+0000 7f200b59e640 1 -- 172.21.15.37:0/1157705574 shutdown_connections 2023-12-11T17:10:48.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.988+0000 7f200b59e640 1 -- 172.21.15.37:0/1157705574 wait complete. 2023-12-11T17:10:48.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.990+0000 7f200b59e640 1 Processor -- start 2023-12-11T17:10:48.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.990+0000 7f200b59e640 1 -- start start 2023-12-11T17:10:48.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.991+0000 7f200b59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f200c0b0760 0x7f200c09cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:48.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.991+0000 7f200b59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f200c0ce5b0 0x7f200c0b50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:48.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.991+0000 7f200b59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f200c0d13c0 0x7f200c09f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:48.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.991+0000 7f200b59e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c0b5620 con 0x7f200c0ce5b0 2023-12-11T17:10:48.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.991+0000 7f200b59e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f200c09d240 con 0x7f200c0d13c0 2023-12-11T17:10:48.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.991+0000 7f200b59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f200c09d520 con 0x7f200c0b0760 2023-12-11T17:10:48.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.992+0000 7f2003fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f200c0ce5b0 0x7f200c0b50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:48.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.992+0000 7f2003fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f200c0ce5b0 0x7f200c0b50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60010/0 (socket says 172.21.15.37:60010) 2023-12-11T17:10:48.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.992+0000 7f2003fff640 1 -- 172.21.15.37:0/963807812 learned_addr learned my addr 172.21.15.37:0/963807812 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.992+0000 7f2003fff640 1 -- 172.21.15.37:0/963807812 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f200c0b0760 msgr2=0x7f200c09cbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.992+0000 7f2003fff640 1 --2- 172.21.15.37:0/963807812 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f200c0b0760 0x7f200c09cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.992+0000 7f2003fff640 1 -- 172.21.15.37:0/963807812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f200c0d13c0 msgr2=0x7f200c09f0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.992+0000 7f2003fff640 1 --2- 172.21.15.37:0/963807812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f200c0d13c0 0x7f200c09f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.992+0000 7f2003fff640 1 -- 172.21.15.37:0/963807812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2004009b30 con 0x7f200c0ce5b0 2023-12-11T17:10:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.992+0000 7f2003fff640 1 --2- 172.21.15.37:0/963807812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f200c0ce5b0 0x7f200c0b50e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400c7f0 tx=0x7f1ff400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.993+0000 7f2002ffd640 1 -- 172.21.15.37:0/963807812 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff4007a30 con 0x7f200c0ce5b0 2023-12-11T17:10:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.993+0000 7f2002ffd640 1 -- 172.21.15.37:0/963807812 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ff4007b90 con 0x7f200c0ce5b0 2023-12-11T17:10:48.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.993+0000 7f2002ffd640 1 -- 172.21.15.37:0/963807812 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ff400ce40 con 0x7f200c0ce5b0 2023-12-11T17:10:48.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.993+0000 7f200b59e640 1 -- 172.21.15.37:0/963807812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f200c09d800 con 0x7f200c0ce5b0 2023-12-11T17:10:48.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.993+0000 7f200b59e640 1 -- 172.21.15.37:0/963807812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f200c09ddc0 con 0x7f200c0ce5b0 2023-12-11T17:10:48.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.994+0000 7f200b59e640 1 -- 172.21.15.37:0/963807812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f200c09dfe0 con 0x7f200c0ce5b0 2023-12-11T17:10:48.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.995+0000 7f2002ffd640 1 -- 172.21.15.37:0/963807812 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1ff40113f0 con 0x7f200c0ce5b0 2023-12-11T17:10:48.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.996+0000 7f2002ffd640 1 --2- 172.21.15.37:0/963807812 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1fec06ae40 0x7f1fec06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:48.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.996+0000 7f2002ffd640 1 -- 172.21.15.37:0/963807812 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f1ff4089b00 con 0x7f200c0ce5b0 2023-12-11T17:10:48.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.997+0000 7f200a59c640 1 --2- 172.21.15.37:0/963807812 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1fec06ae40 0x7f1fec06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:48.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:48.998+0000 7f200a59c640 1 --2- 172.21.15.37:0/963807812 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1fec06ae40 0x7f1fec06d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc001540 tx=0x7f1ffc0079c0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:49.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.001+0000 7f2002ffd640 1 -- 172.21.15.37:0/963807812 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1ff4054860 con 0x7f200c0ce5b0 2023-12-11T17:10:49.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.197+0000 7f200b59e640 1 -- 172.21.15.37:0/963807812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f200c074450 con 0x7f200c0ce5b0 2023-12-11T17:10:49.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.201+0000 7f2002ffd640 1 -- 172.21.15.37:0/963807812 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18779 (secure 0 0 0) 0x7f1ff401f090 con 0x7f200c0ce5b0 2023-12-11T17:10:49.201 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:49.202 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:10:32.309274+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:10:49.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.204+0000 7f200b59e640 1 -- 172.21.15.37:0/963807812 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1fec06ae40 msgr2=0x7f1fec06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:49.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.204+0000 7f200b59e640 1 --2- 172.21.15.37:0/963807812 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1fec06ae40 0x7f1fec06d300 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1ffc001540 tx=0x7f1ffc0079c0 comp rx=0 tx=0).stop 2023-12-11T17:10:49.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.204+0000 7f200b59e640 1 -- 172.21.15.37:0/963807812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f200c0ce5b0 msgr2=0x7f200c0b50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:49.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.204+0000 7f200b59e640 1 --2- 172.21.15.37:0/963807812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f200c0ce5b0 0x7f200c0b50e0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f1ff400c7f0 tx=0x7f1ff400cbf0 comp rx=0 tx=0).stop 2023-12-11T17:10:49.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.204+0000 7f200b59e640 1 -- 172.21.15.37:0/963807812 shutdown_connections 2023-12-11T17:10:49.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.204+0000 7f200b59e640 1 --2- 172.21.15.37:0/963807812 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1fec06ae40 0x7f1fec06d300 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:49.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.204+0000 7f200b59e640 1 --2- 172.21.15.37:0/963807812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f200c0d13c0 0x7f200c09f0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:49.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.204+0000 7f200b59e640 1 --2- 172.21.15.37:0/963807812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f200c0ce5b0 0x7f200c0b50e0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:49.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.204+0000 7f200b59e640 1 --2- 172.21.15.37:0/963807812 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f200c0b0760 0x7f200c09cbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:49.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.204+0000 7f200b59e640 1 -- 172.21.15.37:0/963807812 >> 172.21.15.37:0/963807812 conn(0x7f200c09c260 msgr2=0x7f200c0b5ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:49.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.204+0000 7f200b59e640 1 -- 172.21.15.37:0/963807812 shutdown_connections 2023-12-11T17:10:49.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.204+0000 7f200b59e640 1 -- 172.21.15.37:0/963807812 wait complete. 2023-12-11T17:10:49.228 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T17:09:38.415636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T17:09:42.786774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T17:09:43.660585+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-11T17:09:47.272351+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-11T17:10:49.229 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T17:10:49.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.447+0000 7fa5a89f4640 1 Processor -- start 2023-12-11T17:10:49.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.447+0000 7fa5a89f4640 1 -- start start 2023-12-11T17:10:49.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.449+0000 7fa5a89f4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5a40ce150 0x7fa5a40ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:49.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.449+0000 7fa5a89f4640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa5a40cedf0 0x7fa5a40cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:49.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.449+0000 7fa5a89f4640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5a406c500 con 0x7fa5a4155400 2023-12-11T17:10:49.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.449+0000 7fa5a89f4640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5a40cf7c0 con 0x7fa5a40cedf0 2023-12-11T17:10:49.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.449+0000 7fa5a89f4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a415b4a0 con 0x7fa5a40ce150 2023-12-11T17:10:49.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.449+0000 7fa5a37fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa5a4155400 0x7fa5a406bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56450/0 (socket says 172.21.15.37:56450) 2023-12-11T17:10:49.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.449+0000 7fa5a37fe640 1 -- 172.21.15.37:0/4000927158 learned_addr learned my addr 172.21.15.37:0/4000927158 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:49.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.450+0000 7fa5a3fff640 1 --2- 172.21.15.37:0/4000927158 >> v2:172.21.15.151:3300/0 conn(0x7fa5a40cedf0 0x7fa5a40cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:49.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.450+0000 7fa59bfff640 1 --2- 172.21.15.37:0/4000927158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5a40ce150 0x7fa5a40ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:49.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.450+0000 7fa5a2ffd640 1 -- 172.21.15.37:0/4000927158 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3123033044 0 0) 0x7fa5a406c500 con 0x7fa5a4155400 2023-12-11T17:10:49.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.450+0000 7fa5a2ffd640 1 -- 172.21.15.37:0/4000927158 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa590003520 con 0x7fa5a4155400 2023-12-11T17:10:49.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.450+0000 7fa5a2ffd640 1 -- 172.21.15.37:0/4000927158 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1832116599 0 0) 0x7fa590003520 con 0x7fa5a4155400 2023-12-11T17:10:49.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.450+0000 7fa5a2ffd640 1 -- 172.21.15.37:0/4000927158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5a40ce150 msgr2=0x7fa5a40ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:49.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.450+0000 7fa5a2ffd640 1 --2- 172.21.15.37:0/4000927158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5a40ce150 0x7fa5a40ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:49.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.450+0000 7fa5a2ffd640 1 -- 172.21.15.37:0/4000927158 >> v2:172.21.15.151:3300/0 conn(0x7fa5a40cedf0 msgr2=0x7fa5a40cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:49.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.450+0000 7fa5a2ffd640 1 --2- 172.21.15.37:0/4000927158 >> v2:172.21.15.151:3300/0 conn(0x7fa5a40cedf0 0x7fa5a40cf280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:49.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.450+0000 7fa5a2ffd640 1 -- 172.21.15.37:0/4000927158 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a40adbb0 con 0x7fa5a4155400 2023-12-11T17:10:49.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.450+0000 7fa5a2ffd640 1 -- 172.21.15.37:0/4000927158 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7fa594001670 con 0x7fa5a4155400 2023-12-11T17:10:49.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.450+0000 7fa5a2ffd640 1 -- 172.21.15.37:0/4000927158 >> v1:172.21.15.37:6789/0 conn(0x7fa5a4155400 legacy=0x7fa5a406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:49.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.451+0000 7fa5a2ffd640 1 --2- 172.21.15.37:0/4000927158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5a40ce150 0x7fa590003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:49.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.451+0000 7fa5a2ffd640 1 --2- 172.21.15.37:0/4000927158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa590003ef0 0x7fa5900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:49.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.451+0000 7fa5a2ffd640 1 --2- 172.21.15.37:0/4000927158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa590004d00 0x7fa590005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:49.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.451+0000 7fa5a2ffd640 1 -- 172.21.15.37:0/4000927158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a40cf7c0 con 0x7fa590003ef0 2023-12-11T17:10:49.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.451+0000 7fa5a2ffd640 1 -- 172.21.15.37:0/4000927158 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a415b4a0 con 0x7fa590004d00 2023-12-11T17:10:49.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.451+0000 7fa5a2ffd640 1 -- 172.21.15.37:0/4000927158 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa59000b980 con 0x7fa5a40ce150 2023-12-11T17:10:49.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.451+0000 7fa59bfff640 1 --2- 172.21.15.37:0/4000927158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa590003ef0 0x7fa5900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:49.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.451+0000 7fa5a37fe640 1 --2- 172.21.15.37:0/4000927158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5a40ce150 0x7fa590003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:49.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.451+0000 7fa59bfff640 1 -- 172.21.15.37:0/4000927158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5a40ce150 msgr2=0x7fa590003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:49.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.451+0000 7fa59bfff640 1 --2- 172.21.15.37:0/4000927158 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa5a40ce150 0x7fa590003970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:49.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.451+0000 7fa5a3fff640 1 --2- 172.21.15.37:0/4000927158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa590004d00 0x7fa590005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:49.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.451+0000 7fa59bfff640 1 -- 172.21.15.37:0/4000927158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa590004d00 msgr2=0x7fa590005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:49.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.451+0000 7fa59bfff640 1 --2- 172.21.15.37:0/4000927158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa590004d00 0x7fa590005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:49.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.451+0000 7fa59bfff640 1 -- 172.21.15.37:0/4000927158 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa590003520 con 0x7fa590003ef0 2023-12-11T17:10:49.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.453+0000 7fa59bfff640 1 --2- 172.21.15.37:0/4000927158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa590003ef0 0x7fa5900047c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa58c009ac0 tx=0x7fa5900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8a787f51b3850a server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:49.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.453+0000 7fa5a2ffd640 1 -- 172.21.15.37:0/4000927158 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c02c6b0 con 0x7fa590003ef0 2023-12-11T17:10:49.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.453+0000 7fa5a2ffd640 1 -- 172.21.15.37:0/4000927158 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa58c02c810 con 0x7fa590003ef0 2023-12-11T17:10:49.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.453+0000 7fa5a2ffd640 1 -- 172.21.15.37:0/4000927158 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa58c02cba0 con 0x7fa590003ef0 2023-12-11T17:10:49.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.454+0000 7fa5a89f4640 1 -- 172.21.15.37:0/4000927158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa590003ef0 msgr2=0x7fa5900047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:49.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.454+0000 7fa5a89f4640 1 --2- 172.21.15.37:0/4000927158 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa590003ef0 0x7fa5900047c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fa58c009ac0 tx=0x7fa5900057f0 comp rx=0 tx=0).stop 2023-12-11T17:10:49.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.454+0000 7fa5a3fff640 1 -- 172.21.15.37:0/4000927158 reap_dead start 2023-12-11T17:10:49.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.454+0000 7fa5a89f4640 1 -- 172.21.15.37:0/4000927158 shutdown_connections 2023-12-11T17:10:49.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.454+0000 7fa5a89f4640 1 -- 172.21.15.37:0/4000927158 >> 172.21.15.37:0/4000927158 conn(0x7fa5a406a640 msgr2=0x7fa5a406aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:49.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.454+0000 7fa5a89f4640 1 -- 172.21.15.37:0/4000927158 shutdown_connections 2023-12-11T17:10:49.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.454+0000 7fa5a89f4640 1 -- 172.21.15.37:0/4000927158 wait complete. 2023-12-11T17:10:49.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.457+0000 7fa5a89f4640 1 Processor -- start 2023-12-11T17:10:49.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.458+0000 7fa5a89f4640 1 -- start start 2023-12-11T17:10:49.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.459+0000 7fa5a89f4640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa590003ef0 0x7fa5a4153f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:49.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.459+0000 7fa5a89f4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5a40b3450 0x7fa5a40b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:49.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.459+0000 7fa5a89f4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5a4140550 0x7fa5a4159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:49.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.459+0000 7fa5a89f4640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a40b21a0 con 0x7fa5a4140550 2023-12-11T17:10:49.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.459+0000 7fa5a89f4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a40b38b0 con 0x7fa5a40b3450 2023-12-11T17:10:49.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.459+0000 7fa5a89f4640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5a40b23b0 con 0x7fa590003ef0 2023-12-11T17:10:49.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.460+0000 7fa5a3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5a4140550 0x7fa5a4159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:49.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.460+0000 7fa5a3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5a4140550 0x7fa5a4159ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60024/0 (socket says 172.21.15.37:60024) 2023-12-11T17:10:49.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.460+0000 7fa5a3fff640 1 -- 172.21.15.37:0/4220597327 learned_addr learned my addr 172.21.15.37:0/4220597327 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:49.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.460+0000 7fa5a37fe640 1 --2- 172.21.15.37:0/4220597327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa590003ef0 0x7fa5a4153f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:49.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.460+0000 7fa59bfff640 1 --2- 172.21.15.37:0/4220597327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5a40b3450 0x7fa5a40b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:49.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.460+0000 7fa5a3fff640 1 -- 172.21.15.37:0/4220597327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa590003ef0 msgr2=0x7fa5a4153f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:49.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.460+0000 7fa5a3fff640 1 --2- 172.21.15.37:0/4220597327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa590003ef0 0x7fa5a4153f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:49.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.460+0000 7fa5a3fff640 1 -- 172.21.15.37:0/4220597327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5a40b3450 msgr2=0x7fa5a40b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:49.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.460+0000 7fa5a3fff640 1 --2- 172.21.15.37:0/4220597327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5a40b3450 0x7fa5a40b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:49.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.460+0000 7fa5a3fff640 1 -- 172.21.15.37:0/4220597327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5a40b2690 con 0x7fa5a4140550 2023-12-11T17:10:49.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.460+0000 7fa59bfff640 1 --2- 172.21.15.37:0/4220597327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5a40b3450 0x7fa5a40b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:49.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.460+0000 7fa5a3fff640 1 --2- 172.21.15.37:0/4220597327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5a4140550 0x7fa5a4159ef0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa5a406e3c0 tx=0x7fa59c00f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:49.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.461+0000 7fa5a0ff9640 1 -- 172.21.15.37:0/4220597327 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c016620 con 0x7fa5a4140550 2023-12-11T17:10:49.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.461+0000 7fa5a0ff9640 1 -- 172.21.15.37:0/4220597327 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa59c0167a0 con 0x7fa5a4140550 2023-12-11T17:10:49.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.461+0000 7fa5a0ff9640 1 -- 172.21.15.37:0/4220597327 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa59c016b50 con 0x7fa5a4140550 2023-12-11T17:10:49.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.461+0000 7fa5a89f4640 1 -- 172.21.15.37:0/4220597327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5a40b2970 con 0x7fa5a4140550 2023-12-11T17:10:49.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.461+0000 7fa5a89f4640 1 -- 172.21.15.37:0/4220597327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5a40b2f30 con 0x7fa5a4140550 2023-12-11T17:10:49.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.462+0000 7fa5a89f4640 1 -- 172.21.15.37:0/4220597327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5a4074450 con 0x7fa5a4140550 2023-12-11T17:10:49.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.463+0000 7fa5a0ff9640 1 -- 172.21.15.37:0/4220597327 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa59c016cb0 con 0x7fa5a4140550 2023-12-11T17:10:49.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.464+0000 7fa5a0ff9640 1 --2- 172.21.15.37:0/4220597327 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa58406ae70 0x7fa58406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:49.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.465+0000 7fa5a0ff9640 1 -- 172.21.15.37:0/4220597327 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fa59c08a650 con 0x7fa5a4140550 2023-12-11T17:10:49.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.465+0000 7fa5a37fe640 1 --2- 172.21.15.37:0/4220597327 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa58406ae70 0x7fa58406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:49.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.466+0000 7fa5a37fe640 1 --2- 172.21.15.37:0/4220597327 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa58406ae70 0x7fa58406d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa5940018e0 tx=0x7fa594009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:49.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.469+0000 7fa5a0ff9640 1 -- 172.21.15.37:0/4220597327 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa59c055280 con 0x7fa5a4140550 2023-12-11T17:10:49.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.670+0000 7fa5a89f4640 1 -- 172.21.15.37:0/4220597327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa5a406d750 con 0x7fa5a4140550 2023-12-11T17:10:49.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.671+0000 7fa5a0ff9640 1 -- 172.21.15.37:0/4220597327 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa59c0588a0 con 0x7fa5a4140550 2023-12-11T17:10:49.671 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-11T17:10:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.674+0000 7fa5a89f4640 1 -- 172.21.15.37:0/4220597327 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa58406ae70 msgr2=0x7fa58406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.674+0000 7fa5a89f4640 1 --2- 172.21.15.37:0/4220597327 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa58406ae70 0x7fa58406d330 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fa5940018e0 tx=0x7fa594009040 comp rx=0 tx=0).stop 2023-12-11T17:10:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.674+0000 7fa5a89f4640 1 -- 172.21.15.37:0/4220597327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5a4140550 msgr2=0x7fa5a4159ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.674+0000 7fa5a89f4640 1 --2- 172.21.15.37:0/4220597327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5a4140550 0x7fa5a4159ef0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fa5a406e3c0 tx=0x7fa59c00f520 comp rx=0 tx=0).stop 2023-12-11T17:10:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.674+0000 7fa5a89f4640 1 -- 172.21.15.37:0/4220597327 shutdown_connections 2023-12-11T17:10:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.674+0000 7fa5a89f4640 1 --2- 172.21.15.37:0/4220597327 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa58406ae70 0x7fa58406d330 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.674+0000 7fa5a89f4640 1 --2- 172.21.15.37:0/4220597327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5a40b3450 0x7fa5a40b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.674+0000 7fa5a89f4640 1 --2- 172.21.15.37:0/4220597327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa5a4140550 0x7fa5a4159ef0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:49.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.674+0000 7fa5a89f4640 1 --2- 172.21.15.37:0/4220597327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa590003ef0 0x7fa5a4153f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:49.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.674+0000 7fa5a89f4640 1 -- 172.21.15.37:0/4220597327 >> 172.21.15.37:0/4220597327 conn(0x7fa5a406a640 msgr2=0x7fa5a415b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:49.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.674+0000 7fa5a89f4640 1 -- 172.21.15.37:0/4220597327 shutdown_connections 2023-12-11T17:10:49.675 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.674+0000 7fa5a89f4640 1 -- 172.21.15.37:0/4220597327 wait complete. 2023-12-11T17:10:49.692 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T17:10:49.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.896+0000 7f35b3848640 1 Processor -- start 2023-12-11T17:10:49.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.896+0000 7f35b3848640 1 -- start start 2023-12-11T17:10:49.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.898+0000 7f35b3848640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35ac06c690 0x7f35ac15cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:49.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.898+0000 7f35b3848640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f35ac0d0aa0 0x7f35ac15d080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:49.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.898+0000 7f35b3848640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35ac0ce280 con 0x7f35ac0cdea0 2023-12-11T17:10:49.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.898+0000 7f35b3848640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35ac0b09b0 con 0x7f35ac0d0aa0 2023-12-11T17:10:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.898+0000 7f35b3848640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac0d0090 con 0x7f35ac06c690 2023-12-11T17:10:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.899+0000 7f35b1de5640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f35ac0d0aa0 0x7f35ac15d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.899+0000 7f35b0de3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35ac06c690 0x7f35ac15cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.899+0000 7f35b1de5640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f35ac0d0aa0 0x7f35ac15d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:47512/0 (socket says 172.21.15.37:47512) 2023-12-11T17:10:49.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.899+0000 7f35b1de5640 1 -- 172.21.15.37:0/2624260083 learned_addr learned my addr 172.21.15.37:0/2624260083 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:49.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.900+0000 7f35b1de5640 1 -- 172.21.15.37:0/2624260083 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35ac06c690 msgr2=0x7f35ac15cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:49.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.900+0000 7f35b1de5640 1 --2- 172.21.15.37:0/2624260083 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35ac06c690 0x7f35ac15cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:49.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.900+0000 7f35b1de5640 1 -- 172.21.15.37:0/2624260083 >> v1:172.21.15.151:6789/0 conn(0x7f35ac0cdea0 legacy=0x7f35ac06bf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:49.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.900+0000 7f35b1de5640 1 -- 172.21.15.37:0/2624260083 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35ac0d0370 con 0x7f35ac0d0aa0 2023-12-11T17:10:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.901+0000 7f35b1de5640 1 --2- 172.21.15.37:0/2624260083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35ac0d0aa0 0x7f35ac15d080 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f35a4009e50 tx=0x7f35a402bee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c63bead5f699e14 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:49.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.902+0000 7f35a3fff640 1 -- 172.21.15.37:0/2624260083 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a402ca80 con 0x7f35ac0d0aa0 2023-12-11T17:10:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.902+0000 7f35a3fff640 1 -- 172.21.15.37:0/2624260083 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a402cbe0 con 0x7f35ac0d0aa0 2023-12-11T17:10:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.902+0000 7f35a3fff640 1 -- 172.21.15.37:0/2624260083 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a40343f0 con 0x7f35ac0d0aa0 2023-12-11T17:10:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.902+0000 7f35b3848640 1 -- 172.21.15.37:0/2624260083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35ac0d0aa0 msgr2=0x7f35ac15d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:49.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.902+0000 7f35b3848640 1 --2- 172.21.15.37:0/2624260083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35ac0d0aa0 0x7f35ac15d080 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f35a4009e50 tx=0x7f35a402bee0 comp rx=0 tx=0).stop 2023-12-11T17:10:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.903+0000 7f35b3848640 1 -- 172.21.15.37:0/2624260083 shutdown_connections 2023-12-11T17:10:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.903+0000 7f35b3848640 1 --2- 172.21.15.37:0/2624260083 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35ac0d0aa0 0x7f35ac15d080 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.903+0000 7f35b3848640 1 --2- 172.21.15.37:0/2624260083 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35ac06c690 0x7f35ac15cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.903+0000 7f35b3848640 1 -- 172.21.15.37:0/2624260083 >> 172.21.15.37:0/2624260083 conn(0x7f35ac0d0ed0 msgr2=0x7f35ac0d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.903+0000 7f35b3848640 1 -- 172.21.15.37:0/2624260083 shutdown_connections 2023-12-11T17:10:49.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.903+0000 7f35b3848640 1 -- 172.21.15.37:0/2624260083 wait complete. 2023-12-11T17:10:49.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.905+0000 7f35b3848640 1 Processor -- start 2023-12-11T17:10:49.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.905+0000 7f35b3848640 1 -- start start 2023-12-11T17:10:49.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.906+0000 7f35b3848640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35ac06c690 0x7f35ac14f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:49.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.906+0000 7f35b3848640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35ac0cdea0 0x7f35ac0c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:49.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.906+0000 7f35b3848640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35ac0d0aa0 0x7f35ac0c6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:49.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.906+0000 7f35b3848640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac14f990 con 0x7f35ac06c690 2023-12-11T17:10:49.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.906+0000 7f35b3848640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac15e7b0 con 0x7f35ac0cdea0 2023-12-11T17:10:49.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.906+0000 7f35b3848640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35ac15ea90 con 0x7f35ac0d0aa0 2023-12-11T17:10:49.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.906+0000 7f35b15e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35ac06c690 0x7f35ac14f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:49.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.906+0000 7f35b15e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35ac06c690 0x7f35ac14f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60034/0 (socket says 172.21.15.37:60034) 2023-12-11T17:10:49.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.906+0000 7f35b15e4640 1 -- 172.21.15.37:0/2062239574 learned_addr learned my addr 172.21.15.37:0/2062239574 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:49.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.907+0000 7f35b0de3640 1 --2- 172.21.15.37:0/2062239574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35ac0cdea0 0x7f35ac0c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:49.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.907+0000 7f35b1de5640 1 --2- 172.21.15.37:0/2062239574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35ac0d0aa0 0x7f35ac0c6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:49.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.907+0000 7f35b15e4640 1 -- 172.21.15.37:0/2062239574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35ac0d0aa0 msgr2=0x7f35ac0c6ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:49.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.907+0000 7f35b15e4640 1 --2- 172.21.15.37:0/2062239574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35ac0d0aa0 0x7f35ac0c6ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:49.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.907+0000 7f35b15e4640 1 -- 172.21.15.37:0/2062239574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35ac0cdea0 msgr2=0x7f35ac0c6990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:49.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.907+0000 7f35b15e4640 1 --2- 172.21.15.37:0/2062239574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35ac0cdea0 0x7f35ac0c6990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:49.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.907+0000 7f35b15e4640 1 -- 172.21.15.37:0/2062239574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35a4009b30 con 0x7f35ac06c690 2023-12-11T17:10:49.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.907+0000 7f35b15e4640 1 --2- 172.21.15.37:0/2062239574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35ac06c690 0x7f35ac14f450 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f35a800c450 tx=0x7f35a800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:49.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.907+0000 7f35a1ffb640 1 -- 172.21.15.37:0/2062239574 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a80052d0 con 0x7f35ac06c690 2023-12-11T17:10:49.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.907+0000 7f35a1ffb640 1 -- 172.21.15.37:0/2062239574 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35a8005430 con 0x7f35ac06c690 2023-12-11T17:10:49.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.907+0000 7f35a1ffb640 1 -- 172.21.15.37:0/2062239574 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35a8012870 con 0x7f35ac06c690 2023-12-11T17:10:49.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.907+0000 7f35b3848640 1 -- 172.21.15.37:0/2062239574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35ac15ed70 con 0x7f35ac06c690 2023-12-11T17:10:49.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.908+0000 7f35b3848640 1 -- 172.21.15.37:0/2062239574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35ac15f330 con 0x7f35ac06c690 2023-12-11T17:10:49.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.909+0000 7f35b3848640 1 -- 172.21.15.37:0/2062239574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35ac0745d0 con 0x7f35ac06c690 2023-12-11T17:10:49.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.910+0000 7f35a1ffb640 1 -- 172.21.15.37:0/2062239574 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f35a80129d0 con 0x7f35ac06c690 2023-12-11T17:10:49.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.911+0000 7f35a1ffb640 1 --2- 172.21.15.37:0/2062239574 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f359006ae40 0x7f359006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:49.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.911+0000 7f35a1ffb640 1 -- 172.21.15.37:0/2062239574 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f35a80895c0 con 0x7f35ac06c690 2023-12-11T17:10:49.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.912+0000 7f35b0de3640 1 --2- 172.21.15.37:0/2062239574 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f359006ae40 0x7f359006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:49.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.913+0000 7f35b0de3640 1 --2- 172.21.15.37:0/2062239574 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f359006ae40 0x7f359006d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f35ac1530e0 tx=0x7f359c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:49.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:49.915+0000 7f35a1ffb640 1 -- 172.21.15.37:0/2062239574 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f35a80541f0 con 0x7f35ac06c690 2023-12-11T17:10:50.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.105+0000 7f35b3848640 1 -- 172.21.15.37:0/2062239574 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f35ac15f550 con 0x7f35ac06c690 2023-12-11T17:10:50.105 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.106+0000 7f35a1ffb640 1 -- 172.21.15.37:0/2062239574 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f35a8057810 con 0x7f35ac06c690 2023-12-11T17:10:50.106 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:10:50.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.108+0000 7f35b3848640 1 -- 172.21.15.37:0/2062239574 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f359006ae40 msgr2=0x7f359006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:50.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.108+0000 7f35b3848640 1 --2- 172.21.15.37:0/2062239574 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f359006ae40 0x7f359006d300 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f35ac1530e0 tx=0x7f359c008040 comp rx=0 tx=0).stop 2023-12-11T17:10:50.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.109+0000 7f35b3848640 1 -- 172.21.15.37:0/2062239574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35ac06c690 msgr2=0x7f35ac14f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:50.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.109+0000 7f35b3848640 1 --2- 172.21.15.37:0/2062239574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35ac06c690 0x7f35ac14f450 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f35a800c450 tx=0x7f35a800c910 comp rx=0 tx=0).stop 2023-12-11T17:10:50.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.109+0000 7f35b3848640 1 -- 172.21.15.37:0/2062239574 shutdown_connections 2023-12-11T17:10:50.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.109+0000 7f35b3848640 1 --2- 172.21.15.37:0/2062239574 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f359006ae40 0x7f359006d300 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.109+0000 7f35b3848640 1 --2- 172.21.15.37:0/2062239574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35ac0cdea0 0x7f35ac0c6990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.109+0000 7f35b3848640 1 --2- 172.21.15.37:0/2062239574 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f35ac0d0aa0 0x7f35ac0c6ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.109 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.109+0000 7f35b3848640 1 --2- 172.21.15.37:0/2062239574 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f35ac06c690 0x7f35ac14f450 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.109+0000 7f35b3848640 1 -- 172.21.15.37:0/2062239574 >> 172.21.15.37:0/2062239574 conn(0x7f35ac0d0ed0 msgr2=0x7f35ac0d12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:50.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.109+0000 7f35b3848640 1 -- 172.21.15.37:0/2062239574 shutdown_connections 2023-12-11T17:10:50.110 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.109+0000 7f35b3848640 1 -- 172.21.15.37:0/2062239574 wait complete. 2023-12-11T17:10:50.127 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T17:10:50.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.324+0000 7fee27fff640 1 Processor -- start 2023-12-11T17:10:50.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.324+0000 7fee27fff640 1 -- start start 2023-12-11T17:10:50.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.325+0000 7fee27fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee280b3730 0x7fee280cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:50.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.325+0000 7fee27fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fee280cfca0 0x7fee280cdef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:50.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.325+0000 7fee27fff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee280c6b80 con 0x7fee280b3350 2023-12-11T17:10:50.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.325+0000 7fee27fff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee280d0110 con 0x7fee280cfca0 2023-12-11T17:10:50.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.325+0000 7fee27fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee280d3bf0 con 0x7fee280b3730 2023-12-11T17:10:50.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.326+0000 7fee277fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fee280cfca0 0x7fee280cdef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:50.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.326+0000 7fee26ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fee280b3350 0x7fee280b3ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56462/0 (socket says 172.21.15.37:56462) 2023-12-11T17:10:50.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.326+0000 7fee26ffd640 1 -- 172.21.15.37:0/1620650622 learned_addr learned my addr 172.21.15.37:0/1620650622 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:50.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.326+0000 7fee267fc640 1 --2- 172.21.15.37:0/1620650622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee280b3730 0x7fee280cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:50.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.326+0000 7fee25ffb640 1 -- 172.21.15.37:0/1620650622 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 952076595 0 0) 0x7fee280c6b80 con 0x7fee280b3350 2023-12-11T17:10:50.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.326+0000 7fee277fe640 1 -- 172.21.15.37:0/1620650622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee280b3730 msgr2=0x7fee280cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:50.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.326+0000 7fee277fe640 1 --2- 172.21.15.37:0/1620650622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee280b3730 0x7fee280cf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.326+0000 7fee277fe640 1 -- 172.21.15.37:0/1620650622 >> v1:172.21.15.37:6789/0 conn(0x7fee280b3350 legacy=0x7fee280b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:50.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.326+0000 7fee277fe640 1 -- 172.21.15.37:0/1620650622 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee280d3ed0 con 0x7fee280cfca0 2023-12-11T17:10:50.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.328+0000 7fee277fe640 1 --2- 172.21.15.37:0/1620650622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee280cfca0 0x7fee280cdef0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fee200097a0 tx=0x7fee2002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5492c3838c7a2bdc server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:50.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.328+0000 7fee25ffb640 1 -- 172.21.15.37:0/1620650622 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee20031830 con 0x7fee280cfca0 2023-12-11T17:10:50.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.328+0000 7fee25ffb640 1 -- 172.21.15.37:0/1620650622 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee20031990 con 0x7fee280cfca0 2023-12-11T17:10:50.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.328+0000 7fee25ffb640 1 -- 172.21.15.37:0/1620650622 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee20031d20 con 0x7fee280cfca0 2023-12-11T17:10:50.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.329+0000 7fee27fff640 1 -- 172.21.15.37:0/1620650622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee280cfca0 msgr2=0x7fee280cdef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:50.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.329+0000 7fee27fff640 1 --2- 172.21.15.37:0/1620650622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee280cfca0 0x7fee280cdef0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fee200097a0 tx=0x7fee2002b8d0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.329+0000 7fee27fff640 1 -- 172.21.15.37:0/1620650622 shutdown_connections 2023-12-11T17:10:50.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.329+0000 7fee27fff640 1 --2- 172.21.15.37:0/1620650622 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee280cfca0 0x7fee280cdef0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.329+0000 7fee27fff640 1 --2- 172.21.15.37:0/1620650622 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee280b3730 0x7fee280cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.329+0000 7fee27fff640 1 -- 172.21.15.37:0/1620650622 >> 172.21.15.37:0/1620650622 conn(0x7fee280d3030 msgr2=0x7fee280d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:50.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.329+0000 7fee27fff640 1 -- 172.21.15.37:0/1620650622 shutdown_connections 2023-12-11T17:10:50.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.329+0000 7fee27fff640 1 -- 172.21.15.37:0/1620650622 wait complete. 2023-12-11T17:10:50.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.331+0000 7fee27fff640 1 Processor -- start 2023-12-11T17:10:50.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.331+0000 7fee27fff640 1 -- start start 2023-12-11T17:10:50.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.332+0000 7fee27fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee280b3350 0x7fee280b8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:50.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.332+0000 7fee27fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee280b3730 0x7fee280cc010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:50.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.332+0000 7fee27fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee280cfca0 0x7fee280cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:50.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.332+0000 7fee27fff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee280b7d60 con 0x7fee280cfca0 2023-12-11T17:10:50.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.332+0000 7fee27fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee280b70e0 con 0x7fee280b3350 2023-12-11T17:10:50.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.332+0000 7fee27fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee280b73c0 con 0x7fee280b3730 2023-12-11T17:10:50.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.332+0000 7fee277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee280cfca0 0x7fee280cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:50.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.332+0000 7fee277fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee280cfca0 0x7fee280cc550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60054/0 (socket says 172.21.15.37:60054) 2023-12-11T17:10:50.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.332+0000 7fee277fe640 1 -- 172.21.15.37:0/4217406758 learned_addr learned my addr 172.21.15.37:0/4217406758 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:50.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.332+0000 7fee26ffd640 1 --2- 172.21.15.37:0/4217406758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee280b3350 0x7fee280b8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:50.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.332+0000 7fee267fc640 1 --2- 172.21.15.37:0/4217406758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee280b3730 0x7fee280cc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:50.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.333+0000 7fee277fe640 1 -- 172.21.15.37:0/4217406758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee280b3730 msgr2=0x7fee280cc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:50.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.333+0000 7fee277fe640 1 --2- 172.21.15.37:0/4217406758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee280b3730 0x7fee280cc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.333+0000 7fee277fe640 1 -- 172.21.15.37:0/4217406758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee280b3350 msgr2=0x7fee280b8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:50.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.333+0000 7fee277fe640 1 --2- 172.21.15.37:0/4217406758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee280b3350 0x7fee280b8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.333+0000 7fee277fe640 1 -- 172.21.15.37:0/4217406758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee20009400 con 0x7fee280cfca0 2023-12-11T17:10:50.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.333+0000 7fee277fe640 1 --2- 172.21.15.37:0/4217406758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee280cfca0 0x7fee280cc550 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fee200098c0 tx=0x7fee200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:50.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.333+0000 7fee1f7fe640 1 -- 172.21.15.37:0/4217406758 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2003b970 con 0x7fee280cfca0 2023-12-11T17:10:50.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.333+0000 7fee1f7fe640 1 -- 172.21.15.37:0/4217406758 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2003bad0 con 0x7fee280cfca0 2023-12-11T17:10:50.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.333+0000 7fee27fff640 1 -- 172.21.15.37:0/4217406758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee280b76a0 con 0x7fee280cfca0 2023-12-11T17:10:50.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.333+0000 7fee1f7fe640 1 -- 172.21.15.37:0/4217406758 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2003be80 con 0x7fee280cfca0 2023-12-11T17:10:50.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.334+0000 7fee27fff640 1 -- 172.21.15.37:0/4217406758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee280b6d90 con 0x7fee280cfca0 2023-12-11T17:10:50.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.335+0000 7fee27fff640 1 -- 172.21.15.37:0/4217406758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee28074450 con 0x7fee280cfca0 2023-12-11T17:10:50.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.336+0000 7fee1f7fe640 1 -- 172.21.15.37:0/4217406758 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fee200453f0 con 0x7fee280cfca0 2023-12-11T17:10:50.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.337+0000 7fee1f7fe640 1 --2- 172.21.15.37:0/4217406758 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fee0806ae70 0x7fee0806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:50.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.337+0000 7fee1f7fe640 1 -- 172.21.15.37:0/4217406758 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fee200abcd0 con 0x7fee280cfca0 2023-12-11T17:10:50.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.338+0000 7fee26ffd640 1 --2- 172.21.15.37:0/4217406758 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fee0806ae70 0x7fee0806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:50.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.339+0000 7fee26ffd640 1 --2- 172.21.15.37:0/4217406758 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fee0806ae70 0x7fee0806d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fee18007ed0 tx=0x7fee18007e60 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:50.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.342+0000 7fee1f7fe640 1 -- 172.21.15.37:0/4217406758 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fee20076a20 con 0x7fee280cfca0 2023-12-11T17:10:50.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.530+0000 7fee27fff640 1 -- 172.21.15.37:0/4217406758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fee280c9990 con 0x7fee280cfca0 2023-12-11T17:10:50.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.531+0000 7fee1f7fe640 1 -- 172.21.15.37:0/4217406758 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7fee20035070 con 0x7fee280cfca0 2023-12-11T17:10:50.531 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-11T17:10:50.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.533+0000 7fee27fff640 1 -- 172.21.15.37:0/4217406758 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fee0806ae70 msgr2=0x7fee0806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:50.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.533+0000 7fee27fff640 1 --2- 172.21.15.37:0/4217406758 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fee0806ae70 0x7fee0806d330 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fee18007ed0 tx=0x7fee18007e60 comp rx=0 tx=0).stop 2023-12-11T17:10:50.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.533+0000 7fee27fff640 1 -- 172.21.15.37:0/4217406758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee280cfca0 msgr2=0x7fee280cc550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:50.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.533+0000 7fee27fff640 1 --2- 172.21.15.37:0/4217406758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee280cfca0 0x7fee280cc550 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fee200098c0 tx=0x7fee200046c0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.534+0000 7fee27fff640 1 -- 172.21.15.37:0/4217406758 shutdown_connections 2023-12-11T17:10:50.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.534+0000 7fee27fff640 1 --2- 172.21.15.37:0/4217406758 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fee0806ae70 0x7fee0806d330 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.534+0000 7fee27fff640 1 --2- 172.21.15.37:0/4217406758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fee280cfca0 0x7fee280cc550 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.534 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.534+0000 7fee27fff640 1 --2- 172.21.15.37:0/4217406758 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fee280b3730 0x7fee280cc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.534+0000 7fee27fff640 1 --2- 172.21.15.37:0/4217406758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fee280b3350 0x7fee280b8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.534+0000 7fee27fff640 1 -- 172.21.15.37:0/4217406758 >> 172.21.15.37:0/4217406758 conn(0x7fee280d3030 msgr2=0x7fee280d3410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:50.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.534+0000 7fee27fff640 1 -- 172.21.15.37:0/4217406758 shutdown_connections 2023-12-11T17:10:50.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.534+0000 7fee27fff640 1 -- 172.21.15.37:0/4217406758 wait complete. 2023-12-11T17:10:50.550 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-11T17:10:50.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.761+0000 7f1d31c52640 1 Processor -- start 2023-12-11T17:10:50.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.761+0000 7f1d31c52640 1 -- start start 2023-12-11T17:10:50.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.762+0000 7f1d31c52640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1d2c15d360 0x7f1d2c0d3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:50.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.762+0000 7f1d31c52640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1d2c0d1c40 0x7f1d2c0b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:50.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.762+0000 7f1d31c52640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2c0cdf20 con 0x7f1d2c0cece0 2023-12-11T17:10:50.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.762+0000 7f1d31c52640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d2c0ce200 con 0x7f1d2c0d1c40 2023-12-11T17:10:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.762+0000 7f1d31c52640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d2c0ce4e0 con 0x7f1d2c15d360 2023-12-11T17:10:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.763+0000 7f1d31451640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1d2c0d1c40 0x7f1d2c0b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.763+0000 7f1d31451640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1d2c0d1c40 0x7f1d2c0b28b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60058/0 (socket says 172.21.15.37:60058) 2023-12-11T17:10:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.763+0000 7f1d31451640 1 -- 172.21.15.37:0/547114062 learned_addr learned my addr 172.21.15.37:0/547114062 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.763+0000 7f1d30c50640 1 --2- 172.21.15.37:0/547114062 >> v2:172.21.15.151:3300/0 conn(0x7f1d2c15d360 0x7f1d2c0d3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.763+0000 7f1d31451640 1 -- 172.21.15.37:0/547114062 >> v2:172.21.15.151:3300/0 conn(0x7f1d2c15d360 msgr2=0x7f1d2c0d3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:50.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.763+0000 7f1d31451640 1 --2- 172.21.15.37:0/547114062 >> v2:172.21.15.151:3300/0 conn(0x7f1d2c15d360 0x7f1d2c0d3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.763+0000 7f1d31451640 1 -- 172.21.15.37:0/547114062 >> v1:172.21.15.37:6789/0 conn(0x7f1d2c0cece0 legacy=0x7f1d2c0d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.763+0000 7f1d2b7fe640 1 -- 172.21.15.37:0/547114062 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3162434235 0 0) 0x7f1d2c0cdf20 con 0x7f1d2c0cece0 2023-12-11T17:10:50.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.764+0000 7f1d31451640 1 -- 172.21.15.37:0/547114062 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2c0ce7c0 con 0x7f1d2c0d1c40 2023-12-11T17:10:50.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.766+0000 7f1d31451640 1 --2- 172.21.15.37:0/547114062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2c0d1c40 0x7f1d2c0b28b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0d2eb0 tx=0x7f1d2402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=718a814332306313 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:50.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.766+0000 7f1d2b7fe640 1 -- 172.21.15.37:0/547114062 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2402cbb0 con 0x7f1d2c0d1c40 2023-12-11T17:10:50.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.766+0000 7f1d2b7fe640 1 -- 172.21.15.37:0/547114062 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2402cd10 con 0x7f1d2c0d1c40 2023-12-11T17:10:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.766+0000 7f1d2b7fe640 1 -- 172.21.15.37:0/547114062 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d24034610 con 0x7f1d2c0d1c40 2023-12-11T17:10:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.767+0000 7f1d31c52640 1 -- 172.21.15.37:0/547114062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2c0d1c40 msgr2=0x7f1d2c0b28b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.767+0000 7f1d31c52640 1 --2- 172.21.15.37:0/547114062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2c0d1c40 0x7f1d2c0b28b0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0d2eb0 tx=0x7f1d2402c010 comp rx=0 tx=0).stop 2023-12-11T17:10:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.767+0000 7f1d31c52640 1 -- 172.21.15.37:0/547114062 shutdown_connections 2023-12-11T17:10:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.767+0000 7f1d31c52640 1 --2- 172.21.15.37:0/547114062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2c0d1c40 0x7f1d2c0b28b0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.767+0000 7f1d31c52640 1 --2- 172.21.15.37:0/547114062 >> v2:172.21.15.151:3300/0 conn(0x7f1d2c15d360 0x7f1d2c0d3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.767+0000 7f1d31c52640 1 -- 172.21.15.37:0/547114062 >> 172.21.15.37:0/547114062 conn(0x7f1d2c09c230 msgr2=0x7f1d2c0d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:50.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.767+0000 7f1d31c52640 1 -- 172.21.15.37:0/547114062 shutdown_connections 2023-12-11T17:10:50.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.767+0000 7f1d31c52640 1 -- 172.21.15.37:0/547114062 wait complete. 2023-12-11T17:10:50.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.769+0000 7f1d31c52640 1 Processor -- start 2023-12-11T17:10:50.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.769+0000 7f1d31c52640 1 -- start start 2023-12-11T17:10:50.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.770+0000 7f1d31c52640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2c0cece0 0x7f1d2c15f9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:50.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.770+0000 7f1d31c52640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d2c0d1c40 0x7f1d2c0b88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:50.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.770+0000 7f1d31c52640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d2c15d360 0x7f1d2c0ca020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:50.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.770+0000 7f1d31c52640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c0cd3e0 con 0x7f1d2c0cece0 2023-12-11T17:10:50.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.770+0000 7f1d31c52640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c15f540 con 0x7f1d2c0d1c40 2023-12-11T17:10:50.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.770+0000 7f1d31c52640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c0b8e20 con 0x7f1d2c15d360 2023-12-11T17:10:50.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.770+0000 7f1d30c50640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2c0cece0 0x7f1d2c15f9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:50.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.770+0000 7f1d30c50640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2c0cece0 0x7f1d2c15f9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60068/0 (socket says 172.21.15.37:60068) 2023-12-11T17:10:50.777 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.770+0000 7f1d30c50640 1 -- 172.21.15.37:0/3352890815 learned_addr learned my addr 172.21.15.37:0/3352890815 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:50.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.770+0000 7f1d2bfff640 1 --2- 172.21.15.37:0/3352890815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d2c0d1c40 0x7f1d2c0b88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:50.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.770+0000 7f1d31451640 1 --2- 172.21.15.37:0/3352890815 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d2c15d360 0x7f1d2c0ca020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:50.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.770+0000 7f1d30c50640 1 -- 172.21.15.37:0/3352890815 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d2c15d360 msgr2=0x7f1d2c0ca020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:50.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.771+0000 7f1d30c50640 1 --2- 172.21.15.37:0/3352890815 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d2c15d360 0x7f1d2c0ca020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.778 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.771+0000 7f1d30c50640 1 -- 172.21.15.37:0/3352890815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d2c0d1c40 msgr2=0x7f1d2c0b88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:50.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.771+0000 7f1d30c50640 1 --2- 172.21.15.37:0/3352890815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d2c0d1c40 0x7f1d2c0b88e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.771+0000 7f1d30c50640 1 -- 172.21.15.37:0/3352890815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d24009b30 con 0x7f1d2c0cece0 2023-12-11T17:10:50.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.771+0000 7f1d31451640 1 --2- 172.21.15.37:0/3352890815 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d2c15d360 0x7f1d2c0ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:50.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.771+0000 7f1d30c50640 1 --2- 172.21.15.37:0/3352890815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2c0cece0 0x7f1d2c15f9d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1d2000d830 tx=0x7f1d2000dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:50.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.771+0000 7f1d297fa640 1 -- 172.21.15.37:0/3352890815 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2000b6c0 con 0x7f1d2c0cece0 2023-12-11T17:10:50.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.771+0000 7f1d297fa640 1 -- 172.21.15.37:0/3352890815 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2000b820 con 0x7f1d2c0cece0 2023-12-11T17:10:50.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.771+0000 7f1d297fa640 1 -- 172.21.15.37:0/3352890815 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2000bbb0 con 0x7f1d2c0cece0 2023-12-11T17:10:50.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.771+0000 7f1d31c52640 1 -- 172.21.15.37:0/3352890815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2c0cd100 con 0x7f1d2c0cece0 2023-12-11T17:10:50.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.771+0000 7f1d31c52640 1 -- 172.21.15.37:0/3352890815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2c15f1d0 con 0x7f1d2c0cece0 2023-12-11T17:10:50.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.772+0000 7f1d31c52640 1 -- 172.21.15.37:0/3352890815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d2c0678e0 con 0x7f1d2c0cece0 2023-12-11T17:10:50.780 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.774+0000 7f1d297fa640 1 -- 172.21.15.37:0/3352890815 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1d2001e460 con 0x7f1d2c0cece0 2023-12-11T17:10:50.781 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.774+0000 7f1d297fa640 1 --2- 172.21.15.37:0/3352890815 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1d1806ae40 0x7f1d1806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:50.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.775+0000 7f1d297fa640 1 -- 172.21.15.37:0/3352890815 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f1d2008a0e0 con 0x7f1d2c0cece0 2023-12-11T17:10:50.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.775+0000 7f1d2bfff640 1 --2- 172.21.15.37:0/3352890815 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1d1806ae40 0x7f1d1806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:50.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.776+0000 7f1d2bfff640 1 --2- 172.21.15.37:0/3352890815 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1d1806ae40 0x7f1d1806d300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c007fd0 tx=0x7f1d1c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:50.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.779+0000 7f1d297fa640 1 -- 172.21.15.37:0/3352890815 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1d20054e40 con 0x7f1d2c0cece0 2023-12-11T17:10:50.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.964+0000 7f1d31c52640 1 -- 172.21.15.37:0/3352890815 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f1d2c0d2250 con 0x7f1d2c0cece0 2023-12-11T17:10:50.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.965+0000 7f1d297fa640 1 -- 172.21.15.37:0/3352890815 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f1d20058460 con 0x7f1d2c0cece0 2023-12-11T17:10:50.965 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:10:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.967+0000 7f1d31c52640 1 -- 172.21.15.37:0/3352890815 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1d1806ae40 msgr2=0x7f1d1806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.967+0000 7f1d31c52640 1 --2- 172.21.15.37:0/3352890815 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1d1806ae40 0x7f1d1806d300 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c007fd0 tx=0x7f1d1c009040 comp rx=0 tx=0).stop 2023-12-11T17:10:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.967+0000 7f1d31c52640 1 -- 172.21.15.37:0/3352890815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2c0cece0 msgr2=0x7f1d2c15f9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.967+0000 7f1d31c52640 1 --2- 172.21.15.37:0/3352890815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2c0cece0 0x7f1d2c15f9d0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1d2000d830 tx=0x7f1d2000dcf0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.967+0000 7f1d31c52640 1 -- 172.21.15.37:0/3352890815 shutdown_connections 2023-12-11T17:10:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.967+0000 7f1d31c52640 1 --2- 172.21.15.37:0/3352890815 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1d1806ae40 0x7f1d1806d300 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.967+0000 7f1d31c52640 1 --2- 172.21.15.37:0/3352890815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d2c0d1c40 0x7f1d2c0b88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.967+0000 7f1d31c52640 1 --2- 172.21.15.37:0/3352890815 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d2c15d360 0x7f1d2c0ca020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.967+0000 7f1d31c52640 1 --2- 172.21.15.37:0/3352890815 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2c0cece0 0x7f1d2c15f9d0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:50.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.967+0000 7f1d31c52640 1 -- 172.21.15.37:0/3352890815 >> 172.21.15.37:0/3352890815 conn(0x7f1d2c09c230 msgr2=0x7f1d2c0b0d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:50.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.968+0000 7f1d31c52640 1 -- 172.21.15.37:0/3352890815 shutdown_connections 2023-12-11T17:10:50.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:50.968+0000 7f1d31c52640 1 -- 172.21.15.37:0/3352890815 wait complete. 2023-12-11T17:10:51.014 INFO:tasks.cephfs_test_runner:Starting test: test_generic (tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev) 2023-12-11T17:10:51.014 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:10:51.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.241+0000 7f301dfff640 1 Processor -- start 2023-12-11T17:10:51.242 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.242+0000 7f301dfff640 1 -- start start 2023-12-11T17:10:51.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.243+0000 7f301dfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f301815d150 0x7f3018071ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:51.243 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.243+0000 7f301dfff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f301806dd00 0x7f3018070070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:51.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.243+0000 7f301dfff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30180abd20 con 0x7f30180705b0 2023-12-11T17:10:51.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.243+0000 7f301dfff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3018070a40 con 0x7f301806dd00 2023-12-11T17:10:51.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.243+0000 7f301dfff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301815d530 con 0x7f301815d150 2023-12-11T17:10:51.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.244+0000 7f301d7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f30180705b0 0x7f3018160cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56474/0 (socket says 172.21.15.37:56474) 2023-12-11T17:10:51.244 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.244+0000 7f301d7fe640 1 -- 172.21.15.37:0/2617519546 learned_addr learned my addr 172.21.15.37:0/2617519546 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:51.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.244+0000 7f3017fff640 1 --2- 172.21.15.37:0/2617519546 >> v2:172.21.15.151:3300/0 conn(0x7f301806dd00 0x7f3018070070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:51.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.244+0000 7f301cffd640 1 --2- 172.21.15.37:0/2617519546 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f301815d150 0x7f3018071ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:51.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.244+0000 7f30177fe640 1 -- 172.21.15.37:0/2617519546 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2022578985 0 0) 0x7f30180abd20 con 0x7f30180705b0 2023-12-11T17:10:51.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.244+0000 7f30177fe640 1 -- 172.21.15.37:0/2617519546 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3008003520 con 0x7f30180705b0 2023-12-11T17:10:51.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.245+0000 7f30177fe640 1 -- 172.21.15.37:0/2617519546 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1140354829 0 0) 0x7f3008003520 con 0x7f30180705b0 2023-12-11T17:10:51.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.245+0000 7f30177fe640 1 -- 172.21.15.37:0/2617519546 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f301815d150 msgr2=0x7f3018071ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:51.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.245+0000 7f30177fe640 1 --2- 172.21.15.37:0/2617519546 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f301815d150 0x7f3018071ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:51.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.245+0000 7f30177fe640 1 -- 172.21.15.37:0/2617519546 >> v2:172.21.15.151:3300/0 conn(0x7f301806dd00 msgr2=0x7f3018070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:51.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.245+0000 7f30177fe640 1 --2- 172.21.15.37:0/2617519546 >> v2:172.21.15.151:3300/0 conn(0x7f301806dd00 0x7f3018070070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:51.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.245+0000 7f30177fe640 1 -- 172.21.15.37:0/2617519546 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30180b2950 con 0x7f30180705b0 2023-12-11T17:10:51.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.245+0000 7f30177fe640 1 -- 172.21.15.37:0/2617519546 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f30100019f0 con 0x7f30180705b0 2023-12-11T17:10:51.246 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.245+0000 7f30177fe640 1 -- 172.21.15.37:0/2617519546 >> v1:172.21.15.37:6789/0 conn(0x7f30180705b0 legacy=0x7f3018160cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.245+0000 7f30177fe640 1 --2- 172.21.15.37:0/2617519546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3008003970 0x7f3008003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.245+0000 7f30177fe640 1 --2- 172.21.15.37:0/2617519546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30080047c0 0x7f3008004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.245+0000 7f30177fe640 1 --2- 172.21.15.37:0/2617519546 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f301815d150 0x7f3008005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.245+0000 7f30177fe640 1 -- 172.21.15.37:0/2617519546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3018070a40 con 0x7f3008003970 2023-12-11T17:10:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.245+0000 7f30177fe640 1 -- 172.21.15.37:0/2617519546 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301815d530 con 0x7f30080047c0 2023-12-11T17:10:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.245+0000 7f30177fe640 1 -- 172.21.15.37:0/2617519546 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f300800b980 con 0x7f301815d150 2023-12-11T17:10:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.245+0000 7f301cffd640 1 --2- 172.21.15.37:0/2617519546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3008003970 0x7f3008003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.246+0000 7f301d7fe640 1 --2- 172.21.15.37:0/2617519546 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f301815d150 0x7f3008005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.246+0000 7f301cffd640 1 -- 172.21.15.37:0/2617519546 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f301815d150 msgr2=0x7f3008005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.246+0000 7f301cffd640 1 --2- 172.21.15.37:0/2617519546 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f301815d150 0x7f3008005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.246+0000 7f301cffd640 1 -- 172.21.15.37:0/2617519546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30080047c0 msgr2=0x7f3008004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.246+0000 7f3017fff640 1 --2- 172.21.15.37:0/2617519546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30080047c0 0x7f3008004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.246+0000 7f301cffd640 1 --2- 172.21.15.37:0/2617519546 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f30080047c0 0x7f3008004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:51.247 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.246+0000 7f301cffd640 1 -- 172.21.15.37:0/2617519546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3008003520 con 0x7f3008003970 2023-12-11T17:10:51.248 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.246+0000 7f301d7fe640 1 --2- 172.21.15.37:0/2617519546 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f301815d150 0x7f3008005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.247+0000 7f301cffd640 1 --2- 172.21.15.37:0/2617519546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3008003970 0x7f3008003d90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f300c009ac0 tx=0x7f30080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384cba5d098c32ee server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.247+0000 7f30177fe640 1 -- 172.21.15.37:0/2617519546 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c02c6b0 con 0x7f3008003970 2023-12-11T17:10:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.247+0000 7f30177fe640 1 -- 172.21.15.37:0/2617519546 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300c02c810 con 0x7f3008003970 2023-12-11T17:10:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.247+0000 7f30177fe640 1 -- 172.21.15.37:0/2617519546 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300c02cba0 con 0x7f3008003970 2023-12-11T17:10:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.248+0000 7f301dfff640 1 -- 172.21.15.37:0/2617519546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3008003970 msgr2=0x7f3008003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.248+0000 7f301dfff640 1 --2- 172.21.15.37:0/2617519546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3008003970 0x7f3008003d90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f300c009ac0 tx=0x7f30080057f0 comp rx=0 tx=0).stop 2023-12-11T17:10:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.248+0000 7f301d7fe640 1 -- 172.21.15.37:0/2617519546 reap_dead start 2023-12-11T17:10:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.248+0000 7f301dfff640 1 -- 172.21.15.37:0/2617519546 shutdown_connections 2023-12-11T17:10:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.248+0000 7f301dfff640 1 -- 172.21.15.37:0/2617519546 >> 172.21.15.37:0/2617519546 conn(0x7f30180b0860 msgr2=0x7f30180b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.248+0000 7f301dfff640 1 -- 172.21.15.37:0/2617519546 shutdown_connections 2023-12-11T17:10:51.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.248+0000 7f301dfff640 1 -- 172.21.15.37:0/2617519546 wait complete. 2023-12-11T17:10:51.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.250+0000 7f301dfff640 1 Processor -- start 2023-12-11T17:10:51.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.250+0000 7f301dfff640 1 -- start start 2023-12-11T17:10:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.251+0000 7f301dfff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3008003970 0x7f301809c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.251+0000 7f301dfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3018152b20 0x7f3018145460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:51.251 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.251+0000 7f301dfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f301815c220 0x7f301806cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:51.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.251+0000 7f301dfff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301815af30 con 0x7f3018152b20 2023-12-11T17:10:51.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.251+0000 7f301dfff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f301815b180 con 0x7f301815c220 2023-12-11T17:10:51.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.251+0000 7f301dfff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f301815b460 con 0x7f3008003970 2023-12-11T17:10:51.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.251+0000 7f3017fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3018152b20 0x7f3018145460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:51.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.251+0000 7f3017fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3018152b20 0x7f3018145460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60086/0 (socket says 172.21.15.37:60086) 2023-12-11T17:10:51.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.251+0000 7f3017fff640 1 -- 172.21.15.37:0/3522541335 learned_addr learned my addr 172.21.15.37:0/3522541335 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:51.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.252+0000 7f3017fff640 1 -- 172.21.15.37:0/3522541335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3008003970 msgr2=0x7f301809c8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:51.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.252+0000 7f3017fff640 1 --2- 172.21.15.37:0/3522541335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3008003970 0x7f301809c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:51.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.252+0000 7f3017fff640 1 -- 172.21.15.37:0/3522541335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f301815c220 msgr2=0x7f301806cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:51.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.252+0000 7f3017fff640 1 --2- 172.21.15.37:0/3522541335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f301815c220 0x7f301806cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:51.252 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.252+0000 7f3017fff640 1 -- 172.21.15.37:0/3522541335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f301815b740 con 0x7f3018152b20 2023-12-11T17:10:51.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.252+0000 7f3017fff640 1 --2- 172.21.15.37:0/3522541335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3018152b20 0x7f3018145460 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3004010890 tx=0x7f3004010d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:51.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.252+0000 7f30157fa640 1 -- 172.21.15.37:0/3522541335 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3004009630 con 0x7f3018152b20 2023-12-11T17:10:51.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.252+0000 7f30157fa640 1 -- 172.21.15.37:0/3522541335 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f300400eb60 con 0x7f3018152b20 2023-12-11T17:10:51.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.252+0000 7f30157fa640 1 -- 172.21.15.37:0/3522541335 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300401c400 con 0x7f3018152b20 2023-12-11T17:10:51.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.252+0000 7f301dfff640 1 -- 172.21.15.37:0/3522541335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f301815ba20 con 0x7f3018152b20 2023-12-11T17:10:51.253 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.252+0000 7f301dfff640 1 -- 172.21.15.37:0/3522541335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f301809ce30 con 0x7f3018152b20 2023-12-11T17:10:51.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.254+0000 7f301dfff640 1 -- 172.21.15.37:0/3522541335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3018074450 con 0x7f3018152b20 2023-12-11T17:10:51.254 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.254+0000 7f30157fa640 1 -- 172.21.15.37:0/3522541335 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f300401c560 con 0x7f3018152b20 2023-12-11T17:10:51.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.255+0000 7f30157fa640 1 --2- 172.21.15.37:0/3522541335 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f2ffc06ae40 0x7f2ffc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:51.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.255+0000 7f30157fa640 1 -- 172.21.15.37:0/3522541335 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3004089eb0 con 0x7f3018152b20 2023-12-11T17:10:51.256 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.256+0000 7f301cffd640 1 --2- 172.21.15.37:0/3522541335 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f2ffc06ae40 0x7f2ffc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:51.257 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.257+0000 7f301cffd640 1 --2- 172.21.15.37:0/3522541335 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f2ffc06ae40 0x7f2ffc06d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f300c036000 tx=0x7f300c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:51.259 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.260+0000 7f30157fa640 1 -- 172.21.15.37:0/3522541335 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3004054cc0 con 0x7f3018152b20 2023-12-11T17:10:51.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.455+0000 7f301dfff640 1 -- 172.21.15.37:0/3522541335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f301806da00 con 0x7f3018152b20 2023-12-11T17:10:51.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.458+0000 7f30157fa640 1 -- 172.21.15.37:0/3522541335 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18779 (secure 0 0 0) 0x7f30040582e0 con 0x7f3018152b20 2023-12-11T17:10:51.458 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:51.459 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:10:32.309274+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:10:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.460+0000 7f301dfff640 1 -- 172.21.15.37:0/3522541335 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f2ffc06ae40 msgr2=0x7f2ffc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.460+0000 7f301dfff640 1 --2- 172.21.15.37:0/3522541335 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f2ffc06ae40 0x7f2ffc06d300 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f300c036000 tx=0x7f300c02e000 comp rx=0 tx=0).stop 2023-12-11T17:10:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.460+0000 7f301dfff640 1 -- 172.21.15.37:0/3522541335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3018152b20 msgr2=0x7f3018145460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.460+0000 7f301dfff640 1 --2- 172.21.15.37:0/3522541335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3018152b20 0x7f3018145460 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f3004010890 tx=0x7f3004010d50 comp rx=0 tx=0).stop 2023-12-11T17:10:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.461+0000 7f301dfff640 1 -- 172.21.15.37:0/3522541335 shutdown_connections 2023-12-11T17:10:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.461+0000 7f301dfff640 1 --2- 172.21.15.37:0/3522541335 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f2ffc06ae40 0x7f2ffc06d300 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.461+0000 7f301dfff640 1 --2- 172.21.15.37:0/3522541335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f301815c220 0x7f301806cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.461+0000 7f301dfff640 1 --2- 172.21.15.37:0/3522541335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3018152b20 0x7f3018145460 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.461+0000 7f301dfff640 1 --2- 172.21.15.37:0/3522541335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3008003970 0x7f301809c8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.461+0000 7f301dfff640 1 -- 172.21.15.37:0/3522541335 >> 172.21.15.37:0/3522541335 conn(0x7f30180b0860 msgr2=0x7f30180ae130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:51.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.461+0000 7f301dfff640 1 -- 172.21.15.37:0/3522541335 shutdown_connections 2023-12-11T17:10:51.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.461+0000 7f301dfff640 1 -- 172.21.15.37:0/3522541335 wait complete. 2023-12-11T17:10:51.481 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T17:09:38.415636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T17:09:42.786774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T17:09:43.660585+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-11T17:09:47.272351+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-11T17:10:51.481 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T17:10:51.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.693+0000 7f1fb61b3640 1 Processor -- start 2023-12-11T17:10:51.693 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.693+0000 7f1fb61b3640 1 -- start start 2023-12-11T17:10:51.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.694+0000 7f1fb61b3640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1fb01609a0 0x7f1fb00b27c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:51.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.695+0000 7f1fb61b3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fb00d0be0 0x7f1fb00d1040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:51.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.695+0000 7f1fb61b3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1fb00d15d0 0x7f1fb00d1a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:51.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.695+0000 7f1fb61b3640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb00d1fc0 con 0x7f1fb00d15d0 2023-12-11T17:10:51.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.695+0000 7f1fb61b3640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1fb00cf8e0 con 0x7f1fb01609a0 2023-12-11T17:10:51.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.695+0000 7f1fb61b3640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb0160d80 con 0x7f1fb00d0be0 2023-12-11T17:10:51.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.695+0000 7f1fb59b2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1fb00d15d0 0x7f1fb00d1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:51.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.695+0000 7f1fb59b2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1fb00d15d0 0x7f1fb00d1a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60094/0 (socket says 172.21.15.37:60094) 2023-12-11T17:10:51.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.695+0000 7f1fb59b2640 1 -- 172.21.15.37:0/1431906963 learned_addr learned my addr 172.21.15.37:0/1431906963 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:51.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.695+0000 7f1fb51b1640 1 --2- 172.21.15.37:0/1431906963 >> v2:172.21.15.151:3300/0 conn(0x7f1fb01609a0 0x7f1fb00b27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:51.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.696+0000 7f1fb49b0640 1 --2- 172.21.15.37:0/1431906963 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fb00d0be0 0x7f1fb00d1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:51.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.696+0000 7f1fb59b2640 1 -- 172.21.15.37:0/1431906963 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fb00d0be0 msgr2=0x7f1fb00d1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:51.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.696+0000 7f1fb59b2640 1 --2- 172.21.15.37:0/1431906963 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fb00d0be0 0x7f1fb00d1040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:51.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.696+0000 7f1fb59b2640 1 -- 172.21.15.37:0/1431906963 >> v2:172.21.15.151:3300/0 conn(0x7f1fb01609a0 msgr2=0x7f1fb00b27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:51.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.696+0000 7f1fb59b2640 1 --2- 172.21.15.37:0/1431906963 >> v2:172.21.15.151:3300/0 conn(0x7f1fb01609a0 0x7f1fb00b27c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:51.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.696+0000 7f1fb59b2640 1 -- 172.21.15.37:0/1431906963 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb00b4190 con 0x7f1fb00d15d0 2023-12-11T17:10:51.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.697+0000 7f1fb59b2640 1 --2- 172.21.15.37:0/1431906963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fb00d15d0 0x7f1fb00d1a80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1fb009c820 tx=0x7f1fa802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0156a7bdbb0fda7 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:51.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.697+0000 7f1faffff640 1 -- 172.21.15.37:0/1431906963 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8031870 con 0x7f1fb00d15d0 2023-12-11T17:10:51.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.697+0000 7f1faffff640 1 -- 172.21.15.37:0/1431906963 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1fa80319d0 con 0x7f1fb00d15d0 2023-12-11T17:10:51.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.697+0000 7f1faffff640 1 -- 172.21.15.37:0/1431906963 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1fa8031d60 con 0x7f1fb00d15d0 2023-12-11T17:10:51.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.698+0000 7f1fb61b3640 1 -- 172.21.15.37:0/1431906963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fb00d15d0 msgr2=0x7f1fb00d1a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:51.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.698+0000 7f1fb61b3640 1 --2- 172.21.15.37:0/1431906963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fb00d15d0 0x7f1fb00d1a80 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f1fb009c820 tx=0x7f1fa802b910 comp rx=0 tx=0).stop 2023-12-11T17:10:51.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.698+0000 7f1fb61b3640 1 -- 172.21.15.37:0/1431906963 shutdown_connections 2023-12-11T17:10:51.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.698+0000 7f1fb61b3640 1 --2- 172.21.15.37:0/1431906963 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fb00d15d0 0x7f1fb00d1a80 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:51.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.698+0000 7f1fb61b3640 1 --2- 172.21.15.37:0/1431906963 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fb00d0be0 0x7f1fb00d1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:51.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.698+0000 7f1fb61b3640 1 --2- 172.21.15.37:0/1431906963 >> v2:172.21.15.151:3300/0 conn(0x7f1fb01609a0 0x7f1fb00b27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:51.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.698+0000 7f1fb61b3640 1 -- 172.21.15.37:0/1431906963 >> 172.21.15.37:0/1431906963 conn(0x7f1fb009c2f0 msgr2=0x7f1fb00d3010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:51.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.698+0000 7f1fb61b3640 1 -- 172.21.15.37:0/1431906963 shutdown_connections 2023-12-11T17:10:51.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.698+0000 7f1fb61b3640 1 -- 172.21.15.37:0/1431906963 wait complete. 2023-12-11T17:10:51.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.700+0000 7f1fb61b3640 1 Processor -- start 2023-12-11T17:10:51.700 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.700+0000 7f1fb61b3640 1 -- start start 2023-12-11T17:10:51.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.701+0000 7f1fb61b3640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fb00d0be0 0x7f1fb00c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.701+0000 7f1fb61b3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fb00d15d0 0x7f1fb009cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.701+0000 7f1fb61b3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fb01609a0 0x7f1fb009d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.701+0000 7f1fb61b3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb009e550 con 0x7f1fb00d15d0 2023-12-11T17:10:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.701+0000 7f1fb61b3640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb01f37f0 con 0x7f1fb00d0be0 2023-12-11T17:10:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.701+0000 7f1fb61b3640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1fb009d8d0 con 0x7f1fb01609a0 2023-12-11T17:10:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.701+0000 7f1fb49b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fb00d15d0 0x7f1fb009cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.701+0000 7f1fb49b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fb00d15d0 0x7f1fb009cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60096/0 (socket says 172.21.15.37:60096) 2023-12-11T17:10:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.701+0000 7f1fb49b0640 1 -- 172.21.15.37:0/1234531013 learned_addr learned my addr 172.21.15.37:0/1234531013 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.701+0000 7f1fb51b1640 1 --2- 172.21.15.37:0/1234531013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fb00d0be0 0x7f1fb00c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.702+0000 7f1fb49b0640 1 -- 172.21.15.37:0/1234531013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fb01609a0 msgr2=0x7f1fb009d2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.702+0000 7f1fb49b0640 1 --2- 172.21.15.37:0/1234531013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fb01609a0 0x7f1fb009d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:51.703 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.702+0000 7f1fb49b0640 1 -- 172.21.15.37:0/1234531013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fb00d0be0 msgr2=0x7f1fb00c9230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:51.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.702+0000 7f1fb49b0640 1 --2- 172.21.15.37:0/1234531013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fb00d0be0 0x7f1fb00c9230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:51.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.702+0000 7f1fb49b0640 1 -- 172.21.15.37:0/1234531013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fa80094d0 con 0x7f1fb00d15d0 2023-12-11T17:10:51.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.702+0000 7f1fb51b1640 1 --2- 172.21.15.37:0/1234531013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fb00d0be0 0x7f1fb00c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:51.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.702+0000 7f1fb49b0640 1 --2- 172.21.15.37:0/1234531013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fb00d15d0 0x7f1fb009cd60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c00c570 tx=0x7f1f9c00ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:51.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.702+0000 7f1fadffb640 1 -- 172.21.15.37:0/1234531013 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c004220 con 0x7f1fb00d15d0 2023-12-11T17:10:51.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.702+0000 7f1fadffb640 1 -- 172.21.15.37:0/1234531013 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9c004380 con 0x7f1fb00d15d0 2023-12-11T17:10:51.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.702+0000 7f1fadffb640 1 -- 172.21.15.37:0/1234531013 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9c003850 con 0x7f1fb00d15d0 2023-12-11T17:10:51.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.702+0000 7f1fb61b3640 1 -- 172.21.15.37:0/1234531013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fb009dbb0 con 0x7f1fb00d15d0 2023-12-11T17:10:51.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.702+0000 7f1fb61b3640 1 -- 172.21.15.37:0/1234531013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fb009e170 con 0x7f1fb00d15d0 2023-12-11T17:10:51.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.704+0000 7f1fb61b3640 1 -- 172.21.15.37:0/1234531013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fb0074450 con 0x7f1fb00d15d0 2023-12-11T17:10:51.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.705+0000 7f1fadffb640 1 -- 172.21.15.37:0/1234531013 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1f9c0039b0 con 0x7f1fb00d15d0 2023-12-11T17:10:51.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.706+0000 7f1fadffb640 1 --2- 172.21.15.37:0/1234531013 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1f9406ae40 0x7f1f9406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:51.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.706+0000 7f1fadffb640 1 -- 172.21.15.37:0/1234531013 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f1f9c089620 con 0x7f1fb00d15d0 2023-12-11T17:10:51.706 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.706+0000 7f1fb51b1640 1 --2- 172.21.15.37:0/1234531013 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1f9406ae40 0x7f1f9406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:51.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.707+0000 7f1fb51b1640 1 --2- 172.21.15.37:0/1234531013 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1f9406ae40 0x7f1f9406d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1fb01f10c0 tx=0x7f1fa400b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:51.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.710+0000 7f1fadffb640 1 -- 172.21.15.37:0/1234531013 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1f9c054380 con 0x7f1fb00d15d0 2023-12-11T17:10:51.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.903+0000 7f1fb61b3640 1 -- 172.21.15.37:0/1234531013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1fb00d0690 con 0x7f1fb00d15d0 2023-12-11T17:10:51.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.904+0000 7f1fadffb640 1 -- 172.21.15.37:0/1234531013 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1f9c0579a0 con 0x7f1fb00d15d0 2023-12-11T17:10:51.904 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-11T17:10:51.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.907+0000 7f1fb61b3640 1 -- 172.21.15.37:0/1234531013 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1f9406ae40 msgr2=0x7f1f9406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:51.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.907+0000 7f1fb61b3640 1 --2- 172.21.15.37:0/1234531013 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1f9406ae40 0x7f1f9406d300 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1fb01f10c0 tx=0x7f1fa400b040 comp rx=0 tx=0).stop 2023-12-11T17:10:51.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.907+0000 7f1fb61b3640 1 -- 172.21.15.37:0/1234531013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fb00d15d0 msgr2=0x7f1fb009cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:51.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.907+0000 7f1fb61b3640 1 --2- 172.21.15.37:0/1234531013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fb00d15d0 0x7f1fb009cd60 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f1f9c00c570 tx=0x7f1f9c00ca30 comp rx=0 tx=0).stop 2023-12-11T17:10:51.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.907+0000 7f1fb61b3640 1 -- 172.21.15.37:0/1234531013 shutdown_connections 2023-12-11T17:10:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.907+0000 7f1fb61b3640 1 --2- 172.21.15.37:0/1234531013 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1f9406ae40 0x7f1f9406d300 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.907+0000 7f1fb61b3640 1 --2- 172.21.15.37:0/1234531013 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1fb01609a0 0x7f1fb009d2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.907+0000 7f1fb61b3640 1 --2- 172.21.15.37:0/1234531013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1fb00d15d0 0x7f1fb009cd60 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.907+0000 7f1fb61b3640 1 --2- 172.21.15.37:0/1234531013 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1fb00d0be0 0x7f1fb00c9230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.907+0000 7f1fb61b3640 1 -- 172.21.15.37:0/1234531013 >> 172.21.15.37:0/1234531013 conn(0x7f1fb009c2f0 msgr2=0x7f1fb00cc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.907+0000 7f1fb61b3640 1 -- 172.21.15.37:0/1234531013 shutdown_connections 2023-12-11T17:10:51.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:51.907+0000 7f1fb61b3640 1 -- 172.21.15.37:0/1234531013 wait complete. 2023-12-11T17:10:51.926 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T17:10:52.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.148+0000 7f3c14ec6640 1 Processor -- start 2023-12-11T17:10:52.148 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.148+0000 7f3c14ec6640 1 -- start start 2023-12-11T17:10:52.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.150+0000 7f3c14ec6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c100b40a0 0x7f3c100ce630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:52.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.150+0000 7f3c14ec6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3c100713b0 0x7f3c10071840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:52.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.150+0000 7f3c14ec6640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c10070f20 con 0x7f3c10144330 2023-12-11T17:10:52.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.150+0000 7f3c14ec6640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c100ceb70 con 0x7f3c100713b0 2023-12-11T17:10:52.150 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.150+0000 7f3c14ec6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c10070310 con 0x7f3c100b40a0 2023-12-11T17:10:52.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.150+0000 7f3c0ed9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3c100713b0 0x7f3c10071840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:52.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.150+0000 7f3c0ed9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3c100713b0 0x7f3c10071840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60098/0 (socket says 172.21.15.37:60098) 2023-12-11T17:10:52.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.150+0000 7f3c0ed9d640 1 -- 172.21.15.37:0/2888582595 learned_addr learned my addr 172.21.15.37:0/2888582595 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:52.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.150+0000 7f3c0e59c640 1 --2- 172.21.15.37:0/2888582595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c100b40a0 0x7f3c100ce630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:52.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.151+0000 7f3c0ed9d640 1 -- 172.21.15.37:0/2888582595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c100b40a0 msgr2=0x7f3c100ce630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:52.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.151+0000 7f3c0ed9d640 1 --2- 172.21.15.37:0/2888582595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c100b40a0 0x7f3c100ce630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:52.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.151+0000 7f3c0ed9d640 1 -- 172.21.15.37:0/2888582595 >> v1:172.21.15.151:6789/0 conn(0x7f3c10144330 legacy=0x7f3c100b4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:52.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.151+0000 7f3c0ed9d640 1 -- 172.21.15.37:0/2888582595 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c100705f0 con 0x7f3c100713b0 2023-12-11T17:10:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.152+0000 7f3c0ed9d640 1 --2- 172.21.15.37:0/2888582595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c100713b0 0x7f3c10071840 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3c08009870 tx=0x7f3c0802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7daaadfdaa610e92 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.152+0000 7f3c0d59a640 1 -- 172.21.15.37:0/2888582595 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c080317c0 con 0x7f3c100713b0 2023-12-11T17:10:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.152+0000 7f3c0d59a640 1 -- 172.21.15.37:0/2888582595 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c08031920 con 0x7f3c100713b0 2023-12-11T17:10:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.152+0000 7f3c0d59a640 1 -- 172.21.15.37:0/2888582595 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08031cb0 con 0x7f3c100713b0 2023-12-11T17:10:52.153 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.153+0000 7f3c14ec6640 1 -- 172.21.15.37:0/2888582595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c100713b0 msgr2=0x7f3c10071840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.153+0000 7f3c14ec6640 1 --2- 172.21.15.37:0/2888582595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c100713b0 0x7f3c10071840 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3c08009870 tx=0x7f3c0802b860 comp rx=0 tx=0).stop 2023-12-11T17:10:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.153+0000 7f3c14ec6640 1 -- 172.21.15.37:0/2888582595 shutdown_connections 2023-12-11T17:10:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.153+0000 7f3c14ec6640 1 --2- 172.21.15.37:0/2888582595 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c100713b0 0x7f3c10071840 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.153+0000 7f3c14ec6640 1 --2- 172.21.15.37:0/2888582595 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c100b40a0 0x7f3c100ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.153+0000 7f3c14ec6640 1 -- 172.21.15.37:0/2888582595 >> 172.21.15.37:0/2888582595 conn(0x7f3c1006c430 msgr2=0x7f3c1006c840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.153+0000 7f3c14ec6640 1 -- 172.21.15.37:0/2888582595 shutdown_connections 2023-12-11T17:10:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.153+0000 7f3c14ec6640 1 -- 172.21.15.37:0/2888582595 wait complete. 2023-12-11T17:10:52.154 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.155+0000 7f3c14ec6640 1 Processor -- start 2023-12-11T17:10:52.155 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.155+0000 7f3c14ec6640 1 -- start start 2023-12-11T17:10:52.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.156+0000 7f3c14ec6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c100713b0 0x7f3c1015a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:52.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.156+0000 7f3c14ec6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c100b40a0 0x7f3c1015d950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:52.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.156+0000 7f3c14ec6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c10144330 0x7f3c10138200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:52.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.156+0000 7f3c14ec6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1015d4c0 con 0x7f3c10144330 2023-12-11T17:10:52.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.156+0000 7f3c14ec6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1015ae80 con 0x7f3c100713b0 2023-12-11T17:10:52.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.156+0000 7f3c14ec6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c1015c8b0 con 0x7f3c100b40a0 2023-12-11T17:10:52.156 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.156+0000 7f3c0ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c10144330 0x7f3c10138200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:52.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.156+0000 7f3c0ed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c10144330 0x7f3c10138200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60108/0 (socket says 172.21.15.37:60108) 2023-12-11T17:10:52.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.156+0000 7f3c0ed9d640 1 -- 172.21.15.37:0/4248627678 learned_addr learned my addr 172.21.15.37:0/4248627678 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:52.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.156+0000 7f3c0e59c640 1 --2- 172.21.15.37:0/4248627678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c100713b0 0x7f3c1015a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:52.157 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.156+0000 7f3c0dd9b640 1 --2- 172.21.15.37:0/4248627678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c100b40a0 0x7f3c1015d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.157+0000 7f3c0ed9d640 1 -- 172.21.15.37:0/4248627678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c100b40a0 msgr2=0x7f3c1015d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.157+0000 7f3c0ed9d640 1 --2- 172.21.15.37:0/4248627678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c100b40a0 0x7f3c1015d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.157+0000 7f3c0ed9d640 1 -- 172.21.15.37:0/4248627678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c100713b0 msgr2=0x7f3c1015a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.157+0000 7f3c0ed9d640 1 --2- 172.21.15.37:0/4248627678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c100713b0 0x7f3c1015a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.157+0000 7f3c0ed9d640 1 -- 172.21.15.37:0/4248627678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c080094d0 con 0x7f3c10144330 2023-12-11T17:10:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.157+0000 7f3c0ed9d640 1 --2- 172.21.15.37:0/4248627678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c10144330 0x7f3c10138200 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3c08009870 tx=0x7f3c080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.157+0000 7f3c06ffd640 1 -- 172.21.15.37:0/4248627678 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08032860 con 0x7f3c10144330 2023-12-11T17:10:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.157+0000 7f3c06ffd640 1 -- 172.21.15.37:0/4248627678 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c080329e0 con 0x7f3c10144330 2023-12-11T17:10:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.157+0000 7f3c06ffd640 1 -- 172.21.15.37:0/4248627678 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c08032d90 con 0x7f3c10144330 2023-12-11T17:10:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.157+0000 7f3c14ec6640 1 -- 172.21.15.37:0/4248627678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c1015cb90 con 0x7f3c10144330 2023-12-11T17:10:52.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.157+0000 7f3c14ec6640 1 -- 172.21.15.37:0/4248627678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c1015d150 con 0x7f3c10144330 2023-12-11T17:10:52.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.159+0000 7f3c14ec6640 1 -- 172.21.15.37:0/4248627678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c10074450 con 0x7f3c10144330 2023-12-11T17:10:52.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.160+0000 7f3c06ffd640 1 -- 172.21.15.37:0/4248627678 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3c0804d3f0 con 0x7f3c10144330 2023-12-11T17:10:52.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.161+0000 7f3c06ffd640 1 --2- 172.21.15.37:0/4248627678 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3bf006ae40 0x7f3bf006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:52.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.161+0000 7f3c06ffd640 1 -- 172.21.15.37:0/4248627678 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3c080ab700 con 0x7f3c10144330 2023-12-11T17:10:52.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.162+0000 7f3c0e59c640 1 --2- 172.21.15.37:0/4248627678 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3bf006ae40 0x7f3bf006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:52.162 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.163+0000 7f3c0e59c640 1 --2- 172.21.15.37:0/4248627678 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3bf006ae40 0x7f3bf006d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3c10133e70 tx=0x7f3c000039b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:52.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.165+0000 7f3c06ffd640 1 -- 172.21.15.37:0/4248627678 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3c08076460 con 0x7f3c10144330 2023-12-11T17:10:52.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.360+0000 7f3c14ec6640 1 -- 172.21.15.37:0/4248627678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3c100b4d40 con 0x7f3c10144330 2023-12-11T17:10:52.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.361+0000 7f3c06ffd640 1 -- 172.21.15.37:0/4248627678 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3c08079a80 con 0x7f3c10144330 2023-12-11T17:10:52.361 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:10:52.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.363+0000 7f3c14ec6640 1 -- 172.21.15.37:0/4248627678 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3bf006ae40 msgr2=0x7f3bf006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:52.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.363+0000 7f3c14ec6640 1 --2- 172.21.15.37:0/4248627678 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3bf006ae40 0x7f3bf006d300 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f3c10133e70 tx=0x7f3c000039b0 comp rx=0 tx=0).stop 2023-12-11T17:10:52.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.363+0000 7f3c14ec6640 1 -- 172.21.15.37:0/4248627678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c10144330 msgr2=0x7f3c10138200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:52.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.363+0000 7f3c14ec6640 1 --2- 172.21.15.37:0/4248627678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c10144330 0x7f3c10138200 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f3c08009870 tx=0x7f3c080046c0 comp rx=0 tx=0).stop 2023-12-11T17:10:52.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.363+0000 7f3c14ec6640 1 -- 172.21.15.37:0/4248627678 shutdown_connections 2023-12-11T17:10:52.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.363+0000 7f3c14ec6640 1 --2- 172.21.15.37:0/4248627678 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3bf006ae40 0x7f3bf006d300 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:52.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.363+0000 7f3c14ec6640 1 --2- 172.21.15.37:0/4248627678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3c10144330 0x7f3c10138200 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:52.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.363+0000 7f3c14ec6640 1 --2- 172.21.15.37:0/4248627678 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3c100b40a0 0x7f3c1015d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:52.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.363+0000 7f3c14ec6640 1 --2- 172.21.15.37:0/4248627678 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3c100713b0 0x7f3c1015a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:52.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.363+0000 7f3c14ec6640 1 -- 172.21.15.37:0/4248627678 >> 172.21.15.37:0/4248627678 conn(0x7f3c1006c430 msgr2=0x7f3c100aea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:52.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.364+0000 7f3c14ec6640 1 -- 172.21.15.37:0/4248627678 shutdown_connections 2023-12-11T17:10:52.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.364+0000 7f3c14ec6640 1 -- 172.21.15.37:0/4248627678 wait complete. 2023-12-11T17:10:52.382 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T17:10:52.609 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.610+0000 7feb50490640 1 Processor -- start 2023-12-11T17:10:52.610 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.610+0000 7feb50490640 1 -- start start 2023-12-11T17:10:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.612+0000 7feb50490640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb48071fb0 0x7feb480ce490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.612+0000 7feb50490640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb480caf80 con 0x7feb480c2390 2023-12-11T17:10:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.612+0000 7feb50490640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb4806a5e0 con 0x7feb480ca4f0 2023-12-11T17:10:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.612+0000 7feb50490640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb480ca930 con 0x7feb48071fb0 2023-12-11T17:10:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.612+0000 7feb4ea2d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7feb480c2390 0x7feb481652e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56486/0 (socket says 172.21.15.37:56486) 2023-12-11T17:10:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.612+0000 7feb4ea2d640 1 -- 172.21.15.37:0/173099130 learned_addr learned my addr 172.21.15.37:0/173099130 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.613+0000 7feb4e22c640 1 --2- 172.21.15.37:0/173099130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb48071fb0 0x7feb480ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.613+0000 7feb4d22a640 1 -- 172.21.15.37:0/173099130 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2451725877 0 0) 0x7feb480caf80 con 0x7feb480c2390 2023-12-11T17:10:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.613+0000 7feb4d22a640 1 -- 172.21.15.37:0/173099130 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb34003520 con 0x7feb480c2390 2023-12-11T17:10:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.613+0000 7feb4d22a640 1 -- 172.21.15.37:0/173099130 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1322380361 0 0) 0x7feb34003520 con 0x7feb480c2390 2023-12-11T17:10:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.613+0000 7feb4d22a640 1 -- 172.21.15.37:0/173099130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb48071fb0 msgr2=0x7feb480ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.613+0000 7feb4d22a640 1 --2- 172.21.15.37:0/173099130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb48071fb0 0x7feb480ce490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:52.616 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.613+0000 7feb4d22a640 1 -- 172.21.15.37:0/173099130 >> v1:172.21.15.151:6789/0 conn(0x7feb480ca4f0 legacy=0x7feb480c1c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.613+0000 7feb4d22a640 1 -- 172.21.15.37:0/173099130 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb4806a8c0 con 0x7feb480c2390 2023-12-11T17:10:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.613+0000 7feb4d22a640 1 -- 172.21.15.37:0/173099130 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7feb400019f0 con 0x7feb480c2390 2023-12-11T17:10:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.613+0000 7feb4d22a640 1 -- 172.21.15.37:0/173099130 >> v1:172.21.15.37:6789/0 conn(0x7feb480c2390 legacy=0x7feb481652e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.613+0000 7feb4d22a640 1 --2- 172.21.15.37:0/173099130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb48071fb0 0x7feb340039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.613+0000 7feb4d22a640 1 --2- 172.21.15.37:0/173099130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb34003f20 0x7feb340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.613+0000 7feb4d22a640 1 --2- 172.21.15.37:0/173099130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb34004d00 0x7feb34005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.613+0000 7feb4d22a640 1 -- 172.21.15.37:0/173099130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb480ca930 con 0x7feb34004d00 2023-12-11T17:10:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.613+0000 7feb4d22a640 1 -- 172.21.15.37:0/173099130 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb3400ba60 con 0x7feb34003f20 2023-12-11T17:10:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.613+0000 7feb4d22a640 1 -- 172.21.15.37:0/173099130 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb3400bc20 con 0x7feb48071fb0 2023-12-11T17:10:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.614+0000 7feb4ea2d640 1 --2- 172.21.15.37:0/173099130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb34004d00 0x7feb34005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.614+0000 7feb4e22c640 1 --2- 172.21.15.37:0/173099130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb48071fb0 0x7feb340039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.614+0000 7feb4da2b640 1 --2- 172.21.15.37:0/173099130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb34003f20 0x7feb340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.614+0000 7feb4ea2d640 1 -- 172.21.15.37:0/173099130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb48071fb0 msgr2=0x7feb340039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.614+0000 7feb4ea2d640 1 --2- 172.21.15.37:0/173099130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb48071fb0 0x7feb340039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:52.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.614+0000 7feb4ea2d640 1 -- 172.21.15.37:0/173099130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb34003f20 msgr2=0x7feb340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.614+0000 7feb4ea2d640 1 --2- 172.21.15.37:0/173099130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb34003f20 0x7feb340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.614+0000 7feb4ea2d640 1 -- 172.21.15.37:0/173099130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb34003520 con 0x7feb34004d00 2023-12-11T17:10:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.614+0000 7feb4e22c640 1 --2- 172.21.15.37:0/173099130 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb48071fb0 0x7feb340039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.614+0000 7feb4da2b640 1 --2- 172.21.15.37:0/173099130 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb34003f20 0x7feb340047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.615+0000 7feb4ea2d640 1 --2- 172.21.15.37:0/173099130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb34004d00 0x7feb34005180 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7feb4000a800 tx=0x7feb340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5352823cce8038b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.616+0000 7feb4d22a640 1 -- 172.21.15.37:0/173099130 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb400072d0 con 0x7feb34004d00 2023-12-11T17:10:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.616+0000 7feb4d22a640 1 -- 172.21.15.37:0/173099130 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4002f070 con 0x7feb34004d00 2023-12-11T17:10:52.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.616+0000 7feb4d22a640 1 -- 172.21.15.37:0/173099130 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb400076f0 con 0x7feb34004d00 2023-12-11T17:10:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.616+0000 7feb50490640 1 -- 172.21.15.37:0/173099130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb34004d00 msgr2=0x7feb34005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.616+0000 7feb50490640 1 --2- 172.21.15.37:0/173099130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb34004d00 0x7feb34005180 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7feb4000a800 tx=0x7feb340057f0 comp rx=0 tx=0).stop 2023-12-11T17:10:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.616+0000 7feb4ea2d640 1 -- 172.21.15.37:0/173099130 reap_dead start 2023-12-11T17:10:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.616+0000 7feb50490640 1 -- 172.21.15.37:0/173099130 shutdown_connections 2023-12-11T17:10:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.616+0000 7feb50490640 1 -- 172.21.15.37:0/173099130 >> 172.21.15.37:0/173099130 conn(0x7feb480cee70 msgr2=0x7feb480cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.616+0000 7feb50490640 1 -- 172.21.15.37:0/173099130 shutdown_connections 2023-12-11T17:10:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.617+0000 7feb50490640 1 -- 172.21.15.37:0/173099130 wait complete. 2023-12-11T17:10:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.618+0000 7feb50490640 1 Processor -- start 2023-12-11T17:10:52.619 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.619+0000 7feb50490640 1 -- start start 2023-12-11T17:10:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.620+0000 7feb50490640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb34004d00 0x7feb481520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.620+0000 7feb50490640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb4815f3d0 0x7feb480ae8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:52.621 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.620+0000 7feb50490640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb4806d8c0 0x7feb4806dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.620+0000 7feb50490640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb480c6f40 con 0x7feb4815f3d0 2023-12-11T17:10:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.620+0000 7feb50490640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4806e280 con 0x7feb4806d8c0 2023-12-11T17:10:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.620+0000 7feb50490640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb480af190 con 0x7feb34004d00 2023-12-11T17:10:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.620+0000 7feb4da2b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb4815f3d0 0x7feb480ae8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.620+0000 7feb4da2b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb4815f3d0 0x7feb480ae8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60118/0 (socket says 172.21.15.37:60118) 2023-12-11T17:10:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.620+0000 7feb4da2b640 1 -- 172.21.15.37:0/2924224208 learned_addr learned my addr 172.21.15.37:0/2924224208 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.620+0000 7feb4ea2d640 1 --2- 172.21.15.37:0/2924224208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb4806d8c0 0x7feb4806dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.620+0000 7feb4e22c640 1 --2- 172.21.15.37:0/2924224208 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb34004d00 0x7feb481520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.620+0000 7feb4da2b640 1 -- 172.21.15.37:0/2924224208 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb34004d00 msgr2=0x7feb481520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.620+0000 7feb4da2b640 1 --2- 172.21.15.37:0/2924224208 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb34004d00 0x7feb481520f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.620+0000 7feb4da2b640 1 -- 172.21.15.37:0/2924224208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb4806d8c0 msgr2=0x7feb4806dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.620+0000 7feb4da2b640 1 --2- 172.21.15.37:0/2924224208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb4806d8c0 0x7feb4806dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.620+0000 7feb4da2b640 1 -- 172.21.15.37:0/2924224208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb480af470 con 0x7feb4815f3d0 2023-12-11T17:10:52.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.621+0000 7feb4da2b640 1 --2- 172.21.15.37:0/2924224208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb4815f3d0 0x7feb480ae8b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7feb3800d7a0 tx=0x7feb3800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.621+0000 7feb3effd640 1 -- 172.21.15.37:0/2924224208 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb38017070 con 0x7feb4815f3d0 2023-12-11T17:10:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.621+0000 7feb3effd640 1 -- 172.21.15.37:0/2924224208 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb38005070 con 0x7feb4815f3d0 2023-12-11T17:10:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.621+0000 7feb3effd640 1 -- 172.21.15.37:0/2924224208 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb38005420 con 0x7feb4815f3d0 2023-12-11T17:10:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.621+0000 7feb50490640 1 -- 172.21.15.37:0/2924224208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb480af750 con 0x7feb4815f3d0 2023-12-11T17:10:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.621+0000 7feb50490640 1 -- 172.21.15.37:0/2924224208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb48152630 con 0x7feb4815f3d0 2023-12-11T17:10:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.622+0000 7feb50490640 1 -- 172.21.15.37:0/2924224208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb480afc70 con 0x7feb4815f3d0 2023-12-11T17:10:52.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.623+0000 7feb3effd640 1 -- 172.21.15.37:0/2924224208 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7feb38007030 con 0x7feb4815f3d0 2023-12-11T17:10:52.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.624+0000 7feb3effd640 1 --2- 172.21.15.37:0/2924224208 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7feb2c06ae40 0x7feb2c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:52.624 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.624+0000 7feb3effd640 1 -- 172.21.15.37:0/2924224208 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7feb38089440 con 0x7feb4815f3d0 2023-12-11T17:10:52.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.625+0000 7feb4e22c640 1 --2- 172.21.15.37:0/2924224208 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7feb2c06ae40 0x7feb2c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:52.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.626+0000 7feb4e22c640 1 --2- 172.21.15.37:0/2924224208 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7feb2c06ae40 0x7feb2c06d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7feb440099c0 tx=0x7feb44008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:52.628 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.629+0000 7feb3effd640 1 -- 172.21.15.37:0/2924224208 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7feb480afc70 con 0x7feb4815f3d0 2023-12-11T17:10:52.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.828+0000 7feb50490640 1 -- 172.21.15.37:0/2924224208 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7feb480afc70 con 0x7feb4815f3d0 2023-12-11T17:10:52.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.829+0000 7feb3effd640 1 -- 172.21.15.37:0/2924224208 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7feb480afc70 con 0x7feb4815f3d0 2023-12-11T17:10:52.829 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-11T17:10:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.831+0000 7feb50490640 1 -- 172.21.15.37:0/2924224208 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7feb2c06ae40 msgr2=0x7feb2c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.831+0000 7feb50490640 1 --2- 172.21.15.37:0/2924224208 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7feb2c06ae40 0x7feb2c06d300 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7feb440099c0 tx=0x7feb44008040 comp rx=0 tx=0).stop 2023-12-11T17:10:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.831+0000 7feb50490640 1 -- 172.21.15.37:0/2924224208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb4815f3d0 msgr2=0x7feb480ae8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.831+0000 7feb50490640 1 --2- 172.21.15.37:0/2924224208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb4815f3d0 0x7feb480ae8b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7feb3800d7a0 tx=0x7feb3800dc60 comp rx=0 tx=0).stop 2023-12-11T17:10:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.831+0000 7feb50490640 1 -- 172.21.15.37:0/2924224208 shutdown_connections 2023-12-11T17:10:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.831+0000 7feb50490640 1 --2- 172.21.15.37:0/2924224208 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7feb2c06ae40 0x7feb2c06d300 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:52.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.831+0000 7feb50490640 1 --2- 172.21.15.37:0/2924224208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7feb4806d8c0 0x7feb4806dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.831+0000 7feb50490640 1 --2- 172.21.15.37:0/2924224208 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7feb4815f3d0 0x7feb480ae8b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.831+0000 7feb50490640 1 --2- 172.21.15.37:0/2924224208 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7feb34004d00 0x7feb481520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.831+0000 7feb50490640 1 -- 172.21.15.37:0/2924224208 >> 172.21.15.37:0/2924224208 conn(0x7feb480cee70 msgr2=0x7feb480999f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.831+0000 7feb50490640 1 -- 172.21.15.37:0/2924224208 shutdown_connections 2023-12-11T17:10:52.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:52.832+0000 7feb50490640 1 -- 172.21.15.37:0/2924224208 wait complete. 2023-12-11T17:10:52.852 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-11T17:10:53.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.077+0000 7f436db67640 1 Processor -- start 2023-12-11T17:10:53.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.078+0000 7f436db67640 1 -- start start 2023-12-11T17:10:53.079 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.079+0000 7f436db67640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f436815d360 0x7f43680d3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:53.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.079+0000 7f436db67640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f43680d1c40 0x7f43680b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:53.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.079+0000 7f436db67640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f43680cdf20 con 0x7f43680cece0 2023-12-11T17:10:53.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.079+0000 7f436db67640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43680ce200 con 0x7f436815d360 2023-12-11T17:10:53.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.079+0000 7f436db67640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f43680ce4e0 con 0x7f43680d1c40 2023-12-11T17:10:53.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.080+0000 7f436cb65640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f436815d360 0x7f43680d3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:53.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.080+0000 7f436cb65640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f436815d360 0x7f43680d3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60128/0 (socket says 172.21.15.37:60128) 2023-12-11T17:10:53.080 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.080+0000 7f436cb65640 1 -- 172.21.15.37:0/2532605085 learned_addr learned my addr 172.21.15.37:0/2532605085 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:53.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.080+0000 7f436d366640 1 --2- 172.21.15.37:0/2532605085 >> v2:172.21.15.151:3300/0 conn(0x7f43680d1c40 0x7f43680b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:53.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.080+0000 7f436cb65640 1 -- 172.21.15.37:0/2532605085 >> v2:172.21.15.151:3300/0 conn(0x7f43680d1c40 msgr2=0x7f43680b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:53.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.080+0000 7f436cb65640 1 --2- 172.21.15.37:0/2532605085 >> v2:172.21.15.151:3300/0 conn(0x7f43680d1c40 0x7f43680b28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:53.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.080+0000 7f436cb65640 1 -- 172.21.15.37:0/2532605085 >> v1:172.21.15.151:6789/0 conn(0x7f43680cece0 legacy=0x7f43680d1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:53.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.080+0000 7f436cb65640 1 -- 172.21.15.37:0/2532605085 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43680ce7c0 con 0x7f436815d360 2023-12-11T17:10:53.081 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.080+0000 7f436d366640 1 --2- 172.21.15.37:0/2532605085 >> v2:172.21.15.151:3300/0 conn(0x7f43680d1c40 0x7f43680b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:53.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.082+0000 7f436cb65640 1 --2- 172.21.15.37:0/2532605085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f436815d360 0x7f43680d3660 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f43680c9fb0 tx=0x7f435c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc923dbd57e3f56 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:53.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.082+0000 7f43677fe640 1 -- 172.21.15.37:0/2532605085 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c030860 con 0x7f436815d360 2023-12-11T17:10:53.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.082+0000 7f43677fe640 1 -- 172.21.15.37:0/2532605085 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f435c0309c0 con 0x7f436815d360 2023-12-11T17:10:53.082 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.082+0000 7f43677fe640 1 -- 172.21.15.37:0/2532605085 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f435c030d50 con 0x7f436815d360 2023-12-11T17:10:53.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.083+0000 7f436db67640 1 -- 172.21.15.37:0/2532605085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f436815d360 msgr2=0x7f43680d3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:53.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.083+0000 7f436db67640 1 --2- 172.21.15.37:0/2532605085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f436815d360 0x7f43680d3660 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f43680c9fb0 tx=0x7f435c02b9a0 comp rx=0 tx=0).stop 2023-12-11T17:10:53.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.083+0000 7f436db67640 1 -- 172.21.15.37:0/2532605085 shutdown_connections 2023-12-11T17:10:53.083 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.083+0000 7f436db67640 1 --2- 172.21.15.37:0/2532605085 >> v2:172.21.15.151:3300/0 conn(0x7f43680d1c40 0x7f43680b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:53.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.083+0000 7f436db67640 1 --2- 172.21.15.37:0/2532605085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f436815d360 0x7f43680d3660 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:53.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.083+0000 7f436db67640 1 -- 172.21.15.37:0/2532605085 >> 172.21.15.37:0/2532605085 conn(0x7f436809c230 msgr2=0x7f43680d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:53.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.083+0000 7f436db67640 1 -- 172.21.15.37:0/2532605085 shutdown_connections 2023-12-11T17:10:53.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.083+0000 7f436db67640 1 -- 172.21.15.37:0/2532605085 wait complete. 2023-12-11T17:10:53.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.086+0000 7f436db67640 1 Processor -- start 2023-12-11T17:10:53.086 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.086+0000 7f436db67640 1 -- start start 2023-12-11T17:10:53.087 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.087+0000 7f436db67640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43680cece0 0x7f43680b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:53.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.087+0000 7f436db67640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43680d1c40 0x7f43680cb400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:53.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.087+0000 7f436db67640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f436815d360 0x7f43680b32c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:53.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.087+0000 7f436db67640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43680b3c60 con 0x7f43680d1c40 2023-12-11T17:10:53.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.087+0000 7f436db67640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43680b4660 con 0x7f43680cece0 2023-12-11T17:10:53.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.087+0000 7f436db67640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f43680b4940 con 0x7f436815d360 2023-12-11T17:10:53.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.088+0000 7f4367fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43680d1c40 0x7f43680cb400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:53.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.088+0000 7f4367fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43680d1c40 0x7f43680cb400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60138/0 (socket says 172.21.15.37:60138) 2023-12-11T17:10:53.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.088+0000 7f4367fff640 1 -- 172.21.15.37:0/2002627224 learned_addr learned my addr 172.21.15.37:0/2002627224 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:53.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.088+0000 7f436cb65640 1 --2- 172.21.15.37:0/2002627224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43680cece0 0x7f43680b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:53.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.088+0000 7f4367fff640 1 -- 172.21.15.37:0/2002627224 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f436815d360 msgr2=0x7f43680b32c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:53.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.088+0000 7f4367fff640 1 --2- 172.21.15.37:0/2002627224 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f436815d360 0x7f43680b32c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:53.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.088+0000 7f4367fff640 1 -- 172.21.15.37:0/2002627224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43680cece0 msgr2=0x7f43680b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:53.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.088+0000 7f4367fff640 1 --2- 172.21.15.37:0/2002627224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43680cece0 0x7f43680b5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:53.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.088+0000 7f4367fff640 1 -- 172.21.15.37:0/2002627224 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f435c0094d0 con 0x7f43680d1c40 2023-12-11T17:10:53.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.089+0000 7f4367fff640 1 --2- 172.21.15.37:0/2002627224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43680d1c40 0x7f43680cb400 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f435400b3e0 tx=0x7f435400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:53.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.089+0000 7f43657fa640 1 -- 172.21.15.37:0/2002627224 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4354011830 con 0x7f43680d1c40 2023-12-11T17:10:53.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.089+0000 7f43657fa640 1 -- 172.21.15.37:0/2002627224 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f43540119b0 con 0x7f43680d1c40 2023-12-11T17:10:53.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.089+0000 7f43657fa640 1 -- 172.21.15.37:0/2002627224 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4354011d60 con 0x7f43680d1c40 2023-12-11T17:10:53.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.089+0000 7f436db67640 1 -- 172.21.15.37:0/2002627224 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43680b4c20 con 0x7f43680d1c40 2023-12-11T17:10:53.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.089+0000 7f436db67640 1 -- 172.21.15.37:0/2002627224 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43680cb940 con 0x7f43680d1c40 2023-12-11T17:10:53.090 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.090+0000 7f436db67640 1 -- 172.21.15.37:0/2002627224 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43680b5140 con 0x7f43680d1c40 2023-12-11T17:10:53.091 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.091+0000 7f43657fa640 1 -- 172.21.15.37:0/2002627224 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f435401a400 con 0x7f43680d1c40 2023-12-11T17:10:53.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.092+0000 7f43657fa640 1 --2- 172.21.15.37:0/2002627224 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f434c06ae40 0x7f434c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:53.092 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.092+0000 7f43657fa640 1 -- 172.21.15.37:0/2002627224 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f4354089b30 con 0x7f43680d1c40 2023-12-11T17:10:53.093 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.093+0000 7f436cb65640 1 --2- 172.21.15.37:0/2002627224 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f434c06ae40 0x7f434c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:53.094 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.095+0000 7f436cb65640 1 --2- 172.21.15.37:0/2002627224 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f434c06ae40 0x7f434c06d300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f435c036000 tx=0x7f435c008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:53.098 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.098+0000 7f43657fa640 1 -- 172.21.15.37:0/2002627224 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f43680b5140 con 0x7f43680d1c40 2023-12-11T17:10:53.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.303+0000 7f436db67640 1 -- 172.21.15.37:0/2002627224 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f43680b5140 con 0x7f43680d1c40 2023-12-11T17:10:53.304 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.304+0000 7f43657fa640 1 -- 172.21.15.37:0/2002627224 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f43680b5140 con 0x7f43680d1c40 2023-12-11T17:10:53.304 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:10:53.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.307+0000 7f436db67640 1 -- 172.21.15.37:0/2002627224 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f434c06ae40 msgr2=0x7f434c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:53.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.307+0000 7f436db67640 1 --2- 172.21.15.37:0/2002627224 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f434c06ae40 0x7f434c06d300 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f435c036000 tx=0x7f435c008030 comp rx=0 tx=0).stop 2023-12-11T17:10:53.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.307+0000 7f436db67640 1 -- 172.21.15.37:0/2002627224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43680d1c40 msgr2=0x7f43680cb400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:53.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.307+0000 7f436db67640 1 --2- 172.21.15.37:0/2002627224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43680d1c40 0x7f43680cb400 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f435400b3e0 tx=0x7f435400b8a0 comp rx=0 tx=0).stop 2023-12-11T17:10:53.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.307+0000 7f436db67640 1 -- 172.21.15.37:0/2002627224 shutdown_connections 2023-12-11T17:10:53.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.307+0000 7f436db67640 1 --2- 172.21.15.37:0/2002627224 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f434c06ae40 0x7f434c06d300 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:53.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.307+0000 7f436db67640 1 --2- 172.21.15.37:0/2002627224 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f436815d360 0x7f43680b32c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:53.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.307+0000 7f436db67640 1 --2- 172.21.15.37:0/2002627224 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f43680d1c40 0x7f43680cb400 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:53.307 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.307+0000 7f436db67640 1 --2- 172.21.15.37:0/2002627224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f43680cece0 0x7f43680b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:53.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.307+0000 7f436db67640 1 -- 172.21.15.37:0/2002627224 >> 172.21.15.37:0/2002627224 conn(0x7f436809c230 msgr2=0x7f43680cf500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:53.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.307+0000 7f436db67640 1 -- 172.21.15.37:0/2002627224 shutdown_connections 2023-12-11T17:10:53.308 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.307+0000 7f436db67640 1 -- 172.21.15.37:0/2002627224 wait complete. 2023-12-11T17:10:53.325 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic' 2023-12-11T17:10:53.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.548+0000 7fcd4b3c5640 1 Processor -- start 2023-12-11T17:10:53.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.548+0000 7fcd4b3c5640 1 -- start start 2023-12-11T17:10:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.549+0000 7fcd4b3c5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd440ccb80 0x7fcd440cfa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.549+0000 7fcd4b3c5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd440cc6f0 con 0x7fcd4415b3a0 2023-12-11T17:10:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.549+0000 7fcd4b3c5640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd440cbdc0 con 0x7fcd440cdeb0 2023-12-11T17:10:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.549+0000 7fcd4b3c5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd440cff80 con 0x7fcd440ccb80 2023-12-11T17:10:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.549+0000 7fcd49161640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fcd4415b3a0 0x7fcd440cd7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56502/0 (socket says 172.21.15.37:56502) 2023-12-11T17:10:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.549+0000 7fcd49161640 1 -- 172.21.15.37:0/1889922554 learned_addr learned my addr 172.21.15.37:0/1889922554 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:53.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.550+0000 7fcd43fff640 1 -- 172.21.15.37:0/1889922554 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4123416651 0 0) 0x7fcd440cc6f0 con 0x7fcd4415b3a0 2023-12-11T17:10:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.550+0000 7fcd43fff640 1 -- 172.21.15.37:0/1889922554 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd2c003520 con 0x7fcd4415b3a0 2023-12-11T17:10:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.550+0000 7fcd49962640 1 --2- 172.21.15.37:0/1889922554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd440ccb80 0x7fcd440cfa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.550+0000 7fcd43fff640 1 -- 172.21.15.37:0/1889922554 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3886962173 0 0) 0x7fcd2c003520 con 0x7fcd4415b3a0 2023-12-11T17:10:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.550+0000 7fcd43fff640 1 -- 172.21.15.37:0/1889922554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd440ccb80 msgr2=0x7fcd440cfa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.550+0000 7fcd43fff640 1 --2- 172.21.15.37:0/1889922554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd440ccb80 0x7fcd440cfa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.550+0000 7fcd43fff640 1 -- 172.21.15.37:0/1889922554 >> v1:172.21.15.151:6789/0 conn(0x7fcd440cdeb0 legacy=0x7fcd440adc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.550+0000 7fcd43fff640 1 -- 172.21.15.37:0/1889922554 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd440cc0a0 con 0x7fcd4415b3a0 2023-12-11T17:10:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.550+0000 7fcd43fff640 1 -- 172.21.15.37:0/1889922554 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7fcd340019f0 con 0x7fcd4415b3a0 2023-12-11T17:10:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.550+0000 7fcd43fff640 1 -- 172.21.15.37:0/1889922554 >> v1:172.21.15.37:6789/0 conn(0x7fcd4415b3a0 legacy=0x7fcd440cd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.550+0000 7fcd43fff640 1 --2- 172.21.15.37:0/1889922554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd2c0039a0 0x7fcd2c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.550+0000 7fcd43fff640 1 --2- 172.21.15.37:0/1889922554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd2c0047c0 0x7fcd2c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:53.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.550+0000 7fcd43fff640 1 --2- 172.21.15.37:0/1889922554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd440ccb80 0x7fcd2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.550+0000 7fcd43fff640 1 -- 172.21.15.37:0/1889922554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd440cff80 con 0x7fcd2c0039a0 2023-12-11T17:10:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.550+0000 7fcd43fff640 1 -- 172.21.15.37:0/1889922554 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c00bab0 con 0x7fcd2c0047c0 2023-12-11T17:10:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.550+0000 7fcd43fff640 1 -- 172.21.15.37:0/1889922554 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd2c00bc70 con 0x7fcd440ccb80 2023-12-11T17:10:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.551+0000 7fcd49161640 1 --2- 172.21.15.37:0/1889922554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd2c0039a0 0x7fcd2c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.551+0000 7fcd49161640 1 -- 172.21.15.37:0/1889922554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd440ccb80 msgr2=0x7fcd2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.551+0000 7fcd49161640 1 --2- 172.21.15.37:0/1889922554 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd440ccb80 0x7fcd2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.551+0000 7fcd49161640 1 -- 172.21.15.37:0/1889922554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd2c0047c0 msgr2=0x7fcd2c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.551+0000 7fcd49161640 1 --2- 172.21.15.37:0/1889922554 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd2c0047c0 0x7fcd2c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:53.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.551+0000 7fcd49161640 1 -- 172.21.15.37:0/1889922554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2c003520 con 0x7fcd2c0039a0 2023-12-11T17:10:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.552+0000 7fcd49161640 1 --2- 172.21.15.37:0/1889922554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd2c0039a0 0x7fcd2c003dc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400a830 tx=0x7fcd2c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=928e8cc1cf3e57f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.552+0000 7fcd43fff640 1 -- 172.21.15.37:0/1889922554 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd340072d0 con 0x7fcd2c0039a0 2023-12-11T17:10:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.552+0000 7fcd43fff640 1 -- 172.21.15.37:0/1889922554 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd3402f070 con 0x7fcd2c0039a0 2023-12-11T17:10:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.552+0000 7fcd43fff640 1 -- 172.21.15.37:0/1889922554 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd340076b0 con 0x7fcd2c0039a0 2023-12-11T17:10:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.553+0000 7fcd4b3c5640 1 -- 172.21.15.37:0/1889922554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd2c0039a0 msgr2=0x7fcd2c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:53.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.553+0000 7fcd4b3c5640 1 --2- 172.21.15.37:0/1889922554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd2c0039a0 0x7fcd2c003dc0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fcd3400a830 tx=0x7fcd2c0057f0 comp rx=0 tx=0).stop 2023-12-11T17:10:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.553+0000 7fcd49962640 1 -- 172.21.15.37:0/1889922554 reap_dead start 2023-12-11T17:10:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.553+0000 7fcd4b3c5640 1 -- 172.21.15.37:0/1889922554 shutdown_connections 2023-12-11T17:10:53.555 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.553+0000 7fcd4b3c5640 1 -- 172.21.15.37:0/1889922554 >> 172.21.15.37:0/1889922554 conn(0x7fcd440d0ed0 msgr2=0x7fcd440d12e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:53.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.553+0000 7fcd4b3c5640 1 -- 172.21.15.37:0/1889922554 shutdown_connections 2023-12-11T17:10:53.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.553+0000 7fcd4b3c5640 1 -- 172.21.15.37:0/1889922554 wait complete. 2023-12-11T17:10:53.557 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.555+0000 7fcd4b3c5640 1 Processor -- start 2023-12-11T17:10:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.555+0000 7fcd4b3c5640 1 -- start start 2023-12-11T17:10:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.556+0000 7fcd4b3c5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd2c0039a0 0x7fcd440c79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.556+0000 7fcd4b3c5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd4414f3c0 0x7fcd44152660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.556+0000 7fcd4b3c5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd4406ca20 0x7fcd4406cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.556+0000 7fcd4b3c5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4406d3e0 con 0x7fcd2c0039a0 2023-12-11T17:10:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.556+0000 7fcd4b3c5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd44152ba0 con 0x7fcd4414f3c0 2023-12-11T17:10:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.556+0000 7fcd4b3c5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd440c6920 con 0x7fcd4406ca20 2023-12-11T17:10:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.556+0000 7fcd49161640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd2c0039a0 0x7fcd440c79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.557+0000 7fcd49161640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd2c0039a0 0x7fcd440c79c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60158/0 (socket says 172.21.15.37:60158) 2023-12-11T17:10:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.557+0000 7fcd49161640 1 -- 172.21.15.37:0/2302132794 learned_addr learned my addr 172.21.15.37:0/2302132794 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.557+0000 7fcd49962640 1 --2- 172.21.15.37:0/2302132794 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd4406ca20 0x7fcd4406cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.557+0000 7fcd48960640 1 --2- 172.21.15.37:0/2302132794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd4414f3c0 0x7fcd44152660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:53.558 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.557+0000 7fcd49161640 1 -- 172.21.15.37:0/2302132794 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd4406ca20 msgr2=0x7fcd4406cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.557+0000 7fcd49161640 1 --2- 172.21.15.37:0/2302132794 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd4406ca20 0x7fcd4406cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.557+0000 7fcd49161640 1 -- 172.21.15.37:0/2302132794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd4414f3c0 msgr2=0x7fcd44152660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.557+0000 7fcd49161640 1 --2- 172.21.15.37:0/2302132794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd4414f3c0 0x7fcd44152660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.557+0000 7fcd49161640 1 -- 172.21.15.37:0/2302132794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd440c6c00 con 0x7fcd2c0039a0 2023-12-11T17:10:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.557+0000 7fcd48960640 1 --2- 172.21.15.37:0/2302132794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd4414f3c0 0x7fcd44152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.557+0000 7fcd49962640 1 --2- 172.21.15.37:0/2302132794 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd4406ca20 0x7fcd4406cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.557+0000 7fcd49161640 1 --2- 172.21.15.37:0/2302132794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd2c0039a0 0x7fcd440c79c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcd3402cb70 tx=0x7fcd34001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.558+0000 7fcd41ffb640 1 -- 172.21.15.37:0/2302132794 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd340074e0 con 0x7fcd2c0039a0 2023-12-11T17:10:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.558+0000 7fcd41ffb640 1 -- 172.21.15.37:0/2302132794 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd34007640 con 0x7fcd2c0039a0 2023-12-11T17:10:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.558+0000 7fcd41ffb640 1 -- 172.21.15.37:0/2302132794 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd340079d0 con 0x7fcd2c0039a0 2023-12-11T17:10:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.558+0000 7fcd4b3c5640 1 -- 172.21.15.37:0/2302132794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd440c6ee0 con 0x7fcd2c0039a0 2023-12-11T17:10:53.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.558+0000 7fcd4b3c5640 1 -- 172.21.15.37:0/2302132794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd440c74a0 con 0x7fcd2c0039a0 2023-12-11T17:10:53.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.559+0000 7fcd4b3c5640 1 -- 172.21.15.37:0/2302132794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd440c7630 con 0x7fcd2c0039a0 2023-12-11T17:10:53.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.560+0000 7fcd41ffb640 1 -- 172.21.15.37:0/2302132794 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcd34031030 con 0x7fcd2c0039a0 2023-12-11T17:10:53.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.561+0000 7fcd41ffb640 1 --2- 172.21.15.37:0/2302132794 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcd3006ae40 0x7fcd3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:53.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.561+0000 7fcd41ffb640 1 -- 172.21.15.37:0/2302132794 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fcd340ab500 con 0x7fcd2c0039a0 2023-12-11T17:10:53.561 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.561+0000 7fcd48960640 1 --2- 172.21.15.37:0/2302132794 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcd3006ae40 0x7fcd3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:53.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.563+0000 7fcd48960640 1 --2- 172.21.15.37:0/2302132794 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcd3006ae40 0x7fcd3006d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcd441f6810 tx=0x7fcd38009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:53.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.565+0000 7fcd41ffb640 1 -- 172.21.15.37:0/2302132794 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcd340761c0 con 0x7fcd2c0039a0 2023-12-11T17:10:53.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:53.828+0000 7fcd4b3c5640 1 -- 172.21.15.37:0/2302132794 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]} v 0) v1 -- 0x7fcd440745d0 con 0x7fcd2c0039a0 2023-12-11T17:10:54.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.416+0000 7fcd41ffb640 1 -- 172.21.15.37:0/2302132794 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.tests_from_xfstests_dev.TestXFSTestsDev.test_generic"]}]=0 v78) v1 ==== 147+0+0 (secure 0 0 0) 0x7fcd340797e0 con 0x7fcd2c0039a0 2023-12-11T17:10:54.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.419+0000 7fcd4b3c5640 1 -- 172.21.15.37:0/2302132794 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcd3006ae40 msgr2=0x7fcd3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:54.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.419+0000 7fcd4b3c5640 1 --2- 172.21.15.37:0/2302132794 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcd3006ae40 0x7fcd3006d300 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fcd441f6810 tx=0x7fcd38009040 comp rx=0 tx=0).stop 2023-12-11T17:10:54.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.419+0000 7fcd4b3c5640 1 -- 172.21.15.37:0/2302132794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd2c0039a0 msgr2=0x7fcd440c79c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:54.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.419+0000 7fcd4b3c5640 1 --2- 172.21.15.37:0/2302132794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd2c0039a0 0x7fcd440c79c0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fcd3402cb70 tx=0x7fcd34001d80 comp rx=0 tx=0).stop 2023-12-11T17:10:54.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.419+0000 7fcd4b3c5640 1 -- 172.21.15.37:0/2302132794 shutdown_connections 2023-12-11T17:10:54.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.419+0000 7fcd4b3c5640 1 --2- 172.21.15.37:0/2302132794 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcd3006ae40 0x7fcd3006d300 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:54.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.419+0000 7fcd4b3c5640 1 --2- 172.21.15.37:0/2302132794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcd4414f3c0 0x7fcd44152660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:54.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.419+0000 7fcd4b3c5640 1 --2- 172.21.15.37:0/2302132794 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcd4406ca20 0x7fcd4406cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:54.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.419+0000 7fcd4b3c5640 1 --2- 172.21.15.37:0/2302132794 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcd2c0039a0 0x7fcd440c79c0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:54.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.419+0000 7fcd4b3c5640 1 -- 172.21.15.37:0/2302132794 >> 172.21.15.37:0/2302132794 conn(0x7fcd440d0ed0 msgr2=0x7fcd440b4090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:54.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.420+0000 7fcd4b3c5640 1 -- 172.21.15.37:0/2302132794 shutdown_connections 2023-12-11T17:10:54.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.420+0000 7fcd4b3c5640 1 -- 172.21.15.37:0/2302132794 wait complete. 2023-12-11T17:10:54.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-11T17:10:54.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.667+0000 7eff91a39640 1 Processor -- start 2023-12-11T17:10:54.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.667+0000 7eff91a39640 1 -- start start 2023-12-11T17:10:54.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.669+0000 7eff91a39640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7eff8c1543f0 0x7eff8c15a590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:54.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.669+0000 7eff91a39640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7eff8c0b3810 0x7eff8c0cedf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:54.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.669+0000 7eff91a39640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff8c15ae30 con 0x7eff8c1547d0 2023-12-11T17:10:54.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.669+0000 7eff91a39640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff8c070780 con 0x7eff8c0b3810 2023-12-11T17:10:54.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.669+0000 7eff91a39640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff8c15b110 con 0x7eff8c1543f0 2023-12-11T17:10:54.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.670+0000 7eff8bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7eff8c1547d0 0x7eff8c070070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56508/0 (socket says 172.21.15.37:56508) 2023-12-11T17:10:54.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.670+0000 7eff8bfff640 1 -- 172.21.15.37:0/3949383248 learned_addr learned my addr 172.21.15.37:0/3949383248 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:54.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.670+0000 7eff91238640 1 --2- 172.21.15.37:0/3949383248 >> v2:172.21.15.37:3300/0 conn(0x7eff8c0b3810 0x7eff8c0cedf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.670+0000 7eff90a37640 1 --2- 172.21.15.37:0/3949383248 >> v2:172.21.15.151:3300/0 conn(0x7eff8c1543f0 0x7eff8c15a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.670+0000 7eff8b7fe640 1 -- 172.21.15.37:0/3949383248 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2416267394 0 0) 0x7eff8c15ae30 con 0x7eff8c1547d0 2023-12-11T17:10:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.670+0000 7eff8b7fe640 1 -- 172.21.15.37:0/3949383248 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7eff7c003520 con 0x7eff8c1547d0 2023-12-11T17:10:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.670+0000 7eff91238640 1 -- 172.21.15.37:0/3949383248 >> v2:172.21.15.151:3300/0 conn(0x7eff8c1543f0 msgr2=0x7eff8c15a590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.670+0000 7eff91238640 1 --2- 172.21.15.37:0/3949383248 >> v2:172.21.15.151:3300/0 conn(0x7eff8c1543f0 0x7eff8c15a590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.670+0000 7eff91238640 1 -- 172.21.15.37:0/3949383248 >> v1:172.21.15.37:6789/0 conn(0x7eff8c1547d0 legacy=0x7eff8c070070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.670+0000 7eff91238640 1 -- 172.21.15.37:0/3949383248 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff8c15b3f0 con 0x7eff8c0b3810 2023-12-11T17:10:54.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.670+0000 7eff90a37640 1 --2- 172.21.15.37:0/3949383248 >> v2:172.21.15.151:3300/0 conn(0x7eff8c1543f0 0x7eff8c15a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:10:54.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.671+0000 7eff91238640 1 --2- 172.21.15.37:0/3949383248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff8c0b3810 0x7eff8c0cedf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0cfcb0 tx=0x7eff8402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68605dd4fbe0d1e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:54.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.672+0000 7eff8b7fe640 1 -- 172.21.15.37:0/3949383248 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff8402cc80 con 0x7eff8c0b3810 2023-12-11T17:10:54.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.672+0000 7eff8b7fe640 1 -- 172.21.15.37:0/3949383248 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff8402cde0 con 0x7eff8c0b3810 2023-12-11T17:10:54.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.672+0000 7eff8b7fe640 1 -- 172.21.15.37:0/3949383248 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff84034660 con 0x7eff8c0b3810 2023-12-11T17:10:54.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.672+0000 7eff91a39640 1 -- 172.21.15.37:0/3949383248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff8c0b3810 msgr2=0x7eff8c0cedf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:54.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.672+0000 7eff91a39640 1 --2- 172.21.15.37:0/3949383248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff8c0b3810 0x7eff8c0cedf0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0cfcb0 tx=0x7eff8402bed0 comp rx=0 tx=0).stop 2023-12-11T17:10:54.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.673+0000 7eff91a39640 1 -- 172.21.15.37:0/3949383248 shutdown_connections 2023-12-11T17:10:54.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.673+0000 7eff91a39640 1 --2- 172.21.15.37:0/3949383248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff8c0b3810 0x7eff8c0cedf0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:54.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.673+0000 7eff91a39640 1 --2- 172.21.15.37:0/3949383248 >> v2:172.21.15.151:3300/0 conn(0x7eff8c1543f0 0x7eff8c15a590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:54.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.673+0000 7eff91a39640 1 -- 172.21.15.37:0/3949383248 >> 172.21.15.37:0/3949383248 conn(0x7eff8c06a640 msgr2=0x7eff8c06aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:54.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.673+0000 7eff91a39640 1 -- 172.21.15.37:0/3949383248 shutdown_connections 2023-12-11T17:10:54.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.673+0000 7eff91a39640 1 -- 172.21.15.37:0/3949383248 wait complete. 2023-12-11T17:10:54.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.675+0000 7eff91a39640 1 Processor -- start 2023-12-11T17:10:54.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.675+0000 7eff91a39640 1 -- start start 2023-12-11T17:10:54.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.676+0000 7eff91a39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff8c0b3810 0x7eff8c15c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:54.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.676+0000 7eff91a39640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff8c1543f0 0x7eff8c1f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:54.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.676+0000 7eff91a39640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff8c1547d0 0x7eff8c159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:54.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.676+0000 7eff91a39640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c157650 con 0x7eff8c0b3810 2023-12-11T17:10:54.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.676+0000 7eff91a39640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c15c680 con 0x7eff8c1547d0 2023-12-11T17:10:54.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.676+0000 7eff91a39640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff8c1565d0 con 0x7eff8c1543f0 2023-12-11T17:10:54.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.676+0000 7eff90a37640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff8c0b3810 0x7eff8c15c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:54.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.676+0000 7eff90a37640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff8c0b3810 0x7eff8c15c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60168/0 (socket says 172.21.15.37:60168) 2023-12-11T17:10:54.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.676+0000 7eff90a37640 1 -- 172.21.15.37:0/2191836906 learned_addr learned my addr 172.21.15.37:0/2191836906 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:54.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.676+0000 7eff90a37640 1 -- 172.21.15.37:0/2191836906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff8c1543f0 msgr2=0x7eff8c1f1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:54.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.676+0000 7eff90a37640 1 --2- 172.21.15.37:0/2191836906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff8c1543f0 0x7eff8c1f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:54.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.676+0000 7eff90a37640 1 -- 172.21.15.37:0/2191836906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff8c1547d0 msgr2=0x7eff8c159200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:54.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.676+0000 7eff90a37640 1 --2- 172.21.15.37:0/2191836906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff8c1547d0 0x7eff8c159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:54.677 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.676+0000 7eff90a37640 1 -- 172.21.15.37:0/2191836906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff84009a70 con 0x7eff8c0b3810 2023-12-11T17:10:54.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.677+0000 7eff90a37640 1 --2- 172.21.15.37:0/2191836906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff8c0b3810 0x7eff8c15c140 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7eff8000e7e0 tx=0x7eff8000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:54.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.677+0000 7eff897fa640 1 -- 172.21.15.37:0/2191836906 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff80004030 con 0x7eff8c0b3810 2023-12-11T17:10:54.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.677+0000 7eff897fa640 1 -- 172.21.15.37:0/2191836906 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff80004190 con 0x7eff8c0b3810 2023-12-11T17:10:54.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.677+0000 7eff897fa640 1 -- 172.21.15.37:0/2191836906 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff80004520 con 0x7eff8c0b3810 2023-12-11T17:10:54.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.677+0000 7eff91a39640 1 -- 172.21.15.37:0/2191836906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff8c1568b0 con 0x7eff8c0b3810 2023-12-11T17:10:54.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.677+0000 7eff91a39640 1 -- 172.21.15.37:0/2191836906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff8c156e70 con 0x7eff8c0b3810 2023-12-11T17:10:54.678 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.678+0000 7eff91a39640 1 -- 172.21.15.37:0/2191836906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff8c074450 con 0x7eff8c0b3810 2023-12-11T17:10:54.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.679+0000 7eff897fa640 1 -- 172.21.15.37:0/2191836906 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7eff8000c6d0 con 0x7eff8c0b3810 2023-12-11T17:10:54.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.680+0000 7eff897fa640 1 --2- 172.21.15.37:0/2191836906 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7eff7006ae40 0x7eff7006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:54.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.680+0000 7eff897fa640 1 -- 172.21.15.37:0/2191836906 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7eff800896b0 con 0x7eff8c0b3810 2023-12-11T17:10:54.680 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.681+0000 7eff8bfff640 1 --2- 172.21.15.37:0/2191836906 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7eff7006ae40 0x7eff7006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:54.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.682+0000 7eff8bfff640 1 --2- 172.21.15.37:0/2191836906 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7eff7006ae40 0x7eff7006d300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0cf7e0 tx=0x7eff78007930 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:54.684 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.684+0000 7eff897fa640 1 -- 172.21.15.37:0/2191836906 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7eff80054360 con 0x7eff8c0b3810 2023-12-11T17:10:54.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.879+0000 7eff91a39640 1 -- 172.21.15.37:0/2191836906 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7eff8c070440 con 0x7eff8c0b3810 2023-12-11T17:10:54.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.885+0000 7eff897fa640 1 -- 172.21.15.37:0/2191836906 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7eff80057980 con 0x7eff8c0b3810 2023-12-11T17:10:54.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.887+0000 7eff91a39640 1 -- 172.21.15.37:0/2191836906 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7eff7006ae40 msgr2=0x7eff7006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:54.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.887+0000 7eff91a39640 1 --2- 172.21.15.37:0/2191836906 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7eff7006ae40 0x7eff7006d300 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0cf7e0 tx=0x7eff78007930 comp rx=0 tx=0).stop 2023-12-11T17:10:54.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.887+0000 7eff91a39640 1 -- 172.21.15.37:0/2191836906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff8c0b3810 msgr2=0x7eff8c15c140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:54.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.887+0000 7eff91a39640 1 --2- 172.21.15.37:0/2191836906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff8c0b3810 0x7eff8c15c140 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7eff8000e7e0 tx=0x7eff8000eca0 comp rx=0 tx=0).stop 2023-12-11T17:10:54.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.888+0000 7eff91a39640 1 -- 172.21.15.37:0/2191836906 shutdown_connections 2023-12-11T17:10:54.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.888+0000 7eff91a39640 1 --2- 172.21.15.37:0/2191836906 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7eff7006ae40 0x7eff7006d300 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:54.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.888+0000 7eff91a39640 1 --2- 172.21.15.37:0/2191836906 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7eff8c1547d0 0x7eff8c159200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:54.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.888+0000 7eff91a39640 1 --2- 172.21.15.37:0/2191836906 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7eff8c1543f0 0x7eff8c1f1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:54.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.888+0000 7eff91a39640 1 --2- 172.21.15.37:0/2191836906 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7eff8c0b3810 0x7eff8c15c140 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:54.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.888+0000 7eff91a39640 1 -- 172.21.15.37:0/2191836906 >> 172.21.15.37:0/2191836906 conn(0x7eff8c06a640 msgr2=0x7eff8c0cedc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:54.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.888+0000 7eff91a39640 1 -- 172.21.15.37:0/2191836906 shutdown_connections 2023-12-11T17:10:54.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:54.888+0000 7eff91a39640 1 -- 172.21.15.37:0/2191836906 wait complete. 2023-12-11T17:10:54.907 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-11T17:10:54.908 DEBUG:teuthology.orchestra.run.smithi037:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-11T17:10:55.025 DEBUG:teuthology.orchestra.run.smithi151:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-11T17:10:55.151 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-11T17:10:55.151 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:10:55.151 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-11T17:10:55.215 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:10:55.215 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-11T17:10:55.276 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:10:55.276 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-11T17:10:55.338 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:10:55.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.566+0000 7f08e359e640 1 Processor -- start 2023-12-11T17:10:55.566 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.566+0000 7f08e359e640 1 -- start start 2023-12-11T17:10:55.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.568+0000 7f08e359e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08e415e5d0 0x7f08e406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:55.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.568+0000 7f08e359e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08e40ae200 0x7f08e4070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:55.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.568+0000 7f08e359e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f08e406c330 0x7f08e4071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:55.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.568+0000 7f08e359e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e4071f90 con 0x7f08e415e5d0 2023-12-11T17:10:55.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.568+0000 7f08e359e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08e4072270 con 0x7f08e406c330 2023-12-11T17:10:55.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.568+0000 7f08e359e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e4070070 con 0x7f08e40ae200 2023-12-11T17:10:55.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.568+0000 7f08e259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08e415e5d0 0x7f08e406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:55.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.568+0000 7f08e259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f08e415e5d0 0x7f08e406bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60184/0 (socket says 172.21.15.37:60184) 2023-12-11T17:10:55.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.568+0000 7f08e259c640 1 -- 172.21.15.37:0/272586306 learned_addr learned my addr 172.21.15.37:0/272586306 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:55.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.569+0000 7f08e2d9d640 1 --2- 172.21.15.37:0/272586306 >> v2:172.21.15.151:3300/0 conn(0x7f08e406c330 0x7f08e4071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:55.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.569+0000 7f08e1d9b640 1 --2- 172.21.15.37:0/272586306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08e40ae200 0x7f08e4070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:55.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.569+0000 7f08e259c640 1 -- 172.21.15.37:0/272586306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08e40ae200 msgr2=0x7f08e4070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:55.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.569+0000 7f08e259c640 1 --2- 172.21.15.37:0/272586306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08e40ae200 0x7f08e4070b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:55.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.569+0000 7f08e259c640 1 -- 172.21.15.37:0/272586306 >> v2:172.21.15.151:3300/0 conn(0x7f08e406c330 msgr2=0x7f08e4071090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:55.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.569+0000 7f08e259c640 1 --2- 172.21.15.37:0/272586306 >> v2:172.21.15.151:3300/0 conn(0x7f08e406c330 0x7f08e4071090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:55.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.569+0000 7f08e259c640 1 -- 172.21.15.37:0/272586306 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e4070350 con 0x7f08e415e5d0 2023-12-11T17:10:55.570 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.570+0000 7f08e259c640 1 --2- 172.21.15.37:0/272586306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e415e5d0 0x7f08e406bdf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f08e40b3f90 tx=0x7f08d402b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90554516db031d3e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:55.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.570+0000 7f08e159a640 1 -- 172.21.15.37:0/272586306 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d4031740 con 0x7f08e415e5d0 2023-12-11T17:10:55.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.570+0000 7f08e159a640 1 -- 172.21.15.37:0/272586306 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08d40318a0 con 0x7f08e415e5d0 2023-12-11T17:10:55.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.570+0000 7f08e159a640 1 -- 172.21.15.37:0/272586306 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08d4031c30 con 0x7f08e415e5d0 2023-12-11T17:10:55.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.571+0000 7f08e359e640 1 -- 172.21.15.37:0/272586306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e415e5d0 msgr2=0x7f08e406bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:55.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.571+0000 7f08e359e640 1 --2- 172.21.15.37:0/272586306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e415e5d0 0x7f08e406bdf0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f08e40b3f90 tx=0x7f08d402b7e0 comp rx=0 tx=0).stop 2023-12-11T17:10:55.571 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.571+0000 7f08e359e640 1 -- 172.21.15.37:0/272586306 shutdown_connections 2023-12-11T17:10:55.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.571+0000 7f08e359e640 1 --2- 172.21.15.37:0/272586306 >> v2:172.21.15.151:3300/0 conn(0x7f08e406c330 0x7f08e4071090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:55.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.571+0000 7f08e359e640 1 --2- 172.21.15.37:0/272586306 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08e40ae200 0x7f08e4070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:55.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.571+0000 7f08e359e640 1 --2- 172.21.15.37:0/272586306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e415e5d0 0x7f08e406bdf0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:55.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.571+0000 7f08e359e640 1 -- 172.21.15.37:0/272586306 >> 172.21.15.37:0/272586306 conn(0x7f08e40b0860 msgr2=0x7f08e40b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:55.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.571+0000 7f08e359e640 1 -- 172.21.15.37:0/272586306 shutdown_connections 2023-12-11T17:10:55.572 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.571+0000 7f08e359e640 1 -- 172.21.15.37:0/272586306 wait complete. 2023-12-11T17:10:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.573+0000 7f08e359e640 1 Processor -- start 2023-12-11T17:10:55.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.573+0000 7f08e359e640 1 -- start start 2023-12-11T17:10:55.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.574+0000 7f08e359e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08e406c330 0x7f08e41f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:55.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.574+0000 7f08e359e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08e40ae200 0x7f08e415bf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:55.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.574+0000 7f08e359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e415e5d0 0x7f08e409a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:55.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.574+0000 7f08e359e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e415aeb0 con 0x7f08e415e5d0 2023-12-11T17:10:55.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.574+0000 7f08e359e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08e415b190 con 0x7f08e406c330 2023-12-11T17:10:55.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.574+0000 7f08e359e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e415b470 con 0x7f08e40ae200 2023-12-11T17:10:55.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.574+0000 7f08e2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e415e5d0 0x7f08e409a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:55.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.574+0000 7f08e2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e415e5d0 0x7f08e409a600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60192/0 (socket says 172.21.15.37:60192) 2023-12-11T17:10:55.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.574+0000 7f08e2d9d640 1 -- 172.21.15.37:0/3850561255 learned_addr learned my addr 172.21.15.37:0/3850561255 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:55.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.575+0000 7f08e2d9d640 1 -- 172.21.15.37:0/3850561255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08e40ae200 msgr2=0x7f08e415bf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:55.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.575+0000 7f08e2d9d640 1 --2- 172.21.15.37:0/3850561255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08e40ae200 0x7f08e415bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:55.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.575+0000 7f08e2d9d640 1 -- 172.21.15.37:0/3850561255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08e406c330 msgr2=0x7f08e41f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:55.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.575+0000 7f08e2d9d640 1 --2- 172.21.15.37:0/3850561255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08e406c330 0x7f08e41f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:55.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.575+0000 7f08e2d9d640 1 -- 172.21.15.37:0/3850561255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08d40094d0 con 0x7f08e415e5d0 2023-12-11T17:10:55.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.575+0000 7f08e2d9d640 1 --2- 172.21.15.37:0/3850561255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e415e5d0 0x7f08e409a600 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f08dc007e60 tx=0x7f08dc00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:55.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.575+0000 7f08d2ffd640 1 -- 172.21.15.37:0/3850561255 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc014420 con 0x7f08e415e5d0 2023-12-11T17:10:55.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.575+0000 7f08d2ffd640 1 -- 172.21.15.37:0/3850561255 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08dc0145a0 con 0x7f08e415e5d0 2023-12-11T17:10:55.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.575+0000 7f08d2ffd640 1 -- 172.21.15.37:0/3850561255 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08dc014950 con 0x7f08e415e5d0 2023-12-11T17:10:55.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.576+0000 7f08e359e640 1 -- 172.21.15.37:0/3850561255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08e415b750 con 0x7f08e415e5d0 2023-12-11T17:10:55.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.576+0000 7f08e359e640 1 -- 172.21.15.37:0/3850561255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08e41f2510 con 0x7f08e415e5d0 2023-12-11T17:10:55.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.577+0000 7f08e359e640 1 -- 172.21.15.37:0/3850561255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08e415bc70 con 0x7f08e415e5d0 2023-12-11T17:10:55.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.578+0000 7f08d2ffd640 1 -- 172.21.15.37:0/3850561255 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f08dc014ab0 con 0x7f08e415e5d0 2023-12-11T17:10:55.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.579+0000 7f08d2ffd640 1 --2- 172.21.15.37:0/3850561255 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f08c406ae40 0x7f08c406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:55.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.579+0000 7f08d2ffd640 1 -- 172.21.15.37:0/3850561255 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f08dc08a2b0 con 0x7f08e415e5d0 2023-12-11T17:10:55.579 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.579+0000 7f08e259c640 1 --2- 172.21.15.37:0/3850561255 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f08c406ae40 0x7f08c406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:55.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.580+0000 7f08e259c640 1 --2- 172.21.15.37:0/3850561255 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f08c406ae40 0x7f08c406d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f08d4035000 tx=0x7f08d4030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:55.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.583+0000 7f08d2ffd640 1 -- 172.21.15.37:0/3850561255 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f08e415bc70 con 0x7f08e415e5d0 2023-12-11T17:10:55.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.776+0000 7f08e359e640 1 -- 172.21.15.37:0/3850561255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08e415bc70 con 0x7f08e415e5d0 2023-12-11T17:10:55.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.779+0000 7f08d2ffd640 1 -- 172.21.15.37:0/3850561255 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18779 (secure 0 0 0) 0x7f08e415bc70 con 0x7f08e415e5d0 2023-12-11T17:10:55.779 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:55.780 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:10:32.309274+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:10:55.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.781+0000 7f08e359e640 1 -- 172.21.15.37:0/3850561255 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f08c406ae40 msgr2=0x7f08c406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:55.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.781+0000 7f08e359e640 1 --2- 172.21.15.37:0/3850561255 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f08c406ae40 0x7f08c406d300 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f08d4035000 tx=0x7f08d4030000 comp rx=0 tx=0).stop 2023-12-11T17:10:55.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.781+0000 7f08e359e640 1 -- 172.21.15.37:0/3850561255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e415e5d0 msgr2=0x7f08e409a600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:55.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.781+0000 7f08e359e640 1 --2- 172.21.15.37:0/3850561255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e415e5d0 0x7f08e409a600 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f08dc007e60 tx=0x7f08dc00e4b0 comp rx=0 tx=0).stop 2023-12-11T17:10:55.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.782+0000 7f08e359e640 1 -- 172.21.15.37:0/3850561255 shutdown_connections 2023-12-11T17:10:55.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.782+0000 7f08e359e640 1 --2- 172.21.15.37:0/3850561255 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f08c406ae40 0x7f08c406d300 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:55.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.782+0000 7f08e359e640 1 --2- 172.21.15.37:0/3850561255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f08e415e5d0 0x7f08e409a600 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:55.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.782+0000 7f08e359e640 1 --2- 172.21.15.37:0/3850561255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f08e40ae200 0x7f08e415bf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:55.782 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.782+0000 7f08e359e640 1 --2- 172.21.15.37:0/3850561255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f08e406c330 0x7f08e41f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:55.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.782+0000 7f08e359e640 1 -- 172.21.15.37:0/3850561255 >> 172.21.15.37:0/3850561255 conn(0x7f08e40b0860 msgr2=0x7f08e4159f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:55.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.782+0000 7f08e359e640 1 -- 172.21.15.37:0/3850561255 shutdown_connections 2023-12-11T17:10:55.783 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:55.782+0000 7f08e359e640 1 -- 172.21.15.37:0/3850561255 wait complete. 2023-12-11T17:10:55.803 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T17:09:38.415636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T17:09:42.786774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T17:09:43.660585+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-11T17:09:47.272351+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-11T17:10:55.803 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T17:10:56.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.017+0000 7f4f44aff640 1 Processor -- start 2023-12-11T17:10:56.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.017+0000 7f4f44aff640 1 -- start start 2023-12-11T17:10:56.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.018+0000 7f4f44aff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4f400b3350 0x7f4f400b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:56.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.019+0000 7f4f44aff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f400c6b80 con 0x7f4f400cfe70 2023-12-11T17:10:56.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.019+0000 7f4f44aff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f400d3bf0 con 0x7f4f400b3730 2023-12-11T17:10:56.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.019+0000 7f4f44aff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f400d3ed0 con 0x7f4f400b3350 2023-12-11T17:10:56.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.019+0000 7f4f3ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4f400cfe70 0x7f4f400cdef0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56518/0 (socket says 172.21.15.37:56518) 2023-12-11T17:10:56.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.019+0000 7f4f3ffff640 1 -- 172.21.15.37:0/791651555 learned_addr learned my addr 172.21.15.37:0/791651555 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:56.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.019+0000 7f4f3f7fe640 1 --2- 172.21.15.37:0/791651555 >> v2:172.21.15.151:3300/0 conn(0x7f4f400b3350 0x7f4f400b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:56.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.019+0000 7f4f3e7fc640 1 -- 172.21.15.37:0/791651555 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3607495297 0 0) 0x7f4f400c6b80 con 0x7f4f400cfe70 2023-12-11T17:10:56.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.019+0000 7f4f3e7fc640 1 -- 172.21.15.37:0/791651555 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f28003520 con 0x7f4f400cfe70 2023-12-11T17:10:56.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.020+0000 7f4f3e7fc640 1 -- 172.21.15.37:0/791651555 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2974171585 0 0) 0x7f4f28003520 con 0x7f4f400cfe70 2023-12-11T17:10:56.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.020+0000 7f4f3e7fc640 1 -- 172.21.15.37:0/791651555 >> v2:172.21.15.151:3300/0 conn(0x7f4f400b3350 msgr2=0x7f4f400b3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:56.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.020+0000 7f4f3e7fc640 1 --2- 172.21.15.37:0/791651555 >> v2:172.21.15.151:3300/0 conn(0x7f4f400b3350 0x7f4f400b3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.020+0000 7f4f3e7fc640 1 -- 172.21.15.37:0/791651555 >> v1:172.21.15.151:6789/0 conn(0x7f4f400b3730 legacy=0x7f4f400cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:56.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.020+0000 7f4f3e7fc640 1 -- 172.21.15.37:0/791651555 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f400d18c0 con 0x7f4f400cfe70 2023-12-11T17:10:56.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.020+0000 7f4f3e7fc640 1 -- 172.21.15.37:0/791651555 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f4f38001670 con 0x7f4f400cfe70 2023-12-11T17:10:56.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.020+0000 7f4f3e7fc640 1 -- 172.21.15.37:0/791651555 >> v1:172.21.15.37:6789/0 conn(0x7f4f400cfe70 legacy=0x7f4f400cdef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:56.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.020+0000 7f4f3e7fc640 1 --2- 172.21.15.37:0/791651555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f280039c0 0x7f4f28003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:56.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.020+0000 7f4f3e7fc640 1 --2- 172.21.15.37:0/791651555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f280047c0 0x7f4f28004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:56.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.020+0000 7f4f3e7fc640 1 --2- 172.21.15.37:0/791651555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f28005180 0x7f4f2800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:56.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.020+0000 7f4f3e7fc640 1 -- 172.21.15.37:0/791651555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f400d3ed0 con 0x7f4f280039c0 2023-12-11T17:10:56.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.020+0000 7f4f3e7fc640 1 -- 172.21.15.37:0/791651555 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2800c080 con 0x7f4f28005180 2023-12-11T17:10:56.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.020+0000 7f4f3e7fc640 1 -- 172.21.15.37:0/791651555 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f2800c240 con 0x7f4f280047c0 2023-12-11T17:10:56.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.020+0000 7f4f3f7fe640 1 --2- 172.21.15.37:0/791651555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f280039c0 0x7f4f28003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:56.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.021+0000 7f4f3effd640 1 --2- 172.21.15.37:0/791651555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f280047c0 0x7f4f28004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:56.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.021+0000 7f4f3ffff640 1 --2- 172.21.15.37:0/791651555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f28005180 0x7f4f2800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:56.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.021+0000 7f4f3f7fe640 1 -- 172.21.15.37:0/791651555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f280047c0 msgr2=0x7f4f28004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:56.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.021+0000 7f4f3f7fe640 1 --2- 172.21.15.37:0/791651555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f280047c0 0x7f4f28004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.021+0000 7f4f3f7fe640 1 -- 172.21.15.37:0/791651555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f28005180 msgr2=0x7f4f2800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:56.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.021+0000 7f4f3f7fe640 1 --2- 172.21.15.37:0/791651555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f28005180 0x7f4f2800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.021+0000 7f4f3f7fe640 1 -- 172.21.15.37:0/791651555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f28003520 con 0x7f4f280039c0 2023-12-11T17:10:56.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.021+0000 7f4f3ffff640 1 -- 172.21.15.37:0/791651555 reap_dead start 2023-12-11T17:10:56.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.022+0000 7f4f3f7fe640 1 --2- 172.21.15.37:0/791651555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f280039c0 0x7f4f28003de0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4f30009ac0 tx=0x7f4f280057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b61c05c8fb124f17 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:56.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.022+0000 7f4f3e7fc640 1 -- 172.21.15.37:0/791651555 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3002c6b0 con 0x7f4f280039c0 2023-12-11T17:10:56.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.022+0000 7f4f3e7fc640 1 -- 172.21.15.37:0/791651555 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f3002c810 con 0x7f4f280039c0 2023-12-11T17:10:56.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.022+0000 7f4f3e7fc640 1 -- 172.21.15.37:0/791651555 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f3002cba0 con 0x7f4f280039c0 2023-12-11T17:10:56.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.023+0000 7f4f44aff640 1 -- 172.21.15.37:0/791651555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f280039c0 msgr2=0x7f4f28003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:56.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.023+0000 7f4f44aff640 1 --2- 172.21.15.37:0/791651555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f280039c0 0x7f4f28003de0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f4f30009ac0 tx=0x7f4f280057f0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.023+0000 7f4f44aff640 1 -- 172.21.15.37:0/791651555 shutdown_connections 2023-12-11T17:10:56.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.023+0000 7f4f44aff640 1 --2- 172.21.15.37:0/791651555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f280039c0 0x7f4f28003de0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.023+0000 7f4f44aff640 1 -- 172.21.15.37:0/791651555 >> 172.21.15.37:0/791651555 conn(0x7f4f400d3030 msgr2=0x7f4f400d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:56.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.023+0000 7f4f44aff640 1 -- 172.21.15.37:0/791651555 shutdown_connections 2023-12-11T17:10:56.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.023+0000 7f4f44aff640 1 -- 172.21.15.37:0/791651555 wait complete. 2023-12-11T17:10:56.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.025+0000 7f4f44aff640 1 Processor -- start 2023-12-11T17:10:56.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.025+0000 7f4f44aff640 1 -- start start 2023-12-11T17:10:56.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.026+0000 7f4f44aff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f280039c0 0x7f4f40157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:56.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.026+0000 7f4f44aff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f4015a2e0 0x7f4f401f6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:56.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.026+0000 7f4f44aff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f401f6c90 0x7f4f401f2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:56.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.026+0000 7f4f44aff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f40159280 con 0x7f4f4015a2e0 2023-12-11T17:10:56.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.026+0000 7f4f44aff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f40159520 con 0x7f4f280039c0 2023-12-11T17:10:56.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.026+0000 7f4f44aff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f40159800 con 0x7f4f401f6c90 2023-12-11T17:10:56.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.027+0000 7f4f3effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f4015a2e0 0x7f4f401f6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:56.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.027+0000 7f4f3effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f4015a2e0 0x7f4f401f6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60198/0 (socket says 172.21.15.37:60198) 2023-12-11T17:10:56.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.027+0000 7f4f3effd640 1 -- 172.21.15.37:0/3229702571 learned_addr learned my addr 172.21.15.37:0/3229702571 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:56.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.027+0000 7f4f3f7fe640 1 --2- 172.21.15.37:0/3229702571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f280039c0 0x7f4f40157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:56.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.027+0000 7f4f3ffff640 1 --2- 172.21.15.37:0/3229702571 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f401f6c90 0x7f4f401f2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:56.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.027+0000 7f4f3effd640 1 -- 172.21.15.37:0/3229702571 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f401f6c90 msgr2=0x7f4f401f2fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:56.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.027+0000 7f4f3effd640 1 --2- 172.21.15.37:0/3229702571 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f401f6c90 0x7f4f401f2fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.027+0000 7f4f3effd640 1 -- 172.21.15.37:0/3229702571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f280039c0 msgr2=0x7f4f40157500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:56.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.027+0000 7f4f3effd640 1 --2- 172.21.15.37:0/3229702571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f280039c0 0x7f4f40157500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.027+0000 7f4f3effd640 1 -- 172.21.15.37:0/3229702571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f400b48a0 con 0x7f4f4015a2e0 2023-12-11T17:10:56.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.027+0000 7f4f3ffff640 1 --2- 172.21.15.37:0/3229702571 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f401f6c90 0x7f4f401f2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:56.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.027+0000 7f4f3effd640 1 --2- 172.21.15.37:0/3229702571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f4015a2e0 0x7f4f401f6750 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400e840 tx=0x7f4f3400ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:56.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.028+0000 7f4f27fff640 1 -- 172.21.15.37:0/3229702571 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34003b80 con 0x7f4f4015a2e0 2023-12-11T17:10:56.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.028+0000 7f4f27fff640 1 -- 172.21.15.37:0/3229702571 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f34003ce0 con 0x7f4f4015a2e0 2023-12-11T17:10:56.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.028+0000 7f4f27fff640 1 -- 172.21.15.37:0/3229702571 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f34005310 con 0x7f4f4015a2e0 2023-12-11T17:10:56.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.028+0000 7f4f44aff640 1 -- 172.21.15.37:0/3229702571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f40159ae0 con 0x7f4f4015a2e0 2023-12-11T17:10:56.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.028+0000 7f4f44aff640 1 -- 172.21.15.37:0/3229702571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f401f7140 con 0x7f4f4015a2e0 2023-12-11T17:10:56.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.029+0000 7f4f44aff640 1 -- 172.21.15.37:0/3229702571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f40074450 con 0x7f4f4015a2e0 2023-12-11T17:10:56.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.030+0000 7f4f27fff640 1 -- 172.21.15.37:0/3229702571 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4f34005470 con 0x7f4f4015a2e0 2023-12-11T17:10:56.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.031+0000 7f4f27fff640 1 --2- 172.21.15.37:0/3229702571 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4f2c06ae40 0x7f4f2c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:56.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.031+0000 7f4f27fff640 1 -- 172.21.15.37:0/3229702571 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f4f34089b30 con 0x7f4f4015a2e0 2023-12-11T17:10:56.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.032+0000 7f4f3f7fe640 1 --2- 172.21.15.37:0/3229702571 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4f2c06ae40 0x7f4f2c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:56.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.033+0000 7f4f3f7fe640 1 --2- 172.21.15.37:0/3229702571 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4f2c06ae40 0x7f4f2c06d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4f30036000 tx=0x7f4f30030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:56.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.035+0000 7f4f27fff640 1 -- 172.21.15.37:0/3229702571 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4f340547f0 con 0x7f4f4015a2e0 2023-12-11T17:10:56.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.233+0000 7f4f44aff640 1 -- 172.21.15.37:0/3229702571 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4f40072830 con 0x7f4f4015a2e0 2023-12-11T17:10:56.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.234+0000 7f4f27fff640 1 -- 172.21.15.37:0/3229702571 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4f3401a310 con 0x7f4f4015a2e0 2023-12-11T17:10:56.234 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-11T17:10:56.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.236+0000 7f4f44aff640 1 -- 172.21.15.37:0/3229702571 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4f2c06ae40 msgr2=0x7f4f2c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:56.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.236+0000 7f4f44aff640 1 --2- 172.21.15.37:0/3229702571 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4f2c06ae40 0x7f4f2c06d300 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4f30036000 tx=0x7f4f30030000 comp rx=0 tx=0).stop 2023-12-11T17:10:56.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.236+0000 7f4f44aff640 1 -- 172.21.15.37:0/3229702571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f4015a2e0 msgr2=0x7f4f401f6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:56.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.236+0000 7f4f44aff640 1 --2- 172.21.15.37:0/3229702571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f4015a2e0 0x7f4f401f6750 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f4f3400e840 tx=0x7f4f3400ed00 comp rx=0 tx=0).stop 2023-12-11T17:10:56.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.237+0000 7f4f44aff640 1 -- 172.21.15.37:0/3229702571 shutdown_connections 2023-12-11T17:10:56.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.237+0000 7f4f44aff640 1 --2- 172.21.15.37:0/3229702571 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4f2c06ae40 0x7f4f2c06d300 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.237+0000 7f4f44aff640 1 --2- 172.21.15.37:0/3229702571 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4f401f6c90 0x7f4f401f2fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.237+0000 7f4f44aff640 1 --2- 172.21.15.37:0/3229702571 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4f4015a2e0 0x7f4f401f6750 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.237+0000 7f4f44aff640 1 --2- 172.21.15.37:0/3229702571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4f280039c0 0x7f4f40157500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.237+0000 7f4f44aff640 1 -- 172.21.15.37:0/3229702571 >> 172.21.15.37:0/3229702571 conn(0x7f4f400d3030 msgr2=0x7f4f400b0170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:56.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.237+0000 7f4f44aff640 1 -- 172.21.15.37:0/3229702571 shutdown_connections 2023-12-11T17:10:56.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.237+0000 7f4f44aff640 1 -- 172.21.15.37:0/3229702571 wait complete. 2023-12-11T17:10:56.256 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T17:10:56.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.502+0000 7f83b893b640 1 Processor -- start 2023-12-11T17:10:56.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.502+0000 7f83b893b640 1 -- start start 2023-12-11T17:10:56.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.504+0000 7f83b893b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83b406c130 0x7f83b415f510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.504+0000 7f83b893b640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f83b4070c60 0x7f83b40710e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.504+0000 7f83b893b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83b406c770 con 0x7f83b40cb5b0 2023-12-11T17:10:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.504+0000 7f83b893b640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f83b406ca50 con 0x7f83b4070c60 2023-12-11T17:10:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.504+0000 7f83b893b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b406cd30 con 0x7f83b406c130 2023-12-11T17:10:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.504+0000 7f83b2d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f83b40cb5b0 0x7f83b40cb990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56532/0 (socket says 172.21.15.37:56532) 2023-12-11T17:10:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.504+0000 7f83b2d9d640 1 -- 172.21.15.37:0/2864921094 learned_addr learned my addr 172.21.15.37:0/2864921094 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.505+0000 7f83b359e640 1 --2- 172.21.15.37:0/2864921094 >> v2:172.21.15.151:3300/0 conn(0x7f83b4070c60 0x7f83b40710e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.505+0000 7f83aa59c640 1 --2- 172.21.15.37:0/2864921094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83b406c130 0x7f83b415f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.505+0000 7f83b259c640 1 -- 172.21.15.37:0/2864921094 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2857383854 0 0) 0x7f83b406c770 con 0x7f83b40cb5b0 2023-12-11T17:10:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.505+0000 7f83b259c640 1 -- 172.21.15.37:0/2864921094 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83a0003520 con 0x7f83b40cb5b0 2023-12-11T17:10:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.505+0000 7f83b259c640 1 -- 172.21.15.37:0/2864921094 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1453854503 0 0) 0x7f83a0003520 con 0x7f83b40cb5b0 2023-12-11T17:10:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.505+0000 7f83aa59c640 1 -- 172.21.15.37:0/2864921094 >> v2:172.21.15.151:3300/0 conn(0x7f83b4070c60 msgr2=0x7f83b40710e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.505+0000 7f83aa59c640 1 --2- 172.21.15.37:0/2864921094 >> v2:172.21.15.151:3300/0 conn(0x7f83b4070c60 0x7f83b40710e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.505+0000 7f83aa59c640 1 -- 172.21.15.37:0/2864921094 >> v1:172.21.15.37:6789/0 conn(0x7f83b40cb5b0 legacy=0x7f83b40cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:56.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.505+0000 7f83aa59c640 1 -- 172.21.15.37:0/2864921094 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83b406d010 con 0x7f83b406c130 2023-12-11T17:10:56.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.507+0000 7f83aa59c640 1 --2- 172.21.15.37:0/2864921094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83b406c130 0x7f83b415f510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f839c0097a0 tx=0x7f839c02b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2d9a5754294dec5b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:56.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.507+0000 7f83b259c640 1 -- 172.21.15.37:0/2864921094 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83a4001670 con 0x7f83b406c130 2023-12-11T17:10:56.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.508+0000 7f83b259c640 1 -- 172.21.15.37:0/2864921094 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839c02e050 con 0x7f83b406c130 2023-12-11T17:10:56.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.508+0000 7f83b259c640 1 -- 172.21.15.37:0/2864921094 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c030730 con 0x7f83b406c130 2023-12-11T17:10:56.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.508+0000 7f83b893b640 1 -- 172.21.15.37:0/2864921094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83b406c130 msgr2=0x7f83b415f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:56.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.508+0000 7f83b893b640 1 --2- 172.21.15.37:0/2864921094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83b406c130 0x7f83b415f510 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f839c0097a0 tx=0x7f839c02b790 comp rx=0 tx=0).stop 2023-12-11T17:10:56.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.508+0000 7f83b893b640 1 -- 172.21.15.37:0/2864921094 shutdown_connections 2023-12-11T17:10:56.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.508+0000 7f83b893b640 1 --2- 172.21.15.37:0/2864921094 >> v2:172.21.15.151:3300/0 conn(0x7f83b4070c60 0x7f83b40710e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.508+0000 7f83b893b640 1 --2- 172.21.15.37:0/2864921094 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83b406c130 0x7f83b415f510 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.508+0000 7f83b893b640 1 -- 172.21.15.37:0/2864921094 >> 172.21.15.37:0/2864921094 conn(0x7f83b40b0940 msgr2=0x7f83b40b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:56.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.508+0000 7f83b893b640 1 -- 172.21.15.37:0/2864921094 shutdown_connections 2023-12-11T17:10:56.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.508+0000 7f83b893b640 1 -- 172.21.15.37:0/2864921094 wait complete. 2023-12-11T17:10:56.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.510+0000 7f83b893b640 1 Processor -- start 2023-12-11T17:10:56.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.510+0000 7f83b893b640 1 -- start start 2023-12-11T17:10:56.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.511+0000 7f83b893b640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83b406c130 0x7f83b40b2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:56.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.511+0000 7f83b893b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83b4070c60 0x7f83b4154630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:56.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.511+0000 7f83b893b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83b40cb5b0 0x7f83b41599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:56.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.511+0000 7f83b893b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b40b1de0 con 0x7f83b4070c60 2023-12-11T17:10:56.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.511+0000 7f83b893b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83b40b20c0 con 0x7f83b40cb5b0 2023-12-11T17:10:56.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.511+0000 7f83b893b640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83b40b23a0 con 0x7f83b406c130 2023-12-11T17:10:56.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.512+0000 7f83aa59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83b4070c60 0x7f83b4154630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:56.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.512+0000 7f83aa59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83b4070c60 0x7f83b4154630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60214/0 (socket says 172.21.15.37:60214) 2023-12-11T17:10:56.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.512+0000 7f83aa59c640 1 -- 172.21.15.37:0/585824496 learned_addr learned my addr 172.21.15.37:0/585824496 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:56.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.512+0000 7f83b359e640 1 --2- 172.21.15.37:0/585824496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83b40cb5b0 0x7f83b41599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:56.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.512+0000 7f83aa59c640 1 -- 172.21.15.37:0/585824496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83b406c130 msgr2=0x7f83b40b2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:56.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.512+0000 7f83b2d9d640 1 --2- 172.21.15.37:0/585824496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83b406c130 0x7f83b40b2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:56.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.512+0000 7f83aa59c640 1 --2- 172.21.15.37:0/585824496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83b406c130 0x7f83b40b2e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.512+0000 7f83aa59c640 1 -- 172.21.15.37:0/585824496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83b40cb5b0 msgr2=0x7f83b41599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:56.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.512+0000 7f83aa59c640 1 --2- 172.21.15.37:0/585824496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83b40cb5b0 0x7f83b41599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.514 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.512+0000 7f83aa59c640 1 -- 172.21.15.37:0/585824496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f839c009400 con 0x7f83b4070c60 2023-12-11T17:10:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.512+0000 7f83b359e640 1 --2- 172.21.15.37:0/585824496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83b40cb5b0 0x7f83b41599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.512+0000 7f83aa59c640 1 --2- 172.21.15.37:0/585824496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83b4070c60 0x7f83b4154630 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f839c000c00 tx=0x7f839c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.513+0000 7f83abfff640 1 -- 172.21.15.37:0/585824496 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c03b810 con 0x7f83b4070c60 2023-12-11T17:10:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.513+0000 7f83abfff640 1 -- 172.21.15.37:0/585824496 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f839c03b970 con 0x7f83b4070c60 2023-12-11T17:10:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.513+0000 7f83b893b640 1 -- 172.21.15.37:0/585824496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83b40b2680 con 0x7f83b4070c60 2023-12-11T17:10:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.513+0000 7f83abfff640 1 -- 172.21.15.37:0/585824496 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f839c03bd20 con 0x7f83b4070c60 2023-12-11T17:10:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.513+0000 7f83b893b640 1 -- 172.21.15.37:0/585824496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83b4154b70 con 0x7f83b4070c60 2023-12-11T17:10:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.514+0000 7f83b893b640 1 -- 172.21.15.37:0/585824496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83b4067910 con 0x7f83b4070c60 2023-12-11T17:10:56.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.515+0000 7f83abfff640 1 -- 172.21.15.37:0/585824496 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f839c039040 con 0x7f83b4070c60 2023-12-11T17:10:56.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.516+0000 7f83abfff640 1 --2- 172.21.15.37:0/585824496 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f839406ae40 0x7f839406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:56.516 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.516+0000 7f83abfff640 1 -- 172.21.15.37:0/585824496 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f839c0ab1b0 con 0x7f83b4070c60 2023-12-11T17:10:56.517 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.517+0000 7f83b2d9d640 1 --2- 172.21.15.37:0/585824496 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f839406ae40 0x7f839406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:56.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.518+0000 7f83b2d9d640 1 --2- 172.21.15.37:0/585824496 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f839406ae40 0x7f839406d300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f83a4001380 tx=0x7f83a4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:56.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.521+0000 7f83abfff640 1 -- 172.21.15.37:0/585824496 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f839c075de0 con 0x7f83b4070c60 2023-12-11T17:10:56.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.716+0000 7f83b893b640 1 -- 172.21.15.37:0/585824496 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f83b40b2ba0 con 0x7f83b4070c60 2023-12-11T17:10:56.716 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.717+0000 7f83abfff640 1 -- 172.21.15.37:0/585824496 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f83b40b2ba0 con 0x7f83b4070c60 2023-12-11T17:10:56.717 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:10:56.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.719+0000 7f83b893b640 1 -- 172.21.15.37:0/585824496 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f839406ae40 msgr2=0x7f839406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:56.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.719+0000 7f83b893b640 1 --2- 172.21.15.37:0/585824496 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f839406ae40 0x7f839406d300 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f83a4001380 tx=0x7f83a4009040 comp rx=0 tx=0).stop 2023-12-11T17:10:56.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.719+0000 7f83b893b640 1 -- 172.21.15.37:0/585824496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83b4070c60 msgr2=0x7f83b4154630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:56.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.719+0000 7f83b893b640 1 --2- 172.21.15.37:0/585824496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83b4070c60 0x7f83b4154630 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f839c000c00 tx=0x7f839c0046c0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.719+0000 7f83b893b640 1 -- 172.21.15.37:0/585824496 shutdown_connections 2023-12-11T17:10:56.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.719+0000 7f83b893b640 1 --2- 172.21.15.37:0/585824496 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f839406ae40 0x7f839406d300 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.719+0000 7f83b893b640 1 --2- 172.21.15.37:0/585824496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f83b40cb5b0 0x7f83b41599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.719+0000 7f83b893b640 1 --2- 172.21.15.37:0/585824496 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f83b4070c60 0x7f83b4154630 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.719+0000 7f83b893b640 1 --2- 172.21.15.37:0/585824496 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f83b406c130 0x7f83b40b2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.719+0000 7f83b893b640 1 -- 172.21.15.37:0/585824496 >> 172.21.15.37:0/585824496 conn(0x7f83b40b0940 msgr2=0x7f83b40710e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:56.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.720+0000 7f83b893b640 1 -- 172.21.15.37:0/585824496 shutdown_connections 2023-12-11T17:10:56.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.720+0000 7f83b893b640 1 -- 172.21.15.37:0/585824496 wait complete. 2023-12-11T17:10:56.737 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T17:10:56.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.955+0000 7f88a9290640 1 Processor -- start 2023-12-11T17:10:56.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.955+0000 7f88a9290640 1 -- start start 2023-12-11T17:10:56.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.957+0000 7f88a9290640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a415a1e0 0x7f88a406ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:56.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.957+0000 7f88a9290640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f88a406ab70 0x7f88a415dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:56.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.957+0000 7f88a9290640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a40cdaa0 con 0x7f88a40ae300 2023-12-11T17:10:56.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.957+0000 7f88a9290640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a40cdd80 con 0x7f88a406ab70 2023-12-11T17:10:56.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.957+0000 7f88a9290640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a40ce060 con 0x7f88a415a1e0 2023-12-11T17:10:56.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.957+0000 7f88a27fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f88a40ae300 0x7f88a406a460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56548/0 (socket says 172.21.15.37:56548) 2023-12-11T17:10:56.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.957+0000 7f88a27fc640 1 -- 172.21.15.37:0/1554585327 learned_addr learned my addr 172.21.15.37:0/1554585327 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.958+0000 7f88a2ffd640 1 --2- 172.21.15.37:0/1554585327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a415a1e0 0x7f88a406ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.958+0000 7f88a37fe640 1 --2- 172.21.15.37:0/1554585327 >> v2:172.21.15.151:3300/0 conn(0x7f88a406ab70 0x7f88a415dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.958+0000 7f88a1ffb640 1 -- 172.21.15.37:0/1554585327 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 238405687 0 0) 0x7f88a40cdaa0 con 0x7f88a40ae300 2023-12-11T17:10:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.958+0000 7f88a1ffb640 1 -- 172.21.15.37:0/1554585327 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f888c003520 con 0x7f88a40ae300 2023-12-11T17:10:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.958+0000 7f88a1ffb640 1 -- 172.21.15.37:0/1554585327 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1323924023 0 0) 0x7f888c003520 con 0x7f88a40ae300 2023-12-11T17:10:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.958+0000 7f88a1ffb640 1 -- 172.21.15.37:0/1554585327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a415a1e0 msgr2=0x7f88a406ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.958+0000 7f88a1ffb640 1 --2- 172.21.15.37:0/1554585327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a415a1e0 0x7f88a406ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.958+0000 7f88a1ffb640 1 -- 172.21.15.37:0/1554585327 >> v2:172.21.15.151:3300/0 conn(0x7f88a406ab70 msgr2=0x7f88a415dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.958+0000 7f88a1ffb640 1 --2- 172.21.15.37:0/1554585327 >> v2:172.21.15.151:3300/0 conn(0x7f88a406ab70 0x7f88a415dc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.958+0000 7f88a1ffb640 1 -- 172.21.15.37:0/1554585327 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a40ce340 con 0x7f88a40ae300 2023-12-11T17:10:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.958+0000 7f88a1ffb640 1 -- 172.21.15.37:0/1554585327 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f8898001670 con 0x7f88a40ae300 2023-12-11T17:10:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.958+0000 7f88a1ffb640 1 -- 172.21.15.37:0/1554585327 >> v1:172.21.15.37:6789/0 conn(0x7f88a40ae300 legacy=0x7f88a406a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:56.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.958+0000 7f88a1ffb640 1 --2- 172.21.15.37:0/1554585327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f888c003970 0x7f888c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.959+0000 7f88a1ffb640 1 --2- 172.21.15.37:0/1554585327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f888c0047c0 0x7f888c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.959+0000 7f88a1ffb640 1 --2- 172.21.15.37:0/1554585327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a415a1e0 0x7f888c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.959+0000 7f88a1ffb640 1 -- 172.21.15.37:0/1554585327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a40cdd80 con 0x7f888c0047c0 2023-12-11T17:10:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.959+0000 7f88a1ffb640 1 -- 172.21.15.37:0/1554585327 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a40ce060 con 0x7f888c003970 2023-12-11T17:10:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.959+0000 7f88a1ffb640 1 -- 172.21.15.37:0/1554585327 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f888c00b9d0 con 0x7f88a415a1e0 2023-12-11T17:10:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.959+0000 7f88a27fc640 1 --2- 172.21.15.37:0/1554585327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f888c0047c0 0x7f888c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.959+0000 7f88a2ffd640 1 --2- 172.21.15.37:0/1554585327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f888c003970 0x7f888c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.959+0000 7f88a37fe640 1 --2- 172.21.15.37:0/1554585327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a415a1e0 0x7f888c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.959+0000 7f88a27fc640 1 -- 172.21.15.37:0/1554585327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a415a1e0 msgr2=0x7f888c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.959+0000 7f88a27fc640 1 --2- 172.21.15.37:0/1554585327 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a415a1e0 0x7f888c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.959+0000 7f88a27fc640 1 -- 172.21.15.37:0/1554585327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f888c003970 msgr2=0x7f888c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.959+0000 7f88a27fc640 1 --2- 172.21.15.37:0/1554585327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f888c003970 0x7f888c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.959+0000 7f88a27fc640 1 -- 172.21.15.37:0/1554585327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f888c003520 con 0x7f888c0047c0 2023-12-11T17:10:56.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.960+0000 7f88a27fc640 1 --2- 172.21.15.37:0/1554585327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f888c0047c0 0x7f888c004c40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f889800c140 tx=0x7f888c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c343d2fba69507fb server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:56.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.961+0000 7f88a1ffb640 1 -- 172.21.15.37:0/1554585327 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8898005ad0 con 0x7f888c0047c0 2023-12-11T17:10:56.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.961+0000 7f88a1ffb640 1 -- 172.21.15.37:0/1554585327 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8898005c50 con 0x7f888c0047c0 2023-12-11T17:10:56.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.961+0000 7f88a1ffb640 1 -- 172.21.15.37:0/1554585327 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889802c810 con 0x7f888c0047c0 2023-12-11T17:10:56.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.961+0000 7f88a9290640 1 -- 172.21.15.37:0/1554585327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f888c0047c0 msgr2=0x7f888c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:56.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.961+0000 7f88a9290640 1 --2- 172.21.15.37:0/1554585327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f888c0047c0 0x7f888c004c40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f889800c140 tx=0x7f888c0057f0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.961+0000 7f88a37fe640 1 -- 172.21.15.37:0/1554585327 reap_dead start 2023-12-11T17:10:56.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.962+0000 7f88a9290640 1 -- 172.21.15.37:0/1554585327 shutdown_connections 2023-12-11T17:10:56.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.962+0000 7f88a9290640 1 -- 172.21.15.37:0/1554585327 >> 172.21.15.37:0/1554585327 conn(0x7f88a40cee70 msgr2=0x7f88a40cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:56.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.962+0000 7f88a9290640 1 -- 172.21.15.37:0/1554585327 shutdown_connections 2023-12-11T17:10:56.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.962+0000 7f88a9290640 1 -- 172.21.15.37:0/1554585327 wait complete. 2023-12-11T17:10:56.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.964+0000 7f88a9290640 1 Processor -- start 2023-12-11T17:10:56.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.964+0000 7f88a9290640 1 -- start start 2023-12-11T17:10:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.965+0000 7f88a9290640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f888c0047c0 0x7f88a4150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.965+0000 7f88a9290640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88a4152070 0x7f88a4159130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.965+0000 7f88a9290640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a40ad2c0 0x7f88a41480f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.965+0000 7f88a9290640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a4151c50 con 0x7f888c0047c0 2023-12-11T17:10:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.965+0000 7f88a9290640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a4159670 con 0x7f88a4152070 2023-12-11T17:10:56.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.965+0000 7f88a9290640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a4150fd0 con 0x7f88a40ad2c0 2023-12-11T17:10:56.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.965+0000 7f88a2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f888c0047c0 0x7f88a4150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:56.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.966+0000 7f88a2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f888c0047c0 0x7f88a4150960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60240/0 (socket says 172.21.15.37:60240) 2023-12-11T17:10:56.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.966+0000 7f88a2ffd640 1 -- 172.21.15.37:0/3480405541 learned_addr learned my addr 172.21.15.37:0/3480405541 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:56.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.966+0000 7f88a27fc640 1 --2- 172.21.15.37:0/3480405541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88a4152070 0x7f88a4159130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:56.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.966+0000 7f88a37fe640 1 --2- 172.21.15.37:0/3480405541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a40ad2c0 0x7f88a41480f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:56.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.966+0000 7f88a2ffd640 1 -- 172.21.15.37:0/3480405541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a40ad2c0 msgr2=0x7f88a41480f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:56.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.966+0000 7f88a2ffd640 1 --2- 172.21.15.37:0/3480405541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a40ad2c0 0x7f88a41480f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.966+0000 7f88a2ffd640 1 -- 172.21.15.37:0/3480405541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88a4152070 msgr2=0x7f88a4159130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:56.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.966+0000 7f88a2ffd640 1 --2- 172.21.15.37:0/3480405541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88a4152070 0x7f88a4159130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:56.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.966+0000 7f88a2ffd640 1 -- 172.21.15.37:0/3480405541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a41512b0 con 0x7f888c0047c0 2023-12-11T17:10:56.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.966+0000 7f88a2ffd640 1 --2- 172.21.15.37:0/3480405541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f888c0047c0 0x7f88a4150960 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8894011590 tx=0x7f8894011a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:56.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.967+0000 7f888b7fe640 1 -- 172.21.15.37:0/3480405541 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894015870 con 0x7f888c0047c0 2023-12-11T17:10:56.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.967+0000 7f888b7fe640 1 -- 172.21.15.37:0/3480405541 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88940159d0 con 0x7f888c0047c0 2023-12-11T17:10:56.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.967+0000 7f88a9290640 1 -- 172.21.15.37:0/3480405541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88a4151590 con 0x7f888c0047c0 2023-12-11T17:10:56.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.967+0000 7f888b7fe640 1 -- 172.21.15.37:0/3480405541 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894015d60 con 0x7f888c0047c0 2023-12-11T17:10:56.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.967+0000 7f88a9290640 1 -- 172.21.15.37:0/3480405541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a40ad740 con 0x7f888c0047c0 2023-12-11T17:10:56.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.968+0000 7f88a9290640 1 -- 172.21.15.37:0/3480405541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a4151ec0 con 0x7f888c0047c0 2023-12-11T17:10:56.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.969+0000 7f888b7fe640 1 -- 172.21.15.37:0/3480405541 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f889401d400 con 0x7f888c0047c0 2023-12-11T17:10:56.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.970+0000 7f888b7fe640 1 --2- 172.21.15.37:0/3480405541 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f889006ae40 0x7f889006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:56.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.970+0000 7f888b7fe640 1 -- 172.21.15.37:0/3480405541 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f889408a110 con 0x7f888c0047c0 2023-12-11T17:10:56.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.971+0000 7f88a27fc640 1 --2- 172.21.15.37:0/3480405541 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f889006ae40 0x7f889006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:56.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.972+0000 7f88a27fc640 1 --2- 172.21.15.37:0/3480405541 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f889006ae40 0x7f889006d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8898034000 tx=0x7f8898007000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:56.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:56.975+0000 7f888b7fe640 1 -- 172.21.15.37:0/3480405541 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8894054e80 con 0x7f888c0047c0 2023-12-11T17:10:57.176 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.176+0000 7f88a9290640 1 -- 172.21.15.37:0/3480405541 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f88a4152450 con 0x7f888c0047c0 2023-12-11T17:10:57.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.178+0000 7f888b7fe640 1 -- 172.21.15.37:0/3480405541 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f88a4152450 con 0x7f888c0047c0 2023-12-11T17:10:57.178 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-11T17:10:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.180+0000 7f88a9290640 1 -- 172.21.15.37:0/3480405541 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f889006ae40 msgr2=0x7f889006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.180+0000 7f88a9290640 1 --2- 172.21.15.37:0/3480405541 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f889006ae40 0x7f889006d300 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f8898034000 tx=0x7f8898007000 comp rx=0 tx=0).stop 2023-12-11T17:10:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.180+0000 7f88a9290640 1 -- 172.21.15.37:0/3480405541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f888c0047c0 msgr2=0x7f88a4150960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.180+0000 7f88a9290640 1 --2- 172.21.15.37:0/3480405541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f888c0047c0 0x7f88a4150960 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f8894011590 tx=0x7f8894011a50 comp rx=0 tx=0).stop 2023-12-11T17:10:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.181+0000 7f88a9290640 1 -- 172.21.15.37:0/3480405541 shutdown_connections 2023-12-11T17:10:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.181+0000 7f88a9290640 1 --2- 172.21.15.37:0/3480405541 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f889006ae40 0x7f889006d300 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.181+0000 7f88a9290640 1 --2- 172.21.15.37:0/3480405541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f88a4152070 0x7f88a4159130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.181+0000 7f88a9290640 1 --2- 172.21.15.37:0/3480405541 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f88a40ad2c0 0x7f88a41480f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.181+0000 7f88a9290640 1 --2- 172.21.15.37:0/3480405541 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f888c0047c0 0x7f88a4150960 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.181+0000 7f88a9290640 1 -- 172.21.15.37:0/3480405541 >> 172.21.15.37:0/3480405541 conn(0x7f88a40cee70 msgr2=0x7f88a4152d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:57.181 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.181+0000 7f88a9290640 1 -- 172.21.15.37:0/3480405541 shutdown_connections 2023-12-11T17:10:57.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.181+0000 7f88a9290640 1 -- 172.21.15.37:0/3480405541 wait complete. 2023-12-11T17:10:57.201 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-11T17:10:57.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.432+0000 7f3581148640 1 Processor -- start 2023-12-11T17:10:57.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.432+0000 7f3581148640 1 -- start start 2023-12-11T17:10:57.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.433+0000 7f3581148640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f357c0d0200 0x7f357c0d1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:57.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.433+0000 7f3581148640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357c0b2300 con 0x7f357c0d3a50 2023-12-11T17:10:57.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.433+0000 7f3581148640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f357c15d9d0 con 0x7f357c15d5f0 2023-12-11T17:10:57.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.433+0000 7f3581148640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357c15e620 con 0x7f357c0d0200 2023-12-11T17:10:57.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.434+0000 7f357b59e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f357c0d3a50 0x7f357c0cdca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:56550/0 (socket says 172.21.15.37:56550) 2023-12-11T17:10:57.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.434+0000 7f357b59e640 1 -- 172.21.15.37:0/3797085420 learned_addr learned my addr 172.21.15.37:0/3797085420 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:57.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.434+0000 7f357a59c640 1 --2- 172.21.15.37:0/3797085420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f357c0d0200 0x7f357c0d1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:57.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.435+0000 7f3579d9b640 1 -- 172.21.15.37:0/3797085420 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2564785525 0 0) 0x7f357c0b2300 con 0x7f357c0d3a50 2023-12-11T17:10:57.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.435+0000 7f3579d9b640 1 -- 172.21.15.37:0/3797085420 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3564003520 con 0x7f357c0d3a50 2023-12-11T17:10:57.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.435+0000 7f357a59c640 1 -- 172.21.15.37:0/3797085420 >> v1:172.21.15.151:6789/0 conn(0x7f357c15d5f0 legacy=0x7f357c0cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:57.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.435+0000 7f357a59c640 1 -- 172.21.15.37:0/3797085420 >> v1:172.21.15.37:6789/0 conn(0x7f357c0d3a50 legacy=0x7f357c0cdca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:57.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.435+0000 7f357a59c640 1 -- 172.21.15.37:0/3797085420 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c0d3e80 con 0x7f357c0d0200 2023-12-11T17:10:57.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.437+0000 7f357a59c640 1 --2- 172.21.15.37:0/3797085420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f357c0d0200 0x7f357c0d1d90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f35700097d0 tx=0x7f357002b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1649059f4efc971e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:57.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.437+0000 7f3579d9b640 1 -- 172.21.15.37:0/3797085420 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3570031800 con 0x7f357c0d0200 2023-12-11T17:10:57.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.438+0000 7f3579d9b640 1 -- 172.21.15.37:0/3797085420 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3570031960 con 0x7f357c0d0200 2023-12-11T17:10:57.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.438+0000 7f3579d9b640 1 -- 172.21.15.37:0/3797085420 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3570031cd0 con 0x7f357c0d0200 2023-12-11T17:10:57.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.438+0000 7f3581148640 1 -- 172.21.15.37:0/3797085420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f357c0d0200 msgr2=0x7f357c0d1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:57.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.438+0000 7f3581148640 1 --2- 172.21.15.37:0/3797085420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f357c0d0200 0x7f357c0d1d90 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f35700097d0 tx=0x7f357002b8a0 comp rx=0 tx=0).stop 2023-12-11T17:10:57.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.438+0000 7f3581148640 1 -- 172.21.15.37:0/3797085420 shutdown_connections 2023-12-11T17:10:57.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.438+0000 7f3581148640 1 --2- 172.21.15.37:0/3797085420 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f357c0d0200 0x7f357c0d1d90 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:57.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.438+0000 7f3581148640 1 -- 172.21.15.37:0/3797085420 >> 172.21.15.37:0/3797085420 conn(0x7f357c09c450 msgr2=0x7f357c0d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:57.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.438+0000 7f3581148640 1 -- 172.21.15.37:0/3797085420 shutdown_connections 2023-12-11T17:10:57.439 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.438+0000 7f3581148640 1 -- 172.21.15.37:0/3797085420 wait complete. 2023-12-11T17:10:57.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.440+0000 7f3581148640 1 Processor -- start 2023-12-11T17:10:57.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.440+0000 7f3581148640 1 -- start start 2023-12-11T17:10:57.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.441+0000 7f3581148640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f357c0d0200 0x7f357c14b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:57.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.441+0000 7f3581148640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f357c0d3a50 0x7f357c14c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:57.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.441+0000 7f3581148640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f357c15d5f0 0x7f357c0cbd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:57.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.441+0000 7f3581148640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c0b5d40 con 0x7f357c15d5f0 2023-12-11T17:10:57.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.441+0000 7f3581148640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c0b68c0 con 0x7f357c0d0200 2023-12-11T17:10:57.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.441+0000 7f3581148640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357c0b5f90 con 0x7f357c0d3a50 2023-12-11T17:10:57.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.442+0000 7f357b59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f357c15d5f0 0x7f357c0cbd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:57.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.442+0000 7f357b59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f357c15d5f0 0x7f357c0cbd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60256/0 (socket says 172.21.15.37:60256) 2023-12-11T17:10:57.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.442+0000 7f357b59e640 1 -- 172.21.15.37:0/4111029093 learned_addr learned my addr 172.21.15.37:0/4111029093 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:57.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.442+0000 7f357ad9d640 1 --2- 172.21.15.37:0/4111029093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f357c0d0200 0x7f357c14b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:57.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.442+0000 7f357a59c640 1 --2- 172.21.15.37:0/4111029093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f357c0d3a50 0x7f357c14c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:57.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.442+0000 7f357b59e640 1 -- 172.21.15.37:0/4111029093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f357c0d3a50 msgr2=0x7f357c14c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:57.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.442+0000 7f357b59e640 1 --2- 172.21.15.37:0/4111029093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f357c0d3a50 0x7f357c14c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:57.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.442+0000 7f357b59e640 1 -- 172.21.15.37:0/4111029093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f357c0d0200 msgr2=0x7f357c14b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:57.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.442+0000 7f357b59e640 1 --2- 172.21.15.37:0/4111029093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f357c0d0200 0x7f357c14b4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:57.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.442+0000 7f357b59e640 1 -- 172.21.15.37:0/4111029093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3570009400 con 0x7f357c15d5f0 2023-12-11T17:10:57.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.442+0000 7f357a59c640 1 --2- 172.21.15.37:0/4111029093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f357c0d3a50 0x7f357c14c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:57.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.443+0000 7f357b59e640 1 --2- 172.21.15.37:0/4111029093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f357c15d5f0 0x7f357c0cbd30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f357400cad0 tx=0x7f357400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:57.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.443+0000 7f35637fe640 1 -- 172.21.15.37:0/4111029093 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f357400ac30 con 0x7f357c15d5f0 2023-12-11T17:10:57.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.443+0000 7f35637fe640 1 -- 172.21.15.37:0/4111029093 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f357400ad90 con 0x7f357c15d5f0 2023-12-11T17:10:57.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.443+0000 7f35637fe640 1 -- 172.21.15.37:0/4111029093 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3574012620 con 0x7f357c15d5f0 2023-12-11T17:10:57.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.443+0000 7f3581148640 1 -- 172.21.15.37:0/4111029093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f357c0b6270 con 0x7f357c15d5f0 2023-12-11T17:10:57.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.443+0000 7f3581148640 1 -- 172.21.15.37:0/4111029093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f357c14ba10 con 0x7f357c15d5f0 2023-12-11T17:10:57.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.444+0000 7f3581148640 1 -- 172.21.15.37:0/4111029093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f357c0745d0 con 0x7f357c15d5f0 2023-12-11T17:10:57.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.445+0000 7f35637fe640 1 -- 172.21.15.37:0/4111029093 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3574007070 con 0x7f357c15d5f0 2023-12-11T17:10:57.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.446+0000 7f35637fe640 1 --2- 172.21.15.37:0/4111029093 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f356806ae40 0x7f356806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:57.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.446+0000 7f35637fe640 1 -- 172.21.15.37:0/4111029093 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f35740899f0 con 0x7f357c15d5f0 2023-12-11T17:10:57.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.447+0000 7f357ad9d640 1 --2- 172.21.15.37:0/4111029093 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f356806ae40 0x7f356806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:57.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.448+0000 7f357ad9d640 1 --2- 172.21.15.37:0/4111029093 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f356806ae40 0x7f356806d300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f356c000f60 tx=0x7f356c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:57.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.451+0000 7f35637fe640 1 -- 172.21.15.37:0/4111029093 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f35740546b0 con 0x7f357c15d5f0 2023-12-11T17:10:57.643 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.643+0000 7f3581148640 1 -- 172.21.15.37:0/4111029093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f357c0b6a00 con 0x7f357c15d5f0 2023-12-11T17:10:57.644 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.644+0000 7f35637fe640 1 -- 172.21.15.37:0/4111029093 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f35740170a0 con 0x7f357c15d5f0 2023-12-11T17:10:57.644 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:10:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.647+0000 7f3581148640 1 -- 172.21.15.37:0/4111029093 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f356806ae40 msgr2=0x7f356806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.647+0000 7f3581148640 1 --2- 172.21.15.37:0/4111029093 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f356806ae40 0x7f356806d300 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f356c000f60 tx=0x7f356c009040 comp rx=0 tx=0).stop 2023-12-11T17:10:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.647+0000 7f3581148640 1 -- 172.21.15.37:0/4111029093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f357c15d5f0 msgr2=0x7f357c0cbd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.647+0000 7f3581148640 1 --2- 172.21.15.37:0/4111029093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f357c15d5f0 0x7f357c0cbd30 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f357400cad0 tx=0x7f357400cf90 comp rx=0 tx=0).stop 2023-12-11T17:10:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.647+0000 7f3581148640 1 -- 172.21.15.37:0/4111029093 shutdown_connections 2023-12-11T17:10:57.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.647+0000 7f3581148640 1 --2- 172.21.15.37:0/4111029093 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f356806ae40 0x7f356806d300 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:57.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.647+0000 7f3581148640 1 --2- 172.21.15.37:0/4111029093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f357c15d5f0 0x7f357c0cbd30 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:57.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.647+0000 7f3581148640 1 --2- 172.21.15.37:0/4111029093 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f357c0d3a50 0x7f357c14c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:57.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.647+0000 7f3581148640 1 --2- 172.21.15.37:0/4111029093 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f357c0d0200 0x7f357c14b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:57.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.647+0000 7f3581148640 1 -- 172.21.15.37:0/4111029093 >> 172.21.15.37:0/4111029093 conn(0x7f357c09c450 msgr2=0x7f357c0d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:57.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.647+0000 7f3581148640 1 -- 172.21.15.37:0/4111029093 shutdown_connections 2023-12-11T17:10:57.648 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.647+0000 7f3581148640 1 -- 172.21.15.37:0/4111029093 wait complete. 2023-12-11T17:10:57.666 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-11T17:10:57.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.885+0000 7f7583fff640 1 Processor -- start 2023-12-11T17:10:57.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.885+0000 7f7583fff640 1 -- start start 2023-12-11T17:10:57.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.886+0000 7f7583fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f75840d13c0 0x7f75840ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:57.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.886+0000 7f7583fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75840d0d70 0x7f75840d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:57.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.886+0000 7f7583fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f75840cf6a0 0x7f75840cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:57.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.886+0000 7f7583fff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75840b2280 con 0x7f75840cf6a0 2023-12-11T17:10:57.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.886+0000 7f7583fff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75840cee70 con 0x7f75840d13c0 2023-12-11T17:10:57.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.886+0000 7f7583fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75840d1190 con 0x7f75840d0d70 2023-12-11T17:10:57.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.887+0000 7f75837fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f75840cf6a0 0x7f75840cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:57.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.887+0000 7f75837fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f75840cf6a0 0x7f75840cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60260/0 (socket says 172.21.15.37:60260) 2023-12-11T17:10:57.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.887+0000 7f75837fe640 1 -- 172.21.15.37:0/272764374 learned_addr learned my addr 172.21.15.37:0/272764374 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:57.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.887+0000 7f75827fc640 1 --2- 172.21.15.37:0/272764374 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75840d0d70 0x7f75840d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:57.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.887+0000 7f7582ffd640 1 --2- 172.21.15.37:0/272764374 >> v2:172.21.15.151:3300/0 conn(0x7f75840d13c0 0x7f75840ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:57.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.887+0000 7f75837fe640 1 -- 172.21.15.37:0/272764374 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75840d0d70 msgr2=0x7f75840d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:57.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.887+0000 7f75837fe640 1 --2- 172.21.15.37:0/272764374 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75840d0d70 0x7f75840d17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:57.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.887+0000 7f75837fe640 1 -- 172.21.15.37:0/272764374 >> v2:172.21.15.151:3300/0 conn(0x7f75840d13c0 msgr2=0x7f75840ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:57.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.887+0000 7f75837fe640 1 --2- 172.21.15.37:0/272764374 >> v2:172.21.15.151:3300/0 conn(0x7f75840d13c0 0x7f75840ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:57.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.887+0000 7f75837fe640 1 -- 172.21.15.37:0/272764374 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75840d1ce0 con 0x7f75840cf6a0 2023-12-11T17:10:57.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.887+0000 7f7582ffd640 1 --2- 172.21.15.37:0/272764374 >> v2:172.21.15.151:3300/0 conn(0x7f75840d13c0 0x7f75840ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:57.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.888+0000 7f75837fe640 1 --2- 172.21.15.37:0/272764374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75840cf6a0 0x7f75840cfb10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f758408b740 tx=0x7f757c02b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c6a438bf7558cf server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:57.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.889+0000 7f7581ffb640 1 -- 172.21.15.37:0/272764374 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c0317d0 con 0x7f75840cf6a0 2023-12-11T17:10:57.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.889+0000 7f7581ffb640 1 -- 172.21.15.37:0/272764374 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757c031930 con 0x7f75840cf6a0 2023-12-11T17:10:57.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.889+0000 7f7581ffb640 1 -- 172.21.15.37:0/272764374 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757c031cc0 con 0x7f75840cf6a0 2023-12-11T17:10:57.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.889+0000 7f7583fff640 1 -- 172.21.15.37:0/272764374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75840cf6a0 msgr2=0x7f75840cfb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:57.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.889+0000 7f7583fff640 1 --2- 172.21.15.37:0/272764374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75840cf6a0 0x7f75840cfb10 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f758408b740 tx=0x7f757c02b870 comp rx=0 tx=0).stop 2023-12-11T17:10:57.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.889+0000 7f7583fff640 1 -- 172.21.15.37:0/272764374 shutdown_connections 2023-12-11T17:10:57.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.889+0000 7f7583fff640 1 --2- 172.21.15.37:0/272764374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75840cf6a0 0x7f75840cfb10 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:57.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.889+0000 7f7583fff640 1 --2- 172.21.15.37:0/272764374 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75840d0d70 0x7f75840d17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:57.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.889+0000 7f7583fff640 1 --2- 172.21.15.37:0/272764374 >> v2:172.21.15.151:3300/0 conn(0x7f75840d13c0 0x7f75840ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:57.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.889+0000 7f7583fff640 1 -- 172.21.15.37:0/272764374 >> 172.21.15.37:0/272764374 conn(0x7f758409c260 msgr2=0x7f75840d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:57.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.890+0000 7f7583fff640 1 -- 172.21.15.37:0/272764374 shutdown_connections 2023-12-11T17:10:57.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.890+0000 7f7583fff640 1 -- 172.21.15.37:0/272764374 wait complete. 2023-12-11T17:10:57.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.891+0000 7f7583fff640 1 Processor -- start 2023-12-11T17:10:57.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.892+0000 7f7583fff640 1 -- start start 2023-12-11T17:10:57.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.892+0000 7f7583fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75840cf6a0 0x7f75840a08f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:57.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.892+0000 7f7583fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75840d0d70 0x7f75840ccc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:57.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.893+0000 7f7583fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75840d13c0 0x7f75840b4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:57.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.893+0000 7f7583fff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758409ccd0 con 0x7f75840cf6a0 2023-12-11T17:10:57.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.893+0000 7f7583fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f758415b510 con 0x7f75840d0d70 2023-12-11T17:10:57.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.893+0000 7f7583fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75840cb970 con 0x7f75840d13c0 2023-12-11T17:10:57.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.893+0000 7f7582ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75840cf6a0 0x7f75840a08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:57.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.893+0000 7f7582ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75840cf6a0 0x7f75840a08f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60276/0 (socket says 172.21.15.37:60276) 2023-12-11T17:10:57.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.893+0000 7f7582ffd640 1 -- 172.21.15.37:0/2552039298 learned_addr learned my addr 172.21.15.37:0/2552039298 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:57.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.893+0000 7f7582ffd640 1 -- 172.21.15.37:0/2552039298 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75840d13c0 msgr2=0x7f75840b4830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:57.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.893+0000 7f7582ffd640 1 --2- 172.21.15.37:0/2552039298 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75840d13c0 0x7f75840b4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:57.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.893+0000 7f7582ffd640 1 -- 172.21.15.37:0/2552039298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75840d0d70 msgr2=0x7f75840ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:57.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.893+0000 7f7582ffd640 1 --2- 172.21.15.37:0/2552039298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75840d0d70 0x7f75840ccc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:57.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.893+0000 7f7582ffd640 1 -- 172.21.15.37:0/2552039298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c0094d0 con 0x7f75840cf6a0 2023-12-11T17:10:57.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.894+0000 7f7582ffd640 1 --2- 172.21.15.37:0/2552039298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75840cf6a0 0x7f75840a08f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f757400cf60 tx=0x7f757400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:57.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.894+0000 7f757bfff640 1 -- 172.21.15.37:0/2552039298 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757400d840 con 0x7f75840cf6a0 2023-12-11T17:10:57.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.894+0000 7f757bfff640 1 -- 172.21.15.37:0/2552039298 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757400d9a0 con 0x7f75840cf6a0 2023-12-11T17:10:57.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.894+0000 7f757bfff640 1 -- 172.21.15.37:0/2552039298 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757400dd30 con 0x7f75840cf6a0 2023-12-11T17:10:57.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.894+0000 7f7583fff640 1 -- 172.21.15.37:0/2552039298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75840cbc50 con 0x7f75840cf6a0 2023-12-11T17:10:57.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.894+0000 7f7583fff640 1 -- 172.21.15.37:0/2552039298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f758409cf20 con 0x7f75840cf6a0 2023-12-11T17:10:57.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.895+0000 7f7583fff640 1 -- 172.21.15.37:0/2552039298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7584074450 con 0x7f75840cf6a0 2023-12-11T17:10:57.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.896+0000 7f757bfff640 1 -- 172.21.15.37:0/2552039298 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7574015440 con 0x7f75840cf6a0 2023-12-11T17:10:57.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.897+0000 7f757bfff640 1 --2- 172.21.15.37:0/2552039298 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f756406ae40 0x7f756406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:57.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.897+0000 7f757bfff640 1 -- 172.21.15.37:0/2552039298 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f757408a3c0 con 0x7f75840cf6a0 2023-12-11T17:10:57.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.898+0000 7f75827fc640 1 --2- 172.21.15.37:0/2552039298 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f756406ae40 0x7f756406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:57.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.899+0000 7f75827fc640 1 --2- 172.21.15.37:0/2552039298 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f756406ae40 0x7f756406d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f756c006b10 tx=0x7f756c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:57.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:57.901+0000 7f757bfff640 1 -- 172.21.15.37:0/2552039298 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7574055130 con 0x7f75840cf6a0 2023-12-11T17:10:58.113 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.113+0000 7f7583fff640 1 -- 172.21.15.37:0/2552039298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f75840d2d70 con 0x7f75840cf6a0 2023-12-11T17:10:58.114 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.114+0000 7f757bfff640 1 -- 172.21.15.37:0/2552039298 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7f7574058750 con 0x7f75840cf6a0 2023-12-11T17:10:58.114 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-12-11T17:10:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.116+0000 7f7583fff640 1 -- 172.21.15.37:0/2552039298 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f756406ae40 msgr2=0x7f756406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.116+0000 7f7583fff640 1 --2- 172.21.15.37:0/2552039298 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f756406ae40 0x7f756406d300 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f756c006b10 tx=0x7f756c008040 comp rx=0 tx=0).stop 2023-12-11T17:10:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.116+0000 7f7583fff640 1 -- 172.21.15.37:0/2552039298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75840cf6a0 msgr2=0x7f75840a08f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.116+0000 7f7583fff640 1 --2- 172.21.15.37:0/2552039298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75840cf6a0 0x7f75840a08f0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f757400cf60 tx=0x7f757400cf90 comp rx=0 tx=0).stop 2023-12-11T17:10:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.117+0000 7f7583fff640 1 -- 172.21.15.37:0/2552039298 shutdown_connections 2023-12-11T17:10:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.117+0000 7f7583fff640 1 --2- 172.21.15.37:0/2552039298 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f756406ae40 0x7f756406d300 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.117+0000 7f7583fff640 1 --2- 172.21.15.37:0/2552039298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f75840d0d70 0x7f75840ccc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.117+0000 7f7583fff640 1 --2- 172.21.15.37:0/2552039298 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f75840d13c0 0x7f75840b4830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.117+0000 7f7583fff640 1 --2- 172.21.15.37:0/2552039298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f75840cf6a0 0x7f75840a08f0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:58.117 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.117+0000 7f7583fff640 1 -- 172.21.15.37:0/2552039298 >> 172.21.15.37:0/2552039298 conn(0x7f758409c260 msgr2=0x7f75840b60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:58.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.117+0000 7f7583fff640 1 -- 172.21.15.37:0/2552039298 shutdown_connections 2023-12-11T17:10:58.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.117+0000 7f7583fff640 1 -- 172.21.15.37:0/2552039298 wait complete. 2023-12-11T17:10:58.137 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-11T17:10:58.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:58.138 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-11T17:10:58.248 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-12-11T17:10:58.248 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:10:58.248 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-11T17:10:58.310 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:10:58.310 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-11T17:10:58.370 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:10:58.370 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-11T17:10:58.424 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:10:58.424 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-11T17:10:58.480 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:10:58.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.715+0000 7f5e71783640 1 Processor -- start 2023-12-11T17:10:58.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.715+0000 7f5e71783640 1 -- start start 2023-12-11T17:10:58.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.716+0000 7f5e71783640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e6c143e00 0x7f5e6c0b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:58.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.716+0000 7f5e71783640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5e6c072180 0x7f5e6c0b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:58.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.716+0000 7f5e71783640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e6c0b3bb0 con 0x7f5e6c06c410 2023-12-11T17:10:58.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.716+0000 7f5e71783640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e6c1441e0 con 0x7f5e6c072180 2023-12-11T17:10:58.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.716+0000 7f5e71783640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c072680 con 0x7f5e6c143e00 2023-12-11T17:10:58.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.717+0000 7f5e6a7fc640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5e6c072180 0x7f5e6c0b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:58.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.717+0000 7f5e6affd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e6c143e00 0x7f5e6c0b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:58.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.717+0000 7f5e6a7fc640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5e6c072180 0x7f5e6c0b4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:47810/0 (socket says 172.21.15.37:47810) 2023-12-11T17:10:58.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.717+0000 7f5e6a7fc640 1 -- 172.21.15.37:0/4044358319 learned_addr learned my addr 172.21.15.37:0/4044358319 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:58.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.718+0000 7f5e6a7fc640 1 -- 172.21.15.37:0/4044358319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e6c143e00 msgr2=0x7f5e6c0b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:58.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.718+0000 7f5e6a7fc640 1 --2- 172.21.15.37:0/4044358319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e6c143e00 0x7f5e6c0b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:58.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.718+0000 7f5e6a7fc640 1 -- 172.21.15.37:0/4044358319 >> v1:172.21.15.151:6789/0 conn(0x7f5e6c06c410 legacy=0x7f5e6c070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:58.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.718+0000 7f5e6a7fc640 1 -- 172.21.15.37:0/4044358319 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e6c0b1e30 con 0x7f5e6c072180 2023-12-11T17:10:58.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.719+0000 7f5e6a7fc640 1 --2- 172.21.15.37:0/4044358319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e6c072180 0x7f5e6c0b4580 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009e50 tx=0x7f5e5402bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1978a01016fbe5b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:58.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.720+0000 7f5e69ffb640 1 -- 172.21.15.37:0/4044358319 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5402cb00 con 0x7f5e6c072180 2023-12-11T17:10:58.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.720+0000 7f5e69ffb640 1 -- 172.21.15.37:0/4044358319 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5402cc60 con 0x7f5e6c072180 2023-12-11T17:10:58.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.720+0000 7f5e69ffb640 1 -- 172.21.15.37:0/4044358319 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e540343f0 con 0x7f5e6c072180 2023-12-11T17:10:58.722 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.721+0000 7f5e71783640 1 -- 172.21.15.37:0/4044358319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e6c072180 msgr2=0x7f5e6c0b4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:58.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.721+0000 7f5e71783640 1 --2- 172.21.15.37:0/4044358319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e6c072180 0x7f5e6c0b4580 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5e54009e50 tx=0x7f5e5402bf60 comp rx=0 tx=0).stop 2023-12-11T17:10:58.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.721+0000 7f5e71783640 1 -- 172.21.15.37:0/4044358319 shutdown_connections 2023-12-11T17:10:58.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.721+0000 7f5e71783640 1 --2- 172.21.15.37:0/4044358319 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e6c072180 0x7f5e6c0b4580 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:58.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.721+0000 7f5e71783640 1 --2- 172.21.15.37:0/4044358319 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e6c143e00 0x7f5e6c0b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:58.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.721+0000 7f5e71783640 1 -- 172.21.15.37:0/4044358319 >> 172.21.15.37:0/4044358319 conn(0x7f5e6c0b0a90 msgr2=0x7f5e6c0b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:58.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.721+0000 7f5e71783640 1 -- 172.21.15.37:0/4044358319 shutdown_connections 2023-12-11T17:10:58.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.721+0000 7f5e71783640 1 -- 172.21.15.37:0/4044358319 wait complete. 2023-12-11T17:10:58.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.723+0000 7f5e71783640 1 Processor -- start 2023-12-11T17:10:58.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.723+0000 7f5e71783640 1 -- start start 2023-12-11T17:10:58.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.724+0000 7f5e71783640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e6c06c410 0x7f5e6c15a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:58.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.724+0000 7f5e71783640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e6c072180 0x7f5e6c1f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:58.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.724+0000 7f5e71783640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e6c143e00 0x7f5e6c1f67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:58.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.724+0000 7f5e71783640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c130e80 con 0x7f5e6c072180 2023-12-11T17:10:58.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.724+0000 7f5e71783640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c131400 con 0x7f5e6c143e00 2023-12-11T17:10:58.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.724+0000 7f5e71783640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e6c1f70e0 con 0x7f5e6c06c410 2023-12-11T17:10:58.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.724+0000 7f5e6a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e6c072180 0x7f5e6c1f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:58.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.724+0000 7f5e6a7fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e6c072180 0x7f5e6c1f62b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60282/0 (socket says 172.21.15.37:60282) 2023-12-11T17:10:58.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.724+0000 7f5e6a7fc640 1 -- 172.21.15.37:0/3029929182 learned_addr learned my addr 172.21.15.37:0/3029929182 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:58.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.724+0000 7f5e6a7fc640 1 -- 172.21.15.37:0/3029929182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e6c06c410 msgr2=0x7f5e6c15a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:58.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.724+0000 7f5e6a7fc640 1 --2- 172.21.15.37:0/3029929182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e6c06c410 0x7f5e6c15a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:58.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.724+0000 7f5e6a7fc640 1 -- 172.21.15.37:0/3029929182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e6c143e00 msgr2=0x7f5e6c1f67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:58.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.724+0000 7f5e6b7fe640 1 --2- 172.21.15.37:0/3029929182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e6c143e00 0x7f5e6c1f67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:58.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.725+0000 7f5e6a7fc640 1 --2- 172.21.15.37:0/3029929182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e6c143e00 0x7f5e6c1f67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:58.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.725+0000 7f5e6a7fc640 1 -- 172.21.15.37:0/3029929182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e54009b30 con 0x7f5e6c072180 2023-12-11T17:10:58.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.725+0000 7f5e6b7fe640 1 --2- 172.21.15.37:0/3029929182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e6c143e00 0x7f5e6c1f67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:58.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.725+0000 7f5e6a7fc640 1 --2- 172.21.15.37:0/3029929182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e6c072180 0x7f5e6c1f62b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5e54036040 tx=0x7f5e54004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:58.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.725+0000 7f5e637fe640 1 -- 172.21.15.37:0/3029929182 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5403e450 con 0x7f5e6c072180 2023-12-11T17:10:58.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.725+0000 7f5e637fe640 1 -- 172.21.15.37:0/3029929182 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e5403e5f0 con 0x7f5e6c072180 2023-12-11T17:10:58.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.725+0000 7f5e637fe640 1 -- 172.21.15.37:0/3029929182 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e5403e9a0 con 0x7f5e6c072180 2023-12-11T17:10:58.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.725+0000 7f5e71783640 1 -- 172.21.15.37:0/3029929182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e6c0c67c0 con 0x7f5e6c072180 2023-12-11T17:10:58.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.725+0000 7f5e71783640 1 -- 172.21.15.37:0/3029929182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e6c131090 con 0x7f5e6c072180 2023-12-11T17:10:58.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.727+0000 7f5e71783640 1 -- 172.21.15.37:0/3029929182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e6c0745d0 con 0x7f5e6c072180 2023-12-11T17:10:58.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.728+0000 7f5e637fe640 1 -- 172.21.15.37:0/3029929182 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e5403eb00 con 0x7f5e6c072180 2023-12-11T17:10:58.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.728+0000 7f5e637fe640 1 --2- 172.21.15.37:0/3029929182 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5e4c06ae40 0x7f5e4c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:58.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.729+0000 7f5e637fe640 1 -- 172.21.15.37:0/3029929182 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5e540ac6e0 con 0x7f5e6c072180 2023-12-11T17:10:58.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.729+0000 7f5e6affd640 1 --2- 172.21.15.37:0/3029929182 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5e4c06ae40 0x7f5e4c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:58.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.731+0000 7f5e6affd640 1 --2- 172.21.15.37:0/3029929182 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5e4c06ae40 0x7f5e4c06d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c006a90 tx=0x7f5e5c006a20 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:58.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.733+0000 7f5e637fe640 1 -- 172.21.15.37:0/3029929182 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5e540774f0 con 0x7f5e6c072180 2023-12-11T17:10:58.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.930+0000 7f5e71783640 1 -- 172.21.15.37:0/3029929182 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e6c06e020 con 0x7f5e6c072180 2023-12-11T17:10:58.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.933+0000 7f5e637fe640 1 -- 172.21.15.37:0/3029929182 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18779 (secure 0 0 0) 0x7f5e5403edb0 con 0x7f5e6c072180 2023-12-11T17:10:58.933 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:10:58.934 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:10:32.309274+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:10:58.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.936+0000 7f5e71783640 1 -- 172.21.15.37:0/3029929182 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5e4c06ae40 msgr2=0x7f5e4c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:58.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.936+0000 7f5e71783640 1 --2- 172.21.15.37:0/3029929182 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5e4c06ae40 0x7f5e4c06d300 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c006a90 tx=0x7f5e5c006a20 comp rx=0 tx=0).stop 2023-12-11T17:10:58.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.936+0000 7f5e71783640 1 -- 172.21.15.37:0/3029929182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e6c072180 msgr2=0x7f5e6c1f62b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:58.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.936+0000 7f5e71783640 1 --2- 172.21.15.37:0/3029929182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e6c072180 0x7f5e6c1f62b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f5e54036040 tx=0x7f5e54004a40 comp rx=0 tx=0).stop 2023-12-11T17:10:58.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.936+0000 7f5e71783640 1 -- 172.21.15.37:0/3029929182 shutdown_connections 2023-12-11T17:10:58.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.936+0000 7f5e71783640 1 --2- 172.21.15.37:0/3029929182 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5e4c06ae40 0x7f5e4c06d300 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:58.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.936+0000 7f5e71783640 1 --2- 172.21.15.37:0/3029929182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e6c143e00 0x7f5e6c1f67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:58.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.936+0000 7f5e71783640 1 --2- 172.21.15.37:0/3029929182 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e6c072180 0x7f5e6c1f62b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:58.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.936+0000 7f5e71783640 1 --2- 172.21.15.37:0/3029929182 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e6c06c410 0x7f5e6c15a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:58.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.936+0000 7f5e71783640 1 -- 172.21.15.37:0/3029929182 >> 172.21.15.37:0/3029929182 conn(0x7f5e6c0b0a90 msgr2=0x7f5e6c070690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:58.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.936+0000 7f5e71783640 1 -- 172.21.15.37:0/3029929182 shutdown_connections 2023-12-11T17:10:58.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:58.936+0000 7f5e71783640 1 -- 172.21.15.37:0/3029929182 wait complete. 2023-12-11T17:10:58.958 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T17:09:38.415636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T17:09:42.786774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T17:09:43.660585+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-11T17:09:47.272351+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-11T17:10:58.959 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T17:10:59.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.193+0000 7fdcd9bc9640 1 Processor -- start 2023-12-11T17:10:59.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.193+0000 7fdcd9bc9640 1 -- start start 2023-12-11T17:10:59.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.195+0000 7fdcd9bc9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdcd4155400 0x7fdcd406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:59.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.195+0000 7fdcd9bc9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd415b4a0 con 0x7fdcd40ce150 2023-12-11T17:10:59.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.195+0000 7fdcd9bc9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcd40adbb0 con 0x7fdcd40cf500 2023-12-11T17:10:59.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.195+0000 7fdcd9bc9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcd40ade90 con 0x7fdcd4155400 2023-12-11T17:10:59.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.195+0000 7fdcd3fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdcd40ce150 0x7fdcd40cedf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34218/0 (socket says 172.21.15.37:34218) 2023-12-11T17:10:59.195 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.195+0000 7fdcd3fff640 1 -- 172.21.15.37:0/1743948410 learned_addr learned my addr 172.21.15.37:0/1743948410 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:59.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.196+0000 7fdcd8bc7640 1 --2- 172.21.15.37:0/1743948410 >> v2:172.21.15.151:3300/0 conn(0x7fdcd4155400 0x7fdcd406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:59.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.196+0000 7fdcd37fe640 1 -- 172.21.15.37:0/1743948410 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1318617660 0 0) 0x7fdcd415b4a0 con 0x7fdcd40ce150 2023-12-11T17:10:59.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.196+0000 7fdcd37fe640 1 -- 172.21.15.37:0/1743948410 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcc4003520 con 0x7fdcd40ce150 2023-12-11T17:10:59.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.196+0000 7fdcd37fe640 1 -- 172.21.15.37:0/1743948410 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1708015357 0 0) 0x7fdcc4003520 con 0x7fdcd40ce150 2023-12-11T17:10:59.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.196+0000 7fdcd37fe640 1 -- 172.21.15.37:0/1743948410 >> v2:172.21.15.151:3300/0 conn(0x7fdcd4155400 msgr2=0x7fdcd406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:59.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.196+0000 7fdcd37fe640 1 --2- 172.21.15.37:0/1743948410 >> v2:172.21.15.151:3300/0 conn(0x7fdcd4155400 0x7fdcd406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:59.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.196+0000 7fdcd37fe640 1 -- 172.21.15.37:0/1743948410 >> v1:172.21.15.151:6789/0 conn(0x7fdcd40cf500 legacy=0x7fdcd415b9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:59.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.196+0000 7fdcd37fe640 1 -- 172.21.15.37:0/1743948410 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd40ae170 con 0x7fdcd40ce150 2023-12-11T17:10:59.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.196+0000 7fdcd37fe640 1 -- 172.21.15.37:0/1743948410 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7fdcc0001670 con 0x7fdcd40ce150 2023-12-11T17:10:59.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.196+0000 7fdcd37fe640 1 -- 172.21.15.37:0/1743948410 >> v1:172.21.15.37:6789/0 conn(0x7fdcd40ce150 legacy=0x7fdcd40cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:59.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.196+0000 7fdcd37fe640 1 --2- 172.21.15.37:0/1743948410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc4003970 0x7fdcc4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:59.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.196+0000 7fdcd37fe640 1 --2- 172.21.15.37:0/1743948410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcc40047c0 0x7fdcc4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:59.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.196+0000 7fdcd37fe640 1 --2- 172.21.15.37:0/1743948410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcc4005180 0x7fdcc400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:59.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.196+0000 7fdcd37fe640 1 -- 172.21.15.37:0/1743948410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd40ade90 con 0x7fdcc4003970 2023-12-11T17:10:59.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.196+0000 7fdcd37fe640 1 -- 172.21.15.37:0/1743948410 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc400c020 con 0x7fdcc40047c0 2023-12-11T17:10:59.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.196+0000 7fdcd37fe640 1 -- 172.21.15.37:0/1743948410 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc400c1e0 con 0x7fdcc4005180 2023-12-11T17:10:59.198 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.197+0000 7fdcd8bc7640 1 --2- 172.21.15.37:0/1743948410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc4003970 0x7fdcc4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:59.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.197+0000 7fdcd3fff640 1 --2- 172.21.15.37:0/1743948410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcc40047c0 0x7fdcc4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:59.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.197+0000 7fdcd93c8640 1 --2- 172.21.15.37:0/1743948410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcc4005180 0x7fdcc400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:59.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.197+0000 7fdcd8bc7640 1 -- 172.21.15.37:0/1743948410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcc4005180 msgr2=0x7fdcc400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:59.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.197+0000 7fdcd8bc7640 1 --2- 172.21.15.37:0/1743948410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcc4005180 0x7fdcc400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:59.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.197+0000 7fdcd8bc7640 1 -- 172.21.15.37:0/1743948410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcc40047c0 msgr2=0x7fdcc4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:59.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.197+0000 7fdcd8bc7640 1 --2- 172.21.15.37:0/1743948410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcc40047c0 0x7fdcc4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:59.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.197+0000 7fdcd8bc7640 1 -- 172.21.15.37:0/1743948410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc4003520 con 0x7fdcc4003970 2023-12-11T17:10:59.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.197+0000 7fdcd93c8640 1 --2- 172.21.15.37:0/1743948410 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcc4005180 0x7fdcc400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:59.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.197+0000 7fdcd93c8640 1 -- 172.21.15.37:0/1743948410 reap_dead start 2023-12-11T17:10:59.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.198+0000 7fdcd8bc7640 1 --2- 172.21.15.37:0/1743948410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc4003970 0x7fdcc4003d90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8009ac0 tx=0x7fdcc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1970d48e191314 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:59.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.199+0000 7fdcd37fe640 1 -- 172.21.15.37:0/1743948410 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc802c6b0 con 0x7fdcc4003970 2023-12-11T17:10:59.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.199+0000 7fdcd37fe640 1 -- 172.21.15.37:0/1743948410 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc802c810 con 0x7fdcc4003970 2023-12-11T17:10:59.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.199+0000 7fdcd37fe640 1 -- 172.21.15.37:0/1743948410 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc802cba0 con 0x7fdcc4003970 2023-12-11T17:10:59.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.199+0000 7fdcd9bc9640 1 -- 172.21.15.37:0/1743948410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc4003970 msgr2=0x7fdcc4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:59.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.199+0000 7fdcd9bc9640 1 --2- 172.21.15.37:0/1743948410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc4003970 0x7fdcc4003d90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8009ac0 tx=0x7fdcc40057f0 comp rx=0 tx=0).stop 2023-12-11T17:10:59.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.199+0000 7fdcd9bc9640 1 -- 172.21.15.37:0/1743948410 shutdown_connections 2023-12-11T17:10:59.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.199+0000 7fdcd9bc9640 1 --2- 172.21.15.37:0/1743948410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc4003970 0x7fdcc4003d90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:59.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.199+0000 7fdcd9bc9640 1 -- 172.21.15.37:0/1743948410 >> 172.21.15.37:0/1743948410 conn(0x7fdcd406a640 msgr2=0x7fdcd406aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:59.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.199+0000 7fdcd9bc9640 1 -- 172.21.15.37:0/1743948410 shutdown_connections 2023-12-11T17:10:59.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.200+0000 7fdcd9bc9640 1 -- 172.21.15.37:0/1743948410 wait complete. 2023-12-11T17:10:59.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.201+0000 7fdcd9bc9640 1 Processor -- start 2023-12-11T17:10:59.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.202+0000 7fdcd9bc9640 1 -- start start 2023-12-11T17:10:59.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.203+0000 7fdcd9bc9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc4003970 0x7fdcd414f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.203+0000 7fdcd9bc9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcd414cb60 0x7fdcd413ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.203+0000 7fdcd9bc9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcd413d370 0x7fdcd4159ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.203+0000 7fdcd9bc9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd414c6d0 con 0x7fdcc4003970 2023-12-11T17:10:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.203+0000 7fdcd9bc9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd414f580 con 0x7fdcd413d370 2023-12-11T17:10:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.203+0000 7fdcd9bc9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcd414c380 con 0x7fdcd414cb60 2023-12-11T17:10:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.203+0000 7fdcd8bc7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc4003970 0x7fdcd414f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.203+0000 7fdcd8bc7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc4003970 0x7fdcd414f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46936/0 (socket says 172.21.15.37:46936) 2023-12-11T17:10:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.203+0000 7fdcd8bc7640 1 -- 172.21.15.37:0/1837546716 learned_addr learned my addr 172.21.15.37:0/1837546716 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.203+0000 7fdcd93c8640 1 --2- 172.21.15.37:0/1837546716 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcd413d370 0x7fdcd4159ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.203+0000 7fdcd8bc7640 1 -- 172.21.15.37:0/1837546716 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcd414cb60 msgr2=0x7fdcd413ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.203+0000 7fdcd8bc7640 1 --2- 172.21.15.37:0/1837546716 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcd414cb60 0x7fdcd413ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.203+0000 7fdcd8bc7640 1 -- 172.21.15.37:0/1837546716 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcd413d370 msgr2=0x7fdcd4159ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.203+0000 7fdcd8bc7640 1 --2- 172.21.15.37:0/1837546716 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcd413d370 0x7fdcd4159ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.204+0000 7fdcd8bc7640 1 -- 172.21.15.37:0/1837546716 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcd413d880 con 0x7fdcc4003970 2023-12-11T17:10:59.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.204+0000 7fdcd93c8640 1 --2- 172.21.15.37:0/1837546716 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcd413d370 0x7fdcd4159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.204+0000 7fdcd8bc7640 1 --2- 172.21.15.37:0/1837546716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc4003970 0x7fdcd414f040 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8037040 tx=0x7fdcc8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.204+0000 7fdcd17fa640 1 -- 172.21.15.37:0/1837546716 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8003810 con 0x7fdcc4003970 2023-12-11T17:10:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.204+0000 7fdcd17fa640 1 -- 172.21.15.37:0/1837546716 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc8003970 con 0x7fdcc4003970 2023-12-11T17:10:59.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.204+0000 7fdcd9bc9640 1 -- 172.21.15.37:0/1837546716 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcd413db60 con 0x7fdcc4003970 2023-12-11T17:10:59.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.204+0000 7fdcd17fa640 1 -- 172.21.15.37:0/1837546716 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc8003d00 con 0x7fdcc4003970 2023-12-11T17:10:59.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.204+0000 7fdcd9bc9640 1 -- 172.21.15.37:0/1837546716 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcd414cfe0 con 0x7fdcc4003970 2023-12-11T17:10:59.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.205+0000 7fdcd9bc9640 1 -- 172.21.15.37:0/1837546716 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcd413dda0 con 0x7fdcc4003970 2023-12-11T17:10:59.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.207+0000 7fdcd17fa640 1 -- 172.21.15.37:0/1837546716 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdcc8047450 con 0x7fdcc4003970 2023-12-11T17:10:59.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.208+0000 7fdcd17fa640 1 --2- 172.21.15.37:0/1837546716 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdcb806ae70 0x7fdcb806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:59.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.208+0000 7fdcd17fa640 1 -- 172.21.15.37:0/1837546716 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fdcc80abba0 con 0x7fdcc4003970 2023-12-11T17:10:59.208 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.208+0000 7fdcd3fff640 1 --2- 172.21.15.37:0/1837546716 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdcb806ae70 0x7fdcb806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:59.209 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.209+0000 7fdcd3fff640 1 --2- 172.21.15.37:0/1837546716 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdcb806ae70 0x7fdcb806d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0000f60 tx=0x7fdcc0000ef0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:59.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.212+0000 7fdcd17fa640 1 -- 172.21.15.37:0/1837546716 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdcc80769b0 con 0x7fdcc4003970 2023-12-11T17:10:59.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.406+0000 7fdcd9bc9640 1 -- 172.21.15.37:0/1837546716 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdcd414c4f0 con 0x7fdcc4003970 2023-12-11T17:10:59.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.407+0000 7fdcd17fa640 1 -- 172.21.15.37:0/1837546716 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdcc8079fd0 con 0x7fdcc4003970 2023-12-11T17:10:59.407 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-11T17:10:59.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.409+0000 7fdcd9bc9640 1 -- 172.21.15.37:0/1837546716 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdcb806ae70 msgr2=0x7fdcb806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:59.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.409+0000 7fdcd9bc9640 1 --2- 172.21.15.37:0/1837546716 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdcb806ae70 0x7fdcb806d330 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fdcc0000f60 tx=0x7fdcc0000ef0 comp rx=0 tx=0).stop 2023-12-11T17:10:59.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.409+0000 7fdcd9bc9640 1 -- 172.21.15.37:0/1837546716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc4003970 msgr2=0x7fdcd414f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:59.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.409+0000 7fdcd9bc9640 1 --2- 172.21.15.37:0/1837546716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc4003970 0x7fdcd414f040 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fdcc8037040 tx=0x7fdcc8004730 comp rx=0 tx=0).stop 2023-12-11T17:10:59.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.409+0000 7fdcd9bc9640 1 -- 172.21.15.37:0/1837546716 shutdown_connections 2023-12-11T17:10:59.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.409+0000 7fdcd9bc9640 1 --2- 172.21.15.37:0/1837546716 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdcb806ae70 0x7fdcb806d330 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:59.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.409+0000 7fdcd9bc9640 1 --2- 172.21.15.37:0/1837546716 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdcd413d370 0x7fdcd4159ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:59.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.409+0000 7fdcd9bc9640 1 --2- 172.21.15.37:0/1837546716 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdcd414cb60 0x7fdcd413ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:59.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.409+0000 7fdcd9bc9640 1 --2- 172.21.15.37:0/1837546716 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdcc4003970 0x7fdcd414f040 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:59.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.409+0000 7fdcd9bc9640 1 -- 172.21.15.37:0/1837546716 >> 172.21.15.37:0/1837546716 conn(0x7fdcd406a640 msgr2=0x7fdcd4070070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:59.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.410+0000 7fdcd9bc9640 1 -- 172.21.15.37:0/1837546716 shutdown_connections 2023-12-11T17:10:59.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.410+0000 7fdcd9bc9640 1 -- 172.21.15.37:0/1837546716 wait complete. 2023-12-11T17:10:59.429 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T17:10:59.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.659+0000 7fe591f2c640 1 Processor -- start 2023-12-11T17:10:59.660 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.660+0000 7fe591f2c640 1 -- start start 2023-12-11T17:10:59.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.661+0000 7fe591f2c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe58c06d770 0x7fe58c0b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:59.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.661+0000 7fe591f2c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe58c06db50 0x7fe58c141250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:59.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.662+0000 7fe591f2c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe58c15b780 con 0x7fe58c141790 2023-12-11T17:10:59.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.662+0000 7fe591f2c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe58c141c20 con 0x7fe58c06d770 2023-12-11T17:10:59.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.662+0000 7fe591f2c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe58c15b9d0 con 0x7fe58c06db50 2023-12-11T17:10:59.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.662+0000 7fe58b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe58c06d770 0x7fe58c0b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:59.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.662+0000 7fe58bfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe58c141790 0x7fe58c15ed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34230/0 (socket says 172.21.15.37:34230) 2023-12-11T17:10:59.662 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.662+0000 7fe58bfff640 1 -- 172.21.15.37:0/1165840834 learned_addr learned my addr 172.21.15.37:0/1165840834 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:10:59.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.662+0000 7fe58b7fe640 1 -- 172.21.15.37:0/1165840834 >> v2:172.21.15.151:3300/0 conn(0x7fe58c06db50 msgr2=0x7fe58c141250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:10:59.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.662+0000 7fe58b7fe640 1 --2- 172.21.15.37:0/1165840834 >> v2:172.21.15.151:3300/0 conn(0x7fe58c06db50 0x7fe58c141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:59.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.662+0000 7fe58b7fe640 1 -- 172.21.15.37:0/1165840834 >> v1:172.21.15.37:6789/0 conn(0x7fe58c141790 legacy=0x7fe58c15ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:59.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.662+0000 7fe58affd640 1 -- 172.21.15.37:0/1165840834 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919038679 0 0) 0x7fe58c15b780 con 0x7fe58c141790 2023-12-11T17:10:59.663 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.662+0000 7fe58b7fe640 1 -- 172.21.15.37:0/1165840834 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe58c15bcb0 con 0x7fe58c06d770 2023-12-11T17:10:59.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.664+0000 7fe58b7fe640 1 --2- 172.21.15.37:0/1165840834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c06d770 0x7fe58c0b1e00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe58c067c70 tx=0x7fe57c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e13353565c7ed1fe server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:59.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.664+0000 7fe58affd640 1 -- 172.21.15.37:0/1165840834 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c031830 con 0x7fe58c06d770 2023-12-11T17:10:59.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.664+0000 7fe58affd640 1 -- 172.21.15.37:0/1165840834 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57c031990 con 0x7fe58c06d770 2023-12-11T17:10:59.664 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.664+0000 7fe58affd640 1 -- 172.21.15.37:0/1165840834 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c031d20 con 0x7fe58c06d770 2023-12-11T17:10:59.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.664+0000 7fe591f2c640 1 -- 172.21.15.37:0/1165840834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c06d770 msgr2=0x7fe58c0b1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:59.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.664+0000 7fe591f2c640 1 --2- 172.21.15.37:0/1165840834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c06d770 0x7fe58c0b1e00 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe58c067c70 tx=0x7fe57c02b8d0 comp rx=0 tx=0).stop 2023-12-11T17:10:59.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.665+0000 7fe591f2c640 1 -- 172.21.15.37:0/1165840834 shutdown_connections 2023-12-11T17:10:59.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.665+0000 7fe591f2c640 1 --2- 172.21.15.37:0/1165840834 >> v2:172.21.15.151:3300/0 conn(0x7fe58c06db50 0x7fe58c141250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:59.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.665+0000 7fe591f2c640 1 --2- 172.21.15.37:0/1165840834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c06d770 0x7fe58c0b1e00 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:59.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.665+0000 7fe591f2c640 1 -- 172.21.15.37:0/1165840834 >> 172.21.15.37:0/1165840834 conn(0x7fe58c0cb850 msgr2=0x7fe58c0cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:59.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.665+0000 7fe591f2c640 1 -- 172.21.15.37:0/1165840834 shutdown_connections 2023-12-11T17:10:59.665 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.665+0000 7fe591f2c640 1 -- 172.21.15.37:0/1165840834 wait complete. 2023-12-11T17:10:59.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.667+0000 7fe591f2c640 1 Processor -- start 2023-12-11T17:10:59.667 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.667+0000 7fe591f2c640 1 -- start start 2023-12-11T17:10:59.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.668+0000 7fe591f2c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c06d770 0x7fe58c15f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:59.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.668+0000 7fe591f2c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe58c06db50 0x7fe58c15a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:59.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.668+0000 7fe591f2c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe58c141790 0x7fe58c1f2960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:59.669 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.668+0000 7fe591f2c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c15d910 con 0x7fe58c06d770 2023-12-11T17:10:59.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.668+0000 7fe591f2c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c1f31c0 con 0x7fe58c141790 2023-12-11T17:10:59.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.668+0000 7fe591f2c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe58c1f34a0 con 0x7fe58c06db50 2023-12-11T17:10:59.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.668+0000 7fe58b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c06d770 0x7fe58c15f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:59.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.668+0000 7fe58b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c06d770 0x7fe58c15f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46952/0 (socket says 172.21.15.37:46952) 2023-12-11T17:10:59.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.668+0000 7fe58b7fe640 1 -- 172.21.15.37:0/3583326477 learned_addr learned my addr 172.21.15.37:0/3583326477 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:10:59.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.668+0000 7fe583fff640 1 --2- 172.21.15.37:0/3583326477 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe58c06db50 0x7fe58c15a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:59.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.668+0000 7fe58b7fe640 1 -- 172.21.15.37:0/3583326477 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe58c06db50 msgr2=0x7fe58c15a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:59.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.668+0000 7fe58bfff640 1 --2- 172.21.15.37:0/3583326477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe58c141790 0x7fe58c1f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:59.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.668+0000 7fe58b7fe640 1 --2- 172.21.15.37:0/3583326477 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe58c06db50 0x7fe58c15a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:59.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.668+0000 7fe58b7fe640 1 -- 172.21.15.37:0/3583326477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe58c141790 msgr2=0x7fe58c1f2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:59.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.668+0000 7fe58b7fe640 1 --2- 172.21.15.37:0/3583326477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe58c141790 0x7fe58c1f2960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:59.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.669+0000 7fe58b7fe640 1 -- 172.21.15.37:0/3583326477 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe57c009400 con 0x7fe58c06d770 2023-12-11T17:10:59.670 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.669+0000 7fe583fff640 1 --2- 172.21.15.37:0/3583326477 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe58c06db50 0x7fe58c15a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:10:59.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.669+0000 7fe58b7fe640 1 --2- 172.21.15.37:0/3583326477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c06d770 0x7fe58c15f3a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009890 tx=0x7fe57c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:59.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.669+0000 7fe588ff9640 1 -- 172.21.15.37:0/3583326477 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c03ba70 con 0x7fe58c06d770 2023-12-11T17:10:59.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.669+0000 7fe588ff9640 1 -- 172.21.15.37:0/3583326477 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57c03bbf0 con 0x7fe58c06d770 2023-12-11T17:10:59.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.669+0000 7fe588ff9640 1 -- 172.21.15.37:0/3583326477 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c0453f0 con 0x7fe58c06d770 2023-12-11T17:10:59.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.669+0000 7fe591f2c640 1 -- 172.21.15.37:0/3583326477 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe58c1f3780 con 0x7fe58c06d770 2023-12-11T17:10:59.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.669+0000 7fe591f2c640 1 -- 172.21.15.37:0/3583326477 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe58c1f2ea0 con 0x7fe58c06d770 2023-12-11T17:10:59.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.671+0000 7fe591f2c640 1 -- 172.21.15.37:0/3583326477 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe58c067910 con 0x7fe58c06d770 2023-12-11T17:10:59.671 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.672+0000 7fe588ff9640 1 -- 172.21.15.37:0/3583326477 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe57c045550 con 0x7fe58c06d770 2023-12-11T17:10:59.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.672+0000 7fe588ff9640 1 --2- 172.21.15.37:0/3583326477 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe56c06ae90 0x7fe56c06d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:10:59.672 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.673+0000 7fe588ff9640 1 -- 172.21.15.37:0/3583326477 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe57c0abd40 con 0x7fe58c06d770 2023-12-11T17:10:59.673 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.673+0000 7fe583fff640 1 --2- 172.21.15.37:0/3583326477 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe56c06ae90 0x7fe56c06d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:10:59.674 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.674+0000 7fe583fff640 1 --2- 172.21.15.37:0/3583326477 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe56c06ae90 0x7fe56c06d350 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe574006fd0 tx=0x7fe574008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:10:59.676 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.677+0000 7fe588ff9640 1 -- 172.21.15.37:0/3583326477 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe57c076b10 con 0x7fe58c06d770 2023-12-11T17:10:59.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.873+0000 7fe591f2c640 1 -- 172.21.15.37:0/3583326477 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe58c0745d0 con 0x7fe58c06d770 2023-12-11T17:10:59.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.874+0000 7fe588ff9640 1 -- 172.21.15.37:0/3583326477 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe57c07a130 con 0x7fe58c06d770 2023-12-11T17:10:59.874 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:10:59.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.876+0000 7fe591f2c640 1 -- 172.21.15.37:0/3583326477 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe56c06ae90 msgr2=0x7fe56c06d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:59.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.876+0000 7fe591f2c640 1 --2- 172.21.15.37:0/3583326477 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe56c06ae90 0x7fe56c06d350 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe574006fd0 tx=0x7fe574008040 comp rx=0 tx=0).stop 2023-12-11T17:10:59.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.876+0000 7fe591f2c640 1 -- 172.21.15.37:0/3583326477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c06d770 msgr2=0x7fe58c15f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:10:59.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.876+0000 7fe591f2c640 1 --2- 172.21.15.37:0/3583326477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c06d770 0x7fe58c15f3a0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe57c009890 tx=0x7fe57c0046c0 comp rx=0 tx=0).stop 2023-12-11T17:10:59.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.876+0000 7fe591f2c640 1 -- 172.21.15.37:0/3583326477 shutdown_connections 2023-12-11T17:10:59.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.876+0000 7fe591f2c640 1 --2- 172.21.15.37:0/3583326477 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe56c06ae90 0x7fe56c06d350 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:59.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.876+0000 7fe591f2c640 1 --2- 172.21.15.37:0/3583326477 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe58c141790 0x7fe58c1f2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:59.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.876+0000 7fe591f2c640 1 --2- 172.21.15.37:0/3583326477 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe58c06db50 0x7fe58c15a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:59.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.877+0000 7fe591f2c640 1 --2- 172.21.15.37:0/3583326477 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe58c06d770 0x7fe58c15f3a0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:10:59.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.877+0000 7fe591f2c640 1 -- 172.21.15.37:0/3583326477 >> 172.21.15.37:0/3583326477 conn(0x7fe58c0cb850 msgr2=0x7fe58c13ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:10:59.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.877+0000 7fe591f2c640 1 -- 172.21.15.37:0/3583326477 shutdown_connections 2023-12-11T17:10:59.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:10:59.877+0000 7fe591f2c640 1 -- 172.21.15.37:0/3583326477 wait complete. 2023-12-11T17:10:59.897 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T17:11:00.130 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.130+0000 7f53be5ff640 1 Processor -- start 2023-12-11T17:11:00.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.131+0000 7f53be5ff640 1 -- start start 2023-12-11T17:11:00.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.132+0000 7f53be5ff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f53b80b3350 0x7f53b80b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:00.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.132+0000 7f53be5ff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53b80b3730 0x7f53b80cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:00.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.132+0000 7f53be5ff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53b80c6b80 con 0x7f53b80b40e0 2023-12-11T17:11:00.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.132+0000 7f53be5ff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53b80d3bf0 con 0x7f53b80b3350 2023-12-11T17:11:00.132 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.132+0000 7f53be5ff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b80d3ed0 con 0x7f53b80b3730 2023-12-11T17:11:00.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.133+0000 7f53bd5fd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f53b80b3350 0x7f53b80b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:00.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.133+0000 7f53bd5fd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f53b80b3350 0x7f53b80b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46958/0 (socket says 172.21.15.37:46958) 2023-12-11T17:11:00.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.133+0000 7f53bd5fd640 1 -- 172.21.15.37:0/4173459566 learned_addr learned my addr 172.21.15.37:0/4173459566 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:00.133 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.133+0000 7f53bcdfc640 1 --2- 172.21.15.37:0/4173459566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53b80b3730 0x7f53b80cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:00.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.133+0000 7f53bd5fd640 1 -- 172.21.15.37:0/4173459566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53b80b3730 msgr2=0x7f53b80cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:00.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.133+0000 7f53bd5fd640 1 --2- 172.21.15.37:0/4173459566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53b80b3730 0x7f53b80cf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:00.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.133+0000 7f53bd5fd640 1 -- 172.21.15.37:0/4173459566 >> v1:172.21.15.151:6789/0 conn(0x7f53b80b40e0 legacy=0x7f53b8161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:00.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.133+0000 7f53bd5fd640 1 -- 172.21.15.37:0/4173459566 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53b80d18c0 con 0x7f53b80b3350 2023-12-11T17:11:00.134 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.134+0000 7f53bd5fd640 1 --2- 172.21.15.37:0/4173459566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53b80b3350 0x7f53b80b3ba0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009e50 tx=0x7f53a802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9557af4d8a0fb9a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:00.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.135+0000 7f53b7fff640 1 -- 172.21.15.37:0/4173459566 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a802ca80 con 0x7f53b80b3350 2023-12-11T17:11:00.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.135+0000 7f53b7fff640 1 -- 172.21.15.37:0/4173459566 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a802cbe0 con 0x7f53b80b3350 2023-12-11T17:11:00.135 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.135+0000 7f53b7fff640 1 -- 172.21.15.37:0/4173459566 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a80343f0 con 0x7f53b80b3350 2023-12-11T17:11:00.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.136+0000 7f53be5ff640 1 -- 172.21.15.37:0/4173459566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53b80b3350 msgr2=0x7f53b80b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:00.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.136+0000 7f53be5ff640 1 --2- 172.21.15.37:0/4173459566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53b80b3350 0x7f53b80b3ba0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009e50 tx=0x7f53a802bee0 comp rx=0 tx=0).stop 2023-12-11T17:11:00.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.136+0000 7f53be5ff640 1 -- 172.21.15.37:0/4173459566 shutdown_connections 2023-12-11T17:11:00.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.136+0000 7f53be5ff640 1 --2- 172.21.15.37:0/4173459566 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53b80b3730 0x7f53b80cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:00.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.136+0000 7f53be5ff640 1 --2- 172.21.15.37:0/4173459566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53b80b3350 0x7f53b80b3ba0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:00.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.136+0000 7f53be5ff640 1 -- 172.21.15.37:0/4173459566 >> 172.21.15.37:0/4173459566 conn(0x7f53b80d3030 msgr2=0x7f53b80d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:00.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.136+0000 7f53be5ff640 1 -- 172.21.15.37:0/4173459566 shutdown_connections 2023-12-11T17:11:00.136 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.136+0000 7f53be5ff640 1 -- 172.21.15.37:0/4173459566 wait complete. 2023-12-11T17:11:00.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.138+0000 7f53be5ff640 1 Processor -- start 2023-12-11T17:11:00.138 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.138+0000 7f53be5ff640 1 -- start start 2023-12-11T17:11:00.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.140+0000 7f53be5ff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53b80b3350 0x7f53b80b7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:00.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.140+0000 7f53be5ff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53b80b3730 0x7f53b81f73d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:00.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.140+0000 7f53be5ff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53b80b40e0 0x7f53b80ce690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:00.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.140+0000 7f53be5ff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b8159e70 con 0x7f53b80b3350 2023-12-11T17:11:00.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.140+0000 7f53be5ff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53b80b80d0 con 0x7f53b80b3730 2023-12-11T17:11:00.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.140+0000 7f53be5ff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53b80b00f0 con 0x7f53b80b40e0 2023-12-11T17:11:00.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.140+0000 7f53bd5fd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53b80b3350 0x7f53b80b7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:00.140 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.140+0000 7f53bd5fd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53b80b3350 0x7f53b80b7b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46970/0 (socket says 172.21.15.37:46970) 2023-12-11T17:11:00.141 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.140+0000 7f53bd5fd640 1 -- 172.21.15.37:0/3749799124 learned_addr learned my addr 172.21.15.37:0/3749799124 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.141+0000 7f53bddfe640 1 --2- 172.21.15.37:0/3749799124 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53b80b40e0 0x7f53b80ce690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.141+0000 7f53bcdfc640 1 --2- 172.21.15.37:0/3749799124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53b80b3730 0x7f53b81f73d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.141+0000 7f53bd5fd640 1 -- 172.21.15.37:0/3749799124 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53b80b40e0 msgr2=0x7f53b80ce690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.141+0000 7f53bd5fd640 1 --2- 172.21.15.37:0/3749799124 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53b80b40e0 0x7f53b80ce690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.141+0000 7f53bd5fd640 1 -- 172.21.15.37:0/3749799124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53b80b3730 msgr2=0x7f53b81f73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.141+0000 7f53bd5fd640 1 --2- 172.21.15.37:0/3749799124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53b80b3730 0x7f53b81f73d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.141+0000 7f53bd5fd640 1 -- 172.21.15.37:0/3749799124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a8009b30 con 0x7f53b80b3350 2023-12-11T17:11:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.141+0000 7f53bcdfc640 1 --2- 172.21.15.37:0/3749799124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53b80b3730 0x7f53b81f73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.141+0000 7f53bd5fd640 1 --2- 172.21.15.37:0/3749799124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53b80b3350 0x7f53b80b7b90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009e50 tx=0x7f53a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.141+0000 7f53b5ffb640 1 -- 172.21.15.37:0/3749799124 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a8009510 con 0x7f53b80b3350 2023-12-11T17:11:00.142 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.142+0000 7f53b5ffb640 1 -- 172.21.15.37:0/3749799124 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a803e450 con 0x7f53b80b3350 2023-12-11T17:11:00.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.142+0000 7f53be5ff640 1 -- 172.21.15.37:0/3749799124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53b80b48a0 con 0x7f53b80b3350 2023-12-11T17:11:00.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.142+0000 7f53b5ffb640 1 -- 172.21.15.37:0/3749799124 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a803e800 con 0x7f53b80b3350 2023-12-11T17:11:00.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.142+0000 7f53be5ff640 1 -- 172.21.15.37:0/3749799124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53b80b06b0 con 0x7f53b80b3350 2023-12-11T17:11:00.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.143+0000 7f53be5ff640 1 -- 172.21.15.37:0/3749799124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53b8074450 con 0x7f53b80b3350 2023-12-11T17:11:00.143 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.144+0000 7f53b5ffb640 1 -- 172.21.15.37:0/3749799124 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f53a802cd50 con 0x7f53b80b3350 2023-12-11T17:11:00.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.145+0000 7f53b5ffb640 1 --2- 172.21.15.37:0/3749799124 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f53a406ae40 0x7f53a406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:00.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.145+0000 7f53b5ffb640 1 -- 172.21.15.37:0/3749799124 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f53a80ac5d0 con 0x7f53b80b3350 2023-12-11T17:11:00.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.145+0000 7f53bcdfc640 1 --2- 172.21.15.37:0/3749799124 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f53a406ae40 0x7f53a406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:00.147 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.147+0000 7f53bcdfc640 1 --2- 172.21.15.37:0/3749799124 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f53a406ae40 0x7f53a406d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f53b80cf340 tx=0x7f53ac008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:00.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.149+0000 7f53b5ffb640 1 -- 172.21.15.37:0/3749799124 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f53a8077290 con 0x7f53b80b3350 2023-12-11T17:11:00.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.343+0000 7f53be5ff640 1 -- 172.21.15.37:0/3749799124 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f53b8072830 con 0x7f53b80b3350 2023-12-11T17:11:00.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.344+0000 7f53b5ffb640 1 -- 172.21.15.37:0/3749799124 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f53a807a8b0 con 0x7f53b80b3350 2023-12-11T17:11:00.344 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-11T17:11:00.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.346+0000 7f53be5ff640 1 -- 172.21.15.37:0/3749799124 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f53a406ae40 msgr2=0x7f53a406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:00.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.346+0000 7f53be5ff640 1 --2- 172.21.15.37:0/3749799124 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f53a406ae40 0x7f53a406d300 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f53b80cf340 tx=0x7f53ac008040 comp rx=0 tx=0).stop 2023-12-11T17:11:00.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.346+0000 7f53be5ff640 1 -- 172.21.15.37:0/3749799124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53b80b3350 msgr2=0x7f53b80b7b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:00.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.346+0000 7f53be5ff640 1 --2- 172.21.15.37:0/3749799124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53b80b3350 0x7f53b80b7b90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f53a8009e50 tx=0x7f53a8004a40 comp rx=0 tx=0).stop 2023-12-11T17:11:00.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.346+0000 7f53be5ff640 1 -- 172.21.15.37:0/3749799124 shutdown_connections 2023-12-11T17:11:00.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.347+0000 7f53be5ff640 1 --2- 172.21.15.37:0/3749799124 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f53a406ae40 0x7f53a406d300 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:00.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.347+0000 7f53be5ff640 1 --2- 172.21.15.37:0/3749799124 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53b80b3730 0x7f53b81f73d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:00.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.347+0000 7f53be5ff640 1 --2- 172.21.15.37:0/3749799124 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f53b80b40e0 0x7f53b80ce690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:00.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.347+0000 7f53be5ff640 1 --2- 172.21.15.37:0/3749799124 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f53b80b3350 0x7f53b80b7b90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:00.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.347+0000 7f53be5ff640 1 -- 172.21.15.37:0/3749799124 >> 172.21.15.37:0/3749799124 conn(0x7f53b80d3030 msgr2=0x7f53b8160050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:00.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.347+0000 7f53be5ff640 1 -- 172.21.15.37:0/3749799124 shutdown_connections 2023-12-11T17:11:00.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.347+0000 7f53be5ff640 1 -- 172.21.15.37:0/3749799124 wait complete. 2023-12-11T17:11:00.366 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-11T17:11:00.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.594+0000 7f64b5516640 1 Processor -- start 2023-12-11T17:11:00.594 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.594+0000 7f64b5516640 1 -- start start 2023-12-11T17:11:00.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.595+0000 7f64b5516640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64b015ba90 0x7f64b006d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:00.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.596+0000 7f64b5516640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f64b00b2aa0 0x7f64b00cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:00.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.596+0000 7f64b5516640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64b00cc120 0x7f64b0165070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:00.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.596+0000 7f64b5516640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b00b3fe0 con 0x7f64b00cc120 2023-12-11T17:11:00.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.596+0000 7f64b5516640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64b006d950 con 0x7f64b00b2aa0 2023-12-11T17:11:00.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.596+0000 7f64b5516640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b006c0b0 con 0x7f64b015ba90 2023-12-11T17:11:00.597 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.596+0000 7f64b4d15640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64b00cc120 0x7f64b0165070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:00.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.596+0000 7f64b4d15640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f64b00cc120 0x7f64b0165070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46984/0 (socket says 172.21.15.37:46984) 2023-12-11T17:11:00.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.596+0000 7f64b4d15640 1 -- 172.21.15.37:0/3128492933 learned_addr learned my addr 172.21.15.37:0/3128492933 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:00.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.596+0000 7f64af7fe640 1 --2- 172.21.15.37:0/3128492933 >> v2:172.21.15.151:3300/0 conn(0x7f64b00b2aa0 0x7f64b00cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:00.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.596+0000 7f64affff640 1 --2- 172.21.15.37:0/3128492933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64b015ba90 0x7f64b006d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:00.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.597+0000 7f64b4d15640 1 -- 172.21.15.37:0/3128492933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64b015ba90 msgr2=0x7f64b006d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:00.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.597+0000 7f64b4d15640 1 --2- 172.21.15.37:0/3128492933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64b015ba90 0x7f64b006d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:00.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.597+0000 7f64b4d15640 1 -- 172.21.15.37:0/3128492933 >> v2:172.21.15.151:3300/0 conn(0x7f64b00b2aa0 msgr2=0x7f64b00cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:00.598 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.597+0000 7f64b4d15640 1 --2- 172.21.15.37:0/3128492933 >> v2:172.21.15.151:3300/0 conn(0x7f64b00b2aa0 0x7f64b00cbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:00.599 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.597+0000 7f64b4d15640 1 -- 172.21.15.37:0/3128492933 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64b006c390 con 0x7f64b00cc120 2023-12-11T17:11:00.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.598+0000 7f64b4d15640 1 --2- 172.21.15.37:0/3128492933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64b00cc120 0x7f64b0165070 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f64b006fdd0 tx=0x7f64a802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2529cb9da1471d72 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:00.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.598+0000 7f64aeffd640 1 -- 172.21.15.37:0/3128492933 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a80317e0 con 0x7f64b00cc120 2023-12-11T17:11:00.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.598+0000 7f64aeffd640 1 -- 172.21.15.37:0/3128492933 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a8031940 con 0x7f64b00cc120 2023-12-11T17:11:00.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.598+0000 7f64aeffd640 1 -- 172.21.15.37:0/3128492933 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a8031cd0 con 0x7f64b00cc120 2023-12-11T17:11:00.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.599+0000 7f64b5516640 1 -- 172.21.15.37:0/3128492933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64b00cc120 msgr2=0x7f64b0165070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:00.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.599+0000 7f64b5516640 1 --2- 172.21.15.37:0/3128492933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64b00cc120 0x7f64b0165070 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f64b006fdd0 tx=0x7f64a802b880 comp rx=0 tx=0).stop 2023-12-11T17:11:00.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.599+0000 7f64b5516640 1 -- 172.21.15.37:0/3128492933 shutdown_connections 2023-12-11T17:11:00.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.599+0000 7f64b5516640 1 --2- 172.21.15.37:0/3128492933 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64b00cc120 0x7f64b0165070 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:00.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.599+0000 7f64b5516640 1 --2- 172.21.15.37:0/3128492933 >> v2:172.21.15.151:3300/0 conn(0x7f64b00b2aa0 0x7f64b00cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:00.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.599+0000 7f64b5516640 1 --2- 172.21.15.37:0/3128492933 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64b015ba90 0x7f64b006d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:00.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.599+0000 7f64b5516640 1 -- 172.21.15.37:0/3128492933 >> 172.21.15.37:0/3128492933 conn(0x7f64b00b0940 msgr2=0x7f64b00b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:00.600 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.599+0000 7f64b5516640 1 -- 172.21.15.37:0/3128492933 shutdown_connections 2023-12-11T17:11:00.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.599+0000 7f64b5516640 1 -- 172.21.15.37:0/3128492933 wait complete. 2023-12-11T17:11:00.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.601+0000 7f64b5516640 1 Processor -- start 2023-12-11T17:11:00.601 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.601+0000 7f64b5516640 1 -- start start 2023-12-11T17:11:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.602+0000 7f64b5516640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64b00b2aa0 0x7f64b0158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.602+0000 7f64b5516640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64b00cc120 0x7f64b009bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.602+0000 7f64b5516640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64b015ba90 0x7f64b009c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.602+0000 7f64b5516640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b01f6b10 con 0x7f64b00b2aa0 2023-12-11T17:11:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.602+0000 7f64b5516640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64b00ceb30 con 0x7f64b015ba90 2023-12-11T17:11:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.602+0000 7f64b5516640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64b00cee10 con 0x7f64b00cc120 2023-12-11T17:11:00.602 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.602+0000 7f64affff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64b00b2aa0 0x7f64b0158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:00.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.602+0000 7f64affff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64b00b2aa0 0x7f64b0158c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:46994/0 (socket says 172.21.15.37:46994) 2023-12-11T17:11:00.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.602+0000 7f64affff640 1 -- 172.21.15.37:0/1148182945 learned_addr learned my addr 172.21.15.37:0/1148182945 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:00.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.603+0000 7f64b4d15640 1 --2- 172.21.15.37:0/1148182945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64b015ba90 0x7f64b009c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:00.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.603+0000 7f64affff640 1 -- 172.21.15.37:0/1148182945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64b00cc120 msgr2=0x7f64b009bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:00.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.603+0000 7f64af7fe640 1 --2- 172.21.15.37:0/1148182945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64b00cc120 0x7f64b009bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:00.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.603+0000 7f64affff640 1 --2- 172.21.15.37:0/1148182945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64b00cc120 0x7f64b009bcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:00.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.603+0000 7f64affff640 1 -- 172.21.15.37:0/1148182945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64b015ba90 msgr2=0x7f64b009c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:00.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.603+0000 7f64affff640 1 --2- 172.21.15.37:0/1148182945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64b015ba90 0x7f64b009c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:00.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.603+0000 7f64affff640 1 -- 172.21.15.37:0/1148182945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a80094d0 con 0x7f64b00b2aa0 2023-12-11T17:11:00.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.603+0000 7f64b4d15640 1 --2- 172.21.15.37:0/1148182945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64b015ba90 0x7f64b009c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:00.606 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.603+0000 7f64affff640 1 --2- 172.21.15.37:0/1148182945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64b00b2aa0 0x7f64b0158c80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f64a0007e40 tx=0x7f64a000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:00.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.603+0000 7f64acff9640 1 -- 172.21.15.37:0/1148182945 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a0014620 con 0x7f64b00b2aa0 2023-12-11T17:11:00.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.603+0000 7f64acff9640 1 -- 172.21.15.37:0/1148182945 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64a000ee90 con 0x7f64b00b2aa0 2023-12-11T17:11:00.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.603+0000 7f64b5516640 1 -- 172.21.15.37:0/1148182945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64b0099a90 con 0x7f64b00b2aa0 2023-12-11T17:11:00.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.603+0000 7f64acff9640 1 -- 172.21.15.37:0/1148182945 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f64a00149c0 con 0x7f64b00b2aa0 2023-12-11T17:11:00.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.604+0000 7f64b5516640 1 -- 172.21.15.37:0/1148182945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64b01591c0 con 0x7f64b00b2aa0 2023-12-11T17:11:00.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.605+0000 7f64b5516640 1 -- 172.21.15.37:0/1148182945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64b0067910 con 0x7f64b00b2aa0 2023-12-11T17:11:00.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.606+0000 7f64acff9640 1 -- 172.21.15.37:0/1148182945 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f64a0014b20 con 0x7f64b00b2aa0 2023-12-11T17:11:00.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.606+0000 7f64acff9640 1 --2- 172.21.15.37:0/1148182945 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f649c06ae40 0x7f649c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:00.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.607+0000 7f64acff9640 1 -- 172.21.15.37:0/1148182945 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f64a008a350 con 0x7f64b00b2aa0 2023-12-11T17:11:00.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.607+0000 7f64af7fe640 1 --2- 172.21.15.37:0/1148182945 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f649c06ae40 0x7f649c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:00.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.609+0000 7f64af7fe640 1 --2- 172.21.15.37:0/1148182945 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f649c06ae40 0x7f649c06d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f64b00cdc00 tx=0x7f64a4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:00.611 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.611+0000 7f64acff9640 1 -- 172.21.15.37:0/1148182945 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f64a0054f80 con 0x7f64b00b2aa0 2023-12-11T17:11:00.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.806+0000 7f64b5516640 1 -- 172.21.15.37:0/1148182945 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f64b006c670 con 0x7f64b00b2aa0 2023-12-11T17:11:00.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.807+0000 7f64acff9640 1 -- 172.21.15.37:0/1148182945 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f64a00585a0 con 0x7f64b00b2aa0 2023-12-11T17:11:00.810 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:11:00.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.810+0000 7f64b5516640 1 -- 172.21.15.37:0/1148182945 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f649c06ae40 msgr2=0x7f649c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:00.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.810+0000 7f64b5516640 1 --2- 172.21.15.37:0/1148182945 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f649c06ae40 0x7f649c06d300 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f64b00cdc00 tx=0x7f64a4008040 comp rx=0 tx=0).stop 2023-12-11T17:11:00.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.810+0000 7f64b5516640 1 -- 172.21.15.37:0/1148182945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64b00b2aa0 msgr2=0x7f64b0158c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:00.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.810+0000 7f64b5516640 1 --2- 172.21.15.37:0/1148182945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64b00b2aa0 0x7f64b0158c80 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f64a0007e40 tx=0x7f64a000e4b0 comp rx=0 tx=0).stop 2023-12-11T17:11:00.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.810+0000 7f64b5516640 1 -- 172.21.15.37:0/1148182945 shutdown_connections 2023-12-11T17:11:00.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.810+0000 7f64b5516640 1 --2- 172.21.15.37:0/1148182945 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f649c06ae40 0x7f649c06d300 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:00.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.810+0000 7f64b5516640 1 --2- 172.21.15.37:0/1148182945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f64b015ba90 0x7f64b009c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:00.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.810+0000 7f64b5516640 1 --2- 172.21.15.37:0/1148182945 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f64b00cc120 0x7f64b009bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:00.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.810+0000 7f64b5516640 1 --2- 172.21.15.37:0/1148182945 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f64b00b2aa0 0x7f64b0158c80 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:00.811 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.810+0000 7f64b5516640 1 -- 172.21.15.37:0/1148182945 >> 172.21.15.37:0/1148182945 conn(0x7f64b00b0940 msgr2=0x7f64b00afca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:00.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.810+0000 7f64b5516640 1 -- 172.21.15.37:0/1148182945 shutdown_connections 2023-12-11T17:11:00.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:00.810+0000 7f64b5516640 1 -- 172.21.15.37:0/1148182945 wait complete. 2023-12-11T17:11:00.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-11T17:11:01.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.045+0000 7fcb46002640 1 Processor -- start 2023-12-11T17:11:01.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.046+0000 7fcb46002640 1 -- start start 2023-12-11T17:11:01.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.047+0000 7fcb46002640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcb4015e5d0 0x7fcb4006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:01.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.047+0000 7fcb46002640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb40071260 0x7fcb400cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:01.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.047+0000 7fcb46002640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb40071f90 con 0x7fcb400ae200 2023-12-11T17:11:01.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.048+0000 7fcb46002640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb40072270 con 0x7fcb4015e5d0 2023-12-11T17:11:01.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.048+0000 7fcb46002640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb40070070 con 0x7fcb40071260 2023-12-11T17:11:01.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.048+0000 7fcb45000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcb4015e5d0 0x7fcb4006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:01.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.048+0000 7fcb45801640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb40071260 0x7fcb400cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:01.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.048+0000 7fcb45801640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb40071260 0x7fcb400cded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.37:48816/0 (socket says 172.21.15.37:48816) 2023-12-11T17:11:01.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.048+0000 7fcb45000640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcb4015e5d0 0x7fcb4006bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:39530/0 (socket says 172.21.15.37:39530) 2023-12-11T17:11:01.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.048+0000 7fcb45801640 1 -- 172.21.15.37:0/270700563 learned_addr learned my addr 172.21.15.37:0/270700563 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:01.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.049+0000 7fcb45801640 1 -- 172.21.15.37:0/270700563 >> v2:172.21.15.151:3300/0 conn(0x7fcb4015e5d0 msgr2=0x7fcb4006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:01.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.049+0000 7fcb45801640 1 --2- 172.21.15.37:0/270700563 >> v2:172.21.15.151:3300/0 conn(0x7fcb4015e5d0 0x7fcb4006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:01.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.049+0000 7fcb45801640 1 -- 172.21.15.37:0/270700563 >> v1:172.21.15.151:6789/0 conn(0x7fcb400ae200 legacy=0x7fcb40070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:01.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.049+0000 7fcb45801640 1 -- 172.21.15.37:0/270700563 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb40070350 con 0x7fcb40071260 2023-12-11T17:11:01.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.050+0000 7fcb45801640 1 --2- 172.21.15.37:0/270700563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb40071260 0x7fcb400cded0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcb38009e50 tx=0x7fcb3802bed0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2fe916d5a0108ea8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:01.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.051+0000 7fcb3f7fe640 1 -- 172.21.15.37:0/270700563 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3802ca70 con 0x7fcb40071260 2023-12-11T17:11:01.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.051+0000 7fcb3f7fe640 1 -- 172.21.15.37:0/270700563 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3802cbd0 con 0x7fcb40071260 2023-12-11T17:11:01.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.051+0000 7fcb3f7fe640 1 -- 172.21.15.37:0/270700563 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb380343f0 con 0x7fcb40071260 2023-12-11T17:11:01.051 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.051+0000 7fcb46002640 1 -- 172.21.15.37:0/270700563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb40071260 msgr2=0x7fcb400cded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:01.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.051+0000 7fcb46002640 1 --2- 172.21.15.37:0/270700563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb40071260 0x7fcb400cded0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcb38009e50 tx=0x7fcb3802bed0 comp rx=0 tx=0).stop 2023-12-11T17:11:01.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.051+0000 7fcb46002640 1 -- 172.21.15.37:0/270700563 shutdown_connections 2023-12-11T17:11:01.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.051+0000 7fcb46002640 1 --2- 172.21.15.37:0/270700563 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb40071260 0x7fcb400cded0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:01.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.051+0000 7fcb46002640 1 --2- 172.21.15.37:0/270700563 >> v2:172.21.15.151:3300/0 conn(0x7fcb4015e5d0 0x7fcb4006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:01.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.051+0000 7fcb46002640 1 -- 172.21.15.37:0/270700563 >> 172.21.15.37:0/270700563 conn(0x7fcb400b0860 msgr2=0x7fcb400b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:01.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.051+0000 7fcb46002640 1 -- 172.21.15.37:0/270700563 shutdown_connections 2023-12-11T17:11:01.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.052+0000 7fcb46002640 1 -- 172.21.15.37:0/270700563 wait complete. 2023-12-11T17:11:01.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.053+0000 7fcb46002640 1 Processor -- start 2023-12-11T17:11:01.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.053+0000 7fcb46002640 1 -- start start 2023-12-11T17:11:01.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.054+0000 7fcb46002640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb40071260 0x7fcb40155f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:01.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.054+0000 7fcb46002640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb400ae200 0x7fcb401485e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:01.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.054+0000 7fcb46002640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb4015e5d0 0x7fcb4015d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:01.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.054+0000 7fcb46002640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb40155b00 con 0x7fcb40071260 2023-12-11T17:11:01.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.054+0000 7fcb46002640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb40156460 con 0x7fcb400ae200 2023-12-11T17:11:01.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.054+0000 7fcb46002640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb40148b20 con 0x7fcb4015e5d0 2023-12-11T17:11:01.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.055+0000 7fcb45000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb40071260 0x7fcb40155f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:01.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.055+0000 7fcb45000640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb40071260 0x7fcb40155f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47002/0 (socket says 172.21.15.37:47002) 2023-12-11T17:11:01.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.055+0000 7fcb45000640 1 -- 172.21.15.37:0/1171489667 learned_addr learned my addr 172.21.15.37:0/1171489667 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:01.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.055+0000 7fcb45801640 1 --2- 172.21.15.37:0/1171489667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb4015e5d0 0x7fcb4015d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:01.055 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.055+0000 7fcb3ffff640 1 --2- 172.21.15.37:0/1171489667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb400ae200 0x7fcb401485e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:01.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.055+0000 7fcb45000640 1 -- 172.21.15.37:0/1171489667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb4015e5d0 msgr2=0x7fcb4015d1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:01.056 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.055+0000 7fcb45000640 1 --2- 172.21.15.37:0/1171489667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb4015e5d0 0x7fcb4015d1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:01.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.055+0000 7fcb45000640 1 -- 172.21.15.37:0/1171489667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb400ae200 msgr2=0x7fcb401485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:01.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.055+0000 7fcb45000640 1 --2- 172.21.15.37:0/1171489667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb400ae200 0x7fcb401485e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:01.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.055+0000 7fcb45000640 1 -- 172.21.15.37:0/1171489667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb38009b30 con 0x7fcb40071260 2023-12-11T17:11:01.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.055+0000 7fcb45801640 1 --2- 172.21.15.37:0/1171489667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb4015e5d0 0x7fcb4015d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:11:01.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.056+0000 7fcb45000640 1 --2- 172.21.15.37:0/1171489667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb40071260 0x7fcb40155f20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400e9b0 tx=0x7fcb3400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:01.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.056+0000 7fcb3d7fa640 1 -- 172.21.15.37:0/1171489667 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb34009670 con 0x7fcb40071260 2023-12-11T17:11:01.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.056+0000 7fcb3d7fa640 1 -- 172.21.15.37:0/1171489667 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3400c9a0 con 0x7fcb40071260 2023-12-11T17:11:01.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.056+0000 7fcb3d7fa640 1 -- 172.21.15.37:0/1171489667 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3400cd50 con 0x7fcb40071260 2023-12-11T17:11:01.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.056+0000 7fcb46002640 1 -- 172.21.15.37:0/1171489667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb40155160 con 0x7fcb40071260 2023-12-11T17:11:01.057 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.056+0000 7fcb46002640 1 -- 172.21.15.37:0/1171489667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb40155720 con 0x7fcb40071260 2023-12-11T17:11:01.058 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.058+0000 7fcb46002640 1 -- 172.21.15.37:0/1171489667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb40074450 con 0x7fcb40071260 2023-12-11T17:11:01.059 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.059+0000 7fcb3d7fa640 1 -- 172.21.15.37:0/1171489667 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcb34013470 con 0x7fcb40071260 2023-12-11T17:11:01.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.060+0000 7fcb3d7fa640 1 --2- 172.21.15.37:0/1171489667 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcb2406ae40 0x7fcb2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:01.060 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.060+0000 7fcb3d7fa640 1 -- 172.21.15.37:0/1171489667 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fcb34089c10 con 0x7fcb40071260 2023-12-11T17:11:01.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.061+0000 7fcb3ffff640 1 --2- 172.21.15.37:0/1171489667 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcb2406ae40 0x7fcb2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:01.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.062+0000 7fcb3ffff640 1 --2- 172.21.15.37:0/1171489667 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcb2406ae40 0x7fcb2406d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcb4014bf90 tx=0x7fcb2c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:01.064 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.065+0000 7fcb3d7fa640 1 -- 172.21.15.37:0/1171489667 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcb340548d0 con 0x7fcb40071260 2023-12-11T17:11:01.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.279+0000 7fcb46002640 1 -- 172.21.15.37:0/1171489667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcb400adfe0 con 0x7fcb40071260 2023-12-11T17:11:01.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.280+0000 7fcb3d7fa640 1 -- 172.21.15.37:0/1171489667 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcb34017080 con 0x7fcb40071260 2023-12-11T17:11:01.280 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-12-11T17:11:01.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.282+0000 7fcb46002640 1 -- 172.21.15.37:0/1171489667 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcb2406ae40 msgr2=0x7fcb2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:01.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.282+0000 7fcb46002640 1 --2- 172.21.15.37:0/1171489667 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcb2406ae40 0x7fcb2406d300 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fcb4014bf90 tx=0x7fcb2c009040 comp rx=0 tx=0).stop 2023-12-11T17:11:01.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.282+0000 7fcb46002640 1 -- 172.21.15.37:0/1171489667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb40071260 msgr2=0x7fcb40155f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:01.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.282+0000 7fcb46002640 1 --2- 172.21.15.37:0/1171489667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb40071260 0x7fcb40155f20 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fcb3400e9b0 tx=0x7fcb3400ee70 comp rx=0 tx=0).stop 2023-12-11T17:11:01.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.282+0000 7fcb46002640 1 -- 172.21.15.37:0/1171489667 shutdown_connections 2023-12-11T17:11:01.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.282+0000 7fcb46002640 1 --2- 172.21.15.37:0/1171489667 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcb2406ae40 0x7fcb2406d300 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:01.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.282+0000 7fcb46002640 1 --2- 172.21.15.37:0/1171489667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb400ae200 0x7fcb401485e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:01.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.282+0000 7fcb46002640 1 --2- 172.21.15.37:0/1171489667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb4015e5d0 0x7fcb4015d1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:01.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.282+0000 7fcb46002640 1 --2- 172.21.15.37:0/1171489667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb40071260 0x7fcb40155f20 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:01.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.282+0000 7fcb46002640 1 -- 172.21.15.37:0/1171489667 >> 172.21.15.37:0/1171489667 conn(0x7fcb400b0860 msgr2=0x7fcb400b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:01.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.283+0000 7fcb46002640 1 -- 172.21.15.37:0/1171489667 shutdown_connections 2023-12-11T17:11:01.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.283+0000 7fcb46002640 1 -- 172.21.15.37:0/1171489667 wait complete. 2023-12-11T17:11:01.305 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-12-11T17:11:01.305 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:11:01.305 DEBUG:teuthology.orchestra.run.smithi151:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-12-11T17:11:01.414 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-12-11T17:11:01.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:11:01.414 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-11T17:11:01.476 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:11:01.477 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-11T17:11:01.539 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:11:01.539 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-11T17:11:01.597 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:11:01.597 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-11T17:11:01.654 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:11:01.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.881+0000 7ff60d353640 1 Processor -- start 2023-12-11T17:11:01.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.881+0000 7ff60d353640 1 -- start start 2023-12-11T17:11:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.883+0000 7ff60d353640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff608143e00 0x7ff6080b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.883+0000 7ff60d353640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff608072180 0x7ff6080b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.883+0000 7ff60d353640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6080b3bb0 con 0x7ff60806c410 2023-12-11T17:11:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.883+0000 7ff60d353640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6081441e0 con 0x7ff608072180 2023-12-11T17:11:01.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.883+0000 7ff60d353640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff608072680 con 0x7ff608143e00 2023-12-11T17:11:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.883+0000 7ff6067fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff608072180 0x7ff6080b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.883+0000 7ff6067fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff608072180 0x7ff6080b4580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47006/0 (socket says 172.21.15.37:47006) 2023-12-11T17:11:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.883+0000 7ff6067fc640 1 -- 172.21.15.37:0/1257821292 learned_addr learned my addr 172.21.15.37:0/1257821292 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.884+0000 7ff6067fc640 1 -- 172.21.15.37:0/1257821292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff608143e00 msgr2=0x7ff6080b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.884+0000 7ff6067fc640 1 --2- 172.21.15.37:0/1257821292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff608143e00 0x7ff6080b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.884+0000 7ff6067fc640 1 -- 172.21.15.37:0/1257821292 >> v1:172.21.15.151:6789/0 conn(0x7ff60806c410 legacy=0x7ff608070690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:01.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.884+0000 7ff6067fc640 1 -- 172.21.15.37:0/1257821292 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6080b1e30 con 0x7ff608072180 2023-12-11T17:11:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.885+0000 7ff6067fc640 1 --2- 172.21.15.37:0/1257821292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff608072180 0x7ff6080b4580 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009870 tx=0x7ff5fc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e4229e63a91813b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:01.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.886+0000 7ff605ffb640 1 -- 172.21.15.37:0/1257821292 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc031640 con 0x7ff608072180 2023-12-11T17:11:01.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.886+0000 7ff605ffb640 1 -- 172.21.15.37:0/1257821292 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc0317a0 con 0x7ff608072180 2023-12-11T17:11:01.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.886+0000 7ff605ffb640 1 -- 172.21.15.37:0/1257821292 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc031b30 con 0x7ff608072180 2023-12-11T17:11:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.886+0000 7ff60d353640 1 -- 172.21.15.37:0/1257821292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff608072180 msgr2=0x7ff6080b4580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.886+0000 7ff60d353640 1 --2- 172.21.15.37:0/1257821292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff608072180 0x7ff6080b4580 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009870 tx=0x7ff5fc02b8f0 comp rx=0 tx=0).stop 2023-12-11T17:11:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.887+0000 7ff60d353640 1 -- 172.21.15.37:0/1257821292 shutdown_connections 2023-12-11T17:11:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.887+0000 7ff60d353640 1 --2- 172.21.15.37:0/1257821292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff608072180 0x7ff6080b4580 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.887+0000 7ff60d353640 1 --2- 172.21.15.37:0/1257821292 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff608143e00 0x7ff6080b4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.887+0000 7ff60d353640 1 -- 172.21.15.37:0/1257821292 >> 172.21.15.37:0/1257821292 conn(0x7ff6080b0a90 msgr2=0x7ff6080b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.887+0000 7ff60d353640 1 -- 172.21.15.37:0/1257821292 shutdown_connections 2023-12-11T17:11:01.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.887+0000 7ff60d353640 1 -- 172.21.15.37:0/1257821292 wait complete. 2023-12-11T17:11:01.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.889+0000 7ff60d353640 1 Processor -- start 2023-12-11T17:11:01.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.889+0000 7ff60d353640 1 -- start start 2023-12-11T17:11:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.890+0000 7ff60d353640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff60806c410 0x7ff6081384b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.890+0000 7ff60d353640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff608072180 0x7ff60813a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.891+0000 7ff60d353640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff608143e00 0x7ff60813c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.891+0000 7ff60d353640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff608156570 con 0x7ff608072180 2023-12-11T17:11:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.891+0000 7ff60d353640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6081f2e90 con 0x7ff608143e00 2023-12-11T17:11:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.891+0000 7ff60d353640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60813ac30 con 0x7ff60806c410 2023-12-11T17:11:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.891+0000 7ff6067fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff608072180 0x7ff60813a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:01.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.891+0000 7ff6067fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff608072180 0x7ff60813a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47010/0 (socket says 172.21.15.37:47010) 2023-12-11T17:11:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.891+0000 7ff6067fc640 1 -- 172.21.15.37:0/1785656174 learned_addr learned my addr 172.21.15.37:0/1785656174 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.891+0000 7ff606ffd640 1 --2- 172.21.15.37:0/1785656174 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff60806c410 0x7ff6081384b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:01.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.891+0000 7ff6077fe640 1 --2- 172.21.15.37:0/1785656174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff608143e00 0x7ff60813c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:01.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.891+0000 7ff6067fc640 1 -- 172.21.15.37:0/1785656174 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff60806c410 msgr2=0x7ff6081384b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:01.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.891+0000 7ff6067fc640 1 --2- 172.21.15.37:0/1785656174 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff60806c410 0x7ff6081384b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:01.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.891+0000 7ff6067fc640 1 -- 172.21.15.37:0/1785656174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff608143e00 msgr2=0x7ff60813c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:01.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.891+0000 7ff6067fc640 1 --2- 172.21.15.37:0/1785656174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff608143e00 0x7ff60813c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:01.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.892+0000 7ff6067fc640 1 -- 172.21.15.37:0/1785656174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc0094d0 con 0x7ff608072180 2023-12-11T17:11:01.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.892+0000 7ff606ffd640 1 --2- 172.21.15.37:0/1785656174 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff60806c410 0x7ff6081384b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:11:01.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.892+0000 7ff6067fc640 1 --2- 172.21.15.37:0/1785656174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff608072180 0x7ff60813a6f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009870 tx=0x7ff5fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:01.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.892+0000 7ff5ef7fe640 1 -- 172.21.15.37:0/1785656174 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc03ac60 con 0x7ff608072180 2023-12-11T17:11:01.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.892+0000 7ff5ef7fe640 1 -- 172.21.15.37:0/1785656174 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc03adc0 con 0x7ff608072180 2023-12-11T17:11:01.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.892+0000 7ff5ef7fe640 1 -- 172.21.15.37:0/1785656174 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc044630 con 0x7ff608072180 2023-12-11T17:11:01.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.892+0000 7ff60d353640 1 -- 172.21.15.37:0/1785656174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff608138a90 con 0x7ff608072180 2023-12-11T17:11:01.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.892+0000 7ff60d353640 1 -- 172.21.15.37:0/1785656174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff608139050 con 0x7ff608072180 2023-12-11T17:11:01.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.894+0000 7ff60d353640 1 -- 172.21.15.37:0/1785656174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6080745d0 con 0x7ff608072180 2023-12-11T17:11:01.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.895+0000 7ff5ef7fe640 1 -- 172.21.15.37:0/1785656174 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff5fc02f050 con 0x7ff608072180 2023-12-11T17:11:01.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.896+0000 7ff5ef7fe640 1 --2- 172.21.15.37:0/1785656174 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff5f406ae70 0x7ff5f406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:01.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.896+0000 7ff5ef7fe640 1 -- 172.21.15.37:0/1785656174 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff5fc0aba60 con 0x7ff608072180 2023-12-11T17:11:01.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.896+0000 7ff606ffd640 1 --2- 172.21.15.37:0/1785656174 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff5f406ae70 0x7ff5f406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:01.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.897+0000 7ff606ffd640 1 --2- 172.21.15.37:0/1785656174 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff5f406ae70 0x7ff5f406d330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009890 tx=0x7ff5f8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:01.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:01.900+0000 7ff5ef7fe640 1 -- 172.21.15.37:0/1785656174 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff5fc076690 con 0x7ff608072180 2023-12-11T17:11:02.097 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.097+0000 7ff60d353640 1 -- 172.21.15.37:0/1785656174 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff6080cf810 con 0x7ff608072180 2023-12-11T17:11:02.100 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.100+0000 7ff5ef7fe640 1 -- 172.21.15.37:0/1785656174 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18779 (secure 0 0 0) 0x7ff5fc079cb0 con 0x7ff608072180 2023-12-11T17:11:02.100 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:11:02.100 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:10:32.309274+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:11:02.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.103+0000 7ff60d353640 1 -- 172.21.15.37:0/1785656174 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff5f406ae70 msgr2=0x7ff5f406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:02.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.103+0000 7ff60d353640 1 --2- 172.21.15.37:0/1785656174 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff5f406ae70 0x7ff5f406d330 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8009890 tx=0x7ff5f8008040 comp rx=0 tx=0).stop 2023-12-11T17:11:02.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.103+0000 7ff60d353640 1 -- 172.21.15.37:0/1785656174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff608072180 msgr2=0x7ff60813a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:02.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.103+0000 7ff60d353640 1 --2- 172.21.15.37:0/1785656174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff608072180 0x7ff60813a6f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc009870 tx=0x7ff5fc0046c0 comp rx=0 tx=0).stop 2023-12-11T17:11:02.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.103+0000 7ff60d353640 1 -- 172.21.15.37:0/1785656174 shutdown_connections 2023-12-11T17:11:02.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.103+0000 7ff60d353640 1 --2- 172.21.15.37:0/1785656174 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff5f406ae70 0x7ff5f406d330 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:02.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.103+0000 7ff60d353640 1 --2- 172.21.15.37:0/1785656174 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff608143e00 0x7ff60813c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:02.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.103+0000 7ff60d353640 1 --2- 172.21.15.37:0/1785656174 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff608072180 0x7ff60813a6f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:02.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.103+0000 7ff60d353640 1 --2- 172.21.15.37:0/1785656174 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff60806c410 0x7ff6081384b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:02.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.103+0000 7ff60d353640 1 -- 172.21.15.37:0/1785656174 >> 172.21.15.37:0/1785656174 conn(0x7ff6080b0a90 msgr2=0x7ff608136e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:02.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.103+0000 7ff60d353640 1 -- 172.21.15.37:0/1785656174 shutdown_connections 2023-12-11T17:11:02.104 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.103+0000 7ff60d353640 1 -- 172.21.15.37:0/1785656174 wait complete. 2023-12-11T17:11:02.124 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T17:09:38.415636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T17:09:42.786774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T17:09:43.660585+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-11T17:09:47.272351+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-11T17:11:02.125 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T17:11:02.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.346+0000 7f50f58e7640 1 Processor -- start 2023-12-11T17:11:02.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.346+0000 7f50f58e7640 1 -- start start 2023-12-11T17:11:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.348+0000 7f50f58e7640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f50f00d1970 0x7f50f00b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.348+0000 7f50f58e7640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f00cf130 con 0x7f50f015d620 2023-12-11T17:11:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.348+0000 7f50f58e7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50f00b0220 con 0x7f50f00d1510 2023-12-11T17:11:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.348+0000 7f50f58e7640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50f015da00 con 0x7f50f00d1970 2023-12-11T17:11:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.348+0000 7f50eeffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f50f015d620 0x7f50f00d3a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34246/0 (socket says 172.21.15.37:34246) 2023-12-11T17:11:02.348 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.348+0000 7f50eeffd640 1 -- 172.21.15.37:0/514713199 learned_addr learned my addr 172.21.15.37:0/514713199 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:02.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.349+0000 7f50ef7fe640 1 --2- 172.21.15.37:0/514713199 >> v2:172.21.15.151:3300/0 conn(0x7f50f00d1970 0x7f50f00b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:02.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.349+0000 7f50ee7fc640 1 -- 172.21.15.37:0/514713199 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1376099065 0 0) 0x7f50f00cf130 con 0x7f50f015d620 2023-12-11T17:11:02.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.349+0000 7f50ee7fc640 1 -- 172.21.15.37:0/514713199 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50dc003520 con 0x7f50f015d620 2023-12-11T17:11:02.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.349+0000 7f50ee7fc640 1 -- 172.21.15.37:0/514713199 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1219783772 0 0) 0x7f50dc003520 con 0x7f50f015d620 2023-12-11T17:11:02.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.349+0000 7f50ee7fc640 1 -- 172.21.15.37:0/514713199 >> v2:172.21.15.151:3300/0 conn(0x7f50f00d1970 msgr2=0x7f50f00b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:02.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.349+0000 7f50ee7fc640 1 --2- 172.21.15.37:0/514713199 >> v2:172.21.15.151:3300/0 conn(0x7f50f00d1970 0x7f50f00b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:02.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.349+0000 7f50ee7fc640 1 -- 172.21.15.37:0/514713199 >> v1:172.21.15.151:6789/0 conn(0x7f50f00d1510 legacy=0x7f50f00b06b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:02.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.349+0000 7f50ee7fc640 1 -- 172.21.15.37:0/514713199 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f00ceb70 con 0x7f50f015d620 2023-12-11T17:11:02.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.349+0000 7f50ee7fc640 1 -- 172.21.15.37:0/514713199 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f50e0001670 con 0x7f50f015d620 2023-12-11T17:11:02.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.349+0000 7f50ee7fc640 1 -- 172.21.15.37:0/514713199 >> v1:172.21.15.37:6789/0 conn(0x7f50f015d620 legacy=0x7f50f00d3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:02.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.349+0000 7f50ee7fc640 1 --2- 172.21.15.37:0/514713199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc003970 0x7f50dc003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:02.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.349+0000 7f50ee7fc640 1 --2- 172.21.15.37:0/514713199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50dc0047c0 0x7f50dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:02.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.349+0000 7f50ee7fc640 1 --2- 172.21.15.37:0/514713199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50dc005180 0x7f50dc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:02.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.349+0000 7f50ee7fc640 1 -- 172.21.15.37:0/514713199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f015da00 con 0x7f50dc005180 2023-12-11T17:11:02.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.349+0000 7f50ee7fc640 1 -- 172.21.15.37:0/514713199 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc00c000 con 0x7f50dc003970 2023-12-11T17:11:02.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.349+0000 7f50ee7fc640 1 -- 172.21.15.37:0/514713199 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50dc00c1c0 con 0x7f50dc0047c0 2023-12-11T17:11:02.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.350+0000 7f50ef7fe640 1 --2- 172.21.15.37:0/514713199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50dc005180 0x7f50dc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:02.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.350+0000 7f50eeffd640 1 --2- 172.21.15.37:0/514713199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc003970 0x7f50dc003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:02.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.350+0000 7f50e67fc640 1 --2- 172.21.15.37:0/514713199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50dc0047c0 0x7f50dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:02.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.350+0000 7f50ef7fe640 1 -- 172.21.15.37:0/514713199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50dc0047c0 msgr2=0x7f50dc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:02.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.350+0000 7f50ef7fe640 1 --2- 172.21.15.37:0/514713199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50dc0047c0 0x7f50dc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:02.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.350+0000 7f50ef7fe640 1 -- 172.21.15.37:0/514713199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc003970 msgr2=0x7f50dc003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:02.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.350+0000 7f50ef7fe640 1 --2- 172.21.15.37:0/514713199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc003970 0x7f50dc003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:02.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.350+0000 7f50ef7fe640 1 -- 172.21.15.37:0/514713199 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50dc003520 con 0x7f50dc005180 2023-12-11T17:11:02.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.350+0000 7f50eeffd640 1 --2- 172.21.15.37:0/514713199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc003970 0x7f50dc003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:02.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.350+0000 7f50e67fc640 1 --2- 172.21.15.37:0/514713199 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50dc0047c0 0x7f50dc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:02.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.351+0000 7f50ef7fe640 1 -- 172.21.15.37:0/514713199 reap_dead start 2023-12-11T17:11:02.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.351+0000 7f50ef7fe640 1 --2- 172.21.15.37:0/514713199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50dc005180 0x7f50dc00b980 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009ac0 tx=0x7f50dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed37a7850cd340e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:02.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.351+0000 7f50ee7fc640 1 -- 172.21.15.37:0/514713199 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e8004020 con 0x7f50dc005180 2023-12-11T17:11:02.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.352+0000 7f50ee7fc640 1 -- 172.21.15.37:0/514713199 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e8004180 con 0x7f50dc005180 2023-12-11T17:11:02.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.352+0000 7f50ee7fc640 1 -- 172.21.15.37:0/514713199 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e802c710 con 0x7f50dc005180 2023-12-11T17:11:02.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.352+0000 7f50f58e7640 1 -- 172.21.15.37:0/514713199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50dc005180 msgr2=0x7f50dc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:02.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.352+0000 7f50f58e7640 1 --2- 172.21.15.37:0/514713199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50dc005180 0x7f50dc00b980 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009ac0 tx=0x7f50dc0057f0 comp rx=0 tx=0).stop 2023-12-11T17:11:02.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.352+0000 7f50f58e7640 1 -- 172.21.15.37:0/514713199 shutdown_connections 2023-12-11T17:11:02.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.352+0000 7f50f58e7640 1 --2- 172.21.15.37:0/514713199 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50dc005180 0x7f50dc00b980 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:02.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.352+0000 7f50f58e7640 1 -- 172.21.15.37:0/514713199 >> 172.21.15.37:0/514713199 conn(0x7f50f009c420 msgr2=0x7f50f00d30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:02.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.352+0000 7f50f58e7640 1 -- 172.21.15.37:0/514713199 shutdown_connections 2023-12-11T17:11:02.357 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.352+0000 7f50f58e7640 1 -- 172.21.15.37:0/514713199 wait complete. 2023-12-11T17:11:02.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.354+0000 7f50f58e7640 1 Processor -- start 2023-12-11T17:11:02.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.354+0000 7f50f58e7640 1 -- start start 2023-12-11T17:11:02.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.355+0000 7f50f58e7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc005180 0x7f50f01f5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:02.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.355+0000 7f50f58e7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50f01509b0 0x7f50f015e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:02.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.355+0000 7f50f58e7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f015ead0 0x7f50f015ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:02.361 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.355+0000 7f50f58e7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f00c7030 con 0x7f50f015ead0 2023-12-11T17:11:02.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.355+0000 7f50f58e7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50f015f640 con 0x7f50dc005180 2023-12-11T17:11:02.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.355+0000 7f50f58e7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50f015f920 con 0x7f50f01509b0 2023-12-11T17:11:02.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.356+0000 7f50e67fc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50f01509b0 0x7f50f015e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:02.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.356+0000 7f50ef7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f015ead0 0x7f50f015ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:02.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.356+0000 7f50eeffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc005180 0x7f50f01f5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:02.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.356+0000 7f50e67fc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50f01509b0 0x7f50f015e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.37:48854/0 (socket says 172.21.15.37:48854) 2023-12-11T17:11:02.362 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.356+0000 7f50e67fc640 1 -- 172.21.15.37:0/3748565993 learned_addr learned my addr 172.21.15.37:0/3748565993 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:02.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.356+0000 7f50ef7fe640 1 -- 172.21.15.37:0/3748565993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50f01509b0 msgr2=0x7f50f015e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:02.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.356+0000 7f50ef7fe640 1 --2- 172.21.15.37:0/3748565993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50f01509b0 0x7f50f015e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:02.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.356+0000 7f50ef7fe640 1 -- 172.21.15.37:0/3748565993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc005180 msgr2=0x7f50f01f5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:02.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.356+0000 7f50ef7fe640 1 --2- 172.21.15.37:0/3748565993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc005180 0x7f50f01f5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:02.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.356+0000 7f50ef7fe640 1 -- 172.21.15.37:0/3748565993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50f015fc00 con 0x7f50f015ead0 2023-12-11T17:11:02.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.357+0000 7f50ef7fe640 1 --2- 172.21.15.37:0/3748565993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f015ead0 0x7f50f015ef80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f50f008b9c0 tx=0x7f50e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:02.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.357+0000 7f50ecff9640 1 -- 172.21.15.37:0/3748565993 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e803a070 con 0x7f50f015ead0 2023-12-11T17:11:02.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.357+0000 7f50ecff9640 1 -- 172.21.15.37:0/3748565993 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e80042f0 con 0x7f50f015ead0 2023-12-11T17:11:02.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.357+0000 7f50f58e7640 1 -- 172.21.15.37:0/3748565993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50f015fee0 con 0x7f50f015ead0 2023-12-11T17:11:02.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.357+0000 7f50ecff9640 1 -- 172.21.15.37:0/3748565993 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e8003610 con 0x7f50f015ead0 2023-12-11T17:11:02.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.357+0000 7f50f58e7640 1 -- 172.21.15.37:0/3748565993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50f00c74c0 con 0x7f50f015ead0 2023-12-11T17:11:02.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.358+0000 7f50f58e7640 1 -- 172.21.15.37:0/3748565993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50f00c71a0 con 0x7f50f015ead0 2023-12-11T17:11:02.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.359+0000 7f50ecff9640 1 -- 172.21.15.37:0/3748565993 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f50e8003790 con 0x7f50f015ead0 2023-12-11T17:11:02.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.361+0000 7f50ecff9640 1 --2- 172.21.15.37:0/3748565993 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f50d006ae40 0x7f50d006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:02.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.361+0000 7f50ecff9640 1 -- 172.21.15.37:0/3748565993 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f50e80aa740 con 0x7f50f015ead0 2023-12-11T17:11:02.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.361+0000 7f50eeffd640 1 --2- 172.21.15.37:0/3748565993 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f50d006ae40 0x7f50d006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:02.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.362+0000 7f50eeffd640 1 --2- 172.21.15.37:0/3748565993 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f50d006ae40 0x7f50d006d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f50e00017a0 tx=0x7f50e0009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:02.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.365+0000 7f50ecff9640 1 -- 172.21.15.37:0/3748565993 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f50e8075420 con 0x7f50f015ead0 2023-12-11T17:11:02.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.559+0000 7f50f58e7640 1 -- 172.21.15.37:0/3748565993 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f50f0074450 con 0x7f50f015ead0 2023-12-11T17:11:02.560 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.560+0000 7f50ecff9640 1 -- 172.21.15.37:0/3748565993 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f50e8078a40 con 0x7f50f015ead0 2023-12-11T17:11:02.560 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-11T17:11:02.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.563+0000 7f50f58e7640 1 -- 172.21.15.37:0/3748565993 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f50d006ae40 msgr2=0x7f50d006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:02.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.563+0000 7f50f58e7640 1 --2- 172.21.15.37:0/3748565993 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f50d006ae40 0x7f50d006d300 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f50e00017a0 tx=0x7f50e0009040 comp rx=0 tx=0).stop 2023-12-11T17:11:02.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.563+0000 7f50f58e7640 1 -- 172.21.15.37:0/3748565993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f015ead0 msgr2=0x7f50f015ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:02.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.563+0000 7f50f58e7640 1 --2- 172.21.15.37:0/3748565993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f015ead0 0x7f50f015ef80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f50f008b9c0 tx=0x7f50e8004730 comp rx=0 tx=0).stop 2023-12-11T17:11:02.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.563+0000 7f50f58e7640 1 -- 172.21.15.37:0/3748565993 shutdown_connections 2023-12-11T17:11:02.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.563+0000 7f50f58e7640 1 --2- 172.21.15.37:0/3748565993 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f50d006ae40 0x7f50d006d300 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:02.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.563+0000 7f50f58e7640 1 --2- 172.21.15.37:0/3748565993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50f015ead0 0x7f50f015ef80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:02.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.563+0000 7f50f58e7640 1 --2- 172.21.15.37:0/3748565993 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f50f01509b0 0x7f50f015e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:02.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.563+0000 7f50f58e7640 1 --2- 172.21.15.37:0/3748565993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50dc005180 0x7f50f01f5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:02.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.563+0000 7f50f58e7640 1 -- 172.21.15.37:0/3748565993 >> 172.21.15.37:0/3748565993 conn(0x7f50f009c420 msgr2=0x7f50f015b3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:02.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.563+0000 7f50f58e7640 1 -- 172.21.15.37:0/3748565993 shutdown_connections 2023-12-11T17:11:02.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.563+0000 7f50f58e7640 1 -- 172.21.15.37:0/3748565993 wait complete. 2023-12-11T17:11:02.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T17:11:02.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.815+0000 7fe477f1d640 1 Processor -- start 2023-12-11T17:11:02.815 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.815+0000 7fe477f1d640 1 -- start start 2023-12-11T17:11:02.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.817+0000 7fe477f1d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fe47006d770 0x7fe4700b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:02.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.817+0000 7fe477f1d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe47006db50 0x7fe470141250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:02.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.817+0000 7fe477f1d640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe47015b780 con 0x7fe470141790 2023-12-11T17:11:02.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.817+0000 7fe477f1d640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe470141c20 con 0x7fe47006db50 2023-12-11T17:11:02.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.817+0000 7fe477f1d640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe47015b9d0 con 0x7fe47006d770 2023-12-11T17:11:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.817+0000 7fe4764ba640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe470141790 0x7fe47015ed70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34258/0 (socket says 172.21.15.37:34258) 2023-12-11T17:11:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.817+0000 7fe4764ba640 1 -- 172.21.15.37:0/2537796993 learned_addr learned my addr 172.21.15.37:0/2537796993 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.817+0000 7fe4754b8640 1 --2- 172.21.15.37:0/2537796993 >> v2:172.21.15.37:3300/0 conn(0x7fe47006db50 0x7fe470141250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.817+0000 7fe475cb9640 1 --2- 172.21.15.37:0/2537796993 >> v2:172.21.15.151:3300/0 conn(0x7fe47006d770 0x7fe4700b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.818+0000 7fe4754b8640 1 -- 172.21.15.37:0/2537796993 >> v2:172.21.15.151:3300/0 conn(0x7fe47006d770 msgr2=0x7fe4700b1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.818+0000 7fe4754b8640 1 --2- 172.21.15.37:0/2537796993 >> v2:172.21.15.151:3300/0 conn(0x7fe47006d770 0x7fe4700b1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.818+0000 7fe4754b8640 1 -- 172.21.15.37:0/2537796993 >> v1:172.21.15.37:6789/0 conn(0x7fe470141790 legacy=0x7fe47015ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:02.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.818+0000 7fe4754b8640 1 -- 172.21.15.37:0/2537796993 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe47015bcb0 con 0x7fe47006db50 2023-12-11T17:11:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.819+0000 7fe4754b8640 1 --2- 172.21.15.37:0/2537796993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe47006db50 0x7fe470141250 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe4700b1aa0 tx=0x7fe46002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72f462e8c9439083 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.819+0000 7fe474cb7640 1 -- 172.21.15.37:0/2537796993 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe460031830 con 0x7fe47006db50 2023-12-11T17:11:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.819+0000 7fe474cb7640 1 -- 172.21.15.37:0/2537796993 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe460031990 con 0x7fe47006db50 2023-12-11T17:11:02.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.819+0000 7fe474cb7640 1 -- 172.21.15.37:0/2537796993 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe460031d20 con 0x7fe47006db50 2023-12-11T17:11:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.820+0000 7fe477f1d640 1 -- 172.21.15.37:0/2537796993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe47006db50 msgr2=0x7fe470141250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.820+0000 7fe477f1d640 1 --2- 172.21.15.37:0/2537796993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe47006db50 0x7fe470141250 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fe4700b1aa0 tx=0x7fe46002b8d0 comp rx=0 tx=0).stop 2023-12-11T17:11:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.820+0000 7fe477f1d640 1 -- 172.21.15.37:0/2537796993 shutdown_connections 2023-12-11T17:11:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.820+0000 7fe477f1d640 1 --2- 172.21.15.37:0/2537796993 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe47006db50 0x7fe470141250 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.820+0000 7fe477f1d640 1 --2- 172.21.15.37:0/2537796993 >> v2:172.21.15.151:3300/0 conn(0x7fe47006d770 0x7fe4700b1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:02.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.820+0000 7fe477f1d640 1 -- 172.21.15.37:0/2537796993 >> 172.21.15.37:0/2537796993 conn(0x7fe4700cb850 msgr2=0x7fe4700cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.820+0000 7fe477f1d640 1 -- 172.21.15.37:0/2537796993 shutdown_connections 2023-12-11T17:11:02.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.820+0000 7fe477f1d640 1 -- 172.21.15.37:0/2537796993 wait complete. 2023-12-11T17:11:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.822+0000 7fe477f1d640 1 Processor -- start 2023-12-11T17:11:02.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.823+0000 7fe477f1d640 1 -- start start 2023-12-11T17:11:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.824+0000 7fe477f1d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe47006d770 0x7fe4701425a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.824+0000 7fe477f1d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe47006db50 0x7fe470132f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.824+0000 7fe477f1d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe470141790 0x7fe470133440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.824+0000 7fe477f1d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4701f6780 con 0x7fe47006db50 2023-12-11T17:11:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.824+0000 7fe477f1d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4701f6a60 con 0x7fe470141790 2023-12-11T17:11:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.824+0000 7fe477f1d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4701f6d40 con 0x7fe47006d770 2023-12-11T17:11:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.824+0000 7fe4754b8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe47006db50 0x7fe470132f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.824+0000 7fe4754b8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe47006db50 0x7fe470132f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47054/0 (socket says 172.21.15.37:47054) 2023-12-11T17:11:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.824+0000 7fe4754b8640 1 -- 172.21.15.37:0/2886539052 learned_addr learned my addr 172.21.15.37:0/2886539052 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.824+0000 7fe4764ba640 1 --2- 172.21.15.37:0/2886539052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe470141790 0x7fe470133440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.825+0000 7fe4754b8640 1 -- 172.21.15.37:0/2886539052 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe47006d770 msgr2=0x7fe4701425a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.825+0000 7fe4754b8640 1 --2- 172.21.15.37:0/2886539052 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe47006d770 0x7fe4701425a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:02.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.825+0000 7fe4754b8640 1 -- 172.21.15.37:0/2886539052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe470141790 msgr2=0x7fe470133440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:02.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.825+0000 7fe4754b8640 1 --2- 172.21.15.37:0/2886539052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe470141790 0x7fe470133440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:02.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.825+0000 7fe4754b8640 1 -- 172.21.15.37:0/2886539052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe460009400 con 0x7fe47006db50 2023-12-11T17:11:02.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.825+0000 7fe4754b8640 1 --2- 172.21.15.37:0/2886539052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe47006db50 0x7fe470132f00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe460009890 tx=0x7fe4600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:02.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.825+0000 7fe4667fc640 1 -- 172.21.15.37:0/2886539052 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe46003ba70 con 0x7fe47006db50 2023-12-11T17:11:02.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.826+0000 7fe4667fc640 1 -- 172.21.15.37:0/2886539052 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe46003bbf0 con 0x7fe47006db50 2023-12-11T17:11:02.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.826+0000 7fe4667fc640 1 -- 172.21.15.37:0/2886539052 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe460045400 con 0x7fe47006db50 2023-12-11T17:11:02.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.826+0000 7fe477f1d640 1 -- 172.21.15.37:0/2886539052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4701f7020 con 0x7fe47006db50 2023-12-11T17:11:02.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.826+0000 7fe477f1d640 1 -- 172.21.15.37:0/2886539052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe470142ae0 con 0x7fe47006db50 2023-12-11T17:11:02.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.827+0000 7fe477f1d640 1 -- 172.21.15.37:0/2886539052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4700745d0 con 0x7fe47006db50 2023-12-11T17:11:02.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.828+0000 7fe4667fc640 1 -- 172.21.15.37:0/2886539052 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe46004e440 con 0x7fe47006db50 2023-12-11T17:11:02.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.829+0000 7fe4667fc640 1 --2- 172.21.15.37:0/2886539052 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe45406ae40 0x7fe45406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:02.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.830+0000 7fe4667fc640 1 -- 172.21.15.37:0/2886539052 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fe4600abd40 con 0x7fe47006db50 2023-12-11T17:11:02.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.831+0000 7fe475cb9640 1 --2- 172.21.15.37:0/2886539052 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe45406ae40 0x7fe45406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:02.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.833+0000 7fe475cb9640 1 --2- 172.21.15.37:0/2886539052 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe45406ae40 0x7fe45406d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0098f0 tx=0x7fe46c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:02.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:02.834+0000 7fe4667fc640 1 -- 172.21.15.37:0/2886539052 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe460076970 con 0x7fe47006db50 2023-12-11T17:11:03.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.030+0000 7fe477f1d640 1 -- 172.21.15.37:0/2886539052 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe4701f7540 con 0x7fe47006db50 2023-12-11T17:11:03.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.031+0000 7fe4667fc640 1 -- 172.21.15.37:0/2886539052 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe460035020 con 0x7fe47006db50 2023-12-11T17:11:03.031 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:11:03.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.034+0000 7fe477f1d640 1 -- 172.21.15.37:0/2886539052 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe45406ae40 msgr2=0x7fe45406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:03.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.034+0000 7fe477f1d640 1 --2- 172.21.15.37:0/2886539052 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe45406ae40 0x7fe45406d300 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe46c0098f0 tx=0x7fe46c008040 comp rx=0 tx=0).stop 2023-12-11T17:11:03.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.034+0000 7fe477f1d640 1 -- 172.21.15.37:0/2886539052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe47006db50 msgr2=0x7fe470132f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:03.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.034+0000 7fe477f1d640 1 --2- 172.21.15.37:0/2886539052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe47006db50 0x7fe470132f00 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fe460009890 tx=0x7fe4600046c0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.034+0000 7fe477f1d640 1 -- 172.21.15.37:0/2886539052 shutdown_connections 2023-12-11T17:11:03.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.034+0000 7fe477f1d640 1 --2- 172.21.15.37:0/2886539052 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe45406ae40 0x7fe45406d300 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.034+0000 7fe477f1d640 1 --2- 172.21.15.37:0/2886539052 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe470141790 0x7fe470133440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.034+0000 7fe477f1d640 1 --2- 172.21.15.37:0/2886539052 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe47006db50 0x7fe470132f00 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.034+0000 7fe477f1d640 1 --2- 172.21.15.37:0/2886539052 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe47006d770 0x7fe4701425a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.034+0000 7fe477f1d640 1 -- 172.21.15.37:0/2886539052 >> 172.21.15.37:0/2886539052 conn(0x7fe4700cb850 msgr2=0x7fe4700ac860 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:03.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.034+0000 7fe477f1d640 1 -- 172.21.15.37:0/2886539052 shutdown_connections 2023-12-11T17:11:03.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.034+0000 7fe477f1d640 1 -- 172.21.15.37:0/2886539052 wait complete. 2023-12-11T17:11:03.052 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T17:11:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.284+0000 7f3b6a728640 1 Processor -- start 2023-12-11T17:11:03.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.284+0000 7f3b6a728640 1 -- start start 2023-12-11T17:11:03.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.286+0000 7f3b6a728640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b6415ab30 0x7f3b64071d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:03.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.286+0000 7f3b6a728640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b640701f0 con 0x7f3b640b3c00 2023-12-11T17:11:03.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.286+0000 7f3b6a728640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b640704d0 con 0x7f3b640cf500 2023-12-11T17:11:03.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.286+0000 7f3b6a728640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b640b37b0 con 0x7f3b6415ab30 2023-12-11T17:11:03.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.287+0000 7f3b69726640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3b6415ab30 0x7f3b64071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:03.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.287+0000 7f3b68f25640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3b640b3c00 0x7f3b640cedf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34272/0 (socket says 172.21.15.37:34272) 2023-12-11T17:11:03.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.287+0000 7f3b68f25640 1 -- 172.21.15.37:0/3969604268 learned_addr learned my addr 172.21.15.37:0/3969604268 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:03.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.287+0000 7f3b69726640 1 -- 172.21.15.37:0/3969604268 >> v1:172.21.15.151:6789/0 conn(0x7f3b640cf500 legacy=0x7f3b640b1b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:03.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.287+0000 7f3b69726640 1 -- 172.21.15.37:0/3969604268 >> v1:172.21.15.37:6789/0 conn(0x7f3b640b3c00 legacy=0x7f3b640cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:03.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.287+0000 7f3b69726640 1 -- 172.21.15.37:0/3969604268 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6415af10 con 0x7f3b6415ab30 2023-12-11T17:11:03.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.287+0000 7f3b5bfff640 1 -- 172.21.15.37:0/3969604268 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3763254278 0 0) 0x7f3b640701f0 con 0x7f3b640b3c00 2023-12-11T17:11:03.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.289+0000 7f3b69726640 1 --2- 172.21.15.37:0/3969604268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b6415ab30 0x7f3b64071d30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3b600097a0 tx=0x7f3b6002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da039e4cdf2b44d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:03.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.289+0000 7f3b5bfff640 1 -- 172.21.15.37:0/3969604268 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b60031830 con 0x7f3b6415ab30 2023-12-11T17:11:03.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.289+0000 7f3b5bfff640 1 -- 172.21.15.37:0/3969604268 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b60031990 con 0x7f3b6415ab30 2023-12-11T17:11:03.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.289+0000 7f3b5bfff640 1 -- 172.21.15.37:0/3969604268 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b60031d20 con 0x7f3b6415ab30 2023-12-11T17:11:03.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.290+0000 7f3b6a728640 1 -- 172.21.15.37:0/3969604268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b6415ab30 msgr2=0x7f3b64071d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:03.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.290+0000 7f3b6a728640 1 --2- 172.21.15.37:0/3969604268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b6415ab30 0x7f3b64071d30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f3b600097a0 tx=0x7f3b6002b8d0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.290+0000 7f3b6a728640 1 -- 172.21.15.37:0/3969604268 shutdown_connections 2023-12-11T17:11:03.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.290+0000 7f3b6a728640 1 --2- 172.21.15.37:0/3969604268 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b6415ab30 0x7f3b64071d30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.290+0000 7f3b6a728640 1 -- 172.21.15.37:0/3969604268 >> 172.21.15.37:0/3969604268 conn(0x7f3b6406a640 msgr2=0x7f3b6406aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:03.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.290+0000 7f3b6a728640 1 -- 172.21.15.37:0/3969604268 shutdown_connections 2023-12-11T17:11:03.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.290+0000 7f3b6a728640 1 -- 172.21.15.37:0/3969604268 wait complete. 2023-12-11T17:11:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.292+0000 7f3b6a728640 1 Processor -- start 2023-12-11T17:11:03.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.292+0000 7f3b6a728640 1 -- start start 2023-12-11T17:11:03.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.293+0000 7f3b6a728640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b640b3c00 0x7f3b64152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:03.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.293+0000 7f3b6a728640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b640cf500 0x7f3b64154ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.293+0000 7f3b6a728640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b6415ab30 0x7f3b641551e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.293+0000 7f3b6a728640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b641533b0 con 0x7f3b640b3c00 2023-12-11T17:11:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.293+0000 7f3b6a728640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b64154670 con 0x7f3b6415ab30 2023-12-11T17:11:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.293+0000 7f3b6a728640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b640ad220 con 0x7f3b640cf500 2023-12-11T17:11:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.293+0000 7f3b69726640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b640b3c00 0x7f3b64152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.293+0000 7f3b69726640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b640b3c00 0x7f3b64152e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47066/0 (socket says 172.21.15.37:47066) 2023-12-11T17:11:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.293+0000 7f3b69726640 1 -- 172.21.15.37:0/4204000789 learned_addr learned my addr 172.21.15.37:0/4204000789 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.293+0000 7f3b69f27640 1 --2- 172.21.15.37:0/4204000789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b6415ab30 0x7f3b641551e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.293+0000 7f3b68f25640 1 --2- 172.21.15.37:0/4204000789 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b640cf500 0x7f3b64154ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.294+0000 7f3b69726640 1 -- 172.21.15.37:0/4204000789 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b640cf500 msgr2=0x7f3b64154ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.294+0000 7f3b69726640 1 --2- 172.21.15.37:0/4204000789 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b640cf500 0x7f3b64154ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.294+0000 7f3b69726640 1 -- 172.21.15.37:0/4204000789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b6415ab30 msgr2=0x7f3b641551e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:03.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.294+0000 7f3b69726640 1 --2- 172.21.15.37:0/4204000789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b6415ab30 0x7f3b641551e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.294+0000 7f3b69726640 1 -- 172.21.15.37:0/4204000789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b60009400 con 0x7f3b640b3c00 2023-12-11T17:11:03.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.294+0000 7f3b69726640 1 --2- 172.21.15.37:0/4204000789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b640b3c00 0x7f3b64152e70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3b600098c0 tx=0x7f3b600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:03.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.294+0000 7f3b59ffb640 1 -- 172.21.15.37:0/4204000789 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6003ba70 con 0x7f3b640b3c00 2023-12-11T17:11:03.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.294+0000 7f3b59ffb640 1 -- 172.21.15.37:0/4204000789 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6003bbf0 con 0x7f3b640b3c00 2023-12-11T17:11:03.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.294+0000 7f3b6a728640 1 -- 172.21.15.37:0/4204000789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b640ad500 con 0x7f3b640b3c00 2023-12-11T17:11:03.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.294+0000 7f3b59ffb640 1 -- 172.21.15.37:0/4204000789 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b600453f0 con 0x7f3b640b3c00 2023-12-11T17:11:03.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.295+0000 7f3b6a728640 1 -- 172.21.15.37:0/4204000789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b640add00 con 0x7f3b640b3c00 2023-12-11T17:11:03.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.296+0000 7f3b6a728640 1 -- 172.21.15.37:0/4204000789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b640ada20 con 0x7f3b640b3c00 2023-12-11T17:11:03.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.297+0000 7f3b59ffb640 1 -- 172.21.15.37:0/4204000789 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3b6004e450 con 0x7f3b640b3c00 2023-12-11T17:11:03.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.298+0000 7f3b59ffb640 1 --2- 172.21.15.37:0/4204000789 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3b4806ae40 0x7f3b4806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:03.298 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.298+0000 7f3b59ffb640 1 -- 172.21.15.37:0/4204000789 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3b600abc00 con 0x7f3b640b3c00 2023-12-11T17:11:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.298+0000 7f3b68f25640 1 --2- 172.21.15.37:0/4204000789 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3b4806ae40 0x7f3b4806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:03.299 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.299+0000 7f3b68f25640 1 --2- 172.21.15.37:0/4204000789 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3b4806ae40 0x7f3b4806d300 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3b640ae300 tx=0x7f3b54009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:03.303 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.303+0000 7f3b59ffb640 1 -- 172.21.15.37:0/4204000789 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3b640ada20 con 0x7f3b640b3c00 2023-12-11T17:11:03.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.502+0000 7f3b6a728640 1 -- 172.21.15.37:0/4204000789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3b640ada20 con 0x7f3b640b3c00 2023-12-11T17:11:03.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.504+0000 7f3b59ffb640 1 -- 172.21.15.37:0/4204000789 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3b640ada20 con 0x7f3b640b3c00 2023-12-11T17:11:03.504 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-11T17:11:03.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.506+0000 7f3b6a728640 1 -- 172.21.15.37:0/4204000789 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3b4806ae40 msgr2=0x7f3b4806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:03.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.506+0000 7f3b6a728640 1 --2- 172.21.15.37:0/4204000789 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3b4806ae40 0x7f3b4806d300 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f3b640ae300 tx=0x7f3b54009040 comp rx=0 tx=0).stop 2023-12-11T17:11:03.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.506+0000 7f3b6a728640 1 -- 172.21.15.37:0/4204000789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b640b3c00 msgr2=0x7f3b64152e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:03.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.506+0000 7f3b6a728640 1 --2- 172.21.15.37:0/4204000789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b640b3c00 0x7f3b64152e70 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f3b600098c0 tx=0x7f3b600046c0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.506+0000 7f3b6a728640 1 -- 172.21.15.37:0/4204000789 shutdown_connections 2023-12-11T17:11:03.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.506+0000 7f3b6a728640 1 --2- 172.21.15.37:0/4204000789 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3b4806ae40 0x7f3b4806d300 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.506+0000 7f3b6a728640 1 --2- 172.21.15.37:0/4204000789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3b6415ab30 0x7f3b641551e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.506+0000 7f3b6a728640 1 --2- 172.21.15.37:0/4204000789 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3b640cf500 0x7f3b64154ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.506+0000 7f3b6a728640 1 --2- 172.21.15.37:0/4204000789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3b640b3c00 0x7f3b64152e70 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.506+0000 7f3b6a728640 1 -- 172.21.15.37:0/4204000789 >> 172.21.15.37:0/4204000789 conn(0x7f3b6406a640 msgr2=0x7f3b640b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:03.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.506+0000 7f3b6a728640 1 -- 172.21.15.37:0/4204000789 shutdown_connections 2023-12-11T17:11:03.507 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.507+0000 7f3b6a728640 1 -- 172.21.15.37:0/4204000789 wait complete. 2023-12-11T17:11:03.527 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-11T17:11:03.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.755+0000 7f5f6b59e640 1 Processor -- start 2023-12-11T17:11:03.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.755+0000 7f5f6b59e640 1 -- start start 2023-12-11T17:11:03.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.757+0000 7f5f6b59e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5f6c0cdc00 0x7f5f6c0cfac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:03.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.757+0000 7f5f6b59e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f6c0d00e0 con 0x7f5f6c06c320 2023-12-11T17:11:03.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.757+0000 7f5f6b59e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f6c0d03c0 con 0x7f5f6c06b780 2023-12-11T17:11:03.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.757+0000 7f5f6b59e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f6c0cb3d0 con 0x7f5f6c0cdc00 2023-12-11T17:11:03.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.757+0000 7f5f6ad9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5f6c06c320 0x7f5f6c15c950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34284/0 (socket says 172.21.15.37:34284) 2023-12-11T17:11:03.759 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.757+0000 7f5f6ad9d640 1 -- 172.21.15.37:0/3218512673 learned_addr learned my addr 172.21.15.37:0/3218512673 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:03.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.757+0000 7f5f6a59c640 1 --2- 172.21.15.37:0/3218512673 >> v2:172.21.15.151:3300/0 conn(0x7f5f6c0cdc00 0x7f5f6c0cfac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:03.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.757+0000 7f5f6959a640 1 -- 172.21.15.37:0/3218512673 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1154116420 0 0) 0x7f5f6c0d00e0 con 0x7f5f6c06c320 2023-12-11T17:11:03.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.758+0000 7f5f6959a640 1 -- 172.21.15.37:0/3218512673 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f58003520 con 0x7f5f6c06c320 2023-12-11T17:11:03.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.758+0000 7f5f6959a640 1 -- 172.21.15.37:0/3218512673 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2202423604 0 0) 0x7f5f58003520 con 0x7f5f6c06c320 2023-12-11T17:11:03.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.758+0000 7f5f6959a640 1 -- 172.21.15.37:0/3218512673 >> v2:172.21.15.151:3300/0 conn(0x7f5f6c0cdc00 msgr2=0x7f5f6c0cfac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:03.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.758+0000 7f5f6959a640 1 --2- 172.21.15.37:0/3218512673 >> v2:172.21.15.151:3300/0 conn(0x7f5f6c0cdc00 0x7f5f6c0cfac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.758+0000 7f5f6959a640 1 -- 172.21.15.37:0/3218512673 >> v1:172.21.15.151:6789/0 conn(0x7f5f6c06b780 legacy=0x7f5f6c06bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:03.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.758+0000 7f5f6959a640 1 -- 172.21.15.37:0/3218512673 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c0cb6b0 con 0x7f5f6c06c320 2023-12-11T17:11:03.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.758+0000 7f5f6959a640 1 -- 172.21.15.37:0/3218512673 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f5f64001670 con 0x7f5f6c06c320 2023-12-11T17:11:03.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.758+0000 7f5f6959a640 1 -- 172.21.15.37:0/3218512673 >> v1:172.21.15.37:6789/0 conn(0x7f5f6c06c320 legacy=0x7f5f6c15c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:03.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.758+0000 7f5f6959a640 1 --2- 172.21.15.37:0/3218512673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f580039c0 0x7f5f58003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:03.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.758+0000 7f5f6959a640 1 --2- 172.21.15.37:0/3218512673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f580047c0 0x7f5f58004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:03.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.758+0000 7f5f6959a640 1 --2- 172.21.15.37:0/3218512673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f580051d0 0x7f5f5800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:03.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.758+0000 7f5f6959a640 1 -- 172.21.15.37:0/3218512673 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c0cb3d0 con 0x7f5f580047c0 2023-12-11T17:11:03.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.758+0000 7f5f6959a640 1 -- 172.21.15.37:0/3218512673 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5800c100 con 0x7f5f580051d0 2023-12-11T17:11:03.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.758+0000 7f5f6959a640 1 -- 172.21.15.37:0/3218512673 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f5800c2c0 con 0x7f5f580039c0 2023-12-11T17:11:03.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.758+0000 7f5f69d9b640 1 --2- 172.21.15.37:0/3218512673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f580047c0 0x7f5f58004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:03.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.759+0000 7f5f6a59c640 1 --2- 172.21.15.37:0/3218512673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f580039c0 0x7f5f58003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:03.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.759+0000 7f5f6ad9d640 1 --2- 172.21.15.37:0/3218512673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f580051d0 0x7f5f5800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.759+0000 7f5f69d9b640 1 -- 172.21.15.37:0/3218512673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f580039c0 msgr2=0x7f5f58003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.759+0000 7f5f69d9b640 1 --2- 172.21.15.37:0/3218512673 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f580039c0 0x7f5f58003dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.759+0000 7f5f69d9b640 1 -- 172.21.15.37:0/3218512673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f580051d0 msgr2=0x7f5f5800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.759+0000 7f5f69d9b640 1 --2- 172.21.15.37:0/3218512673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f580051d0 0x7f5f5800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.759+0000 7f5f69d9b640 1 -- 172.21.15.37:0/3218512673 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f58003520 con 0x7f5f580047c0 2023-12-11T17:11:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.759+0000 7f5f6ad9d640 1 --2- 172.21.15.37:0/3218512673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f580051d0 0x7f5f5800b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.759+0000 7f5f6ad9d640 1 -- 172.21.15.37:0/3218512673 reap_dead start 2023-12-11T17:11:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.760+0000 7f5f69d9b640 1 --2- 172.21.15.37:0/3218512673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f580047c0 0x7f5f58004c40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5f54003d80 tx=0x7f5f580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd5b1b5dfb5a664e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:03.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.760+0000 7f5f6959a640 1 -- 172.21.15.37:0/3218512673 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f54032600 con 0x7f5f580047c0 2023-12-11T17:11:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.760+0000 7f5f6959a640 1 -- 172.21.15.37:0/3218512673 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5402e050 con 0x7f5f580047c0 2023-12-11T17:11:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.760+0000 7f5f6959a640 1 -- 172.21.15.37:0/3218512673 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f540329e0 con 0x7f5f580047c0 2023-12-11T17:11:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.761+0000 7f5f6b59e640 1 -- 172.21.15.37:0/3218512673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f580047c0 msgr2=0x7f5f58004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.761+0000 7f5f6b59e640 1 --2- 172.21.15.37:0/3218512673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f580047c0 0x7f5f58004c40 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5f54003d80 tx=0x7f5f580057f0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.761+0000 7f5f6b59e640 1 -- 172.21.15.37:0/3218512673 shutdown_connections 2023-12-11T17:11:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.761+0000 7f5f6b59e640 1 --2- 172.21.15.37:0/3218512673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f580047c0 0x7f5f58004c40 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.761+0000 7f5f6b59e640 1 -- 172.21.15.37:0/3218512673 >> 172.21.15.37:0/3218512673 conn(0x7f5f6c0d0ce0 msgr2=0x7f5f6c0d10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:03.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.761+0000 7f5f6b59e640 1 -- 172.21.15.37:0/3218512673 shutdown_connections 2023-12-11T17:11:03.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.761+0000 7f5f6b59e640 1 -- 172.21.15.37:0/3218512673 wait complete. 2023-12-11T17:11:03.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.763+0000 7f5f6b59e640 1 Processor -- start 2023-12-11T17:11:03.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.763+0000 7f5f6b59e640 1 -- start start 2023-12-11T17:11:03.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.764+0000 7f5f6b59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f580047c0 0x7f5f6c15c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:03.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.764+0000 7f5f6b59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f6c1f3220 0x7f5f6c0c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:03.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.764+0000 7f5f6b59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f6c0c82f0 0x7f5f6c0c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:03.771 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.764+0000 7f5f6b59e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c0c87a0 con 0x7f5f580047c0 2023-12-11T17:11:03.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.764+0000 7f5f6b59e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c0ada50 con 0x7f5f6c0c82f0 2023-12-11T17:11:03.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.764+0000 7f5f6b59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f6c0ae010 con 0x7f5f6c1f3220 2023-12-11T17:11:03.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.764+0000 7f5f6a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f580047c0 0x7f5f6c15c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:03.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.765+0000 7f5f6a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f580047c0 0x7f5f6c15c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47088/0 (socket says 172.21.15.37:47088) 2023-12-11T17:11:03.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.765+0000 7f5f6a59c640 1 -- 172.21.15.37:0/1180889760 learned_addr learned my addr 172.21.15.37:0/1180889760 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:03.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.765+0000 7f5f69d9b640 1 --2- 172.21.15.37:0/1180889760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f6c1f3220 0x7f5f6c0c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:03.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.765+0000 7f5f6ad9d640 1 --2- 172.21.15.37:0/1180889760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f6c0c82f0 0x7f5f6c0c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:03.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.765+0000 7f5f6a59c640 1 -- 172.21.15.37:0/1180889760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f6c1f3220 msgr2=0x7f5f6c0c7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:03.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.765+0000 7f5f6a59c640 1 --2- 172.21.15.37:0/1180889760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f6c1f3220 0x7f5f6c0c7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.765+0000 7f5f6a59c640 1 -- 172.21.15.37:0/1180889760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f6c0c82f0 msgr2=0x7f5f6c0c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:03.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.765+0000 7f5f6a59c640 1 --2- 172.21.15.37:0/1180889760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f6c0c82f0 0x7f5f6c0c5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.765+0000 7f5f6a59c640 1 -- 172.21.15.37:0/1180889760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f6c0c6d30 con 0x7f5f580047c0 2023-12-11T17:11:03.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.765+0000 7f5f6ad9d640 1 --2- 172.21.15.37:0/1180889760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f6c0c82f0 0x7f5f6c0c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:03.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.765+0000 7f5f6a59c640 1 --2- 172.21.15.37:0/1180889760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f580047c0 0x7f5f6c15c910 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c007f20 tx=0x7f5f5c00f5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:03.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.766+0000 7f5f62ffd640 1 -- 172.21.15.37:0/1180889760 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c0145f0 con 0x7f5f580047c0 2023-12-11T17:11:03.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.766+0000 7f5f62ffd640 1 -- 172.21.15.37:0/1180889760 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f5c014750 con 0x7f5f580047c0 2023-12-11T17:11:03.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.766+0000 7f5f62ffd640 1 -- 172.21.15.37:0/1180889760 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f5c014b00 con 0x7f5f580047c0 2023-12-11T17:11:03.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.766+0000 7f5f6b59e640 1 -- 172.21.15.37:0/1180889760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f6c0c7010 con 0x7f5f580047c0 2023-12-11T17:11:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.766+0000 7f5f6b59e640 1 -- 172.21.15.37:0/1180889760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f6c1f36a0 con 0x7f5f580047c0 2023-12-11T17:11:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.767+0000 7f5f6b59e640 1 -- 172.21.15.37:0/1180889760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f6c074450 con 0x7f5f580047c0 2023-12-11T17:11:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.768+0000 7f5f62ffd640 1 -- 172.21.15.37:0/1180889760 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5f5c014c60 con 0x7f5f580047c0 2023-12-11T17:11:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.769+0000 7f5f62ffd640 1 --2- 172.21.15.37:0/1180889760 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5f4c06ae70 0x7f5f4c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.769+0000 7f5f62ffd640 1 -- 172.21.15.37:0/1180889760 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f5f5c08a7c0 con 0x7f5f580047c0 2023-12-11T17:11:03.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.769+0000 7f5f69d9b640 1 --2- 172.21.15.37:0/1180889760 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5f4c06ae70 0x7f5f4c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:03.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.771+0000 7f5f69d9b640 1 --2- 172.21.15.37:0/1180889760 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5f4c06ae70 0x7f5f4c06d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5f54034000 tx=0x7f5f54009030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:03.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.773+0000 7f5f62ffd640 1 -- 172.21.15.37:0/1180889760 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5f5c055490 con 0x7f5f580047c0 2023-12-11T17:11:03.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.971+0000 7f5f6b59e640 1 -- 172.21.15.37:0/1180889760 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f5f6c0b6c60 con 0x7f5f580047c0 2023-12-11T17:11:03.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.972+0000 7f5f62ffd640 1 -- 172.21.15.37:0/1180889760 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f5f5c058ab0 con 0x7f5f580047c0 2023-12-11T17:11:03.973 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:11:03.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.975+0000 7f5f6b59e640 1 -- 172.21.15.37:0/1180889760 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5f4c06ae70 msgr2=0x7f5f4c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:03.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.975+0000 7f5f6b59e640 1 --2- 172.21.15.37:0/1180889760 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5f4c06ae70 0x7f5f4c06d330 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5f54034000 tx=0x7f5f54009030 comp rx=0 tx=0).stop 2023-12-11T17:11:03.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.975+0000 7f5f6b59e640 1 -- 172.21.15.37:0/1180889760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f580047c0 msgr2=0x7f5f6c15c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:03.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.975+0000 7f5f6b59e640 1 --2- 172.21.15.37:0/1180889760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f580047c0 0x7f5f6c15c910 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f5f5c007f20 tx=0x7f5f5c00f5e0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.975+0000 7f5f6b59e640 1 -- 172.21.15.37:0/1180889760 shutdown_connections 2023-12-11T17:11:03.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.975+0000 7f5f6b59e640 1 --2- 172.21.15.37:0/1180889760 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5f4c06ae70 0x7f5f4c06d330 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.975+0000 7f5f6b59e640 1 --2- 172.21.15.37:0/1180889760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f6c0c82f0 0x7f5f6c0c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.975+0000 7f5f6b59e640 1 --2- 172.21.15.37:0/1180889760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5f6c1f3220 0x7f5f6c0c7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.975+0000 7f5f6b59e640 1 --2- 172.21.15.37:0/1180889760 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5f580047c0 0x7f5f6c15c910 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:03.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.975+0000 7f5f6b59e640 1 -- 172.21.15.37:0/1180889760 >> 172.21.15.37:0/1180889760 conn(0x7f5f6c0d0ce0 msgr2=0x7f5f6c161630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:03.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.975+0000 7f5f6b59e640 1 -- 172.21.15.37:0/1180889760 shutdown_connections 2023-12-11T17:11:03.977 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:03.975+0000 7f5f6b59e640 1 -- 172.21.15.37:0/1180889760 wait complete. 2023-12-11T17:11:03.994 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-11T17:11:04.221 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.221+0000 7fef519ba640 1 Processor -- start 2023-12-11T17:11:04.222 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.221+0000 7fef519ba640 1 -- start start 2023-12-11T17:11:04.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.223+0000 7fef519ba640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef4c0d13c0 0x7fef4c0ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:04.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.223+0000 7fef519ba640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fef4c0d0d70 0x7fef4c0d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:04.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.223+0000 7fef519ba640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef4c0b2280 con 0x7fef4c0cf6a0 2023-12-11T17:11:04.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.223+0000 7fef519ba640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef4c0cee70 con 0x7fef4c0d0d70 2023-12-11T17:11:04.223 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.223+0000 7fef519ba640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c0d1190 con 0x7fef4c0d13c0 2023-12-11T17:11:04.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.223+0000 7fef511b9640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fef4c0cf6a0 0x7fef4c0cfb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34300/0 (socket says 172.21.15.37:34300) 2023-12-11T17:11:04.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.224+0000 7fef511b9640 1 -- 172.21.15.37:0/1965743107 learned_addr learned my addr 172.21.15.37:0/1965743107 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:04.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.224+0000 7fef509b8640 1 --2- 172.21.15.37:0/1965743107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef4c0d13c0 0x7fef4c0ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:04.224 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.224+0000 7fef4bfff640 1 --2- 172.21.15.37:0/1965743107 >> v2:172.21.15.151:3300/0 conn(0x7fef4c0d0d70 0x7fef4c0d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:04.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.224+0000 7fef4b7fe640 1 -- 172.21.15.37:0/1965743107 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2223118293 0 0) 0x7fef4c0b2280 con 0x7fef4c0cf6a0 2023-12-11T17:11:04.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.224+0000 7fef4b7fe640 1 -- 172.21.15.37:0/1965743107 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fef3c003520 con 0x7fef4c0cf6a0 2023-12-11T17:11:04.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.224+0000 7fef4b7fe640 1 -- 172.21.15.37:0/1965743107 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2395366241 0 0) 0x7fef3c003520 con 0x7fef4c0cf6a0 2023-12-11T17:11:04.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.224+0000 7fef4b7fe640 1 -- 172.21.15.37:0/1965743107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef4c0d13c0 msgr2=0x7fef4c0ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:04.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.224+0000 7fef4b7fe640 1 --2- 172.21.15.37:0/1965743107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef4c0d13c0 0x7fef4c0ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:04.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.224+0000 7fef4b7fe640 1 -- 172.21.15.37:0/1965743107 >> v2:172.21.15.151:3300/0 conn(0x7fef4c0d0d70 msgr2=0x7fef4c0d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:04.225 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.224+0000 7fef4b7fe640 1 --2- 172.21.15.37:0/1965743107 >> v2:172.21.15.151:3300/0 conn(0x7fef4c0d0d70 0x7fef4c0d17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:04.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.225+0000 7fef4b7fe640 1 -- 172.21.15.37:0/1965743107 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c0d1ce0 con 0x7fef4c0cf6a0 2023-12-11T17:11:04.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.225+0000 7fef4b7fe640 1 -- 172.21.15.37:0/1965743107 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7fef440019f0 con 0x7fef4c0cf6a0 2023-12-11T17:11:04.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.225+0000 7fef4b7fe640 1 -- 172.21.15.37:0/1965743107 >> v1:172.21.15.37:6789/0 conn(0x7fef4c0cf6a0 legacy=0x7fef4c0cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:04.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.225+0000 7fef4b7fe640 1 --2- 172.21.15.37:0/1965743107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef3c003970 0x7fef3c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:04.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.225+0000 7fef4b7fe640 1 --2- 172.21.15.37:0/1965743107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef3c0047c0 0x7fef3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:04.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.225+0000 7fef4b7fe640 1 --2- 172.21.15.37:0/1965743107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef4c0d13c0 0x7fef3c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:04.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.225+0000 7fef4b7fe640 1 -- 172.21.15.37:0/1965743107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c0cee70 con 0x7fef3c003970 2023-12-11T17:11:04.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.225+0000 7fef4b7fe640 1 -- 172.21.15.37:0/1965743107 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c0d1190 con 0x7fef3c0047c0 2023-12-11T17:11:04.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.225+0000 7fef4b7fe640 1 -- 172.21.15.37:0/1965743107 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef3c00b9d0 con 0x7fef4c0d13c0 2023-12-11T17:11:04.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.225+0000 7fef509b8640 1 --2- 172.21.15.37:0/1965743107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef3c003970 0x7fef3c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:04.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.225+0000 7fef4bfff640 1 --2- 172.21.15.37:0/1965743107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef3c0047c0 0x7fef3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:04.226 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.225+0000 7fef511b9640 1 --2- 172.21.15.37:0/1965743107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef4c0d13c0 0x7fef3c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:04.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.226+0000 7fef509b8640 1 -- 172.21.15.37:0/1965743107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef4c0d13c0 msgr2=0x7fef3c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:04.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.226+0000 7fef509b8640 1 --2- 172.21.15.37:0/1965743107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef4c0d13c0 0x7fef3c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:04.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.226+0000 7fef509b8640 1 -- 172.21.15.37:0/1965743107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef3c0047c0 msgr2=0x7fef3c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:04.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.226+0000 7fef509b8640 1 --2- 172.21.15.37:0/1965743107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef3c0047c0 0x7fef3c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:04.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.226+0000 7fef509b8640 1 -- 172.21.15.37:0/1965743107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef3c003520 con 0x7fef3c003970 2023-12-11T17:11:04.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.226+0000 7fef4bfff640 1 --2- 172.21.15.37:0/1965743107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef3c0047c0 0x7fef3c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:11:04.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.227+0000 7fef509b8640 1 --2- 172.21.15.37:0/1965743107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef3c003970 0x7fef3c003d90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fef40009af0 tx=0x7fef3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd041b21dd15a09d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:04.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.227+0000 7fef4b7fe640 1 -- 172.21.15.37:0/1965743107 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4002c6b0 con 0x7fef3c003970 2023-12-11T17:11:04.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.227+0000 7fef4b7fe640 1 -- 172.21.15.37:0/1965743107 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef4002c810 con 0x7fef3c003970 2023-12-11T17:11:04.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.227+0000 7fef4b7fe640 1 -- 172.21.15.37:0/1965743107 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef4002cba0 con 0x7fef3c003970 2023-12-11T17:11:04.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.228+0000 7fef519ba640 1 -- 172.21.15.37:0/1965743107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef3c003970 msgr2=0x7fef3c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:04.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.228+0000 7fef519ba640 1 --2- 172.21.15.37:0/1965743107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef3c003970 0x7fef3c003d90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fef40009af0 tx=0x7fef3c0057f0 comp rx=0 tx=0).stop 2023-12-11T17:11:04.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.228+0000 7fef511b9640 1 -- 172.21.15.37:0/1965743107 reap_dead start 2023-12-11T17:11:04.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.228+0000 7fef519ba640 1 -- 172.21.15.37:0/1965743107 shutdown_connections 2023-12-11T17:11:04.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.228+0000 7fef519ba640 1 -- 172.21.15.37:0/1965743107 >> 172.21.15.37:0/1965743107 conn(0x7fef4c09c260 msgr2=0x7fef4c0d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:04.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.228+0000 7fef519ba640 1 -- 172.21.15.37:0/1965743107 shutdown_connections 2023-12-11T17:11:04.229 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.228+0000 7fef519ba640 1 -- 172.21.15.37:0/1965743107 wait complete. 2023-12-11T17:11:04.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.230+0000 7fef519ba640 1 Processor -- start 2023-12-11T17:11:04.230 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.230+0000 7fef519ba640 1 -- start start 2023-12-11T17:11:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.231+0000 7fef519ba640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef3c003970 0x7fef4c1f2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.231+0000 7fef519ba640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4c159010 0x7fef4c159490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.231+0000 7fef519ba640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef4c1471d0 0x7fef4c147650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.231+0000 7fef519ba640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c146170 con 0x7fef4c159010 2023-12-11T17:11:04.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.231+0000 7fef519ba640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c146410 con 0x7fef3c003970 2023-12-11T17:11:04.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.231+0000 7fef519ba640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef4c1466f0 con 0x7fef4c1471d0 2023-12-11T17:11:04.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.231+0000 7fef4bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4c159010 0x7fef4c159490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:04.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.232+0000 7fef4bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4c159010 0x7fef4c159490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47106/0 (socket says 172.21.15.37:47106) 2023-12-11T17:11:04.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.232+0000 7fef4bfff640 1 -- 172.21.15.37:0/298341681 learned_addr learned my addr 172.21.15.37:0/298341681 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.232+0000 7fef509b8640 1 --2- 172.21.15.37:0/298341681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef3c003970 0x7fef4c1f2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.232+0000 7fef4bfff640 1 -- 172.21.15.37:0/298341681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef4c1471d0 msgr2=0x7fef4c147650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.232+0000 7fef4bfff640 1 --2- 172.21.15.37:0/298341681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef4c1471d0 0x7fef4c147650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.232+0000 7fef4bfff640 1 -- 172.21.15.37:0/298341681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef3c003970 msgr2=0x7fef4c1f2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.232+0000 7fef4bfff640 1 --2- 172.21.15.37:0/298341681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef3c003970 0x7fef4c1f2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.232+0000 7fef4bfff640 1 -- 172.21.15.37:0/298341681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef4c1469d0 con 0x7fef4c159010 2023-12-11T17:11:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.232+0000 7fef4bfff640 1 --2- 172.21.15.37:0/298341681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4c159010 0x7fef4c159490 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fef380116d0 tx=0x7fef38011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.233+0000 7fef497fa640 1 -- 172.21.15.37:0/298341681 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3800f940 con 0x7fef4c159010 2023-12-11T17:11:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.233+0000 7fef497fa640 1 -- 172.21.15.37:0/298341681 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef3800faa0 con 0x7fef4c159010 2023-12-11T17:11:04.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.233+0000 7fef497fa640 1 -- 172.21.15.37:0/298341681 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef3800fe30 con 0x7fef4c159010 2023-12-11T17:11:04.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.233+0000 7fef519ba640 1 -- 172.21.15.37:0/298341681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef4c146cb0 con 0x7fef4c159010 2023-12-11T17:11:04.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.233+0000 7fef519ba640 1 -- 172.21.15.37:0/298341681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef4c1599d0 con 0x7fef4c159010 2023-12-11T17:11:04.234 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.234+0000 7fef519ba640 1 -- 172.21.15.37:0/298341681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef4c0b5ad0 con 0x7fef4c159010 2023-12-11T17:11:04.235 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.235+0000 7fef497fa640 1 -- 172.21.15.37:0/298341681 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fef38015460 con 0x7fef4c159010 2023-12-11T17:11:04.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.236+0000 7fef497fa640 1 --2- 172.21.15.37:0/298341681 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fef3006ae40 0x7fef3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:04.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.236+0000 7fef497fa640 1 -- 172.21.15.37:0/298341681 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fef3808a1b0 con 0x7fef4c159010 2023-12-11T17:11:04.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.237+0000 7fef509b8640 1 --2- 172.21.15.37:0/298341681 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fef3006ae40 0x7fef3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:04.238 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.238+0000 7fef509b8640 1 --2- 172.21.15.37:0/298341681 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fef3006ae40 0x7fef3006d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fef40036000 tx=0x7fef40030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:04.240 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.241+0000 7fef497fa640 1 -- 172.21.15.37:0/298341681 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fef38054e80 con 0x7fef4c159010 2023-12-11T17:11:04.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.449+0000 7fef519ba640 1 -- 172.21.15.37:0/298341681 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fef4c074450 con 0x7fef4c159010 2023-12-11T17:11:04.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.450+0000 7fef497fa640 1 -- 172.21.15.37:0/298341681 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7fef380584a0 con 0x7fef4c159010 2023-12-11T17:11:04.450 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-12-11T17:11:04.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.452+0000 7fef519ba640 1 -- 172.21.15.37:0/298341681 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fef3006ae40 msgr2=0x7fef3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:04.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.452+0000 7fef519ba640 1 --2- 172.21.15.37:0/298341681 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fef3006ae40 0x7fef3006d300 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fef40036000 tx=0x7fef40030000 comp rx=0 tx=0).stop 2023-12-11T17:11:04.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.452+0000 7fef519ba640 1 -- 172.21.15.37:0/298341681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4c159010 msgr2=0x7fef4c159490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:04.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.452+0000 7fef519ba640 1 --2- 172.21.15.37:0/298341681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4c159010 0x7fef4c159490 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fef380116d0 tx=0x7fef38011b90 comp rx=0 tx=0).stop 2023-12-11T17:11:04.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.453+0000 7fef519ba640 1 -- 172.21.15.37:0/298341681 shutdown_connections 2023-12-11T17:11:04.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.453+0000 7fef519ba640 1 --2- 172.21.15.37:0/298341681 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fef3006ae40 0x7fef3006d300 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:04.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.453+0000 7fef519ba640 1 --2- 172.21.15.37:0/298341681 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fef4c1471d0 0x7fef4c147650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:04.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.453+0000 7fef519ba640 1 --2- 172.21.15.37:0/298341681 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef4c159010 0x7fef4c159490 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:04.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.453+0000 7fef519ba640 1 --2- 172.21.15.37:0/298341681 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef3c003970 0x7fef4c1f2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:04.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.453+0000 7fef519ba640 1 -- 172.21.15.37:0/298341681 >> 172.21.15.37:0/298341681 conn(0x7fef4c09c260 msgr2=0x7fef4c0b8650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:04.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.453+0000 7fef519ba640 1 -- 172.21.15.37:0/298341681 shutdown_connections 2023-12-11T17:11:04.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:04.453+0000 7fef519ba640 1 -- 172.21.15.37:0/298341681 wait complete. 2023-12-11T17:11:04.474 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-12-11T17:11:04.474 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:11:04.475 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-12-11T17:11:04.585 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-12-11T17:11:04.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:11:04.585 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-11T17:11:04.638 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:11:04.638 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-11T17:11:04.699 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:11:04.699 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-11T17:11:04.752 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-11T17:11:04.752 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-11T17:11:04.804 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:11:05.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.036+0000 7fa11bda9640 1 Processor -- start 2023-12-11T17:11:05.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.036+0000 7fa11bda9640 1 -- start start 2023-12-11T17:11:05.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.038+0000 7fa11bda9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa114143e00 0x7fa1140b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:05.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.038+0000 7fa11bda9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa114072180 0x7fa1140b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:05.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.038+0000 7fa11bda9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa11406c410 0x7fa1140b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:05.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.038+0000 7fa11bda9640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1140b3bb0 con 0x7fa114143e00 2023-12-11T17:11:05.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.038+0000 7fa11bda9640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1141441e0 con 0x7fa114072180 2023-12-11T17:11:05.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.038+0000 7fa11bda9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa114072680 con 0x7fa11406c410 2023-12-11T17:11:05.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.038+0000 7fa119b45640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa114143e00 0x7fa1140b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:05.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.039+0000 7fa119b45640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa114143e00 0x7fa1140b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47114/0 (socket says 172.21.15.37:47114) 2023-12-11T17:11:05.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.039+0000 7fa119b45640 1 -- 172.21.15.37:0/2684324683 learned_addr learned my addr 172.21.15.37:0/2684324683 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:05.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.039+0000 7fa119b45640 1 -- 172.21.15.37:0/2684324683 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa11406c410 msgr2=0x7fa1140b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:05.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.039+0000 7fa119b45640 1 --2- 172.21.15.37:0/2684324683 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa11406c410 0x7fa1140b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.039+0000 7fa119b45640 1 -- 172.21.15.37:0/2684324683 >> v2:172.21.15.151:3300/0 conn(0x7fa114072180 msgr2=0x7fa1140b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:05.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.039+0000 7fa119b45640 1 --2- 172.21.15.37:0/2684324683 >> v2:172.21.15.151:3300/0 conn(0x7fa114072180 0x7fa1140b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.039+0000 7fa119b45640 1 -- 172.21.15.37:0/2684324683 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1140b1e30 con 0x7fa114143e00 2023-12-11T17:11:05.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.040+0000 7fa119b45640 1 --2- 172.21.15.37:0/2684324683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa114143e00 0x7fa1140b4040 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa114067da0 tx=0x7fa11002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2258f6caf4019c90 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:05.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.040+0000 7fa118b43640 1 -- 172.21.15.37:0/2684324683 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa110031870 con 0x7fa114143e00 2023-12-11T17:11:05.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.040+0000 7fa118b43640 1 -- 172.21.15.37:0/2684324683 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1100319d0 con 0x7fa114143e00 2023-12-11T17:11:05.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.040+0000 7fa118b43640 1 -- 172.21.15.37:0/2684324683 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa110031d60 con 0x7fa114143e00 2023-12-11T17:11:05.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.041+0000 7fa11bda9640 1 -- 172.21.15.37:0/2684324683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa114143e00 msgr2=0x7fa1140b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:05.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.041+0000 7fa11bda9640 1 --2- 172.21.15.37:0/2684324683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa114143e00 0x7fa1140b4040 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fa114067da0 tx=0x7fa11002b910 comp rx=0 tx=0).stop 2023-12-11T17:11:05.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.041+0000 7fa11bda9640 1 -- 172.21.15.37:0/2684324683 shutdown_connections 2023-12-11T17:11:05.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.041+0000 7fa11bda9640 1 --2- 172.21.15.37:0/2684324683 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa11406c410 0x7fa1140b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.041+0000 7fa11bda9640 1 --2- 172.21.15.37:0/2684324683 >> v2:172.21.15.151:3300/0 conn(0x7fa114072180 0x7fa1140b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.042 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.041+0000 7fa11bda9640 1 --2- 172.21.15.37:0/2684324683 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa114143e00 0x7fa1140b4040 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.041+0000 7fa11bda9640 1 -- 172.21.15.37:0/2684324683 >> 172.21.15.37:0/2684324683 conn(0x7fa1140b0a90 msgr2=0x7fa1140b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:05.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.041+0000 7fa11bda9640 1 -- 172.21.15.37:0/2684324683 shutdown_connections 2023-12-11T17:11:05.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.041+0000 7fa11bda9640 1 -- 172.21.15.37:0/2684324683 wait complete. 2023-12-11T17:11:05.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.043+0000 7fa11bda9640 1 Processor -- start 2023-12-11T17:11:05.044 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.043+0000 7fa11bda9640 1 -- start start 2023-12-11T17:11:05.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.044+0000 7fa11bda9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa11406c410 0x7fa11412e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:05.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.044+0000 7fa11bda9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa114072180 0x7fa11412cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:05.045 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.044+0000 7fa11bda9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa114143e00 0x7fa11412d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:05.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.044+0000 7fa11bda9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11413ec10 con 0x7fa11406c410 2023-12-11T17:11:05.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.044+0000 7fa11bda9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11412ed60 con 0x7fa114143e00 2023-12-11T17:11:05.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.044+0000 7fa11bda9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11412f040 con 0x7fa114072180 2023-12-11T17:11:05.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.045+0000 7fa119b45640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa11406c410 0x7fa11412e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:05.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.045+0000 7fa119b45640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa11406c410 0x7fa11412e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47124/0 (socket says 172.21.15.37:47124) 2023-12-11T17:11:05.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.045+0000 7fa119b45640 1 -- 172.21.15.37:0/1374852539 learned_addr learned my addr 172.21.15.37:0/1374852539 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:05.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.045+0000 7fa119b45640 1 -- 172.21.15.37:0/1374852539 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa114072180 msgr2=0x7fa11412cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:05.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.045+0000 7fa119b45640 1 --2- 172.21.15.37:0/1374852539 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa114072180 0x7fa11412cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.045+0000 7fa119b45640 1 -- 172.21.15.37:0/1374852539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa114143e00 msgr2=0x7fa11412d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:05.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.045+0000 7fa11a346640 1 --2- 172.21.15.37:0/1374852539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa114143e00 0x7fa11412d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:05.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.045+0000 7fa119b45640 1 --2- 172.21.15.37:0/1374852539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa114143e00 0x7fa11412d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.045+0000 7fa119b45640 1 -- 172.21.15.37:0/1374852539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1100094d0 con 0x7fa11406c410 2023-12-11T17:11:05.046 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.046+0000 7fa119b45640 1 --2- 172.21.15.37:0/1374852539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa11406c410 0x7fa11412e780 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa110000c00 tx=0x7fa1100046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:05.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.046+0000 7fa10a7fc640 1 -- 172.21.15.37:0/1374852539 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11003ad10 con 0x7fa11406c410 2023-12-11T17:11:05.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.046+0000 7fa10a7fc640 1 -- 172.21.15.37:0/1374852539 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11003ae70 con 0x7fa11406c410 2023-12-11T17:11:05.047 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.046+0000 7fa10a7fc640 1 -- 172.21.15.37:0/1374852539 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa110044610 con 0x7fa11406c410 2023-12-11T17:11:05.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.046+0000 7fa11bda9640 1 -- 172.21.15.37:0/1374852539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa11412f320 con 0x7fa11406c410 2023-12-11T17:11:05.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.046+0000 7fa11bda9640 1 -- 172.21.15.37:0/1374852539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa11412f8e0 con 0x7fa11406c410 2023-12-11T17:11:05.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.047+0000 7fa11bda9640 1 -- 172.21.15.37:0/1374852539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1140745d0 con 0x7fa11406c410 2023-12-11T17:11:05.048 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.048+0000 7fa10a7fc640 1 -- 172.21.15.37:0/1374852539 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa11004d450 con 0x7fa11406c410 2023-12-11T17:11:05.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.049+0000 7fa10a7fc640 1 --2- 172.21.15.37:0/1374852539 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa0f806ae40 0x7fa0f806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:05.049 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.049+0000 7fa10a7fc640 1 -- 172.21.15.37:0/1374852539 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fa11002d040 con 0x7fa11406c410 2023-12-11T17:11:05.050 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.050+0000 7fa119344640 1 --2- 172.21.15.37:0/1374852539 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa0f806ae40 0x7fa0f806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:05.052 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.051+0000 7fa119344640 1 --2- 172.21.15.37:0/1374852539 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa0f806ae40 0x7fa0f806d300 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa1140b1d80 tx=0x7fa104006c90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:05.053 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.053+0000 7fa10a7fc640 1 -- 172.21.15.37:0/1374852539 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa110076d80 con 0x7fa11406c410 2023-12-11T17:11:05.255 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.255+0000 7fa11bda9640 1 -- 172.21.15.37:0/1374852539 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa11406e020 con 0x7fa11406c410 2023-12-11T17:11:05.258 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.258+0000 7fa10a7fc640 1 -- 172.21.15.37:0/1374852539 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18779 (secure 0 0 0) 0x7fa11007a3a0 con 0x7fa11406c410 2023-12-11T17:11:05.259 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:11:05.259 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:10:32.309274+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:11:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.261+0000 7fa11bda9640 1 -- 172.21.15.37:0/1374852539 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa0f806ae40 msgr2=0x7fa0f806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.261+0000 7fa11bda9640 1 --2- 172.21.15.37:0/1374852539 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa0f806ae40 0x7fa0f806d300 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fa1140b1d80 tx=0x7fa104006c90 comp rx=0 tx=0).stop 2023-12-11T17:11:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.261+0000 7fa11bda9640 1 -- 172.21.15.37:0/1374852539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa11406c410 msgr2=0x7fa11412e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.261+0000 7fa11bda9640 1 --2- 172.21.15.37:0/1374852539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa11406c410 0x7fa11412e780 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fa110000c00 tx=0x7fa1100046c0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.261+0000 7fa11bda9640 1 -- 172.21.15.37:0/1374852539 shutdown_connections 2023-12-11T17:11:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.261+0000 7fa11bda9640 1 --2- 172.21.15.37:0/1374852539 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa0f806ae40 0x7fa0f806d300 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.261 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.261+0000 7fa11bda9640 1 --2- 172.21.15.37:0/1374852539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa114143e00 0x7fa11412d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.261+0000 7fa11bda9640 1 --2- 172.21.15.37:0/1374852539 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa114072180 0x7fa11412cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.261+0000 7fa11bda9640 1 --2- 172.21.15.37:0/1374852539 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa11406c410 0x7fa11412e780 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.261+0000 7fa11bda9640 1 -- 172.21.15.37:0/1374852539 >> 172.21.15.37:0/1374852539 conn(0x7fa1140b0a90 msgr2=0x7fa1140af680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.261+0000 7fa11bda9640 1 -- 172.21.15.37:0/1374852539 shutdown_connections 2023-12-11T17:11:05.262 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.261+0000 7fa11bda9640 1 -- 172.21.15.37:0/1374852539 wait complete. 2023-12-11T17:11:05.282 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T17:09:38.415636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T17:09:42.786774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T17:09:43.660585+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-11T17:09:47.272351+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-11T17:11:05.283 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T17:11:05.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.500+0000 7fd2af59e640 1 Processor -- start 2023-12-11T17:11:05.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.500+0000 7fd2af59e640 1 -- start start 2023-12-11T17:11:05.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.501+0000 7fd2af59e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fd2b0155400 0x7fd2b006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:05.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.501+0000 7fd2af59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2b00ce150 0x7fd2b00ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:05.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.501+0000 7fd2af59e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2b00cedf0 0x7fd2b00cf280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:05.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.501+0000 7fd2af59e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b00cf7c0 con 0x7fd2b00cedf0 2023-12-11T17:11:05.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.501+0000 7fd2af59e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2b015b4a0 con 0x7fd2b0155400 2023-12-11T17:11:05.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.501+0000 7fd2af59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b00adbb0 con 0x7fd2b00ce150 2023-12-11T17:11:05.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.502+0000 7fd2aed9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2b00cedf0 0x7fd2b00cf280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:05.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.502+0000 7fd2aed9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd2b00cedf0 0x7fd2b00cf280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47138/0 (socket says 172.21.15.37:47138) 2023-12-11T17:11:05.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.502+0000 7fd2aed9d640 1 -- 172.21.15.37:0/1525537620 learned_addr learned my addr 172.21.15.37:0/1525537620 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:05.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.502+0000 7fd2add9b640 1 --2- 172.21.15.37:0/1525537620 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2b00ce150 0x7fd2b00ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:05.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.502+0000 7fd2aed9d640 1 -- 172.21.15.37:0/1525537620 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2b00ce150 msgr2=0x7fd2b00ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:05.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.502+0000 7fd2aed9d640 1 --2- 172.21.15.37:0/1525537620 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2b00ce150 0x7fd2b00ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.502+0000 7fd2aed9d640 1 -- 172.21.15.37:0/1525537620 >> v2:172.21.15.151:3300/0 conn(0x7fd2b0155400 msgr2=0x7fd2b006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:05.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.502+0000 7fd2aed9d640 1 --2- 172.21.15.37:0/1525537620 >> v2:172.21.15.151:3300/0 conn(0x7fd2b0155400 0x7fd2b006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.502+0000 7fd2aed9d640 1 -- 172.21.15.37:0/1525537620 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2b00ade90 con 0x7fd2b00cedf0 2023-12-11T17:11:05.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.503+0000 7fd2aed9d640 1 --2- 172.21.15.37:0/1525537620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b00cedf0 0x7fd2b00cf280 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd2b00cfb20 tx=0x7fd2a802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=886b6d10e7df9164 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:05.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.504+0000 7fd2ad59a640 1 -- 172.21.15.37:0/1525537620 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a802ca80 con 0x7fd2b00cedf0 2023-12-11T17:11:05.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.504+0000 7fd2ad59a640 1 -- 172.21.15.37:0/1525537620 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a802cbe0 con 0x7fd2b00cedf0 2023-12-11T17:11:05.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.504+0000 7fd2ad59a640 1 -- 172.21.15.37:0/1525537620 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a80343f0 con 0x7fd2b00cedf0 2023-12-11T17:11:05.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.504+0000 7fd2af59e640 1 -- 172.21.15.37:0/1525537620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b00cedf0 msgr2=0x7fd2b00cf280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:05.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.504+0000 7fd2af59e640 1 --2- 172.21.15.37:0/1525537620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b00cedf0 0x7fd2b00cf280 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd2b00cfb20 tx=0x7fd2a802bee0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.504+0000 7fd2af59e640 1 -- 172.21.15.37:0/1525537620 shutdown_connections 2023-12-11T17:11:05.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.504+0000 7fd2af59e640 1 --2- 172.21.15.37:0/1525537620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b00cedf0 0x7fd2b00cf280 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.504+0000 7fd2af59e640 1 --2- 172.21.15.37:0/1525537620 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2b00ce150 0x7fd2b00ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.504+0000 7fd2af59e640 1 --2- 172.21.15.37:0/1525537620 >> v2:172.21.15.151:3300/0 conn(0x7fd2b0155400 0x7fd2b006bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.504+0000 7fd2af59e640 1 -- 172.21.15.37:0/1525537620 >> 172.21.15.37:0/1525537620 conn(0x7fd2b006a640 msgr2=0x7fd2b006aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:05.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.505+0000 7fd2af59e640 1 -- 172.21.15.37:0/1525537620 shutdown_connections 2023-12-11T17:11:05.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.505+0000 7fd2af59e640 1 -- 172.21.15.37:0/1525537620 wait complete. 2023-12-11T17:11:05.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.507+0000 7fd2af59e640 1 Processor -- start 2023-12-11T17:11:05.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.507+0000 7fd2af59e640 1 -- start start 2023-12-11T17:11:05.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.508+0000 7fd2af59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b00ce150 0x7fd2b0143510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.508+0000 7fd2af59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2b00cedf0 0x7fd2b01e50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.508+0000 7fd2af59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2b0155400 0x7fd2b01e5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.508+0000 7fd2af59e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b01e4d50 con 0x7fd2b00ce150 2023-12-11T17:11:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.508+0000 7fd2af59e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b01e41d0 con 0x7fd2b0155400 2023-12-11T17:11:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.508+0000 7fd2af59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2b01e44b0 con 0x7fd2b00cedf0 2023-12-11T17:11:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.508+0000 7fd2ae59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b00ce150 0x7fd2b0143510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.508+0000 7fd2ae59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b00ce150 0x7fd2b0143510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47150/0 (socket says 172.21.15.37:47150) 2023-12-11T17:11:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.508+0000 7fd2ae59c640 1 -- 172.21.15.37:0/2813635475 learned_addr learned my addr 172.21.15.37:0/2813635475 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.508+0000 7fd2add9b640 1 --2- 172.21.15.37:0/2813635475 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2b00cedf0 0x7fd2b01e50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.508+0000 7fd2ae59c640 1 -- 172.21.15.37:0/2813635475 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2b00cedf0 msgr2=0x7fd2b01e50e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.508+0000 7fd2ae59c640 1 --2- 172.21.15.37:0/2813635475 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2b00cedf0 0x7fd2b01e50e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.509+0000 7fd2ae59c640 1 -- 172.21.15.37:0/2813635475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2b0155400 msgr2=0x7fd2b01e5620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:05.509 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.509+0000 7fd2ae59c640 1 --2- 172.21.15.37:0/2813635475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2b0155400 0x7fd2b01e5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.509+0000 7fd2ae59c640 1 -- 172.21.15.37:0/2813635475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a8009b30 con 0x7fd2b00ce150 2023-12-11T17:11:05.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.509+0000 7fd2ae59c640 1 --2- 172.21.15.37:0/2813635475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b00ce150 0x7fd2b0143510 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000b410 tx=0x7fd2a000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:05.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.509+0000 7fd29effd640 1 -- 172.21.15.37:0/2813635475 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0011830 con 0x7fd2b00ce150 2023-12-11T17:11:05.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.509+0000 7fd29effd640 1 -- 172.21.15.37:0/2813635475 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2a00119b0 con 0x7fd2b00ce150 2023-12-11T17:11:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.509+0000 7fd29effd640 1 -- 172.21.15.37:0/2813635475 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2a0011d60 con 0x7fd2b00ce150 2023-12-11T17:11:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.509+0000 7fd2af59e640 1 -- 172.21.15.37:0/2813635475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2b01e4790 con 0x7fd2b00ce150 2023-12-11T17:11:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.509+0000 7fd2af59e640 1 -- 172.21.15.37:0/2813635475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2b0143a50 con 0x7fd2b00ce150 2023-12-11T17:11:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.511+0000 7fd2af59e640 1 -- 172.21.15.37:0/2813635475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2b006d510 con 0x7fd2b00ce150 2023-12-11T17:11:05.511 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.512+0000 7fd29effd640 1 -- 172.21.15.37:0/2813635475 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fd2a001a400 con 0x7fd2b00ce150 2023-12-11T17:11:05.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.513+0000 7fd29effd640 1 --2- 172.21.15.37:0/2813635475 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fd29006ae40 0x7fd29006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:05.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.513+0000 7fd29effd640 1 -- 172.21.15.37:0/2813635475 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fd2a0089b70 con 0x7fd2b00ce150 2023-12-11T17:11:05.513 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.514+0000 7fd2add9b640 1 --2- 172.21.15.37:0/2813635475 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fd29006ae40 0x7fd29006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:05.515 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.515+0000 7fd2add9b640 1 --2- 172.21.15.37:0/2813635475 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fd29006ae40 0x7fd29006d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd2b00b09f0 tx=0x7fd2a4008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:05.518 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.518+0000 7fd29effd640 1 -- 172.21.15.37:0/2813635475 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fd2a0054840 con 0x7fd2b00ce150 2023-12-11T17:11:05.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.711+0000 7fd2af59e640 1 -- 172.21.15.37:0/2813635475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd2b0074450 con 0x7fd2b00ce150 2023-12-11T17:11:05.712 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.712+0000 7fd29effd640 1 -- 172.21.15.37:0/2813635475 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd2a0015020 con 0x7fd2b00ce150 2023-12-11T17:11:05.712 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-11T17:11:05.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.714+0000 7fd2af59e640 1 -- 172.21.15.37:0/2813635475 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fd29006ae40 msgr2=0x7fd29006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.714+0000 7fd2af59e640 1 --2- 172.21.15.37:0/2813635475 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fd29006ae40 0x7fd29006d300 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fd2b00b09f0 tx=0x7fd2a4008040 comp rx=0 tx=0).stop 2023-12-11T17:11:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.714+0000 7fd2af59e640 1 -- 172.21.15.37:0/2813635475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b00ce150 msgr2=0x7fd2b0143510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.714+0000 7fd2af59e640 1 --2- 172.21.15.37:0/2813635475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b00ce150 0x7fd2b0143510 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd2a000b410 tx=0x7fd2a000b8d0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.714+0000 7fd2af59e640 1 -- 172.21.15.37:0/2813635475 shutdown_connections 2023-12-11T17:11:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.714+0000 7fd2af59e640 1 --2- 172.21.15.37:0/2813635475 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fd29006ae40 0x7fd29006d300 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.714+0000 7fd2af59e640 1 --2- 172.21.15.37:0/2813635475 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2b0155400 0x7fd2b01e5620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.714+0000 7fd2af59e640 1 --2- 172.21.15.37:0/2813635475 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fd2b00cedf0 0x7fd2b01e50e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.714+0000 7fd2af59e640 1 --2- 172.21.15.37:0/2813635475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd2b00ce150 0x7fd2b0143510 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.714+0000 7fd2af59e640 1 -- 172.21.15.37:0/2813635475 >> 172.21.15.37:0/2813635475 conn(0x7fd2b006a640 msgr2=0x7fd2b00b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.715+0000 7fd2af59e640 1 -- 172.21.15.37:0/2813635475 shutdown_connections 2023-12-11T17:11:05.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.715+0000 7fd2af59e640 1 -- 172.21.15.37:0/2813635475 wait complete. 2023-12-11T17:11:05.734 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T17:11:05.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.969+0000 7f51d90f3640 1 Processor -- start 2023-12-11T17:11:05.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.969+0000 7f51d90f3640 1 -- start start 2023-12-11T17:11:05.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.970+0000 7f51d90f3640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f51d4143810 0x7f51d40ada80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:05.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.970+0000 7f51d90f3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f51d40cd7d0 0x7f51d406d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:05.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.970+0000 7f51d90f3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51d40adfc0 0x7f51d406da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:05.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.971+0000 7f51d90f3640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d4143bf0 con 0x7f51d40cd7d0 2023-12-11T17:11:05.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.971+0000 7f51d90f3640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51d40ae520 con 0x7f51d4143810 2023-12-11T17:11:05.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.971+0000 7f51d90f3640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d40ae800 con 0x7f51d40adfc0 2023-12-11T17:11:05.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.971+0000 7f51cbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f51d40cd7d0 0x7f51d406d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:05.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.971+0000 7f51cbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f51d40cd7d0 0x7f51d406d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47166/0 (socket says 172.21.15.37:47166) 2023-12-11T17:11:05.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.971+0000 7f51cbfff640 1 -- 172.21.15.37:0/3001890459 learned_addr learned my addr 172.21.15.37:0/3001890459 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:05.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.971+0000 7f51d359e640 1 --2- 172.21.15.37:0/3001890459 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51d40adfc0 0x7f51d406da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:05.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.971+0000 7f51cbfff640 1 -- 172.21.15.37:0/3001890459 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51d40adfc0 msgr2=0x7f51d406da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:05.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.971+0000 7f51cbfff640 1 --2- 172.21.15.37:0/3001890459 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51d40adfc0 0x7f51d406da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.971+0000 7f51cbfff640 1 -- 172.21.15.37:0/3001890459 >> v2:172.21.15.151:3300/0 conn(0x7f51d4143810 msgr2=0x7f51d40ada80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:05.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.971+0000 7f51d2d9d640 1 --2- 172.21.15.37:0/3001890459 >> v2:172.21.15.151:3300/0 conn(0x7f51d4143810 0x7f51d40ada80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:05.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.972+0000 7f51cbfff640 1 --2- 172.21.15.37:0/3001890459 >> v2:172.21.15.151:3300/0 conn(0x7f51d4143810 0x7f51d40ada80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.972+0000 7f51cbfff640 1 -- 172.21.15.37:0/3001890459 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51d40cccf0 con 0x7f51d40cd7d0 2023-12-11T17:11:05.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.972+0000 7f51d2d9d640 1 --2- 172.21.15.37:0/3001890459 >> v2:172.21.15.151:3300/0 conn(0x7f51d4143810 0x7f51d40ada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:05.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.973+0000 7f51cbfff640 1 --2- 172.21.15.37:0/3001890459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51d40cd7d0 0x7f51d406d500 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f51d406ff40 tx=0x7f51bc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8252d85310a75237 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:05.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.973+0000 7f51d259c640 1 -- 172.21.15.37:0/3001890459 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc031870 con 0x7f51d40cd7d0 2023-12-11T17:11:05.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.973+0000 7f51d259c640 1 -- 172.21.15.37:0/3001890459 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51bc0319d0 con 0x7f51d40cd7d0 2023-12-11T17:11:05.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.973+0000 7f51d259c640 1 -- 172.21.15.37:0/3001890459 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51bc031d60 con 0x7f51d40cd7d0 2023-12-11T17:11:05.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.974+0000 7f51d90f3640 1 -- 172.21.15.37:0/3001890459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51d40cd7d0 msgr2=0x7f51d406d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:05.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.974+0000 7f51d90f3640 1 --2- 172.21.15.37:0/3001890459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51d40cd7d0 0x7f51d406d500 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f51d406ff40 tx=0x7f51bc02b910 comp rx=0 tx=0).stop 2023-12-11T17:11:05.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.974+0000 7f51d90f3640 1 -- 172.21.15.37:0/3001890459 shutdown_connections 2023-12-11T17:11:05.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.974+0000 7f51d90f3640 1 --2- 172.21.15.37:0/3001890459 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51d40adfc0 0x7f51d406da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.974 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.974+0000 7f51d90f3640 1 --2- 172.21.15.37:0/3001890459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51d40cd7d0 0x7f51d406d500 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.974+0000 7f51d90f3640 1 --2- 172.21.15.37:0/3001890459 >> v2:172.21.15.151:3300/0 conn(0x7f51d4143810 0x7f51d40ada80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.974+0000 7f51d90f3640 1 -- 172.21.15.37:0/3001890459 >> 172.21.15.37:0/3001890459 conn(0x7f51d40cb850 msgr2=0x7f51d40cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:05.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.974+0000 7f51d90f3640 1 -- 172.21.15.37:0/3001890459 shutdown_connections 2023-12-11T17:11:05.975 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.974+0000 7f51d90f3640 1 -- 172.21.15.37:0/3001890459 wait complete. 2023-12-11T17:11:05.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.976+0000 7f51d90f3640 1 Processor -- start 2023-12-11T17:11:05.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.977+0000 7f51d90f3640 1 -- start start 2023-12-11T17:11:05.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.978+0000 7f51d90f3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51d40adfc0 0x7f51d41397e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:05.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.978+0000 7f51d90f3640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51d40cd7d0 0x7f51d40c3d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:05.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.978+0000 7f51d90f3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51d4143810 0x7f51d4143d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:05.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.978+0000 7f51d90f3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d40c5060 con 0x7f51d40adfc0 2023-12-11T17:11:05.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.978+0000 7f51d90f3640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51d4139d20 con 0x7f51d40cd7d0 2023-12-11T17:11:05.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.978+0000 7f51d90f3640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51d40c47c0 con 0x7f51d4143810 2023-12-11T17:11:05.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.978+0000 7f51d2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51d40adfc0 0x7f51d41397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:05.978 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.978+0000 7f51d2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51d40adfc0 0x7f51d41397e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47176/0 (socket says 172.21.15.37:47176) 2023-12-11T17:11:05.979 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.978+0000 7f51d2d9d640 1 -- 172.21.15.37:0/1907860288 learned_addr learned my addr 172.21.15.37:0/1907860288 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:05.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.979+0000 7f51d2d9d640 1 -- 172.21.15.37:0/1907860288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51d4143810 msgr2=0x7f51d4143d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:05.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.979+0000 7f51d2d9d640 1 --2- 172.21.15.37:0/1907860288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51d4143810 0x7f51d4143d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.979+0000 7f51d2d9d640 1 -- 172.21.15.37:0/1907860288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51d40cd7d0 msgr2=0x7f51d40c3d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:05.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.979+0000 7f51d2d9d640 1 --2- 172.21.15.37:0/1907860288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51d40cd7d0 0x7f51d40c3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:05.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.979+0000 7f51d2d9d640 1 -- 172.21.15.37:0/1907860288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc0094d0 con 0x7f51d40adfc0 2023-12-11T17:11:05.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.979+0000 7f51d2d9d640 1 --2- 172.21.15.37:0/1907860288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51d40adfc0 0x7f51d41397e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f51c400c7f0 tx=0x7f51c400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:05.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.979+0000 7f51cb7fe640 1 -- 172.21.15.37:0/1907860288 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c4007820 con 0x7f51d40adfc0 2023-12-11T17:11:05.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.979+0000 7f51cb7fe640 1 -- 172.21.15.37:0/1907860288 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51c4007980 con 0x7f51d40adfc0 2023-12-11T17:11:05.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.979+0000 7f51cb7fe640 1 -- 172.21.15.37:0/1907860288 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51c4007cf0 con 0x7f51d40adfc0 2023-12-11T17:11:05.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.979+0000 7f51d90f3640 1 -- 172.21.15.37:0/1907860288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51d40c4aa0 con 0x7f51d40adfc0 2023-12-11T17:11:05.980 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.980+0000 7f51d90f3640 1 -- 172.21.15.37:0/1907860288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51d40c53b0 con 0x7f51d40adfc0 2023-12-11T17:11:05.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.981+0000 7f51d90f3640 1 -- 172.21.15.37:0/1907860288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51d40c51f0 con 0x7f51d40adfc0 2023-12-11T17:11:05.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.982+0000 7f51cb7fe640 1 -- 172.21.15.37:0/1907860288 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f51c40113f0 con 0x7f51d40adfc0 2023-12-11T17:11:05.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.983+0000 7f51cb7fe640 1 --2- 172.21.15.37:0/1907860288 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f51b406ae70 0x7f51b406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:05.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.983+0000 7f51cb7fe640 1 -- 172.21.15.37:0/1907860288 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f51c4089d10 con 0x7f51d40adfc0 2023-12-11T17:11:05.983 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.983+0000 7f51cbfff640 1 --2- 172.21.15.37:0/1907860288 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f51b406ae70 0x7f51b406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:05.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.985+0000 7f51cbfff640 1 --2- 172.21.15.37:0/1907860288 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f51b406ae70 0x7f51b406d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f51bc036000 tx=0x7f51bc030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:05.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:05.987+0000 7f51cb7fe640 1 -- 172.21.15.37:0/1907860288 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f51c40549e0 con 0x7f51d40adfc0 2023-12-11T17:11:06.182 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.181+0000 7f51d90f3640 1 -- 172.21.15.37:0/1907860288 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f51d40745d0 con 0x7f51d40adfc0 2023-12-11T17:11:06.183 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.183+0000 7f51cb7fe640 1 -- 172.21.15.37:0/1907860288 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f51c4058000 con 0x7f51d40adfc0 2023-12-11T17:11:06.183 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:11:06.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.185+0000 7f51d90f3640 1 -- 172.21.15.37:0/1907860288 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f51b406ae70 msgr2=0x7f51b406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:06.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.185+0000 7f51d90f3640 1 --2- 172.21.15.37:0/1907860288 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f51b406ae70 0x7f51b406d330 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f51bc036000 tx=0x7f51bc030000 comp rx=0 tx=0).stop 2023-12-11T17:11:06.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.185+0000 7f51d90f3640 1 -- 172.21.15.37:0/1907860288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51d40adfc0 msgr2=0x7f51d41397e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:06.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.185+0000 7f51d90f3640 1 --2- 172.21.15.37:0/1907860288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51d40adfc0 0x7f51d41397e0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f51c400c7f0 tx=0x7f51c400ccb0 comp rx=0 tx=0).stop 2023-12-11T17:11:06.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.185+0000 7f51d90f3640 1 -- 172.21.15.37:0/1907860288 shutdown_connections 2023-12-11T17:11:06.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.185+0000 7f51d90f3640 1 --2- 172.21.15.37:0/1907860288 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f51b406ae70 0x7f51b406d330 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:06.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.185+0000 7f51d90f3640 1 --2- 172.21.15.37:0/1907860288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51d40cd7d0 0x7f51d40c3d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:06.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.185+0000 7f51d90f3640 1 --2- 172.21.15.37:0/1907860288 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f51d4143810 0x7f51d4143d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:06.185 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.185+0000 7f51d90f3640 1 --2- 172.21.15.37:0/1907860288 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f51d40adfc0 0x7f51d41397e0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:06.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.185+0000 7f51d90f3640 1 -- 172.21.15.37:0/1907860288 >> 172.21.15.37:0/1907860288 conn(0x7f51d40cb850 msgr2=0x7f51d40affd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:06.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.185+0000 7f51d90f3640 1 -- 172.21.15.37:0/1907860288 shutdown_connections 2023-12-11T17:11:06.186 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.186+0000 7f51d90f3640 1 -- 172.21.15.37:0/1907860288 wait complete. 2023-12-11T17:11:06.204 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T17:11:06.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.432+0000 7f89ffc4f640 1 Processor -- start 2023-12-11T17:11:06.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.432+0000 7f89ffc4f640 1 -- start start 2023-12-11T17:11:06.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.433+0000 7f89ffc4f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f89f80ce7e0 0x7f89f815ec00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:06.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.434+0000 7f89ffc4f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f8071cd0 con 0x7f89f815af50 2023-12-11T17:11:06.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.434+0000 7f89ffc4f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f80719f0 con 0x7f89f806a460 2023-12-11T17:11:06.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.434+0000 7f89ffc4f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f80717e0 con 0x7f89f80ce7e0 2023-12-11T17:11:06.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.434+0000 7f89fd9eb640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f89f815af50 0x7f89f806c170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34314/0 (socket says 172.21.15.37:34314) 2023-12-11T17:11:06.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.434+0000 7f89fd9eb640 1 -- 172.21.15.37:0/332549359 learned_addr learned my addr 172.21.15.37:0/332549359 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:06.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.434+0000 7f89fd1ea640 1 --2- 172.21.15.37:0/332549359 >> v2:172.21.15.37:3300/0 conn(0x7f89f80ce7e0 0x7f89f815ec00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:06.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.435+0000 7f89fc9e9640 1 -- 172.21.15.37:0/332549359 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1811343580 0 0) 0x7f89f8071cd0 con 0x7f89f815af50 2023-12-11T17:11:06.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.435+0000 7f89fc9e9640 1 -- 172.21.15.37:0/332549359 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89e4003520 con 0x7f89f815af50 2023-12-11T17:11:06.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.435+0000 7f89fd1ea640 1 -- 172.21.15.37:0/332549359 >> v1:172.21.15.151:6789/0 conn(0x7f89f806a460 legacy=0x7f89f80ccc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:06.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.435+0000 7f89fd1ea640 1 -- 172.21.15.37:0/332549359 >> v1:172.21.15.37:6789/0 conn(0x7f89f815af50 legacy=0x7f89f806c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:06.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.435+0000 7f89fd1ea640 1 -- 172.21.15.37:0/332549359 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f8071ff0 con 0x7f89f80ce7e0 2023-12-11T17:11:06.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.436+0000 7f89fd1ea640 1 --2- 172.21.15.37:0/332549359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f80ce7e0 0x7f89f815ec00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f89e80097a0 tx=0x7f89e802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a142e32957965774 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:06.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.436+0000 7f89fc9e9640 1 -- 172.21.15.37:0/332549359 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e802e070 con 0x7f89f80ce7e0 2023-12-11T17:11:06.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.436+0000 7f89fc9e9640 1 -- 172.21.15.37:0/332549359 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89e80315a0 con 0x7f89f80ce7e0 2023-12-11T17:11:06.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.436+0000 7f89fc9e9640 1 -- 172.21.15.37:0/332549359 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89e8031930 con 0x7f89f80ce7e0 2023-12-11T17:11:06.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.437+0000 7f89ffc4f640 1 -- 172.21.15.37:0/332549359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f80ce7e0 msgr2=0x7f89f815ec00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:06.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.437+0000 7f89ffc4f640 1 --2- 172.21.15.37:0/332549359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f80ce7e0 0x7f89f815ec00 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f89e80097a0 tx=0x7f89e802b840 comp rx=0 tx=0).stop 2023-12-11T17:11:06.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.437+0000 7f89ffc4f640 1 -- 172.21.15.37:0/332549359 shutdown_connections 2023-12-11T17:11:06.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.437+0000 7f89ffc4f640 1 --2- 172.21.15.37:0/332549359 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f80ce7e0 0x7f89f815ec00 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:06.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.437+0000 7f89ffc4f640 1 -- 172.21.15.37:0/332549359 >> 172.21.15.37:0/332549359 conn(0x7f89f80cee70 msgr2=0x7f89f80cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:06.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.437+0000 7f89ffc4f640 1 -- 172.21.15.37:0/332549359 shutdown_connections 2023-12-11T17:11:06.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.437+0000 7f89ffc4f640 1 -- 172.21.15.37:0/332549359 wait complete. 2023-12-11T17:11:06.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.439+0000 7f89ffc4f640 1 Processor -- start 2023-12-11T17:11:06.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.439+0000 7f89ffc4f640 1 -- start start 2023-12-11T17:11:06.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.440+0000 7f89ffc4f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89f806a460 0x7f89f813fa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:06.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.440+0000 7f89ffc4f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89f80ce7e0 0x7f89f8153540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:06.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.440+0000 7f89ffc4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f815af50 0x7f89f8141d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:06.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.440+0000 7f89ffc4f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f81f2ec0 con 0x7f89f815af50 2023-12-11T17:11:06.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.440+0000 7f89ffc4f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f8153a80 con 0x7f89f80ce7e0 2023-12-11T17:11:06.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.440+0000 7f89ffc4f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f80c2df0 con 0x7f89f806a460 2023-12-11T17:11:06.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.440+0000 7f89fe1ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f815af50 0x7f89f8141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:06.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.440+0000 7f89fe1ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f815af50 0x7f89f8141d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47192/0 (socket says 172.21.15.37:47192) 2023-12-11T17:11:06.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.440+0000 7f89fe1ec640 1 -- 172.21.15.37:0/2188961959 learned_addr learned my addr 172.21.15.37:0/2188961959 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:06.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.441+0000 7f89fd9eb640 1 --2- 172.21.15.37:0/2188961959 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89f806a460 0x7f89f813fa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:06.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.441+0000 7f89fd1ea640 1 --2- 172.21.15.37:0/2188961959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89f80ce7e0 0x7f89f8153540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:06.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.441+0000 7f89fe1ec640 1 -- 172.21.15.37:0/2188961959 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89f806a460 msgr2=0x7f89f813fa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:06.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.441+0000 7f89fe1ec640 1 --2- 172.21.15.37:0/2188961959 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89f806a460 0x7f89f813fa80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:06.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.441+0000 7f89fe1ec640 1 -- 172.21.15.37:0/2188961959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89f80ce7e0 msgr2=0x7f89f8153540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:06.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.441+0000 7f89fe1ec640 1 --2- 172.21.15.37:0/2188961959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89f80ce7e0 0x7f89f8153540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:06.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.441+0000 7f89fe1ec640 1 -- 172.21.15.37:0/2188961959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89e8009400 con 0x7f89f815af50 2023-12-11T17:11:06.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.441+0000 7f89fd1ea640 1 --2- 172.21.15.37:0/2188961959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89f80ce7e0 0x7f89f8153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:06.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.441+0000 7f89fe1ec640 1 --2- 172.21.15.37:0/2188961959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f815af50 0x7f89f8141d50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f89f000c6e0 tx=0x7f89f000cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:06.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.441+0000 7f89ee7fc640 1 -- 172.21.15.37:0/2188961959 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f0003b70 con 0x7f89f815af50 2023-12-11T17:11:06.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.441+0000 7f89ee7fc640 1 -- 172.21.15.37:0/2188961959 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89f0003cf0 con 0x7f89f815af50 2023-12-11T17:11:06.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.441+0000 7f89ee7fc640 1 -- 172.21.15.37:0/2188961959 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89f0005310 con 0x7f89f815af50 2023-12-11T17:11:06.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.441+0000 7f89ffc4f640 1 -- 172.21.15.37:0/2188961959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f80c3690 con 0x7f89f815af50 2023-12-11T17:11:06.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.442+0000 7f89ffc4f640 1 -- 172.21.15.37:0/2188961959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f8159d60 con 0x7f89f815af50 2023-12-11T17:11:06.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.443+0000 7f89ffc4f640 1 -- 172.21.15.37:0/2188961959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f80c3820 con 0x7f89f815af50 2023-12-11T17:11:06.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.444+0000 7f89ee7fc640 1 -- 172.21.15.37:0/2188961959 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f89f0005470 con 0x7f89f815af50 2023-12-11T17:11:06.445 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.445+0000 7f89ee7fc640 1 --2- 172.21.15.37:0/2188961959 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f89dc06ae70 0x7f89dc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:06.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.445+0000 7f89ee7fc640 1 -- 172.21.15.37:0/2188961959 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f89f0089710 con 0x7f89f815af50 2023-12-11T17:11:06.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.445+0000 7f89fd9eb640 1 --2- 172.21.15.37:0/2188961959 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f89dc06ae70 0x7f89dc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:06.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.446+0000 7f89fd9eb640 1 --2- 172.21.15.37:0/2188961959 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f89dc06ae70 0x7f89dc06d330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f89f40011e0 tx=0x7f89f4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:06.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.449+0000 7f89ee7fc640 1 -- 172.21.15.37:0/2188961959 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f89f00543d0 con 0x7f89f815af50 2023-12-11T17:11:06.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.648+0000 7f89ffc4f640 1 -- 172.21.15.37:0/2188961959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f89f8074450 con 0x7f89f815af50 2023-12-11T17:11:06.650 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.649+0000 7f89ee7fc640 1 -- 172.21.15.37:0/2188961959 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7f89f0003e60 con 0x7f89f815af50 2023-12-11T17:11:06.650 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-11T17:11:06.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.654+0000 7f89ffc4f640 1 -- 172.21.15.37:0/2188961959 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f89dc06ae70 msgr2=0x7f89dc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:06.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.654+0000 7f89ffc4f640 1 --2- 172.21.15.37:0/2188961959 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f89dc06ae70 0x7f89dc06d330 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f89f40011e0 tx=0x7f89f4009040 comp rx=0 tx=0).stop 2023-12-11T17:11:06.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.654+0000 7f89ffc4f640 1 -- 172.21.15.37:0/2188961959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f815af50 msgr2=0x7f89f8141d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:06.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.654+0000 7f89ffc4f640 1 --2- 172.21.15.37:0/2188961959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f815af50 0x7f89f8141d50 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f89f000c6e0 tx=0x7f89f000cba0 comp rx=0 tx=0).stop 2023-12-11T17:11:06.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.654+0000 7f89ffc4f640 1 -- 172.21.15.37:0/2188961959 shutdown_connections 2023-12-11T17:11:06.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.654+0000 7f89ffc4f640 1 --2- 172.21.15.37:0/2188961959 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f89dc06ae70 0x7f89dc06d330 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:06.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.654+0000 7f89ffc4f640 1 --2- 172.21.15.37:0/2188961959 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f89f80ce7e0 0x7f89f8153540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:06.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.654+0000 7f89ffc4f640 1 --2- 172.21.15.37:0/2188961959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89f815af50 0x7f89f8141d50 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:06.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.654+0000 7f89ffc4f640 1 --2- 172.21.15.37:0/2188961959 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89f806a460 0x7f89f813fa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:06.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.654+0000 7f89ffc4f640 1 -- 172.21.15.37:0/2188961959 >> 172.21.15.37:0/2188961959 conn(0x7f89f80cee70 msgr2=0x7f89f80cf250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:06.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.654+0000 7f89ffc4f640 1 -- 172.21.15.37:0/2188961959 shutdown_connections 2023-12-11T17:11:06.656 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.654+0000 7f89ffc4f640 1 -- 172.21.15.37:0/2188961959 wait complete. 2023-12-11T17:11:06.673 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-11T17:11:06.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.901+0000 7f8946c09640 1 Processor -- start 2023-12-11T17:11:06.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.901+0000 7f8946c09640 1 -- start start 2023-12-11T17:11:06.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.902+0000 7f8946c09640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f894015d5f0 0x7f89400d1d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:06.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.903+0000 7f8946c09640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89400d3a50 0x7f89400cfaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:06.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.903+0000 7f8946c09640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f89400d0030 0x7f8940161000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:06.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.903+0000 7f8946c09640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f894015e620 con 0x7f894015d5f0 2023-12-11T17:11:06.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.903+0000 7f8946c09640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f894015ea40 con 0x7f89400d0030 2023-12-11T17:11:06.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.903+0000 7f8946c09640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89400d0480 con 0x7f89400d3a50 2023-12-11T17:11:06.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.903+0000 7f89449a5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f894015d5f0 0x7f89400d1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:06.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.903+0000 7f89449a5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f894015d5f0 0x7f89400d1d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47194/0 (socket says 172.21.15.37:47194) 2023-12-11T17:11:06.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.903+0000 7f89449a5640 1 -- 172.21.15.37:0/1427900791 learned_addr learned my addr 172.21.15.37:0/1427900791 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:06.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.903+0000 7f89449a5640 1 -- 172.21.15.37:0/1427900791 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89400d3a50 msgr2=0x7f89400cfaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:06.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.903+0000 7f89449a5640 1 --2- 172.21.15.37:0/1427900791 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89400d3a50 0x7f89400cfaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:06.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.903+0000 7f89449a5640 1 -- 172.21.15.37:0/1427900791 >> v2:172.21.15.151:3300/0 conn(0x7f89400d0030 msgr2=0x7f8940161000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:06.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.903+0000 7f89451a6640 1 --2- 172.21.15.37:0/1427900791 >> v2:172.21.15.151:3300/0 conn(0x7f89400d0030 0x7f8940161000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:06.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.904+0000 7f89449a5640 1 --2- 172.21.15.37:0/1427900791 >> v2:172.21.15.151:3300/0 conn(0x7f89400d0030 0x7f8940161000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:06.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.904+0000 7f89449a5640 1 -- 172.21.15.37:0/1427900791 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89400b2300 con 0x7f894015d5f0 2023-12-11T17:11:06.905 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.904+0000 7f89451a6640 1 --2- 172.21.15.37:0/1427900791 >> v2:172.21.15.151:3300/0 conn(0x7f89400d0030 0x7f8940161000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:06.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.905+0000 7f89449a5640 1 --2- 172.21.15.37:0/1427900791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f894015d5f0 0x7f89400d1d90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f894008c580 tx=0x7f893c02be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=934c8f824193a5dc server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:06.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.905+0000 7f89377fe640 1 -- 172.21.15.37:0/1427900791 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c02c9f0 con 0x7f894015d5f0 2023-12-11T17:11:06.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.905+0000 7f89377fe640 1 -- 172.21.15.37:0/1427900791 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c02cb50 con 0x7f894015d5f0 2023-12-11T17:11:06.906 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.905+0000 7f89377fe640 1 -- 172.21.15.37:0/1427900791 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c0343f0 con 0x7f894015d5f0 2023-12-11T17:11:06.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.906+0000 7f8946c09640 1 -- 172.21.15.37:0/1427900791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f894015d5f0 msgr2=0x7f89400d1d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:06.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.906+0000 7f8946c09640 1 --2- 172.21.15.37:0/1427900791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f894015d5f0 0x7f89400d1d90 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f894008c580 tx=0x7f893c02be50 comp rx=0 tx=0).stop 2023-12-11T17:11:06.907 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.906+0000 7f8946c09640 1 -- 172.21.15.37:0/1427900791 shutdown_connections 2023-12-11T17:11:06.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.906+0000 7f8946c09640 1 --2- 172.21.15.37:0/1427900791 >> v2:172.21.15.151:3300/0 conn(0x7f89400d0030 0x7f8940161000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:06.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.906+0000 7f8946c09640 1 --2- 172.21.15.37:0/1427900791 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89400d3a50 0x7f89400cfaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:06.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.906+0000 7f8946c09640 1 --2- 172.21.15.37:0/1427900791 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f894015d5f0 0x7f89400d1d90 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:06.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.906+0000 7f8946c09640 1 -- 172.21.15.37:0/1427900791 >> 172.21.15.37:0/1427900791 conn(0x7f894009c450 msgr2=0x7f89400d3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:06.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.906+0000 7f8946c09640 1 -- 172.21.15.37:0/1427900791 shutdown_connections 2023-12-11T17:11:06.908 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.906+0000 7f8946c09640 1 -- 172.21.15.37:0/1427900791 wait complete. 2023-12-11T17:11:06.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.908+0000 7f8946c09640 1 Processor -- start 2023-12-11T17:11:06.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.908+0000 7f8946c09640 1 -- start start 2023-12-11T17:11:06.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.909+0000 7f8946c09640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89400d0030 0x7f894014d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:06.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.909+0000 7f8946c09640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89400d3a50 0x7f8940149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:06.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.909+0000 7f8946c09640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f894015d5f0 0x7f89400b7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:06.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.909+0000 7f8946c09640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894014a3f0 con 0x7f89400d3a50 2023-12-11T17:11:06.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.909+0000 7f8946c09640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89400cd180 con 0x7f894015d5f0 2023-12-11T17:11:06.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.909+0000 7f8946c09640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89400b8280 con 0x7f89400d0030 2023-12-11T17:11:06.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.909+0000 7f8937fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89400d3a50 0x7f8940149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:06.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.909+0000 7f8937fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89400d3a50 0x7f8940149eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47204/0 (socket says 172.21.15.37:47204) 2023-12-11T17:11:06.911 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.910+0000 7f8937fff640 1 -- 172.21.15.37:0/401480630 learned_addr learned my addr 172.21.15.37:0/401480630 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:06.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.910+0000 7f8937fff640 1 -- 172.21.15.37:0/401480630 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89400d0030 msgr2=0x7f894014d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:06.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.910+0000 7f8937fff640 1 --2- 172.21.15.37:0/401480630 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89400d0030 0x7f894014d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:06.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.910+0000 7f8937fff640 1 -- 172.21.15.37:0/401480630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f894015d5f0 msgr2=0x7f89400b7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:06.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.910+0000 7f8937fff640 1 --2- 172.21.15.37:0/401480630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f894015d5f0 0x7f89400b7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:06.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.910+0000 7f8937fff640 1 -- 172.21.15.37:0/401480630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893c009b30 con 0x7f89400d3a50 2023-12-11T17:11:06.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.910+0000 7f8937fff640 1 --2- 172.21.15.37:0/401480630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89400d3a50 0x7f8940149eb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f893000b410 tx=0x7f893000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:06.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.910+0000 7f89357fa640 1 -- 172.21.15.37:0/401480630 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930011830 con 0x7f89400d3a50 2023-12-11T17:11:06.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.911+0000 7f89357fa640 1 -- 172.21.15.37:0/401480630 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89300119b0 con 0x7f89400d3a50 2023-12-11T17:11:06.912 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.911+0000 7f89357fa640 1 -- 172.21.15.37:0/401480630 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8930011d60 con 0x7f89400d3a50 2023-12-11T17:11:06.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.911+0000 7f8946c09640 1 -- 172.21.15.37:0/401480630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89400b8560 con 0x7f89400d3a50 2023-12-11T17:11:06.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.911+0000 7f8946c09640 1 -- 172.21.15.37:0/401480630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89400b8b20 con 0x7f89400d3a50 2023-12-11T17:11:06.913 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.912+0000 7f8946c09640 1 -- 172.21.15.37:0/401480630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89400745d0 con 0x7f89400d3a50 2023-12-11T17:11:06.914 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.913+0000 7f89357fa640 1 -- 172.21.15.37:0/401480630 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f893001a400 con 0x7f89400d3a50 2023-12-11T17:11:06.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.914+0000 7f89357fa640 1 --2- 172.21.15.37:0/401480630 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f892c06ae40 0x7f892c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:06.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.914+0000 7f89357fa640 1 -- 172.21.15.37:0/401480630 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f8930089c10 con 0x7f89400d3a50 2023-12-11T17:11:06.915 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.915+0000 7f89449a5640 1 --2- 172.21.15.37:0/401480630 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f892c06ae40 0x7f892c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:06.916 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.916+0000 7f89449a5640 1 --2- 172.21.15.37:0/401480630 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f892c06ae40 0x7f892c06d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f893c035000 tx=0x7f893c02e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:06.919 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:06.919+0000 7f89357fa640 1 -- 172.21.15.37:0/401480630 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8930054840 con 0x7f89400d3a50 2023-12-11T17:11:07.115 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.114+0000 7f8946c09640 1 -- 172.21.15.37:0/401480630 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7f89400d3830 con 0x7f89400d3a50 2023-12-11T17:11:07.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.116+0000 7f89357fa640 1 -- 172.21.15.37:0/401480630 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7f8930015020 con 0x7f89400d3a50 2023-12-11T17:11:07.117 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:11:07.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.118+0000 7f8946c09640 1 -- 172.21.15.37:0/401480630 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f892c06ae40 msgr2=0x7f892c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:07.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.118+0000 7f8946c09640 1 --2- 172.21.15.37:0/401480630 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f892c06ae40 0x7f892c06d300 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f893c035000 tx=0x7f893c02e000 comp rx=0 tx=0).stop 2023-12-11T17:11:07.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.118+0000 7f8946c09640 1 -- 172.21.15.37:0/401480630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89400d3a50 msgr2=0x7f8940149eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:07.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.118+0000 7f8946c09640 1 --2- 172.21.15.37:0/401480630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89400d3a50 0x7f8940149eb0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f893000b410 tx=0x7f893000b8d0 comp rx=0 tx=0).stop 2023-12-11T17:11:07.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.119+0000 7f8946c09640 1 -- 172.21.15.37:0/401480630 shutdown_connections 2023-12-11T17:11:07.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.119+0000 7f8946c09640 1 --2- 172.21.15.37:0/401480630 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f892c06ae40 0x7f892c06d300 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:07.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.119+0000 7f8946c09640 1 --2- 172.21.15.37:0/401480630 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f894015d5f0 0x7f89400b7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:07.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.119+0000 7f8946c09640 1 --2- 172.21.15.37:0/401480630 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f89400d3a50 0x7f8940149eb0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:07.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.119+0000 7f8946c09640 1 --2- 172.21.15.37:0/401480630 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f89400d0030 0x7f894014d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:07.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.119+0000 7f8946c09640 1 -- 172.21.15.37:0/401480630 >> 172.21.15.37:0/401480630 conn(0x7f894009c450 msgr2=0x7f89400afdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:07.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.119+0000 7f8946c09640 1 -- 172.21.15.37:0/401480630 shutdown_connections 2023-12-11T17:11:07.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.119+0000 7f8946c09640 1 -- 172.21.15.37:0/401480630 wait complete. 2023-12-11T17:11:07.140 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-11T17:11:07.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.372+0000 7ff378eff640 1 Processor -- start 2023-12-11T17:11:07.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.373+0000 7ff378eff640 1 -- start start 2023-12-11T17:11:07.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.374+0000 7ff378eff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff37415e5d0 0x7ff37406bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:07.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.375+0000 7ff378eff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff374071f90 con 0x7ff374071260 2023-12-11T17:11:07.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.375+0000 7ff378eff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff374072270 con 0x7ff3740ae200 2023-12-11T17:11:07.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.375+0000 7ff378eff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff374070070 con 0x7ff37415e5d0 2023-12-11T17:11:07.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.375+0000 7ff373fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff374071260 0x7ff3740cded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34320/0 (socket says 172.21.15.37:34320) 2023-12-11T17:11:07.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.375+0000 7ff373fff640 1 -- 172.21.15.37:0/3039313730 learned_addr learned my addr 172.21.15.37:0/3039313730 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:07.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.375+0000 7ff3737fe640 1 --2- 172.21.15.37:0/3039313730 >> v2:172.21.15.151:3300/0 conn(0x7ff37415e5d0 0x7ff37406bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:07.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.375+0000 7ff3727fc640 1 -- 172.21.15.37:0/3039313730 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 684357912 0 0) 0x7ff374071f90 con 0x7ff374071260 2023-12-11T17:11:07.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.376+0000 7ff3727fc640 1 -- 172.21.15.37:0/3039313730 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff35c003520 con 0x7ff374071260 2023-12-11T17:11:07.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.376+0000 7ff3727fc640 1 -- 172.21.15.37:0/3039313730 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3038386927 0 0) 0x7ff35c003520 con 0x7ff374071260 2023-12-11T17:11:07.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.376+0000 7ff3727fc640 1 -- 172.21.15.37:0/3039313730 >> v2:172.21.15.151:3300/0 conn(0x7ff37415e5d0 msgr2=0x7ff37406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:07.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.376+0000 7ff3727fc640 1 --2- 172.21.15.37:0/3039313730 >> v2:172.21.15.151:3300/0 conn(0x7ff37415e5d0 0x7ff37406bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:07.378 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.376+0000 7ff3727fc640 1 -- 172.21.15.37:0/3039313730 >> v1:172.21.15.151:6789/0 conn(0x7ff3740ae200 legacy=0x7ff374070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:07.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.376+0000 7ff3727fc640 1 -- 172.21.15.37:0/3039313730 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff374070350 con 0x7ff374071260 2023-12-11T17:11:07.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.376+0000 7ff3727fc640 1 -- 172.21.15.37:0/3039313730 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7ff36c0019f0 con 0x7ff374071260 2023-12-11T17:11:07.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.376+0000 7ff3727fc640 1 -- 172.21.15.37:0/3039313730 >> v1:172.21.15.37:6789/0 conn(0x7ff374071260 legacy=0x7ff3740cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:07.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.376+0000 7ff3727fc640 1 --2- 172.21.15.37:0/3039313730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff35c003970 0x7ff35c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:07.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.376+0000 7ff3727fc640 1 --2- 172.21.15.37:0/3039313730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff35c0047c0 0x7ff35c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:07.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.376+0000 7ff3727fc640 1 --2- 172.21.15.37:0/3039313730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff35c005180 0x7ff35c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:07.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.376+0000 7ff3727fc640 1 -- 172.21.15.37:0/3039313730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff374070070 con 0x7ff35c003970 2023-12-11T17:11:07.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.376+0000 7ff3727fc640 1 -- 172.21.15.37:0/3039313730 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c00c120 con 0x7ff35c005180 2023-12-11T17:11:07.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.376+0000 7ff3727fc640 1 -- 172.21.15.37:0/3039313730 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff35c00c2e0 con 0x7ff35c0047c0 2023-12-11T17:11:07.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.376+0000 7ff3737fe640 1 --2- 172.21.15.37:0/3039313730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff35c003970 0x7ff35c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:07.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.377+0000 7ff373fff640 1 --2- 172.21.15.37:0/3039313730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff35c005180 0x7ff35c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:07.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.377+0000 7ff372ffd640 1 --2- 172.21.15.37:0/3039313730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff35c0047c0 0x7ff35c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:07.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.377+0000 7ff3737fe640 1 -- 172.21.15.37:0/3039313730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff35c0047c0 msgr2=0x7ff35c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:07.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.377+0000 7ff3737fe640 1 --2- 172.21.15.37:0/3039313730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff35c0047c0 0x7ff35c004c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:07.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.377+0000 7ff3737fe640 1 -- 172.21.15.37:0/3039313730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff35c005180 msgr2=0x7ff35c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:07.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.377+0000 7ff3737fe640 1 --2- 172.21.15.37:0/3039313730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff35c005180 0x7ff35c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:07.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.377+0000 7ff3737fe640 1 -- 172.21.15.37:0/3039313730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff35c003520 con 0x7ff35c003970 2023-12-11T17:11:07.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.377+0000 7ff373fff640 1 --2- 172.21.15.37:0/3039313730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff35c005180 0x7ff35c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:07.380 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.377+0000 7ff373fff640 1 -- 172.21.15.37:0/3039313730 reap_dead start 2023-12-11T17:11:07.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.378+0000 7ff3737fe640 1 --2- 172.21.15.37:0/3039313730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff35c003970 0x7ff35c003d90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff364009ac0 tx=0x7ff35c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcaa18dc53e77813 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:07.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.378+0000 7ff3727fc640 1 -- 172.21.15.37:0/3039313730 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36402c6b0 con 0x7ff35c003970 2023-12-11T17:11:07.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.379+0000 7ff3727fc640 1 -- 172.21.15.37:0/3039313730 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36402c810 con 0x7ff35c003970 2023-12-11T17:11:07.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.379+0000 7ff3727fc640 1 -- 172.21.15.37:0/3039313730 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36402cba0 con 0x7ff35c003970 2023-12-11T17:11:07.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.379+0000 7ff378eff640 1 -- 172.21.15.37:0/3039313730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff35c003970 msgr2=0x7ff35c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:07.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.379+0000 7ff378eff640 1 --2- 172.21.15.37:0/3039313730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff35c003970 0x7ff35c003d90 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7ff364009ac0 tx=0x7ff35c0057f0 comp rx=0 tx=0).stop 2023-12-11T17:11:07.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.379+0000 7ff378eff640 1 -- 172.21.15.37:0/3039313730 shutdown_connections 2023-12-11T17:11:07.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.379+0000 7ff378eff640 1 --2- 172.21.15.37:0/3039313730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff35c003970 0x7ff35c003d90 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:07.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.379+0000 7ff378eff640 1 -- 172.21.15.37:0/3039313730 >> 172.21.15.37:0/3039313730 conn(0x7ff3740b0860 msgr2=0x7ff3740b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:07.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.379+0000 7ff378eff640 1 -- 172.21.15.37:0/3039313730 shutdown_connections 2023-12-11T17:11:07.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.379+0000 7ff378eff640 1 -- 172.21.15.37:0/3039313730 wait complete. 2023-12-11T17:11:07.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.381+0000 7ff378eff640 1 Processor -- start 2023-12-11T17:11:07.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.381+0000 7ff378eff640 1 -- start start 2023-12-11T17:11:07.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.382+0000 7ff378eff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff35c003970 0x7ff374142ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.382+0000 7ff378eff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff374151bb0 0x7ff374145ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.382+0000 7ff378eff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3740b2c00 0x7ff3741555c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.382+0000 7ff378eff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3740b1950 con 0x7ff3740b2c00 2023-12-11T17:11:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.382+0000 7ff378eff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff3740b2770 con 0x7ff374151bb0 2023-12-11T17:11:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.382+0000 7ff378eff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3741431e0 con 0x7ff35c003970 2023-12-11T17:11:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.383+0000 7ff373fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3740b2c00 0x7ff3741555c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.383+0000 7ff373fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3740b2c00 0x7ff3741555c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47232/0 (socket says 172.21.15.37:47232) 2023-12-11T17:11:07.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.383+0000 7ff373fff640 1 -- 172.21.15.37:0/1973969057 learned_addr learned my addr 172.21.15.37:0/1973969057 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:07.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.383+0000 7ff372ffd640 1 --2- 172.21.15.37:0/1973969057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff374151bb0 0x7ff374145ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:07.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.383+0000 7ff373fff640 1 -- 172.21.15.37:0/1973969057 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff35c003970 msgr2=0x7ff374142ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:07.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.383+0000 7ff373fff640 1 --2- 172.21.15.37:0/1973969057 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff35c003970 0x7ff374142ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:07.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.383+0000 7ff373fff640 1 -- 172.21.15.37:0/1973969057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff374151bb0 msgr2=0x7ff374145ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:07.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.383+0000 7ff373fff640 1 --2- 172.21.15.37:0/1973969057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff374151bb0 0x7ff374145ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:07.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.383+0000 7ff373fff640 1 -- 172.21.15.37:0/1973969057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3740b1b60 con 0x7ff3740b2c00 2023-12-11T17:11:07.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.383+0000 7ff373fff640 1 --2- 172.21.15.37:0/1973969057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3740b2c00 0x7ff3741555c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff3740cdc90 tx=0x7ff36c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:07.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.384+0000 7ff35bfff640 1 -- 172.21.15.37:0/1973969057 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c004d60 con 0x7ff3740b2c00 2023-12-11T17:11:07.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.384+0000 7ff35bfff640 1 -- 172.21.15.37:0/1973969057 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36c00bb80 con 0x7ff3740b2c00 2023-12-11T17:11:07.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.384+0000 7ff35bfff640 1 -- 172.21.15.37:0/1973969057 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36c007070 con 0x7ff3740b2c00 2023-12-11T17:11:07.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.384+0000 7ff378eff640 1 -- 172.21.15.37:0/1973969057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff3740b1e40 con 0x7ff3740b2c00 2023-12-11T17:11:07.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.384+0000 7ff378eff640 1 -- 172.21.15.37:0/1973969057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff3740b2400 con 0x7ff3740b2c00 2023-12-11T17:11:07.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.385+0000 7ff378eff640 1 -- 172.21.15.37:0/1973969057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff3740b2590 con 0x7ff3740b2c00 2023-12-11T17:11:07.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.386+0000 7ff35bfff640 1 -- 172.21.15.37:0/1973969057 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff36c0071d0 con 0x7ff3740b2c00 2023-12-11T17:11:07.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.387+0000 7ff35bfff640 1 --2- 172.21.15.37:0/1973969057 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff36006ae70 0x7ff36006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:07.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.387+0000 7ff35bfff640 1 -- 172.21.15.37:0/1973969057 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7ff36c0897d0 con 0x7ff3740b2c00 2023-12-11T17:11:07.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.388+0000 7ff3737fe640 1 --2- 172.21.15.37:0/1973969057 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff36006ae70 0x7ff36006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:07.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.389+0000 7ff3737fe640 1 --2- 172.21.15.37:0/1973969057 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff36006ae70 0x7ff36006d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff364036000 tx=0x7ff36402e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:07.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.391+0000 7ff35bfff640 1 -- 172.21.15.37:0/1973969057 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff36c054490 con 0x7ff3740b2c00 2023-12-11T17:11:07.603 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.602+0000 7ff378eff640 1 -- 172.21.15.37:0/1973969057 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ff3740b2920 con 0x7ff3740b2c00 2023-12-11T17:11:07.604 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.603+0000 7ff35bfff640 1 -- 172.21.15.37:0/1973969057 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v27) v1 ==== 80+0+0 (secure 0 0 0) 0x7ff3740b2920 con 0x7ff3740b2c00 2023-12-11T17:11:07.604 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-12-11T17:11:07.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.606+0000 7ff378eff640 1 -- 172.21.15.37:0/1973969057 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff36006ae70 msgr2=0x7ff36006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:07.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.606+0000 7ff378eff640 1 --2- 172.21.15.37:0/1973969057 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff36006ae70 0x7ff36006d330 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7ff364036000 tx=0x7ff36402e000 comp rx=0 tx=0).stop 2023-12-11T17:11:07.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.606+0000 7ff378eff640 1 -- 172.21.15.37:0/1973969057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3740b2c00 msgr2=0x7ff3741555c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:07.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.606+0000 7ff378eff640 1 --2- 172.21.15.37:0/1973969057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3740b2c00 0x7ff3741555c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7ff3740cdc90 tx=0x7ff36c00b4a0 comp rx=0 tx=0).stop 2023-12-11T17:11:07.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.606+0000 7ff378eff640 1 -- 172.21.15.37:0/1973969057 shutdown_connections 2023-12-11T17:11:07.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.606+0000 7ff378eff640 1 --2- 172.21.15.37:0/1973969057 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff36006ae70 0x7ff36006d330 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:07.607 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.606+0000 7ff378eff640 1 --2- 172.21.15.37:0/1973969057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff374151bb0 0x7ff374145ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:07.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.606+0000 7ff378eff640 1 --2- 172.21.15.37:0/1973969057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff3740b2c00 0x7ff3741555c0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:07.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.606+0000 7ff378eff640 1 --2- 172.21.15.37:0/1973969057 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff35c003970 0x7ff374142ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:07.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.606+0000 7ff378eff640 1 -- 172.21.15.37:0/1973969057 >> 172.21.15.37:0/1973969057 conn(0x7ff3740b0860 msgr2=0x7ff3740af060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:07.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.606+0000 7ff378eff640 1 -- 172.21.15.37:0/1973969057 shutdown_connections 2023-12-11T17:11:07.608 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:07.606+0000 7ff378eff640 1 -- 172.21.15.37:0/1973969057 wait complete. 2023-12-11T17:11:07.625 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-12-11T17:11:07.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:11:07.625 DEBUG:teuthology.orchestra.run.smithi151:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-12-11T17:11:07.734 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-12-11T17:11:07.735 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:11:07.735 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-11T17:11:07.789 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-11T17:11:07.789 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T17:11:08.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.023+0000 7f9c22635640 1 Processor -- start 2023-12-11T17:11:08.025 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.024+0000 7f9c22635640 1 -- start start 2023-12-11T17:11:08.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.025+0000 7f9c22635640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9c1c0cee00 0x7f9c1c15bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:08.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.025+0000 7f9c22635640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c1c06e8d0 0x7f9c1c06ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:08.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.025+0000 7f9c22635640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1c15c500 con 0x7f9c1c158c30 2023-12-11T17:11:08.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.025+0000 7f9c22635640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c1c06f280 con 0x7f9c1c0cee00 2023-12-11T17:11:08.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.025+0000 7f9c22635640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c0cd270 con 0x7f9c1c06e8d0 2023-12-11T17:11:08.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.026+0000 7f9c21e34640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c1c06e8d0 0x7f9c1c06ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:08.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.026+0000 7f9c21633640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f9c1c158c30 0x7f9c1c0ccab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.37:52194/0 (socket says 172.21.15.37:52194) 2023-12-11T17:11:08.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.026+0000 7f9c21633640 1 -- 172.21.15.37:0/450253337 learned_addr learned my addr 172.21.15.37:0/450253337 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:08.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.026+0000 7f9c20e32640 1 --2- 172.21.15.37:0/450253337 >> v2:172.21.15.151:3300/0 conn(0x7f9c1c0cee00 0x7f9c1c15bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:08.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.027+0000 7f9c21e34640 1 -- 172.21.15.37:0/450253337 >> v2:172.21.15.151:3300/0 conn(0x7f9c1c0cee00 msgr2=0x7f9c1c15bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:08.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.027+0000 7f9c21e34640 1 --2- 172.21.15.37:0/450253337 >> v2:172.21.15.151:3300/0 conn(0x7f9c1c0cee00 0x7f9c1c15bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:08.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.027+0000 7f9c21e34640 1 -- 172.21.15.37:0/450253337 >> v1:172.21.15.151:6789/0 conn(0x7f9c1c158c30 legacy=0x7f9c1c0ccab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:08.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.027+0000 7f9c21e34640 1 -- 172.21.15.37:0/450253337 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1c0cd550 con 0x7f9c1c06e8d0 2023-12-11T17:11:08.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.029+0000 7f9c21e34640 1 --2- 172.21.15.37:0/450253337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c1c06e8d0 0x7f9c1c06ed40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9c140097a0 tx=0x7f9c1402b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7670ee0e0677bbc8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:08.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.029+0000 7f9c1bfff640 1 -- 172.21.15.37:0/450253337 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c14031830 con 0x7f9c1c06e8d0 2023-12-11T17:11:08.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.029+0000 7f9c1bfff640 1 -- 172.21.15.37:0/450253337 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c14031990 con 0x7f9c1c06e8d0 2023-12-11T17:11:08.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.030+0000 7f9c1bfff640 1 -- 172.21.15.37:0/450253337 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c14031d20 con 0x7f9c1c06e8d0 2023-12-11T17:11:08.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.030+0000 7f9c22635640 1 -- 172.21.15.37:0/450253337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c1c06e8d0 msgr2=0x7f9c1c06ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:08.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.030+0000 7f9c22635640 1 --2- 172.21.15.37:0/450253337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c1c06e8d0 0x7f9c1c06ed40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9c140097a0 tx=0x7f9c1402b8d0 comp rx=0 tx=0).stop 2023-12-11T17:11:08.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.030+0000 7f9c22635640 1 -- 172.21.15.37:0/450253337 shutdown_connections 2023-12-11T17:11:08.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.030+0000 7f9c22635640 1 --2- 172.21.15.37:0/450253337 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c1c06e8d0 0x7f9c1c06ed40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:08.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.030+0000 7f9c22635640 1 --2- 172.21.15.37:0/450253337 >> v2:172.21.15.151:3300/0 conn(0x7f9c1c0cee00 0x7f9c1c15bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:08.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.030+0000 7f9c22635640 1 -- 172.21.15.37:0/450253337 >> 172.21.15.37:0/450253337 conn(0x7f9c1c070b20 msgr2=0x7f9c1c070f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:08.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.030+0000 7f9c22635640 1 -- 172.21.15.37:0/450253337 shutdown_connections 2023-12-11T17:11:08.032 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.030+0000 7f9c22635640 1 -- 172.21.15.37:0/450253337 wait complete. 2023-12-11T17:11:08.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.032+0000 7f9c22635640 1 Processor -- start 2023-12-11T17:11:08.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.032+0000 7f9c22635640 1 -- start start 2023-12-11T17:11:08.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.033+0000 7f9c22635640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c1c06e8d0 0x7f9c1c1428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:08.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.033+0000 7f9c22635640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c1c0cee00 0x7f9c1c0c7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:08.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.033+0000 7f9c22635640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c1c158c30 0x7f9c1c0ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:08.035 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.033+0000 7f9c22635640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c142df0 con 0x7f9c1c06e8d0 2023-12-11T17:11:08.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.033+0000 7f9c22635640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c0cb240 con 0x7f9c1c0cee00 2023-12-11T17:11:08.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.033+0000 7f9c22635640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c0ca9a0 con 0x7f9c1c158c30 2023-12-11T17:11:08.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.034+0000 7f9c21633640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c1c06e8d0 0x7f9c1c1428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:08.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.034+0000 7f9c21633640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c1c06e8d0 0x7f9c1c1428b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47234/0 (socket says 172.21.15.37:47234) 2023-12-11T17:11:08.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.034+0000 7f9c21633640 1 -- 172.21.15.37:0/2565812107 learned_addr learned my addr 172.21.15.37:0/2565812107 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:08.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.034+0000 7f9c20e32640 1 --2- 172.21.15.37:0/2565812107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c1c0cee00 0x7f9c1c0c7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:08.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.034+0000 7f9c21e34640 1 --2- 172.21.15.37:0/2565812107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c1c158c30 0x7f9c1c0ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:08.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.034+0000 7f9c21633640 1 -- 172.21.15.37:0/2565812107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c1c158c30 msgr2=0x7f9c1c0ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:08.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.034+0000 7f9c21633640 1 --2- 172.21.15.37:0/2565812107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c1c158c30 0x7f9c1c0ac860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:08.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.034+0000 7f9c21633640 1 -- 172.21.15.37:0/2565812107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c1c0cee00 msgr2=0x7f9c1c0c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:08.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.034+0000 7f9c21633640 1 --2- 172.21.15.37:0/2565812107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c1c0cee00 0x7f9c1c0c7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:08.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.034+0000 7f9c21633640 1 -- 172.21.15.37:0/2565812107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c14009400 con 0x7f9c1c06e8d0 2023-12-11T17:11:08.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.034+0000 7f9c21e34640 1 --2- 172.21.15.37:0/2565812107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c1c158c30 0x7f9c1c0ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:08.036 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.034+0000 7f9c20e32640 1 --2- 172.21.15.37:0/2565812107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c1c0cee00 0x7f9c1c0c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:08.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.035+0000 7f9c21633640 1 --2- 172.21.15.37:0/2565812107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c1c06e8d0 0x7f9c1c1428b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000ca70 tx=0x7f9c1000cf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:08.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.035+0000 7f9c19ffb640 1 -- 172.21.15.37:0/2565812107 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1000abd0 con 0x7f9c1c06e8d0 2023-12-11T17:11:08.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.035+0000 7f9c19ffb640 1 -- 172.21.15.37:0/2565812107 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1000ad30 con 0x7f9c1c06e8d0 2023-12-11T17:11:08.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.035+0000 7f9c19ffb640 1 -- 172.21.15.37:0/2565812107 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c10012620 con 0x7f9c1c06e8d0 2023-12-11T17:11:08.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.035+0000 7f9c22635640 1 -- 172.21.15.37:0/2565812107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c1c0cac80 con 0x7f9c1c06e8d0 2023-12-11T17:11:08.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.035+0000 7f9c22635640 1 -- 172.21.15.37:0/2565812107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c1c143100 con 0x7f9c1c06e8d0 2023-12-11T17:11:08.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.036+0000 7f9c22635640 1 -- 172.21.15.37:0/2565812107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c1c143320 con 0x7f9c1c06e8d0 2023-12-11T17:11:08.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.037+0000 7f9c19ffb640 1 -- 172.21.15.37:0/2565812107 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9c10007070 con 0x7f9c1c06e8d0 2023-12-11T17:11:08.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.038+0000 7f9c19ffb640 1 --2- 172.21.15.37:0/2565812107 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9c0006ae40 0x7f9c0006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:08.039 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.038+0000 7f9c19ffb640 1 -- 172.21.15.37:0/2565812107 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f9c100897c0 con 0x7f9c1c06e8d0 2023-12-11T17:11:08.040 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.039+0000 7f9c20e32640 1 --2- 172.21.15.37:0/2565812107 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9c0006ae40 0x7f9c0006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:08.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.040+0000 7f9c20e32640 1 --2- 172.21.15.37:0/2565812107 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9c0006ae40 0x7f9c0006d300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c1f64a0 tx=0x7f9c08008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:08.043 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.043+0000 7f9c19ffb640 1 -- 172.21.15.37:0/2565812107 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9c10054480 con 0x7f9c1c06e8d0 2023-12-11T17:11:08.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.276+0000 7f9c22635640 1 -- 172.21.15.37:0/2565812107 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c1c15c500 con 0x7f9c1c06e8d0 2023-12-11T17:11:08.279 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.278+0000 7f9c19ffb640 1 -- 172.21.15.37:0/2565812107 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f9c1c15c500 con 0x7f9c1c06e8d0 2023-12-11T17:11:08.279 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:11:08.279 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2395601865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2395601865},{"type":"v1","addr":"172.21.15.151:6835","nonce":2395601865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1535809271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1535809271},{"type":"v1","addr":"172.21.15.151:6837","nonce":1535809271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2590175074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2590175074},{"type":"v1","addr":"172.21.15.37:6833","nonce":2590175074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-11T17:09:44.643511+0000","modified":"2023-12-11T17:10:12.829357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/2348606057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2348606057},{"type":"v1","addr":"172.21.15.37:6835","nonce":2348606057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T17:11:08.279 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-12-11T17:11:08.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.280+0000 7f9c22635640 1 -- 172.21.15.37:0/2565812107 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9c0006ae40 msgr2=0x7f9c0006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:08.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.281+0000 7f9c22635640 1 --2- 172.21.15.37:0/2565812107 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9c0006ae40 0x7f9c0006d300 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c1f64a0 tx=0x7f9c08008040 comp rx=0 tx=0).stop 2023-12-11T17:11:08.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.281+0000 7f9c22635640 1 -- 172.21.15.37:0/2565812107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c1c06e8d0 msgr2=0x7f9c1c1428b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:08.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.281+0000 7f9c22635640 1 --2- 172.21.15.37:0/2565812107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c1c06e8d0 0x7f9c1c1428b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f9c1000ca70 tx=0x7f9c1000cf30 comp rx=0 tx=0).stop 2023-12-11T17:11:08.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.281+0000 7f9c22635640 1 -- 172.21.15.37:0/2565812107 shutdown_connections 2023-12-11T17:11:08.282 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.281+0000 7f9c22635640 1 --2- 172.21.15.37:0/2565812107 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f9c0006ae40 0x7f9c0006d300 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:08.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.281+0000 7f9c22635640 1 --2- 172.21.15.37:0/2565812107 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9c1c0cee00 0x7f9c1c0c7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:08.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.281+0000 7f9c22635640 1 --2- 172.21.15.37:0/2565812107 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9c1c158c30 0x7f9c1c0ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:08.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.281+0000 7f9c22635640 1 --2- 172.21.15.37:0/2565812107 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9c1c06e8d0 0x7f9c1c1428b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:08.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.281+0000 7f9c22635640 1 -- 172.21.15.37:0/2565812107 >> 172.21.15.37:0/2565812107 conn(0x7f9c1c070b20 msgr2=0x7f9c1c0ccab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:08.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.281+0000 7f9c22635640 1 -- 172.21.15.37:0/2565812107 shutdown_connections 2023-12-11T17:11:08.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.281+0000 7f9c22635640 1 -- 172.21.15.37:0/2565812107 wait complete. 2023-12-11T17:11:08.303 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:11:08.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.534+0000 7f1d2cdea640 1 Processor -- start 2023-12-11T17:11:08.535 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.534+0000 7f1d2cdea640 1 -- start start 2023-12-11T17:11:08.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.536+0000 7f1d2cdea640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d2806e2b0 0x7f1d280ce4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:08.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.536+0000 7f1d2cdea640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d2806dc50 con 0x7f1d280cc8f0 2023-12-11T17:11:08.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.536+0000 7f1d2cdea640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d280cea30 con 0x7f1d2806c410 2023-12-11T17:11:08.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.536+0000 7f1d2cdea640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2806d040 con 0x7f1d2806e2b0 2023-12-11T17:11:08.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.536+0000 7f1d26d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1d280cc8f0 0x7f1d280ccda0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34332/0 (socket says 172.21.15.37:34332) 2023-12-11T17:11:08.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.536+0000 7f1d26d9d640 1 -- 172.21.15.37:0/1227576019 learned_addr learned my addr 172.21.15.37:0/1227576019 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:08.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.537+0000 7f1d2659c640 1 --2- 172.21.15.37:0/1227576019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d2806e2b0 0x7f1d280ce4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:08.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.537+0000 7f1d2559a640 1 -- 172.21.15.37:0/1227576019 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881383149 0 0) 0x7f1d2806dc50 con 0x7f1d280cc8f0 2023-12-11T17:11:08.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.537+0000 7f1d2559a640 1 -- 172.21.15.37:0/1227576019 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d10003520 con 0x7f1d280cc8f0 2023-12-11T17:11:08.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.537+0000 7f1d2559a640 1 -- 172.21.15.37:0/1227576019 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2937202894 0 0) 0x7f1d10003520 con 0x7f1d280cc8f0 2023-12-11T17:11:08.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.537+0000 7f1d2559a640 1 -- 172.21.15.37:0/1227576019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d2806e2b0 msgr2=0x7f1d280ce4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:08.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.537+0000 7f1d2559a640 1 --2- 172.21.15.37:0/1227576019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d2806e2b0 0x7f1d280ce4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:08.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.537+0000 7f1d2559a640 1 -- 172.21.15.37:0/1227576019 >> v1:172.21.15.151:6789/0 conn(0x7f1d2806c410 legacy=0x7f1d2806c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:08.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.537+0000 7f1d2559a640 1 -- 172.21.15.37:0/1227576019 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d2806d320 con 0x7f1d280cc8f0 2023-12-11T17:11:08.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.537+0000 7f1d2559a640 1 -- 172.21.15.37:0/1227576019 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f1d200019f0 con 0x7f1d280cc8f0 2023-12-11T17:11:08.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.537+0000 7f1d2559a640 1 -- 172.21.15.37:0/1227576019 >> v1:172.21.15.37:6789/0 conn(0x7f1d280cc8f0 legacy=0x7f1d280ccda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:08.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.537+0000 7f1d2559a640 1 --2- 172.21.15.37:0/1227576019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d2806e2b0 0x7f1d100039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:08.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.537+0000 7f1d2559a640 1 --2- 172.21.15.37:0/1227576019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d10003f70 0x7f1d100047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:08.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.538+0000 7f1d2559a640 1 --2- 172.21.15.37:0/1227576019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d10004d00 0x7f1d10005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:08.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.538+0000 7f1d2559a640 1 -- 172.21.15.37:0/1227576019 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2806d040 con 0x7f1d10003f70 2023-12-11T17:11:08.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.538+0000 7f1d2559a640 1 -- 172.21.15.37:0/1227576019 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1000bb70 con 0x7f1d10004d00 2023-12-11T17:11:08.539 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.538+0000 7f1d2559a640 1 -- 172.21.15.37:0/1227576019 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d1000bd30 con 0x7f1d2806e2b0 2023-12-11T17:11:08.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.538+0000 7f1d2659c640 1 --2- 172.21.15.37:0/1227576019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d2806e2b0 0x7f1d100039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:08.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.538+0000 7f1d26d9d640 1 --2- 172.21.15.37:0/1227576019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d10004d00 0x7f1d10005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:08.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.538+0000 7f1d25d9b640 1 --2- 172.21.15.37:0/1227576019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d10003f70 0x7f1d100047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:08.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.539+0000 7f1d2659c640 1 -- 172.21.15.37:0/1227576019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d10004d00 msgr2=0x7f1d10005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:08.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.539+0000 7f1d2659c640 1 --2- 172.21.15.37:0/1227576019 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d10004d00 0x7f1d10005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:08.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.539+0000 7f1d2659c640 1 -- 172.21.15.37:0/1227576019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d10003f70 msgr2=0x7f1d100047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:08.540 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.539+0000 7f1d2659c640 1 --2- 172.21.15.37:0/1227576019 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d10003f70 0x7f1d100047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:08.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.539+0000 7f1d2659c640 1 -- 172.21.15.37:0/1227576019 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d10003520 con 0x7f1d2806e2b0 2023-12-11T17:11:08.541 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.540+0000 7f1d2659c640 1 --2- 172.21.15.37:0/1227576019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d2806e2b0 0x7f1d100039a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800aac0 tx=0x7f1d100057f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9f94a1712f962e8b server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:08.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.541+0000 7f1d2559a640 1 -- 172.21.15.37:0/1227576019 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d18034600 con 0x7f1d2806e2b0 2023-12-11T17:11:08.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.541+0000 7f1d2559a640 1 -- 172.21.15.37:0/1227576019 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d18030050 con 0x7f1d2806e2b0 2023-12-11T17:11:08.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.541+0000 7f1d2559a640 1 -- 172.21.15.37:0/1227576019 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d18034980 con 0x7f1d2806e2b0 2023-12-11T17:11:08.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.542+0000 7f1d2cdea640 1 -- 172.21.15.37:0/1227576019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d2806e2b0 msgr2=0x7f1d100039a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:08.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.542+0000 7f1d2cdea640 1 --2- 172.21.15.37:0/1227576019 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d2806e2b0 0x7f1d100039a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800aac0 tx=0x7f1d100057f0 comp rx=0 tx=0).stop 2023-12-11T17:11:08.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.542+0000 7f1d26d9d640 1 -- 172.21.15.37:0/1227576019 reap_dead start 2023-12-11T17:11:08.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.542+0000 7f1d2cdea640 1 -- 172.21.15.37:0/1227576019 shutdown_connections 2023-12-11T17:11:08.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.542+0000 7f1d2cdea640 1 -- 172.21.15.37:0/1227576019 >> 172.21.15.37:0/1227576019 conn(0x7f1d280b0a90 msgr2=0x7f1d280b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:08.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.542+0000 7f1d2cdea640 1 -- 172.21.15.37:0/1227576019 shutdown_connections 2023-12-11T17:11:08.543 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.542+0000 7f1d2cdea640 1 -- 172.21.15.37:0/1227576019 wait complete. 2023-12-11T17:11:08.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.544+0000 7f1d2cdea640 1 Processor -- start 2023-12-11T17:11:08.545 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.544+0000 7f1d2cdea640 1 -- start start 2023-12-11T17:11:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.545+0000 7f1d2cdea640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2806e2b0 0x7f1d28145b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.545+0000 7f1d2cdea640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d28148620 0x7f1d28145360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.545+0000 7f1d2cdea640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d28147270 0x7f1d280ccd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.545+0000 7f1d2cdea640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d28146de0 con 0x7f1d2806e2b0 2023-12-11T17:11:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.545+0000 7f1d2cdea640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d281458a0 con 0x7f1d28148620 2023-12-11T17:11:08.546 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.545+0000 7f1d2cdea640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d281461d0 con 0x7f1d28147270 2023-12-11T17:11:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.546+0000 7f1d2659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2806e2b0 0x7f1d28145b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.546+0000 7f1d2659c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2806e2b0 0x7f1d28145b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47266/0 (socket says 172.21.15.37:47266) 2023-12-11T17:11:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.546+0000 7f1d2659c640 1 -- 172.21.15.37:0/3815899601 learned_addr learned my addr 172.21.15.37:0/3815899601 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.546+0000 7f1d25d9b640 1 --2- 172.21.15.37:0/3815899601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d28148620 0x7f1d28145360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.546+0000 7f1d26d9d640 1 --2- 172.21.15.37:0/3815899601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d28147270 0x7f1d280ccd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.546+0000 7f1d2659c640 1 -- 172.21.15.37:0/3815899601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d28147270 msgr2=0x7f1d280ccd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.546+0000 7f1d2659c640 1 --2- 172.21.15.37:0/3815899601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d28147270 0x7f1d280ccd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:08.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.546+0000 7f1d2659c640 1 -- 172.21.15.37:0/3815899601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d28148620 msgr2=0x7f1d28145360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:08.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.546+0000 7f1d2659c640 1 --2- 172.21.15.37:0/3815899601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d28148620 0x7f1d28145360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:08.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.546+0000 7f1d2659c640 1 -- 172.21.15.37:0/3815899601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d281464b0 con 0x7f1d2806e2b0 2023-12-11T17:11:08.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.546+0000 7f1d2659c640 1 --2- 172.21.15.37:0/3815899601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2806e2b0 0x7f1d28145b80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800abe0 tx=0x7f1d18004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:08.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.547+0000 7f1d16ffd640 1 -- 172.21.15.37:0/3815899601 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d18003d50 con 0x7f1d2806e2b0 2023-12-11T17:11:08.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.547+0000 7f1d16ffd640 1 -- 172.21.15.37:0/3815899601 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d1803e410 con 0x7f1d2806e2b0 2023-12-11T17:11:08.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.547+0000 7f1d16ffd640 1 -- 172.21.15.37:0/3815899601 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d1803e7c0 con 0x7f1d2806e2b0 2023-12-11T17:11:08.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.547+0000 7f1d2cdea640 1 -- 172.21.15.37:0/3815899601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d28146790 con 0x7f1d2806e2b0 2023-12-11T17:11:08.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.547+0000 7f1d2cdea640 1 -- 172.21.15.37:0/3815899601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d28148aa0 con 0x7f1d2806e2b0 2023-12-11T17:11:08.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.548+0000 7f1d2cdea640 1 -- 172.21.15.37:0/3815899601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d280745d0 con 0x7f1d2806e2b0 2023-12-11T17:11:08.550 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.550+0000 7f1d16ffd640 1 -- 172.21.15.37:0/3815899601 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1d1803e920 con 0x7f1d2806e2b0 2023-12-11T17:11:08.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.551+0000 7f1d16ffd640 1 --2- 172.21.15.37:0/3815899601 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1d0806ae70 0x7f1d0806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:08.551 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.551+0000 7f1d16ffd640 1 -- 172.21.15.37:0/3815899601 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f1d180ac7a0 con 0x7f1d2806e2b0 2023-12-11T17:11:08.552 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.551+0000 7f1d25d9b640 1 --2- 172.21.15.37:0/3815899601 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1d0806ae70 0x7f1d0806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:08.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.553+0000 7f1d25d9b640 1 --2- 172.21.15.37:0/3815899601 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1d0806ae70 0x7f1d0806d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1d28156a40 tx=0x7f1d1c009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:08.556 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.555+0000 7f1d16ffd640 1 -- 172.21.15.37:0/3815899601 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1d180774f0 con 0x7f1d2806e2b0 2023-12-11T17:11:08.756 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.755+0000 7f1d2cdea640 1 -- 172.21.15.37:0/3815899601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d280cb580 con 0x7f1d2806e2b0 2023-12-11T17:11:08.758 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.757+0000 7f1d16ffd640 1 -- 172.21.15.37:0/3815899601 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18779 (secure 0 0 0) 0x7f1d1800b040 con 0x7f1d2806e2b0 2023-12-11T17:11:08.758 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:11:08.758 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:10:32.309274+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:11:08.761 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.760+0000 7f1d2cdea640 1 -- 172.21.15.37:0/3815899601 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1d0806ae70 msgr2=0x7f1d0806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:08.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.760+0000 7f1d2cdea640 1 --2- 172.21.15.37:0/3815899601 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1d0806ae70 0x7f1d0806d330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1d28156a40 tx=0x7f1d1c009040 comp rx=0 tx=0).stop 2023-12-11T17:11:08.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.760+0000 7f1d2cdea640 1 -- 172.21.15.37:0/3815899601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2806e2b0 msgr2=0x7f1d28145b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:08.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.760+0000 7f1d2cdea640 1 --2- 172.21.15.37:0/3815899601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2806e2b0 0x7f1d28145b80 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f1d1800abe0 tx=0x7f1d18004730 comp rx=0 tx=0).stop 2023-12-11T17:11:08.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.760+0000 7f1d2cdea640 1 -- 172.21.15.37:0/3815899601 shutdown_connections 2023-12-11T17:11:08.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.760+0000 7f1d2cdea640 1 --2- 172.21.15.37:0/3815899601 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1d0806ae70 0x7f1d0806d330 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:08.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.760+0000 7f1d2cdea640 1 --2- 172.21.15.37:0/3815899601 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d28148620 0x7f1d28145360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:08.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.760+0000 7f1d2cdea640 1 --2- 172.21.15.37:0/3815899601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d28147270 0x7f1d280ccd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:08.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.760+0000 7f1d2cdea640 1 --2- 172.21.15.37:0/3815899601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d2806e2b0 0x7f1d28145b80 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:08.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.760+0000 7f1d2cdea640 1 -- 172.21.15.37:0/3815899601 >> 172.21.15.37:0/3815899601 conn(0x7f1d280b0a90 msgr2=0x7f1d2815aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:08.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.760+0000 7f1d2cdea640 1 -- 172.21.15.37:0/3815899601 shutdown_connections 2023-12-11T17:11:08.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:08.760+0000 7f1d2cdea640 1 -- 172.21.15.37:0/3815899601 wait complete. 2023-12-11T17:11:08.782 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T17:09:38.415636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T17:09:42.786774+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T17:09:43.660585+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2023-12-11T17:09:47.272351+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '25', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-12-11T17:11:08.783 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T17:11:09.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.014+0000 7f3489f1d640 1 Processor -- start 2023-12-11T17:11:09.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.014+0000 7f3489f1d640 1 -- start start 2023-12-11T17:11:09.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.015+0000 7f3489f1d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f348415a1e0 0x7f348406ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:09.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.015+0000 7f3489f1d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34840ae300 0x7f348406a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:09.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.015+0000 7f3489f1d640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34840cdaa0 con 0x7f3484070370 2023-12-11T17:11:09.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.015+0000 7f3489f1d640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34840cdd80 con 0x7f348415a1e0 2023-12-11T17:11:09.016 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.015+0000 7f3489f1d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34840ce060 con 0x7f34840ae300 2023-12-11T17:11:09.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.016+0000 7f3483fff640 1 --1- >> v1:172.21.15.151:6789/0 conn(0x7f3484070370 0x7f34840ca290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.37:50338/0 (socket says 172.21.15.37:50338) 2023-12-11T17:11:09.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.016+0000 7f3483fff640 1 -- 172.21.15.37:0/817068102 learned_addr learned my addr 172.21.15.37:0/817068102 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:09.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.017+0000 7f34837fe640 1 --2- 172.21.15.37:0/817068102 >> v2:172.21.15.151:3300/0 conn(0x7f348415a1e0 0x7f348406ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:09.017 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.017+0000 7f3482ffd640 1 --2- 172.21.15.37:0/817068102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34840ae300 0x7f348406a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:09.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.017+0000 7f34827fc640 1 -- 172.21.15.37:0/817068102 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2393380170 0 0) 0x7f34840cdaa0 con 0x7f3484070370 2023-12-11T17:11:09.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.017+0000 7f34827fc640 1 -- 172.21.15.37:0/817068102 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f346c003520 con 0x7f3484070370 2023-12-11T17:11:09.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.017+0000 7f34837fe640 1 -- 172.21.15.37:0/817068102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34840ae300 msgr2=0x7f348406a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:09.018 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.017+0000 7f34837fe640 1 --2- 172.21.15.37:0/817068102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34840ae300 0x7f348406a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:09.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.018+0000 7f34837fe640 1 -- 172.21.15.37:0/817068102 >> v1:172.21.15.151:6789/0 conn(0x7f3484070370 legacy=0x7f34840ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:09.019 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.018+0000 7f34837fe640 1 -- 172.21.15.37:0/817068102 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34840ce340 con 0x7f348415a1e0 2023-12-11T17:11:09.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.019+0000 7f34837fe640 1 --2- 172.21.15.37:0/817068102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f348415a1e0 0x7f348406ca10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f34740097a0 tx=0x7f347402da30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be120e4fae8de348 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:09.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.019+0000 7f34827fc640 1 -- 172.21.15.37:0/817068102 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3474031850 con 0x7f348415a1e0 2023-12-11T17:11:09.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.019+0000 7f34827fc640 1 -- 172.21.15.37:0/817068102 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34740319b0 con 0x7f348415a1e0 2023-12-11T17:11:09.020 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.019+0000 7f34827fc640 1 -- 172.21.15.37:0/817068102 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3474031d20 con 0x7f348415a1e0 2023-12-11T17:11:09.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.020+0000 7f3489f1d640 1 -- 172.21.15.37:0/817068102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f348415a1e0 msgr2=0x7f348406ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:09.021 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.020+0000 7f3489f1d640 1 --2- 172.21.15.37:0/817068102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f348415a1e0 0x7f348406ca10 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f34740097a0 tx=0x7f347402da30 comp rx=0 tx=0).stop 2023-12-11T17:11:09.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.020+0000 7f3489f1d640 1 -- 172.21.15.37:0/817068102 shutdown_connections 2023-12-11T17:11:09.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.020+0000 7f3489f1d640 1 --2- 172.21.15.37:0/817068102 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f34840ae300 0x7f348406a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:09.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.020+0000 7f3489f1d640 1 --2- 172.21.15.37:0/817068102 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f348415a1e0 0x7f348406ca10 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:09.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.020+0000 7f3489f1d640 1 -- 172.21.15.37:0/817068102 >> 172.21.15.37:0/817068102 conn(0x7f34840cee70 msgr2=0x7f34840cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:09.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.020+0000 7f3489f1d640 1 -- 172.21.15.37:0/817068102 shutdown_connections 2023-12-11T17:11:09.022 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.020+0000 7f3489f1d640 1 -- 172.21.15.37:0/817068102 wait complete. 2023-12-11T17:11:09.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.022+0000 7f3489f1d640 1 Processor -- start 2023-12-11T17:11:09.023 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.022+0000 7f3489f1d640 1 -- start start 2023-12-11T17:11:09.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.023+0000 7f3489f1d640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3484070370 0x7f3484148f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:09.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.023+0000 7f3489f1d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34840ae300 0x7f34840c30b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:09.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.023+0000 7f3489f1d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f348415a1e0 0x7f348409b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:09.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.023+0000 7f3489f1d640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348409a910 con 0x7f34840ae300 2023-12-11T17:11:09.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.023+0000 7f3489f1d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f348409abf0 con 0x7f348415a1e0 2023-12-11T17:11:09.024 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.023+0000 7f3489f1d640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f348409aed0 con 0x7f3484070370 2023-12-11T17:11:09.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.024+0000 7f3482ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34840ae300 0x7f34840c30b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:09.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.024+0000 7f3482ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34840ae300 0x7f34840c30b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35106/0 (socket says 172.21.15.37:35106) 2023-12-11T17:11:09.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.024+0000 7f3482ffd640 1 -- 172.21.15.37:0/2040917545 learned_addr learned my addr 172.21.15.37:0/2040917545 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:09.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.024+0000 7f34837fe640 1 --2- 172.21.15.37:0/2040917545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3484070370 0x7f3484148f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:09.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.024+0000 7f3483fff640 1 --2- 172.21.15.37:0/2040917545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f348415a1e0 0x7f348409b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:09.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.024+0000 7f3482ffd640 1 -- 172.21.15.37:0/2040917545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3484070370 msgr2=0x7f3484148f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:09.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.024+0000 7f3482ffd640 1 --2- 172.21.15.37:0/2040917545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3484070370 0x7f3484148f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:09.026 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.024+0000 7f3482ffd640 1 -- 172.21.15.37:0/2040917545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f348415a1e0 msgr2=0x7f348409b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:09.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.024+0000 7f3482ffd640 1 --2- 172.21.15.37:0/2040917545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f348415a1e0 0x7f348409b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:09.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.024+0000 7f3482ffd640 1 -- 172.21.15.37:0/2040917545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3474009400 con 0x7f34840ae300 2023-12-11T17:11:09.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.025+0000 7f3482ffd640 1 --2- 172.21.15.37:0/2040917545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34840ae300 0x7f34840c30b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f347800e9b0 tx=0x7f347800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:09.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.025+0000 7f346bfff640 1 -- 172.21.15.37:0/2040917545 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3478009670 con 0x7f34840ae300 2023-12-11T17:11:09.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.025+0000 7f346bfff640 1 -- 172.21.15.37:0/2040917545 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f347800c9a0 con 0x7f34840ae300 2023-12-11T17:11:09.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.025+0000 7f346bfff640 1 -- 172.21.15.37:0/2040917545 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f347800cd50 con 0x7f34840ae300 2023-12-11T17:11:09.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.025+0000 7f3489f1d640 1 -- 172.21.15.37:0/2040917545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f348409b1b0 con 0x7f34840ae300 2023-12-11T17:11:09.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.025+0000 7f3489f1d640 1 -- 172.21.15.37:0/2040917545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3484149470 con 0x7f34840ae300 2023-12-11T17:11:09.027 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.026+0000 7f3489f1d640 1 -- 172.21.15.37:0/2040917545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34840700e0 con 0x7f34840ae300 2023-12-11T17:11:09.028 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.028+0000 7f346bfff640 1 -- 172.21.15.37:0/2040917545 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3478013470 con 0x7f34840ae300 2023-12-11T17:11:09.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.028+0000 7f346bfff640 1 --2- 172.21.15.37:0/2040917545 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f347006ae70 0x7f347006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:09.029 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.029+0000 7f346bfff640 1 -- 172.21.15.37:0/2040917545 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3478089dc0 con 0x7f34840ae300 2023-12-11T17:11:09.030 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.029+0000 7f34837fe640 1 --2- 172.21.15.37:0/2040917545 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f347006ae70 0x7f347006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:09.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.030+0000 7f34837fe640 1 --2- 172.21.15.37:0/2040917545 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f347006ae70 0x7f347006d330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3474038000 tx=0x7f347403b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:09.034 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.033+0000 7f346bfff640 1 -- 172.21.15.37:0/2040917545 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3478054970 con 0x7f34840ae300 2023-12-11T17:11:09.227 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.226+0000 7f3489f1d640 1 -- 172.21.15.37:0/2040917545 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3484074450 con 0x7f34840ae300 2023-12-11T17:11:09.228 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.227+0000 7f346bfff640 1 -- 172.21.15.37:0/2040917545 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v27) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3478057f90 con 0x7f34840ae300 2023-12-11T17:11:09.228 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-11T17:11:09.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.230+0000 7f3489f1d640 1 -- 172.21.15.37:0/2040917545 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f347006ae70 msgr2=0x7f347006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:09.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.230+0000 7f3489f1d640 1 --2- 172.21.15.37:0/2040917545 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f347006ae70 0x7f347006d330 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3474038000 tx=0x7f347403b040 comp rx=0 tx=0).stop 2023-12-11T17:11:09.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.230+0000 7f3489f1d640 1 -- 172.21.15.37:0/2040917545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34840ae300 msgr2=0x7f34840c30b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:09.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.230+0000 7f3489f1d640 1 --2- 172.21.15.37:0/2040917545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34840ae300 0x7f34840c30b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f347800e9b0 tx=0x7f347800ee70 comp rx=0 tx=0).stop 2023-12-11T17:11:09.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.230+0000 7f3489f1d640 1 -- 172.21.15.37:0/2040917545 shutdown_connections 2023-12-11T17:11:09.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.230+0000 7f3489f1d640 1 --2- 172.21.15.37:0/2040917545 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f347006ae70 0x7f347006d330 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:09.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.230+0000 7f3489f1d640 1 --2- 172.21.15.37:0/2040917545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f348415a1e0 0x7f348409b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:09.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.230+0000 7f3489f1d640 1 --2- 172.21.15.37:0/2040917545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f34840ae300 0x7f34840c30b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:09.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.230+0000 7f3489f1d640 1 --2- 172.21.15.37:0/2040917545 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3484070370 0x7f3484148f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:09.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.230+0000 7f3489f1d640 1 -- 172.21.15.37:0/2040917545 >> 172.21.15.37:0/2040917545 conn(0x7f34840cee70 msgr2=0x7f34840cc840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:09.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.230+0000 7f3489f1d640 1 -- 172.21.15.37:0/2040917545 shutdown_connections 2023-12-11T17:11:09.232 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.230+0000 7f3489f1d640 1 -- 172.21.15.37:0/2040917545 wait complete. 2023-12-11T17:11:09.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-11T17:11:09.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.478+0000 7f8cdda90640 1 Processor -- start 2023-12-11T17:11:09.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.479+0000 7f8cdda90640 1 -- start start 2023-12-11T17:11:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.480+0000 7f8cdda90640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd8142de0 0x7f8cd80cdd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:09.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.480+0000 7f8cdda90640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8cd806dc10 0x7f8cd8070250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.480+0000 7f8cdda90640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd80b4980 con 0x7f8cd81432b0 2023-12-11T17:11:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.480+0000 7f8cdda90640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cd80ce2a0 con 0x7f8cd806dc10 2023-12-11T17:11:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.480+0000 7f8cdda90640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd80b4050 con 0x7f8cd8142de0 2023-12-11T17:11:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.481+0000 7f8cd77fe640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd8142de0 0x7f8cd80cdd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.481+0000 7f8cd7fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8cd806dc10 0x7f8cd8070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:09.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.481+0000 7f8cd7fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8cd806dc10 0x7f8cd8070250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:55108/0 (socket says 172.21.15.37:55108) 2023-12-11T17:11:09.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.481+0000 7f8cd7fff640 1 -- 172.21.15.37:0/1586770819 learned_addr learned my addr 172.21.15.37:0/1586770819 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:09.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.482+0000 7f8cd7fff640 1 -- 172.21.15.37:0/1586770819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd8142de0 msgr2=0x7f8cd80cdd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:09.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.482+0000 7f8cd7fff640 1 --2- 172.21.15.37:0/1586770819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd8142de0 0x7f8cd80cdd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:09.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.482+0000 7f8cd7fff640 1 -- 172.21.15.37:0/1586770819 >> v1:172.21.15.151:6789/0 conn(0x7f8cd81432b0 legacy=0x7f8cd806d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:09.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.482+0000 7f8cd7fff640 1 -- 172.21.15.37:0/1586770819 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd80b4330 con 0x7f8cd806dc10 2023-12-11T17:11:09.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.484+0000 7f8cd7fff640 1 --2- 172.21.15.37:0/1586770819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd806dc10 0x7f8cd8070250 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0009e50 tx=0x7f8cd002be40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=41f3601c1a896657 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:09.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.484+0000 7f8cd6ffd640 1 -- 172.21.15.37:0/1586770819 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd002c9e0 con 0x7f8cd806dc10 2023-12-11T17:11:09.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.484+0000 7f8cd6ffd640 1 -- 172.21.15.37:0/1586770819 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd002cb40 con 0x7f8cd806dc10 2023-12-11T17:11:09.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.484+0000 7f8cd6ffd640 1 -- 172.21.15.37:0/1586770819 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd00343f0 con 0x7f8cd806dc10 2023-12-11T17:11:09.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.485+0000 7f8cdda90640 1 -- 172.21.15.37:0/1586770819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd806dc10 msgr2=0x7f8cd8070250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:09.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.485+0000 7f8cdda90640 1 --2- 172.21.15.37:0/1586770819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd806dc10 0x7f8cd8070250 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0009e50 tx=0x7f8cd002be40 comp rx=0 tx=0).stop 2023-12-11T17:11:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.485+0000 7f8cdda90640 1 -- 172.21.15.37:0/1586770819 shutdown_connections 2023-12-11T17:11:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.485+0000 7f8cdda90640 1 --2- 172.21.15.37:0/1586770819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd806dc10 0x7f8cd8070250 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.485+0000 7f8cdda90640 1 --2- 172.21.15.37:0/1586770819 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd8142de0 0x7f8cd80cdd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.485+0000 7f8cdda90640 1 -- 172.21.15.37:0/1586770819 >> 172.21.15.37:0/1586770819 conn(0x7f8cd80cb850 msgr2=0x7f8cd80cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.485+0000 7f8cdda90640 1 -- 172.21.15.37:0/1586770819 shutdown_connections 2023-12-11T17:11:09.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.485+0000 7f8cdda90640 1 -- 172.21.15.37:0/1586770819 wait complete. 2023-12-11T17:11:09.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.487+0000 7f8cdda90640 1 Processor -- start 2023-12-11T17:11:09.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.487+0000 7f8cdda90640 1 -- start start 2023-12-11T17:11:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.488+0000 7f8cdda90640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd806dc10 0x7f8cd81f2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.488+0000 7f8cdda90640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd8142de0 0x7f8cd8154bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.488+0000 7f8cdda90640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd81432b0 0x7f8cd813ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.488+0000 7f8cdda90640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd81426d0 con 0x7f8cd81432b0 2023-12-11T17:11:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.488+0000 7f8cdda90640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd813c020 con 0x7f8cd806dc10 2023-12-11T17:11:09.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.488+0000 7f8cdda90640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd813c300 con 0x7f8cd8142de0 2023-12-11T17:11:09.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.489+0000 7f8cd7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd81432b0 0x7f8cd813ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:09.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.489+0000 7f8cd7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd81432b0 0x7f8cd813ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35110/0 (socket says 172.21.15.37:35110) 2023-12-11T17:11:09.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.489+0000 7f8cd7fff640 1 -- 172.21.15.37:0/2828671524 learned_addr learned my addr 172.21.15.37:0/2828671524 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:09.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.489+0000 7f8ccffff640 1 --2- 172.21.15.37:0/2828671524 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd8142de0 0x7f8cd8154bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:09.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.489+0000 7f8cd77fe640 1 --2- 172.21.15.37:0/2828671524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd806dc10 0x7f8cd81f2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:09.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.489+0000 7f8cd7fff640 1 -- 172.21.15.37:0/2828671524 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd8142de0 msgr2=0x7f8cd8154bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:09.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.489+0000 7f8cd7fff640 1 --2- 172.21.15.37:0/2828671524 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd8142de0 0x7f8cd8154bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:09.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.489+0000 7f8cd7fff640 1 -- 172.21.15.37:0/2828671524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd806dc10 msgr2=0x7f8cd81f2d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:09.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.489+0000 7f8cd7fff640 1 --2- 172.21.15.37:0/2828671524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd806dc10 0x7f8cd81f2d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:09.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.489+0000 7f8cd7fff640 1 -- 172.21.15.37:0/2828671524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd0009b30 con 0x7f8cd81432b0 2023-12-11T17:11:09.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.489+0000 7f8cd7fff640 1 --2- 172.21.15.37:0/2828671524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd81432b0 0x7f8cd813ee50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0009e50 tx=0x7f8cd0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:09.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.490+0000 7f8cd4ff9640 1 -- 172.21.15.37:0/2828671524 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd003e450 con 0x7f8cd81432b0 2023-12-11T17:11:09.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.490+0000 7f8cd4ff9640 1 -- 172.21.15.37:0/2828671524 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd003e5b0 con 0x7f8cd81432b0 2023-12-11T17:11:09.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.490+0000 7f8cd4ff9640 1 -- 172.21.15.37:0/2828671524 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd003e960 con 0x7f8cd81432b0 2023-12-11T17:11:09.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.490+0000 7f8cdda90640 1 -- 172.21.15.37:0/2828671524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd813c5e0 con 0x7f8cd81432b0 2023-12-11T17:11:09.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.490+0000 7f8cdda90640 1 -- 172.21.15.37:0/2828671524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd81f32c0 con 0x7f8cd81432b0 2023-12-11T17:11:09.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.491+0000 7f8cdda90640 1 -- 172.21.15.37:0/2828671524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd80745d0 con 0x7f8cd81432b0 2023-12-11T17:11:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.492+0000 7f8cd4ff9640 1 -- 172.21.15.37:0/2828671524 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8cd003eac0 con 0x7f8cd81432b0 2023-12-11T17:11:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.493+0000 7f8cd4ff9640 1 --2- 172.21.15.37:0/2828671524 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8cb806ae40 0x7f8cb806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:09.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.493+0000 7f8cd4ff9640 1 -- 172.21.15.37:0/2828671524 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f8cd00ac700 con 0x7f8cd81432b0 2023-12-11T17:11:09.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.494+0000 7f8cd77fe640 1 --2- 172.21.15.37:0/2828671524 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8cb806ae40 0x7f8cb806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:09.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.495+0000 7f8cd77fe640 1 --2- 172.21.15.37:0/2828671524 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8cb806ae40 0x7f8cb806d300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8009ad0 tx=0x7f8cc8008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:09.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.498+0000 7f8cd4ff9640 1 -- 172.21.15.37:0/2828671524 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8cd0077330 con 0x7f8cd81432b0 2023-12-11T17:11:09.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.690+0000 7f8cdda90640 1 -- 172.21.15.37:0/2828671524 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8cd813caa0 con 0x7f8cd81432b0 2023-12-11T17:11:09.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.691+0000 7f8cd4ff9640 1 -- 172.21.15.37:0/2828671524 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v27) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8cd007a950 con 0x7f8cd81432b0 2023-12-11T17:11:09.692 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:11:09.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.693+0000 7f8cdda90640 1 -- 172.21.15.37:0/2828671524 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8cb806ae40 msgr2=0x7f8cb806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:09.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.693+0000 7f8cdda90640 1 --2- 172.21.15.37:0/2828671524 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8cb806ae40 0x7f8cb806d300 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8009ad0 tx=0x7f8cc8008040 comp rx=0 tx=0).stop 2023-12-11T17:11:09.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.693+0000 7f8cdda90640 1 -- 172.21.15.37:0/2828671524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd81432b0 msgr2=0x7f8cd813ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:09.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.693+0000 7f8cdda90640 1 --2- 172.21.15.37:0/2828671524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd81432b0 0x7f8cd813ee50 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f8cd0009e50 tx=0x7f8cd0004a40 comp rx=0 tx=0).stop 2023-12-11T17:11:09.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.694+0000 7f8cdda90640 1 -- 172.21.15.37:0/2828671524 shutdown_connections 2023-12-11T17:11:09.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.694+0000 7f8cdda90640 1 --2- 172.21.15.37:0/2828671524 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8cb806ae40 0x7f8cb806d300 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:09.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.694+0000 7f8cdda90640 1 --2- 172.21.15.37:0/2828671524 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cd81432b0 0x7f8cd813ee50 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:09.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.694+0000 7f8cdda90640 1 --2- 172.21.15.37:0/2828671524 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cd8142de0 0x7f8cd8154bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:09.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.694+0000 7f8cdda90640 1 --2- 172.21.15.37:0/2828671524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd806dc10 0x7f8cd81f2d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:09.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.694+0000 7f8cdda90640 1 -- 172.21.15.37:0/2828671524 >> 172.21.15.37:0/2828671524 conn(0x7f8cd80cb850 msgr2=0x7f8cd8070bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:09.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.694+0000 7f8cdda90640 1 -- 172.21.15.37:0/2828671524 shutdown_connections 2023-12-11T17:11:09.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.694+0000 7f8cdda90640 1 -- 172.21.15.37:0/2828671524 wait complete. 2023-12-11T17:11:09.715 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-11T17:11:09.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.948+0000 7efc87c68640 1 Processor -- start 2023-12-11T17:11:09.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.948+0000 7efc87c68640 1 -- start start 2023-12-11T17:11:09.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.949+0000 7efc87c68640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efc8015a1e0 0x7efc8006ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:09.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.949+0000 7efc87c68640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7efc8006ab70 0x7efc8015dc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:09.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.950+0000 7efc87c68640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc800cdaa0 con 0x7efc800ae300 2023-12-11T17:11:09.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.950+0000 7efc87c68640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc800cdd80 con 0x7efc8015a1e0 2023-12-11T17:11:09.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.950+0000 7efc87c68640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc800ce060 con 0x7efc8006ab70 2023-12-11T17:11:09.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.950+0000 7efc85a04640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efc8015a1e0 0x7efc8006ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:09.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.950+0000 7efc85a04640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efc8015a1e0 0x7efc8006ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35112/0 (socket says 172.21.15.37:35112) 2023-12-11T17:11:09.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.950+0000 7efc85a04640 1 -- 172.21.15.37:0/1978062136 learned_addr learned my addr 172.21.15.37:0/1978062136 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.950+0000 7efc85a04640 1 -- 172.21.15.37:0/1978062136 >> v2:172.21.15.151:3300/0 conn(0x7efc8006ab70 msgr2=0x7efc8015dc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.950+0000 7efc85a04640 1 --2- 172.21.15.37:0/1978062136 >> v2:172.21.15.151:3300/0 conn(0x7efc8006ab70 0x7efc8015dc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.950+0000 7efc85a04640 1 -- 172.21.15.37:0/1978062136 >> v1:172.21.15.37:6789/0 conn(0x7efc800ae300 legacy=0x7efc8006a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.950+0000 7efc85a04640 1 -- 172.21.15.37:0/1978062136 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc800ce340 con 0x7efc8015a1e0 2023-12-11T17:11:09.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.951+0000 7efc85a04640 1 --2- 172.21.15.37:0/1978062136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8015a1e0 0x7efc8006ca10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efc8006e640 tx=0x7efc7c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f4bab31847bdd46 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.952+0000 7efc84a02640 1 -- 172.21.15.37:0/1978062136 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c031870 con 0x7efc8015a1e0 2023-12-11T17:11:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.952+0000 7efc84a02640 1 -- 172.21.15.37:0/1978062136 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c0319d0 con 0x7efc8015a1e0 2023-12-11T17:11:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.952+0000 7efc84a02640 1 -- 172.21.15.37:0/1978062136 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c031d60 con 0x7efc8015a1e0 2023-12-11T17:11:09.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.952+0000 7efc87c68640 1 -- 172.21.15.37:0/1978062136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8015a1e0 msgr2=0x7efc8006ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:09.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.952+0000 7efc87c68640 1 --2- 172.21.15.37:0/1978062136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8015a1e0 0x7efc8006ca10 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7efc8006e640 tx=0x7efc7c02b910 comp rx=0 tx=0).stop 2023-12-11T17:11:09.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.953+0000 7efc87c68640 1 -- 172.21.15.37:0/1978062136 shutdown_connections 2023-12-11T17:11:09.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.953+0000 7efc87c68640 1 --2- 172.21.15.37:0/1978062136 >> v2:172.21.15.151:3300/0 conn(0x7efc8006ab70 0x7efc8015dc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:09.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.953+0000 7efc87c68640 1 --2- 172.21.15.37:0/1978062136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8015a1e0 0x7efc8006ca10 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:09.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.953+0000 7efc87c68640 1 -- 172.21.15.37:0/1978062136 >> 172.21.15.37:0/1978062136 conn(0x7efc800cee70 msgr2=0x7efc800cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:09.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.953+0000 7efc87c68640 1 -- 172.21.15.37:0/1978062136 shutdown_connections 2023-12-11T17:11:09.954 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.953+0000 7efc87c68640 1 -- 172.21.15.37:0/1978062136 wait complete. 2023-12-11T17:11:09.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.955+0000 7efc87c68640 1 Processor -- start 2023-12-11T17:11:09.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.955+0000 7efc87c68640 1 -- start start 2023-12-11T17:11:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.956+0000 7efc87c68640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8006ab70 0x7efc80155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.956+0000 7efc87c68640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc800ae300 0x7efc800b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.956+0000 7efc87c68640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc8015a1e0 0x7efc800c4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.956+0000 7efc87c68640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc800b3780 con 0x7efc8006ab70 2023-12-11T17:11:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.956+0000 7efc87c68640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc80156290 con 0x7efc800ae300 2023-12-11T17:11:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.956+0000 7efc87c68640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc800b2b70 con 0x7efc8015a1e0 2023-12-11T17:11:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.957+0000 7efc85a04640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8006ab70 0x7efc80155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.957+0000 7efc85a04640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8006ab70 0x7efc80155d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35126/0 (socket says 172.21.15.37:35126) 2023-12-11T17:11:09.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.957+0000 7efc85a04640 1 -- 172.21.15.37:0/2277285513 learned_addr learned my addr 172.21.15.37:0/2277285513 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:09.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.957+0000 7efc85a04640 1 -- 172.21.15.37:0/2277285513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc8015a1e0 msgr2=0x7efc800c4c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:09.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.957+0000 7efc86205640 1 --2- 172.21.15.37:0/2277285513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc8015a1e0 0x7efc800c4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:09.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.957+0000 7efc85a04640 1 --2- 172.21.15.37:0/2277285513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc8015a1e0 0x7efc800c4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:09.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.957+0000 7efc85a04640 1 -- 172.21.15.37:0/2277285513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc800ae300 msgr2=0x7efc800b3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:09.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.957+0000 7efc85a04640 1 --2- 172.21.15.37:0/2277285513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc800ae300 0x7efc800b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:09.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.957+0000 7efc85a04640 1 -- 172.21.15.37:0/2277285513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7c0094d0 con 0x7efc8006ab70 2023-12-11T17:11:09.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.958+0000 7efc85a04640 1 --2- 172.21.15.37:0/2277285513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8006ab70 0x7efc80155d50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efc7c0090b0 tx=0x7efc7c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:09.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.958+0000 7efc767fc640 1 -- 172.21.15.37:0/2277285513 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c03adf0 con 0x7efc8006ab70 2023-12-11T17:11:09.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.958+0000 7efc767fc640 1 -- 172.21.15.37:0/2277285513 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7c0443f0 con 0x7efc8006ab70 2023-12-11T17:11:09.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.958+0000 7efc87c68640 1 -- 172.21.15.37:0/2277285513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc800b2e50 con 0x7efc8006ab70 2023-12-11T17:11:09.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.958+0000 7efc767fc640 1 -- 172.21.15.37:0/2277285513 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7c0447a0 con 0x7efc8006ab70 2023-12-11T17:11:09.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.958+0000 7efc87c68640 1 -- 172.21.15.37:0/2277285513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc800b3410 con 0x7efc8006ab70 2023-12-11T17:11:09.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.959+0000 7efc87c68640 1 -- 172.21.15.37:0/2277285513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc80074450 con 0x7efc8006ab70 2023-12-11T17:11:09.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.960+0000 7efc767fc640 1 -- 172.21.15.37:0/2277285513 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efc7c04d450 con 0x7efc8006ab70 2023-12-11T17:11:09.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.962+0000 7efc767fc640 1 --2- 172.21.15.37:0/2277285513 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efc6406ae40 0x7efc6406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:09.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.962+0000 7efc767fc640 1 -- 172.21.15.37:0/2277285513 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7efc7c02d040 con 0x7efc8006ab70 2023-12-11T17:11:09.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.963+0000 7efc85203640 1 --2- 172.21.15.37:0/2277285513 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efc6406ae40 0x7efc6406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:09.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.964+0000 7efc85203640 1 --2- 172.21.15.37:0/2277285513 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efc6406ae40 0x7efc6406d300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efc70000f60 tx=0x7efc700079d0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:09.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:09.966+0000 7efc767fc640 1 -- 172.21.15.37:0/2277285513 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efc7c076cf0 con 0x7efc8006ab70 2023-12-11T17:11:10.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.159+0000 7efc87c68640 1 -- 172.21.15.37:0/2277285513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efc8006de10 con 0x7efc8006ab70 2023-12-11T17:11:10.161 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.160+0000 7efc767fc640 1 -- 172.21.15.37:0/2277285513 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v27) v1 ==== 100+0+11 (secure 0 0 0) 0x7efc7c07a310 con 0x7efc8006ab70 2023-12-11T17:11:10.161 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-11T17:11:10.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.163+0000 7efc87c68640 1 -- 172.21.15.37:0/2277285513 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efc6406ae40 msgr2=0x7efc6406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:10.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.163+0000 7efc87c68640 1 --2- 172.21.15.37:0/2277285513 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efc6406ae40 0x7efc6406d300 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7efc70000f60 tx=0x7efc700079d0 comp rx=0 tx=0).stop 2023-12-11T17:11:10.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.163+0000 7efc87c68640 1 -- 172.21.15.37:0/2277285513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8006ab70 msgr2=0x7efc80155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:10.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.163+0000 7efc87c68640 1 --2- 172.21.15.37:0/2277285513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8006ab70 0x7efc80155d50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7efc7c0090b0 tx=0x7efc7c0046c0 comp rx=0 tx=0).stop 2023-12-11T17:11:10.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.163+0000 7efc87c68640 1 -- 172.21.15.37:0/2277285513 shutdown_connections 2023-12-11T17:11:10.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.163+0000 7efc87c68640 1 --2- 172.21.15.37:0/2277285513 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efc6406ae40 0x7efc6406d300 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:10.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.163+0000 7efc87c68640 1 --2- 172.21.15.37:0/2277285513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efc800ae300 0x7efc800b3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:10.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.163+0000 7efc87c68640 1 --2- 172.21.15.37:0/2277285513 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efc8015a1e0 0x7efc800c4c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:10.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.163+0000 7efc87c68640 1 --2- 172.21.15.37:0/2277285513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc8006ab70 0x7efc80155d50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:10.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.163+0000 7efc87c68640 1 -- 172.21.15.37:0/2277285513 >> 172.21.15.37:0/2277285513 conn(0x7efc800cee70 msgr2=0x7efc8006ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:10.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.163+0000 7efc87c68640 1 -- 172.21.15.37:0/2277285513 shutdown_connections 2023-12-11T17:11:10.165 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.163+0000 7efc87c68640 1 -- 172.21.15.37:0/2277285513 wait complete. 2023-12-11T17:11:10.182 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2023-12-11T17:11:10.232 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:11:10.237 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:11:10.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.397+0000 7fad57fff640 1 Processor -- start 2023-12-11T17:11:10.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.398+0000 7fad57fff640 1 -- start start 2023-12-11T17:11:10.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.400+0000 7fad57fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad58071c70 0x7fad58165ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:10.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.400+0000 7fad57fff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5806c770 con 0x7fad5806c130 2023-12-11T17:11:10.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.400+0000 7fad57fff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5806ca50 con 0x7fad580cb5b0 2023-12-11T17:11:10.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.400+0000 7fad57fff640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad5806cd30 con 0x7fad58071c70 2023-12-11T17:11:10.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.400+0000 7fad567fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fad5806c130 0x7fad5815f510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38716/0 (socket says 172.21.15.37:38716) 2023-12-11T17:11:10.401 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.400+0000 7fad567fc640 1 -- 172.21.15.37:0/529281303 learned_addr learned my addr 172.21.15.37:0/529281303 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:10.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.400+0000 7fad577fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad58071c70 0x7fad58165ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:10.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.401+0000 7fad577fe640 1 -- 172.21.15.37:0/529281303 >> v1:172.21.15.151:6789/0 conn(0x7fad580cb5b0 legacy=0x7fad580cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:10.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.401+0000 7fad577fe640 1 -- 172.21.15.37:0/529281303 >> v1:172.21.15.37:6789/0 conn(0x7fad5806c130 legacy=0x7fad5815f510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:10.402 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.401+0000 7fad577fe640 1 -- 172.21.15.37:0/529281303 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad5806d010 con 0x7fad58071c70 2023-12-11T17:11:10.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.402+0000 7fad577fe640 1 --2- 172.21.15.37:0/529281303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad58071c70 0x7fad58165ee0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fad500097a0 tx=0x7fad5002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a70eb63851820cbc server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:10.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.402+0000 7fad55ffb640 1 -- 172.21.15.37:0/529281303 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad50030610 con 0x7fad58071c70 2023-12-11T17:11:10.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.402+0000 7fad55ffb640 1 -- 172.21.15.37:0/529281303 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad50030770 con 0x7fad58071c70 2023-12-11T17:11:10.403 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.402+0000 7fad55ffb640 1 -- 172.21.15.37:0/529281303 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad50030b00 con 0x7fad58071c70 2023-12-11T17:11:10.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.403+0000 7fad57fff640 1 -- 172.21.15.37:0/529281303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad58071c70 msgr2=0x7fad58165ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:10.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.403+0000 7fad57fff640 1 --2- 172.21.15.37:0/529281303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad58071c70 0x7fad58165ee0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fad500097a0 tx=0x7fad5002b960 comp rx=0 tx=0).stop 2023-12-11T17:11:10.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.403+0000 7fad57fff640 1 -- 172.21.15.37:0/529281303 shutdown_connections 2023-12-11T17:11:10.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.403+0000 7fad57fff640 1 --2- 172.21.15.37:0/529281303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad58071c70 0x7fad58165ee0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:10.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.403+0000 7fad57fff640 1 -- 172.21.15.37:0/529281303 >> 172.21.15.37:0/529281303 conn(0x7fad580b0940 msgr2=0x7fad580b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:10.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.403+0000 7fad57fff640 1 -- 172.21.15.37:0/529281303 shutdown_connections 2023-12-11T17:11:10.404 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.403+0000 7fad57fff640 1 -- 172.21.15.37:0/529281303 wait complete. 2023-12-11T17:11:10.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.405+0000 7fad57fff640 1 Processor -- start 2023-12-11T17:11:10.406 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.405+0000 7fad57fff640 1 -- start start 2023-12-11T17:11:10.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.406+0000 7fad57fff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad5806c130 0x7fad581502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:10.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.406+0000 7fad57fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad58071c70 0x7fad581599c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:10.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.406+0000 7fad57fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad580cb5b0 0x7fad58159f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:10.407 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.406+0000 7fad57fff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad58150820 con 0x7fad580cb5b0 2023-12-11T17:11:10.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.406+0000 7fad57fff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad581552c0 con 0x7fad58071c70 2023-12-11T17:11:10.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.406+0000 7fad57fff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad581555a0 con 0x7fad5806c130 2023-12-11T17:11:10.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.407+0000 7fad577fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad580cb5b0 0x7fad58159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:10.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.407+0000 7fad577fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad580cb5b0 0x7fad58159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35144/0 (socket says 172.21.15.37:35144) 2023-12-11T17:11:10.408 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.407+0000 7fad577fe640 1 -- 172.21.15.37:0/1470326459 learned_addr learned my addr 172.21.15.37:0/1470326459 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:10.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.407+0000 7fad567fc640 1 --2- 172.21.15.37:0/1470326459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad58071c70 0x7fad581599c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:10.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.407+0000 7fad56ffd640 1 --2- 172.21.15.37:0/1470326459 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad5806c130 0x7fad581502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:10.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.407+0000 7fad577fe640 1 -- 172.21.15.37:0/1470326459 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad5806c130 msgr2=0x7fad581502e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:10.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.407+0000 7fad577fe640 1 --2- 172.21.15.37:0/1470326459 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad5806c130 0x7fad581502e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:10.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.407+0000 7fad577fe640 1 -- 172.21.15.37:0/1470326459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad58071c70 msgr2=0x7fad581599c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:10.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.407+0000 7fad577fe640 1 --2- 172.21.15.37:0/1470326459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad58071c70 0x7fad581599c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:10.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.407+0000 7fad577fe640 1 -- 172.21.15.37:0/1470326459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad50009400 con 0x7fad580cb5b0 2023-12-11T17:11:10.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.407+0000 7fad56ffd640 1 --2- 172.21.15.37:0/1470326459 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad5806c130 0x7fad581502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:10.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.407+0000 7fad577fe640 1 --2- 172.21.15.37:0/1470326459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad580cb5b0 0x7fad58159f00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fad500098c0 tx=0x7fad50004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:10.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.408+0000 7fad4ffff640 1 -- 172.21.15.37:0/1470326459 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5003e040 con 0x7fad580cb5b0 2023-12-11T17:11:10.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.408+0000 7fad4ffff640 1 -- 172.21.15.37:0/1470326459 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad50039c50 con 0x7fad580cb5b0 2023-12-11T17:11:10.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.408+0000 7fad4ffff640 1 -- 172.21.15.37:0/1470326459 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad500443f0 con 0x7fad580cb5b0 2023-12-11T17:11:10.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.408+0000 7fad57fff640 1 -- 172.21.15.37:0/1470326459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad58155880 con 0x7fad580cb5b0 2023-12-11T17:11:10.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.408+0000 7fad57fff640 1 -- 172.21.15.37:0/1470326459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad581574e0 con 0x7fad580cb5b0 2023-12-11T17:11:10.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.409+0000 7fad57fff640 1 -- 172.21.15.37:0/1470326459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad58067910 con 0x7fad580cb5b0 2023-12-11T17:11:10.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.410+0000 7fad4ffff640 1 -- 172.21.15.37:0/1470326459 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fad5004d3b0 con 0x7fad580cb5b0 2023-12-11T17:11:10.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.411+0000 7fad4ffff640 1 --2- 172.21.15.37:0/1470326459 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fad3806ae40 0x7fad3806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:10.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.411+0000 7fad4ffff640 1 -- 172.21.15.37:0/1470326459 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fad500ac090 con 0x7fad580cb5b0 2023-12-11T17:11:10.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.411+0000 7fad56ffd640 1 --2- 172.21.15.37:0/1470326459 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fad3806ae40 0x7fad3806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:10.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.412+0000 7fad56ffd640 1 --2- 172.21.15.37:0/1470326459 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fad3806ae40 0x7fad3806d300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fad480015e0 tx=0x7fad48009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:10.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.415+0000 7fad4ffff640 1 -- 172.21.15.37:0/1470326459 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fad50076d50 con 0x7fad580cb5b0 2023-12-11T17:11:10.613 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.612+0000 7fad57fff640 1 -- 172.21.15.37:0/1470326459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) v1 -- 0x7fad58074450 con 0x7fad580cb5b0 2023-12-11T17:11:10.614 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.613+0000 7fad4ffff640 1 -- 172.21.15.37:0/1470326459 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v27) v1 ==== 103+0+11 (secure 0 0 0) 0x7fad5007a370 con 0x7fad580cb5b0 2023-12-11T17:11:10.614 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-11T17:11:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.616+0000 7fad57fff640 1 -- 172.21.15.37:0/1470326459 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fad3806ae40 msgr2=0x7fad3806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.616+0000 7fad57fff640 1 --2- 172.21.15.37:0/1470326459 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fad3806ae40 0x7fad3806d300 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fad480015e0 tx=0x7fad48009040 comp rx=0 tx=0).stop 2023-12-11T17:11:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.616+0000 7fad57fff640 1 -- 172.21.15.37:0/1470326459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad580cb5b0 msgr2=0x7fad58159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:10.617 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.616+0000 7fad57fff640 1 --2- 172.21.15.37:0/1470326459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad580cb5b0 0x7fad58159f00 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fad500098c0 tx=0x7fad50004730 comp rx=0 tx=0).stop 2023-12-11T17:11:10.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.616+0000 7fad57fff640 1 -- 172.21.15.37:0/1470326459 shutdown_connections 2023-12-11T17:11:10.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.616+0000 7fad57fff640 1 --2- 172.21.15.37:0/1470326459 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fad3806ae40 0x7fad3806d300 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:10.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.616+0000 7fad57fff640 1 --2- 172.21.15.37:0/1470326459 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad58071c70 0x7fad581599c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:10.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.616+0000 7fad57fff640 1 --2- 172.21.15.37:0/1470326459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad580cb5b0 0x7fad58159f00 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:10.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.616+0000 7fad57fff640 1 --2- 172.21.15.37:0/1470326459 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fad5806c130 0x7fad581502e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:10.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.616+0000 7fad57fff640 1 -- 172.21.15.37:0/1470326459 >> 172.21.15.37:0/1470326459 conn(0x7fad580b0940 msgr2=0x7fad580aca70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:10.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.616+0000 7fad57fff640 1 -- 172.21.15.37:0/1470326459 shutdown_connections 2023-12-11T17:11:10.618 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.616+0000 7fad57fff640 1 -- 172.21.15.37:0/1470326459 wait complete. 2023-12-11T17:11:10.636 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T17:11:10.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.861+0000 7f8aaf59e640 1 Processor -- start 2023-12-11T17:11:10.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.862+0000 7f8aaf59e640 1 -- start start 2023-12-11T17:11:10.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.863+0000 7f8aaf59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ab00d13c0 0x7f8ab00ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:10.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.863+0000 7f8aaf59e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8ab00b0760 0x7f8ab00b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:10.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.863+0000 7f8aaf59e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ab00b2280 con 0x7f8ab00d0d70 2023-12-11T17:11:10.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.864+0000 7f8aaf59e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ab00cee70 con 0x7f8ab00b0760 2023-12-11T17:11:10.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.864+0000 7f8aaf59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab00d1190 con 0x7f8ab00d13c0 2023-12-11T17:11:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.864+0000 7f8aa7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8ab00d0d70 0x7f8ab00d17a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38718/0 (socket says 172.21.15.37:38718) 2023-12-11T17:11:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.864+0000 7f8aa7fff640 1 -- 172.21.15.37:0/3183526760 learned_addr learned my addr 172.21.15.37:0/3183526760 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.864+0000 7f8aae59c640 1 --2- 172.21.15.37:0/3183526760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ab00d13c0 0x7f8ab00ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.864+0000 7f8aaed9d640 1 --2- 172.21.15.37:0/3183526760 >> v2:172.21.15.151:3300/0 conn(0x7f8ab00b0760 0x7f8ab00b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.864+0000 7f8aadd9b640 1 -- 172.21.15.37:0/3183526760 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2319422763 0 0) 0x7f8ab00b2280 con 0x7f8ab00d0d70 2023-12-11T17:11:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.865+0000 7f8aadd9b640 1 -- 172.21.15.37:0/3183526760 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8a9c003520 con 0x7f8ab00d0d70 2023-12-11T17:11:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.865+0000 7f8aae59c640 1 -- 172.21.15.37:0/3183526760 >> v2:172.21.15.151:3300/0 conn(0x7f8ab00b0760 msgr2=0x7f8ab00b0bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.865+0000 7f8aae59c640 1 --2- 172.21.15.37:0/3183526760 >> v2:172.21.15.151:3300/0 conn(0x7f8ab00b0760 0x7f8ab00b0bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.865+0000 7f8aae59c640 1 -- 172.21.15.37:0/3183526760 >> v1:172.21.15.37:6789/0 conn(0x7f8ab00d0d70 legacy=0x7f8ab00d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:10.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.865+0000 7f8aae59c640 1 -- 172.21.15.37:0/3183526760 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ab00ceb90 con 0x7f8ab00d13c0 2023-12-11T17:11:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.866+0000 7f8aae59c640 1 --2- 172.21.15.37:0/3183526760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ab00d13c0 0x7f8ab00ce5b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00097a0 tx=0x7f8aa002b820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fdbe7db85369973f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:10.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.867+0000 7f8aadd9b640 1 -- 172.21.15.37:0/3183526760 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0031780 con 0x7f8ab00d13c0 2023-12-11T17:11:10.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.867+0000 7f8aadd9b640 1 -- 172.21.15.37:0/3183526760 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa00318e0 con 0x7f8ab00d13c0 2023-12-11T17:11:10.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.867+0000 7f8aadd9b640 1 -- 172.21.15.37:0/3183526760 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa0031c70 con 0x7f8ab00d13c0 2023-12-11T17:11:10.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.867+0000 7f8aaf59e640 1 -- 172.21.15.37:0/3183526760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ab00d13c0 msgr2=0x7f8ab00ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:10.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.867+0000 7f8aaf59e640 1 --2- 172.21.15.37:0/3183526760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ab00d13c0 0x7f8ab00ce5b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f8aa00097a0 tx=0x7f8aa002b820 comp rx=0 tx=0).stop 2023-12-11T17:11:10.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.867+0000 7f8aaf59e640 1 -- 172.21.15.37:0/3183526760 shutdown_connections 2023-12-11T17:11:10.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.868+0000 7f8aaf59e640 1 --2- 172.21.15.37:0/3183526760 >> v2:172.21.15.151:3300/0 conn(0x7f8ab00b0760 0x7f8ab00b0bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:10.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.868+0000 7f8aaf59e640 1 --2- 172.21.15.37:0/3183526760 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ab00d13c0 0x7f8ab00ce5b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:10.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.868+0000 7f8aaf59e640 1 -- 172.21.15.37:0/3183526760 >> 172.21.15.37:0/3183526760 conn(0x7f8ab009c260 msgr2=0x7f8ab00d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:10.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.868+0000 7f8aaf59e640 1 -- 172.21.15.37:0/3183526760 shutdown_connections 2023-12-11T17:11:10.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.868+0000 7f8aaf59e640 1 -- 172.21.15.37:0/3183526760 wait complete. 2023-12-11T17:11:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.870+0000 7f8aaf59e640 1 Processor -- start 2023-12-11T17:11:10.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.870+0000 7f8aaf59e640 1 -- start start 2023-12-11T17:11:10.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.872+0000 7f8aaf59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ab00b0760 0x7f8ab014ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:10.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.872+0000 7f8aaf59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ab00d0d70 0x7f8ab014f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:10.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.872+0000 7f8aaf59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ab00d13c0 0x7f8ab014f710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:10.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.872+0000 7f8aaf59e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab014fc50 con 0x7f8ab00d13c0 2023-12-11T17:11:10.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.872+0000 7f8aaf59e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab01f2e40 con 0x7f8ab00d0d70 2023-12-11T17:11:10.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.872+0000 7f8aaf59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ab01f3070 con 0x7f8ab00b0760 2023-12-11T17:11:10.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.872+0000 7f8aaed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ab00d13c0 0x7f8ab014f710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:10.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.872+0000 7f8aaed9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ab00d13c0 0x7f8ab014f710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35146/0 (socket says 172.21.15.37:35146) 2023-12-11T17:11:10.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.872+0000 7f8aaed9d640 1 -- 172.21.15.37:0/1921249841 learned_addr learned my addr 172.21.15.37:0/1921249841 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:10.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.872+0000 7f8aae59c640 1 --2- 172.21.15.37:0/1921249841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ab00b0760 0x7f8ab014ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:10.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.872+0000 7f8aa7fff640 1 --2- 172.21.15.37:0/1921249841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ab00d0d70 0x7f8ab014f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:10.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.873+0000 7f8aaed9d640 1 -- 172.21.15.37:0/1921249841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ab00b0760 msgr2=0x7f8ab014ec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:10.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.873+0000 7f8aaed9d640 1 --2- 172.21.15.37:0/1921249841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ab00b0760 0x7f8ab014ec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:10.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.873+0000 7f8aaed9d640 1 -- 172.21.15.37:0/1921249841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ab00d0d70 msgr2=0x7f8ab014f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:10.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.873+0000 7f8aaed9d640 1 --2- 172.21.15.37:0/1921249841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ab00d0d70 0x7f8ab014f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:10.875 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.873+0000 7f8aaed9d640 1 -- 172.21.15.37:0/1921249841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aa0009400 con 0x7f8ab00d13c0 2023-12-11T17:11:10.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.873+0000 7f8aaed9d640 1 --2- 172.21.15.37:0/1921249841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ab00d13c0 0x7f8ab014f710 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800ec10 tx=0x7f8aa800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:10.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.873+0000 7f8aa6ffd640 1 -- 172.21.15.37:0/1921249841 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa800cd20 con 0x7f8ab00d13c0 2023-12-11T17:11:10.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.873+0000 7f8aa6ffd640 1 -- 172.21.15.37:0/1921249841 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8aa800f040 con 0x7f8ab00d13c0 2023-12-11T17:11:10.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.873+0000 7f8aa6ffd640 1 -- 172.21.15.37:0/1921249841 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8aa80146c0 con 0x7f8ab00d13c0 2023-12-11T17:11:10.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.873+0000 7f8aaf59e640 1 -- 172.21.15.37:0/1921249841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ab01f3350 con 0x7f8ab00d13c0 2023-12-11T17:11:10.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.874+0000 7f8aaf59e640 1 -- 172.21.15.37:0/1921249841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ab01f3910 con 0x7f8ab00d13c0 2023-12-11T17:11:10.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.875+0000 7f8aaf59e640 1 -- 172.21.15.37:0/1921249841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ab0074450 con 0x7f8ab00d13c0 2023-12-11T17:11:10.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.876+0000 7f8aa6ffd640 1 -- 172.21.15.37:0/1921249841 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8aa8014a30 con 0x7f8ab00d13c0 2023-12-11T17:11:10.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.876+0000 7f8aa6ffd640 1 --2- 172.21.15.37:0/1921249841 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8a9006ae40 0x7f8a9006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:10.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.877+0000 7f8aa6ffd640 1 -- 172.21.15.37:0/1921249841 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f8aa808a5b0 con 0x7f8ab00d13c0 2023-12-11T17:11:10.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.877+0000 7f8aae59c640 1 --2- 172.21.15.37:0/1921249841 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8a9006ae40 0x7f8a9006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:10.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.878+0000 7f8aae59c640 1 --2- 172.21.15.37:0/1921249841 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8a9006ae40 0x7f8a9006d300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0036000 tx=0x7f8aa003d040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:10.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:10.881+0000 7f8aa6ffd640 1 -- 172.21.15.37:0/1921249841 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8aa8055280 con 0x7f8ab00d13c0 2023-12-11T17:11:11.116 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.115+0000 7f8aaf59e640 1 -- 172.21.15.37:0/1921249841 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ab00ca390 con 0x7f8ab00d13c0 2023-12-11T17:11:11.118 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.117+0000 7f8aa6ffd640 1 -- 172.21.15.37:0/1921249841 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f8aa80588a0 con 0x7f8ab00d13c0 2023-12-11T17:11:11.118 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:11:11.118 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2395601865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2395601865},{"type":"v1","addr":"172.21.15.151:6835","nonce":2395601865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1535809271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1535809271},{"type":"v1","addr":"172.21.15.151:6837","nonce":1535809271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2590175074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2590175074},{"type":"v1","addr":"172.21.15.37:6833","nonce":2590175074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-11T17:09:44.643511+0000","modified":"2023-12-11T17:10:12.829357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/2348606057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2348606057},{"type":"v1","addr":"172.21.15.37:6835","nonce":2348606057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T17:11:11.118 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-12-11T17:11:11.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.119+0000 7f8aaf59e640 1 -- 172.21.15.37:0/1921249841 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8a9006ae40 msgr2=0x7f8a9006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:11.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.119+0000 7f8aaf59e640 1 --2- 172.21.15.37:0/1921249841 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8a9006ae40 0x7f8a9006d300 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f8aa0036000 tx=0x7f8aa003d040 comp rx=0 tx=0).stop 2023-12-11T17:11:11.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.119+0000 7f8aaf59e640 1 -- 172.21.15.37:0/1921249841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ab00d13c0 msgr2=0x7f8ab014f710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:11.120 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.119+0000 7f8aaf59e640 1 --2- 172.21.15.37:0/1921249841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ab00d13c0 0x7f8ab014f710 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800ec10 tx=0x7f8aa800c490 comp rx=0 tx=0).stop 2023-12-11T17:11:11.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.120+0000 7f8aaf59e640 1 -- 172.21.15.37:0/1921249841 shutdown_connections 2023-12-11T17:11:11.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.120+0000 7f8aaf59e640 1 --2- 172.21.15.37:0/1921249841 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8a9006ae40 0x7f8a9006d300 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:11.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.120+0000 7f8aaf59e640 1 --2- 172.21.15.37:0/1921249841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8ab00d0d70 0x7f8ab014f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:11.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.120+0000 7f8aaf59e640 1 --2- 172.21.15.37:0/1921249841 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8ab00d13c0 0x7f8ab014f710 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:11.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.120+0000 7f8aaf59e640 1 --2- 172.21.15.37:0/1921249841 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8ab00b0760 0x7f8ab014ec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:11.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.120+0000 7f8aaf59e640 1 -- 172.21.15.37:0/1921249841 >> 172.21.15.37:0/1921249841 conn(0x7f8ab009c260 msgr2=0x7f8ab00b83d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:11.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.120+0000 7f8aaf59e640 1 -- 172.21.15.37:0/1921249841 shutdown_connections 2023-12-11T17:11:11.121 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.120+0000 7f8aaf59e640 1 -- 172.21.15.37:0/1921249841 wait complete. 2023-12-11T17:11:11.140 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:11:11.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.362+0000 7fdc6a8e6640 1 Processor -- start 2023-12-11T17:11:11.363 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.362+0000 7fdc6a8e6640 1 -- start start 2023-12-11T17:11:11.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.363+0000 7fdc6a8e6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdc640d13c0 0x7fdc640ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:11.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.363+0000 7fdc6a8e6640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fdc640d0d70 0x7fdc640d17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:11.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.363+0000 7fdc6a8e6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc640cf6a0 0x7fdc640cfb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:11.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.363+0000 7fdc6a8e6640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc640b2280 con 0x7fdc640d13c0 2023-12-11T17:11:11.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.363+0000 7fdc6a8e6640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc640cee70 con 0x7fdc640d0d70 2023-12-11T17:11:11.364 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.363+0000 7fdc6a8e6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc640d11c0 con 0x7fdc640cf6a0 2023-12-11T17:11:11.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.363+0000 7fdc698e4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdc640d13c0 0x7fdc640ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:11.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.363+0000 7fdc698e4640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdc640d13c0 0x7fdc640ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35148/0 (socket says 172.21.15.37:35148) 2023-12-11T17:11:11.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.363+0000 7fdc698e4640 1 -- 172.21.15.37:0/4129404183 learned_addr learned my addr 172.21.15.37:0/4129404183 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:11.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.364+0000 7fdc6a0e5640 1 --2- 172.21.15.37:0/4129404183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc640cf6a0 0x7fdc640cfb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:11.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.364+0000 7fdc690e3640 1 --2- 172.21.15.37:0/4129404183 >> v2:172.21.15.151:3300/0 conn(0x7fdc640d0d70 0x7fdc640d17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:11.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.364+0000 7fdc698e4640 1 -- 172.21.15.37:0/4129404183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc640cf6a0 msgr2=0x7fdc640cfb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:11.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.364+0000 7fdc698e4640 1 --2- 172.21.15.37:0/4129404183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc640cf6a0 0x7fdc640cfb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:11.365 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.364+0000 7fdc698e4640 1 -- 172.21.15.37:0/4129404183 >> v2:172.21.15.151:3300/0 conn(0x7fdc640d0d70 msgr2=0x7fdc640d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:11.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.364+0000 7fdc698e4640 1 --2- 172.21.15.37:0/4129404183 >> v2:172.21.15.151:3300/0 conn(0x7fdc640d0d70 0x7fdc640d17a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:11.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.364+0000 7fdc698e4640 1 -- 172.21.15.37:0/4129404183 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc640d1ce0 con 0x7fdc640d13c0 2023-12-11T17:11:11.366 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.365+0000 7fdc698e4640 1 --2- 172.21.15.37:0/4129404183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc640d13c0 0x7fdc640ce5b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdc640cf040 tx=0x7fdc5802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca9bf738e09b01cb server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:11.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.366+0000 7fdc688e2640 1 -- 172.21.15.37:0/4129404183 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc580317e0 con 0x7fdc640d13c0 2023-12-11T17:11:11.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.366+0000 7fdc688e2640 1 -- 172.21.15.37:0/4129404183 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc58031940 con 0x7fdc640d13c0 2023-12-11T17:11:11.367 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.366+0000 7fdc688e2640 1 -- 172.21.15.37:0/4129404183 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc58031cd0 con 0x7fdc640d13c0 2023-12-11T17:11:11.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.366+0000 7fdc6a8e6640 1 -- 172.21.15.37:0/4129404183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc640d13c0 msgr2=0x7fdc640ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:11.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.366+0000 7fdc6a8e6640 1 --2- 172.21.15.37:0/4129404183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc640d13c0 0x7fdc640ce5b0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fdc640cf040 tx=0x7fdc5802b880 comp rx=0 tx=0).stop 2023-12-11T17:11:11.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.367+0000 7fdc6a8e6640 1 -- 172.21.15.37:0/4129404183 shutdown_connections 2023-12-11T17:11:11.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.367+0000 7fdc6a8e6640 1 --2- 172.21.15.37:0/4129404183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc640cf6a0 0x7fdc640cfb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:11.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.367+0000 7fdc6a8e6640 1 --2- 172.21.15.37:0/4129404183 >> v2:172.21.15.151:3300/0 conn(0x7fdc640d0d70 0x7fdc640d17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:11.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.367+0000 7fdc6a8e6640 1 --2- 172.21.15.37:0/4129404183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc640d13c0 0x7fdc640ce5b0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:11.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.367+0000 7fdc6a8e6640 1 -- 172.21.15.37:0/4129404183 >> 172.21.15.37:0/4129404183 conn(0x7fdc6409c260 msgr2=0x7fdc640d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:11.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.367+0000 7fdc6a8e6640 1 -- 172.21.15.37:0/4129404183 shutdown_connections 2023-12-11T17:11:11.368 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.367+0000 7fdc6a8e6640 1 -- 172.21.15.37:0/4129404183 wait complete. 2023-12-11T17:11:11.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.368+0000 7fdc6a8e6640 1 Processor -- start 2023-12-11T17:11:11.369 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.369+0000 7fdc6a8e6640 1 -- start start 2023-12-11T17:11:11.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.370+0000 7fdc6a8e6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc640cf6a0 0x7fdc6414c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:11.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.370+0000 7fdc6a8e6640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc640d0d70 0x7fdc640b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:11.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.370+0000 7fdc6a8e6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc640d13c0 0x7fdc640cc1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:11.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.370+0000 7fdc6a8e6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc640b3da0 con 0x7fdc640d13c0 2023-12-11T17:11:11.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.370+0000 7fdc6a8e6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc640ca5e0 con 0x7fdc640cf6a0 2023-12-11T17:11:11.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.370+0000 7fdc6a8e6640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc640b37e0 con 0x7fdc640d0d70 2023-12-11T17:11:11.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.370+0000 7fdc6a0e5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc640d13c0 0x7fdc640cc1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:11.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.370+0000 7fdc6a0e5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc640d13c0 0x7fdc640cc1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35150/0 (socket says 172.21.15.37:35150) 2023-12-11T17:11:11.371 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.370+0000 7fdc6a0e5640 1 -- 172.21.15.37:0/1937925717 learned_addr learned my addr 172.21.15.37:0/1937925717 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.370+0000 7fdc6a0e5640 1 -- 172.21.15.37:0/1937925717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc640d0d70 msgr2=0x7fdc640b2e00 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-11T17:11:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.370+0000 7fdc6a0e5640 1 --2- 172.21.15.37:0/1937925717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc640d0d70 0x7fdc640b2e00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:11.372 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.370+0000 7fdc6a0e5640 1 -- 172.21.15.37:0/1937925717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc640cf6a0 msgr2=0x7fdc6414c290 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-11T17:11:11.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.370+0000 7fdc6a0e5640 1 --2- 172.21.15.37:0/1937925717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc640cf6a0 0x7fdc6414c290 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:11.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.370+0000 7fdc6a0e5640 1 -- 172.21.15.37:0/1937925717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc580094d0 con 0x7fdc640d13c0 2023-12-11T17:11:11.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.371+0000 7fdc6a0e5640 1 --2- 172.21.15.37:0/1937925717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc640d13c0 0x7fdc640cc1e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c00c480 tx=0x7fdc5c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:11.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.371+0000 7fdc567fc640 1 -- 172.21.15.37:0/1937925717 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c011800 con 0x7fdc640d13c0 2023-12-11T17:11:11.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.371+0000 7fdc567fc640 1 -- 172.21.15.37:0/1937925717 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5c011960 con 0x7fdc640d13c0 2023-12-11T17:11:11.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.371+0000 7fdc567fc640 1 -- 172.21.15.37:0/1937925717 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5c011d10 con 0x7fdc640d13c0 2023-12-11T17:11:11.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.371+0000 7fdc6a8e6640 1 -- 172.21.15.37:0/1937925717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc640b3ac0 con 0x7fdc640d13c0 2023-12-11T17:11:11.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.371+0000 7fdc6a8e6640 1 -- 172.21.15.37:0/1937925717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc64156e00 con 0x7fdc640d13c0 2023-12-11T17:11:11.373 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.372+0000 7fdc6a8e6640 1 -- 172.21.15.37:0/1937925717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc640ca060 con 0x7fdc640d13c0 2023-12-11T17:11:11.374 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.373+0000 7fdc567fc640 1 -- 172.21.15.37:0/1937925717 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdc5c018360 con 0x7fdc640d13c0 2023-12-11T17:11:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.374+0000 7fdc567fc640 1 --2- 172.21.15.37:0/1937925717 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdc4806ae40 0x7fdc4806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:11.375 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.374+0000 7fdc567fc640 1 -- 172.21.15.37:0/1937925717 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7fdc5c089940 con 0x7fdc640d13c0 2023-12-11T17:11:11.376 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.375+0000 7fdc698e4640 1 --2- 172.21.15.37:0/1937925717 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdc4806ae40 0x7fdc4806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:11.377 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.376+0000 7fdc698e4640 1 --2- 172.21.15.37:0/1937925717 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdc4806ae40 0x7fdc4806d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdc58036000 tx=0x7fdc58008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:11.379 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.378+0000 7fdc567fc640 1 -- 172.21.15.37:0/1937925717 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdc640ca060 con 0x7fdc640d13c0 2023-12-11T17:11:11.576 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.575+0000 7fdc6a8e6640 1 -- 172.21.15.37:0/1937925717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdc640ca060 con 0x7fdc640d13c0 2023-12-11T17:11:11.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.577+0000 7fdc567fc640 1 -- 172.21.15.37:0/1937925717 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18779 (secure 0 0 0) 0x7fdc640ca060 con 0x7fdc640d13c0 2023-12-11T17:11:11.579 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:11:11.579 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:10:32.309274+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:11:11.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.580+0000 7fdc6a8e6640 1 -- 172.21.15.37:0/1937925717 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdc4806ae40 msgr2=0x7fdc4806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:11.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.580+0000 7fdc6a8e6640 1 --2- 172.21.15.37:0/1937925717 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdc4806ae40 0x7fdc4806d300 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fdc58036000 tx=0x7fdc58008030 comp rx=0 tx=0).stop 2023-12-11T17:11:11.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.580+0000 7fdc6a8e6640 1 -- 172.21.15.37:0/1937925717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc640d13c0 msgr2=0x7fdc640cc1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:11.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.580+0000 7fdc6a8e6640 1 --2- 172.21.15.37:0/1937925717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc640d13c0 0x7fdc640cc1e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fdc5c00c480 tx=0x7fdc5c00c940 comp rx=0 tx=0).stop 2023-12-11T17:11:11.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.580+0000 7fdc6a8e6640 1 -- 172.21.15.37:0/1937925717 shutdown_connections 2023-12-11T17:11:11.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.580+0000 7fdc6a8e6640 1 --2- 172.21.15.37:0/1937925717 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdc4806ae40 0x7fdc4806d300 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:11.581 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.580+0000 7fdc6a8e6640 1 --2- 172.21.15.37:0/1937925717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdc640d13c0 0x7fdc640cc1e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:11.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.580+0000 7fdc6a8e6640 1 --2- 172.21.15.37:0/1937925717 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdc640d0d70 0x7fdc640b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:11.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.580+0000 7fdc6a8e6640 1 --2- 172.21.15.37:0/1937925717 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdc640cf6a0 0x7fdc6414c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:11.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.580+0000 7fdc6a8e6640 1 -- 172.21.15.37:0/1937925717 >> 172.21.15.37:0/1937925717 conn(0x7fdc6409c260 msgr2=0x7fdc640b5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:11.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.580+0000 7fdc6a8e6640 1 -- 172.21.15.37:0/1937925717 shutdown_connections 2023-12-11T17:11:11.582 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.580+0000 7fdc6a8e6640 1 -- 172.21.15.37:0/1937925717 wait complete. 2023-12-11T17:11:11.602 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-11T17:11:11.602 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T17:11:11.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.818+0000 7f11a11c9640 1 Processor -- start 2023-12-11T17:11:11.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.818+0000 7f11a11c9640 1 -- start start 2023-12-11T17:11:11.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.819+0000 7f11a11c9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f119c15e5d0 0x7f119c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:11.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.819+0000 7f11a11c9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f119c071260 0x7f119c0cded0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:11.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.819+0000 7f11a11c9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f119c071f90 con 0x7f119c0ae200 2023-12-11T17:11:11.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.819+0000 7f11a11c9640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f119c072270 con 0x7f119c15e5d0 2023-12-11T17:11:11.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.819+0000 7f11a11c9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119c070070 con 0x7f119c071260 2023-12-11T17:11:11.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.820+0000 7f119bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f119c15e5d0 0x7f119c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:11.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.820+0000 7f119bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f119c15e5d0 0x7f119c06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35152/0 (socket says 172.21.15.37:35152) 2023-12-11T17:11:11.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.820+0000 7f119bfff640 1 -- 172.21.15.37:0/2063836859 learned_addr learned my addr 172.21.15.37:0/2063836859 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:11.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.820+0000 7f11a09c8640 1 --2- 172.21.15.37:0/2063836859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f119c071260 0x7f119c0cded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:11.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.820+0000 7f119bfff640 1 -- 172.21.15.37:0/2063836859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f119c071260 msgr2=0x7f119c0cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:11.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.820+0000 7f119bfff640 1 --2- 172.21.15.37:0/2063836859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f119c071260 0x7f119c0cded0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:11.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.820+0000 7f119bfff640 1 -- 172.21.15.37:0/2063836859 >> v1:172.21.15.151:6789/0 conn(0x7f119c0ae200 legacy=0x7f119c070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:11.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.820+0000 7f119bfff640 1 -- 172.21.15.37:0/2063836859 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f119c070350 con 0x7f119c15e5d0 2023-12-11T17:11:11.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.820+0000 7f11a09c8640 1 --2- 172.21.15.37:0/2063836859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f119c071260 0x7f119c0cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:11.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.822+0000 7f119bfff640 1 --2- 172.21.15.37:0/2063836859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f119c15e5d0 0x7f119c06bdf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f118c009e50 tx=0x7f118c02be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75d68823d7af8786 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:11.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.822+0000 7f119affd640 1 -- 172.21.15.37:0/2063836859 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c02c9e0 con 0x7f119c15e5d0 2023-12-11T17:11:11.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.822+0000 7f119affd640 1 -- 172.21.15.37:0/2063836859 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118c02cb40 con 0x7f119c15e5d0 2023-12-11T17:11:11.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.822+0000 7f119affd640 1 -- 172.21.15.37:0/2063836859 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c0343f0 con 0x7f119c15e5d0 2023-12-11T17:11:11.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.823+0000 7f11a11c9640 1 -- 172.21.15.37:0/2063836859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f119c15e5d0 msgr2=0x7f119c06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:11.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.823+0000 7f11a11c9640 1 --2- 172.21.15.37:0/2063836859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f119c15e5d0 0x7f119c06bdf0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f118c009e50 tx=0x7f118c02be40 comp rx=0 tx=0).stop 2023-12-11T17:11:11.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.823+0000 7f11a11c9640 1 -- 172.21.15.37:0/2063836859 shutdown_connections 2023-12-11T17:11:11.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.823+0000 7f11a11c9640 1 --2- 172.21.15.37:0/2063836859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f119c071260 0x7f119c0cded0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:11.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.823+0000 7f11a11c9640 1 --2- 172.21.15.37:0/2063836859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f119c15e5d0 0x7f119c06bdf0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:11.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.823+0000 7f11a11c9640 1 -- 172.21.15.37:0/2063836859 >> 172.21.15.37:0/2063836859 conn(0x7f119c0b0860 msgr2=0x7f119c0b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:11.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.823+0000 7f11a11c9640 1 -- 172.21.15.37:0/2063836859 shutdown_connections 2023-12-11T17:11:11.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.823+0000 7f11a11c9640 1 -- 172.21.15.37:0/2063836859 wait complete. 2023-12-11T17:11:11.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.825+0000 7f11a11c9640 1 Processor -- start 2023-12-11T17:11:11.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.825+0000 7f11a11c9640 1 -- start start 2023-12-11T17:11:11.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.826+0000 7f11a11c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f119c071260 0x7f119c14a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:11.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.826+0000 7f11a11c9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f119c0ae200 0x7f119c0999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:11.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.826+0000 7f11a11c9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f119c15e5d0 0x7f119c14f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:11.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.826+0000 7f11a11c9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c09a440 con 0x7f119c071260 2023-12-11T17:11:11.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.826+0000 7f11a11c9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f119c09a720 con 0x7f119c0ae200 2023-12-11T17:11:11.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.826+0000 7f11a11c9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f119c09b2b0 con 0x7f119c15e5d0 2023-12-11T17:11:11.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.826+0000 7f119bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f119c071260 0x7f119c14a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:11.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.826+0000 7f119bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f119c071260 0x7f119c14a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35168/0 (socket says 172.21.15.37:35168) 2023-12-11T17:11:11.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.826+0000 7f119bfff640 1 -- 172.21.15.37:0/2773410099 learned_addr learned my addr 172.21.15.37:0/2773410099 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:11.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.826+0000 7f11a09c8640 1 --2- 172.21.15.37:0/2773410099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f119c15e5d0 0x7f119c14f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:11.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.826+0000 7f119b7fe640 1 --2- 172.21.15.37:0/2773410099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f119c0ae200 0x7f119c0999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:11.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.827+0000 7f119bfff640 1 -- 172.21.15.37:0/2773410099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f119c15e5d0 msgr2=0x7f119c14f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:11.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.827+0000 7f119bfff640 1 --2- 172.21.15.37:0/2773410099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f119c15e5d0 0x7f119c14f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:11.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.827+0000 7f119bfff640 1 -- 172.21.15.37:0/2773410099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f119c0ae200 msgr2=0x7f119c0999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:11.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.827+0000 7f119bfff640 1 --2- 172.21.15.37:0/2773410099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f119c0ae200 0x7f119c0999f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:11.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.827+0000 7f119bfff640 1 -- 172.21.15.37:0/2773410099 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f118c009b30 con 0x7f119c071260 2023-12-11T17:11:11.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.827+0000 7f119b7fe640 1 --2- 172.21.15.37:0/2773410099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f119c0ae200 0x7f119c0999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:11.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.827+0000 7f119bfff640 1 --2- 172.21.15.37:0/2773410099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f119c071260 0x7f119c14a7e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f118c009e50 tx=0x7f118c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:11.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.827+0000 7f1198ff9640 1 -- 172.21.15.37:0/2773410099 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c03e450 con 0x7f119c071260 2023-12-11T17:11:11.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.827+0000 7f1198ff9640 1 -- 172.21.15.37:0/2773410099 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f118c03e5f0 con 0x7f119c071260 2023-12-11T17:11:11.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.827+0000 7f1198ff9640 1 -- 172.21.15.37:0/2773410099 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f118c03e9a0 con 0x7f119c071260 2023-12-11T17:11:11.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.827+0000 7f11a11c9640 1 -- 172.21.15.37:0/2773410099 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f119c09b590 con 0x7f119c071260 2023-12-11T17:11:11.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.828+0000 7f11a11c9640 1 -- 172.21.15.37:0/2773410099 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f119c14e170 con 0x7f119c071260 2023-12-11T17:11:11.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.829+0000 7f11a11c9640 1 -- 172.21.15.37:0/2773410099 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f119c09b110 con 0x7f119c071260 2023-12-11T17:11:11.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.830+0000 7f1198ff9640 1 -- 172.21.15.37:0/2773410099 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f118c03eb00 con 0x7f119c071260 2023-12-11T17:11:11.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.831+0000 7f1198ff9640 1 --2- 172.21.15.37:0/2773410099 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f118806ae40 0x7f118806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:11.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.831+0000 7f1198ff9640 1 -- 172.21.15.37:0/2773410099 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f118c0aca80 con 0x7f119c071260 2023-12-11T17:11:11.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.831+0000 7f119b7fe640 1 --2- 172.21.15.37:0/2773410099 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f118806ae40 0x7f118806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:11.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.833+0000 7f119b7fe640 1 --2- 172.21.15.37:0/2773410099 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f118806ae40 0x7f118806d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f119c0ade30 tx=0x7f1190008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:11.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:11.836+0000 7f1198ff9640 1 -- 172.21.15.37:0/2773410099 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f119c09b110 con 0x7f119c071260 2023-12-11T17:11:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.068+0000 7f11a11c9640 1 -- 172.21.15.37:0/2773410099 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f119c09b110 con 0x7f119c071260 2023-12-11T17:11:12.069 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.069+0000 7f1198ff9640 1 -- 172.21.15.37:0/2773410099 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f119c09b110 con 0x7f119c071260 2023-12-11T17:11:12.070 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:11:12.070 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2395601865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2395601865},{"type":"v1","addr":"172.21.15.151:6835","nonce":2395601865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1535809271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1535809271},{"type":"v1","addr":"172.21.15.151:6837","nonce":1535809271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2590175074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2590175074},{"type":"v1","addr":"172.21.15.37:6833","nonce":2590175074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-11T17:09:44.643511+0000","modified":"2023-12-11T17:10:12.829357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/2348606057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2348606057},{"type":"v1","addr":"172.21.15.37:6835","nonce":2348606057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T17:11:12.070 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-12-11T17:11:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.071+0000 7f11a11c9640 1 -- 172.21.15.37:0/2773410099 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f118806ae40 msgr2=0x7f118806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.071+0000 7f11a11c9640 1 --2- 172.21.15.37:0/2773410099 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f118806ae40 0x7f118806d300 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f119c0ade30 tx=0x7f1190008040 comp rx=0 tx=0).stop 2023-12-11T17:11:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.071+0000 7f11a11c9640 1 -- 172.21.15.37:0/2773410099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f119c071260 msgr2=0x7f119c14a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:12.072 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.071+0000 7f11a11c9640 1 --2- 172.21.15.37:0/2773410099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f119c071260 0x7f119c14a7e0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f118c009e50 tx=0x7f118c004a40 comp rx=0 tx=0).stop 2023-12-11T17:11:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.071+0000 7f11a11c9640 1 -- 172.21.15.37:0/2773410099 shutdown_connections 2023-12-11T17:11:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.071+0000 7f11a11c9640 1 --2- 172.21.15.37:0/2773410099 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f118806ae40 0x7f118806d300 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.071+0000 7f11a11c9640 1 --2- 172.21.15.37:0/2773410099 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f119c0ae200 0x7f119c0999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.071+0000 7f11a11c9640 1 --2- 172.21.15.37:0/2773410099 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f119c15e5d0 0x7f119c14f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.071+0000 7f11a11c9640 1 --2- 172.21.15.37:0/2773410099 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f119c071260 0x7f119c14a7e0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.071+0000 7f11a11c9640 1 -- 172.21.15.37:0/2773410099 >> 172.21.15.37:0/2773410099 conn(0x7f119c0b0860 msgr2=0x7f119c0affb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.071+0000 7f11a11c9640 1 -- 172.21.15.37:0/2773410099 shutdown_connections 2023-12-11T17:11:12.073 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.072+0000 7f11a11c9640 1 -- 172.21.15.37:0/2773410099 wait complete. 2023-12-11T17:11:12.092 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T17:11:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.312+0000 7f8025725640 1 Processor -- start 2023-12-11T17:11:12.313 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.312+0000 7f8025725640 1 -- start start 2023-12-11T17:11:12.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.314+0000 7f8025725640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8020072180 0x7f80200b4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:12.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.314+0000 7f8025725640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80200b3bb0 con 0x7f802006c410 2023-12-11T17:11:12.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.314+0000 7f8025725640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80201441e0 con 0x7f8020143e00 2023-12-11T17:11:12.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.314+0000 7f8025725640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8020072680 con 0x7f8020072180 2023-12-11T17:11:12.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.314+0000 7f801f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f802006c410 0x7f802015ecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38724/0 (socket says 172.21.15.37:38724) 2023-12-11T17:11:12.315 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.314+0000 7f801f7fe640 1 -- 172.21.15.37:0/2123841884 learned_addr learned my addr 172.21.15.37:0/2123841884 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.315+0000 7f80167fc640 1 --2- 172.21.15.37:0/2123841884 >> v2:172.21.15.151:3300/0 conn(0x7f8020072180 0x7f80200b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.315+0000 7f801e7fc640 1 -- 172.21.15.37:0/2123841884 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3015201865 0 0) 0x7f80200b3bb0 con 0x7f802006c410 2023-12-11T17:11:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.315+0000 7f801e7fc640 1 -- 172.21.15.37:0/2123841884 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f800c003520 con 0x7f802006c410 2023-12-11T17:11:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.315+0000 7f801e7fc640 1 -- 172.21.15.37:0/2123841884 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 986879864 0 0) 0x7f800c003520 con 0x7f802006c410 2023-12-11T17:11:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.315+0000 7f801e7fc640 1 -- 172.21.15.37:0/2123841884 >> v2:172.21.15.151:3300/0 conn(0x7f8020072180 msgr2=0x7f80200b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.315+0000 7f801e7fc640 1 --2- 172.21.15.37:0/2123841884 >> v2:172.21.15.151:3300/0 conn(0x7f8020072180 0x7f80200b4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.315+0000 7f801e7fc640 1 -- 172.21.15.37:0/2123841884 >> v1:172.21.15.151:6789/0 conn(0x7f8020143e00 legacy=0x7f80200b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:12.317 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.315+0000 7f801e7fc640 1 -- 172.21.15.37:0/2123841884 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80200b1e30 con 0x7f802006c410 2023-12-11T17:11:12.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.315+0000 7f801e7fc640 1 -- 172.21.15.37:0/2123841884 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f80180019f0 con 0x7f802006c410 2023-12-11T17:11:12.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.315+0000 7f801e7fc640 1 -- 172.21.15.37:0/2123841884 >> v1:172.21.15.37:6789/0 conn(0x7f802006c410 legacy=0x7f802015ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:12.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.315+0000 7f801e7fc640 1 --2- 172.21.15.37:0/2123841884 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f800c0039c0 0x7f800c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:12.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.315+0000 7f801e7fc640 1 --2- 172.21.15.37:0/2123841884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f800c0047c0 0x7f800c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:12.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.315+0000 7f801e7fc640 1 --2- 172.21.15.37:0/2123841884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f800c005180 0x7f800c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:12.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.315+0000 7f801e7fc640 1 -- 172.21.15.37:0/2123841884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8020072680 con 0x7f800c005180 2023-12-11T17:11:12.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.315+0000 7f801e7fc640 1 -- 172.21.15.37:0/2123841884 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f800c00c050 con 0x7f800c0047c0 2023-12-11T17:11:12.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.315+0000 7f801e7fc640 1 -- 172.21.15.37:0/2123841884 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800c00c210 con 0x7f800c0039c0 2023-12-11T17:11:12.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.316+0000 7f801f7fe640 1 --2- 172.21.15.37:0/2123841884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f800c005180 0x7f800c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:12.318 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.316+0000 7f80167fc640 1 --2- 172.21.15.37:0/2123841884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f800c0047c0 0x7f800c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:12.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.316+0000 7f801effd640 1 --2- 172.21.15.37:0/2123841884 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f800c0039c0 0x7f800c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:12.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.316+0000 7f801f7fe640 1 -- 172.21.15.37:0/2123841884 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f800c0039c0 msgr2=0x7f800c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:12.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.316+0000 7f801f7fe640 1 --2- 172.21.15.37:0/2123841884 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f800c0039c0 0x7f800c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:12.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.316+0000 7f801f7fe640 1 -- 172.21.15.37:0/2123841884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f800c0047c0 msgr2=0x7f800c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:12.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.316+0000 7f801f7fe640 1 --2- 172.21.15.37:0/2123841884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f800c0047c0 0x7f800c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:12.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.316+0000 7f801f7fe640 1 -- 172.21.15.37:0/2123841884 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800c003520 con 0x7f800c005180 2023-12-11T17:11:12.319 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.316+0000 7f80167fc640 1 --2- 172.21.15.37:0/2123841884 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f800c0047c0 0x7f800c004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:11:12.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.317+0000 7f801f7fe640 1 -- 172.21.15.37:0/2123841884 reap_dead start 2023-12-11T17:11:12.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.317+0000 7f801f7fe640 1 --2- 172.21.15.37:0/2123841884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f800c005180 0x7f800c00b980 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f801800a770 tx=0x7f800c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be1b178dd0e5493d server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:12.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.318+0000 7f801e7fc640 1 -- 172.21.15.37:0/2123841884 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8018034630 con 0x7f800c005180 2023-12-11T17:11:12.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.318+0000 7f801e7fc640 1 -- 172.21.15.37:0/2123841884 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801802f070 con 0x7f800c005180 2023-12-11T17:11:12.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.318+0000 7f801e7fc640 1 -- 172.21.15.37:0/2123841884 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8018034a10 con 0x7f800c005180 2023-12-11T17:11:12.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.318+0000 7f8025725640 1 -- 172.21.15.37:0/2123841884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f800c005180 msgr2=0x7f800c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:12.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.318+0000 7f8025725640 1 --2- 172.21.15.37:0/2123841884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f800c005180 0x7f800c00b980 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f801800a770 tx=0x7f800c0057f0 comp rx=0 tx=0).stop 2023-12-11T17:11:12.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.318+0000 7f8025725640 1 -- 172.21.15.37:0/2123841884 shutdown_connections 2023-12-11T17:11:12.320 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.318+0000 7f8025725640 1 --2- 172.21.15.37:0/2123841884 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f800c005180 0x7f800c00b980 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.318+0000 7f8025725640 1 -- 172.21.15.37:0/2123841884 >> 172.21.15.37:0/2123841884 conn(0x7f80200b0a90 msgr2=0x7f80200b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.318+0000 7f8025725640 1 -- 172.21.15.37:0/2123841884 shutdown_connections 2023-12-11T17:11:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.319+0000 7f8025725640 1 -- 172.21.15.37:0/2123841884 wait complete. 2023-12-11T17:11:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.320+0000 7f8025725640 1 Processor -- start 2023-12-11T17:11:12.321 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.321+0000 7f8025725640 1 -- start start 2023-12-11T17:11:12.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.321+0000 7f8025725640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f800c005180 0x7f80201e85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:12.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.321+0000 7f8025725640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8020139710 0x7f8020139b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:12.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.322+0000 7f8025725640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f802013bb90 0x7f802013bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:12.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.322+0000 7f8025725640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802013d480 con 0x7f8020139710 2023-12-11T17:11:12.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.322+0000 7f8025725640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802013a0b0 con 0x7f800c005180 2023-12-11T17:11:12.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.322+0000 7f8025725640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802013c900 con 0x7f802013bb90 2023-12-11T17:11:12.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.322+0000 7f80167fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8020139710 0x7f8020139b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:12.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.322+0000 7f80167fc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8020139710 0x7f8020139b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35196/0 (socket says 172.21.15.37:35196) 2023-12-11T17:11:12.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.322+0000 7f80167fc640 1 -- 172.21.15.37:0/1231571020 learned_addr learned my addr 172.21.15.37:0/1231571020 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:12.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.322+0000 7f80167fc640 1 -- 172.21.15.37:0/1231571020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f802013bb90 msgr2=0x7f802013bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.322+0000 7f80167fc640 1 --2- 172.21.15.37:0/1231571020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f802013bb90 0x7f802013bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.322+0000 7f80167fc640 1 -- 172.21.15.37:0/1231571020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f800c005180 msgr2=0x7f80201e85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.322+0000 7f80167fc640 1 --2- 172.21.15.37:0/1231571020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f800c005180 0x7f80201e85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.322+0000 7f80167fc640 1 -- 172.21.15.37:0/1231571020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802013cbe0 con 0x7f8020139710 2023-12-11T17:11:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.323+0000 7f80167fc640 1 --2- 172.21.15.37:0/1231571020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8020139710 0x7f8020139b70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f80080114e0 tx=0x7f80080119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.323+0000 7f8017fff640 1 -- 172.21.15.37:0/1231571020 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8008015870 con 0x7f8020139710 2023-12-11T17:11:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.323+0000 7f8017fff640 1 -- 172.21.15.37:0/1231571020 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80080159d0 con 0x7f8020139710 2023-12-11T17:11:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.323+0000 7f8017fff640 1 -- 172.21.15.37:0/1231571020 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8008015d40 con 0x7f8020139710 2023-12-11T17:11:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.323+0000 7f8025725640 1 -- 172.21.15.37:0/1231571020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802013cec0 con 0x7f8020139710 2023-12-11T17:11:12.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.323+0000 7f8025725640 1 -- 172.21.15.37:0/1231571020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802013c530 con 0x7f8020139710 2023-12-11T17:11:12.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.324+0000 7f8025725640 1 -- 172.21.15.37:0/1231571020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80200745d0 con 0x7f8020139710 2023-12-11T17:11:12.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.325+0000 7f8017fff640 1 -- 172.21.15.37:0/1231571020 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f800801d400 con 0x7f8020139710 2023-12-11T17:11:12.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.326+0000 7f8017fff640 1 --2- 172.21.15.37:0/1231571020 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f800006ae70 0x7f800006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:12.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.326+0000 7f8017fff640 1 -- 172.21.15.37:0/1231571020 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f8008089e60 con 0x7f8020139710 2023-12-11T17:11:12.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.327+0000 7f801effd640 1 --2- 172.21.15.37:0/1231571020 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f800006ae70 0x7f800006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:12.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.328+0000 7f801effd640 1 --2- 172.21.15.37:0/1231571020 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f800006ae70 0x7f800006d330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8010004c80 tx=0x7f8010009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:12.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.330+0000 7f8017fff640 1 -- 172.21.15.37:0/1231571020 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8008054b50 con 0x7f8020139710 2023-12-11T17:11:12.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.563+0000 7f8025725640 1 -- 172.21.15.37:0/1231571020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f802006e020 con 0x7f8020139710 2023-12-11T17:11:12.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.565+0000 7f8017fff640 1 -- 172.21.15.37:0/1231571020 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4915 (secure 0 0 0) 0x7f8008022090 con 0x7f8020139710 2023-12-11T17:11:12.566 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:11:12.566 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/2395601865","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":2395601865},{"type":"v1","addr":"172.21.15.151:6835","nonce":2395601865}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4229,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1535809271","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1535809271},{"type":"v1","addr":"172.21.15.151:6837","nonce":1535809271}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":3},{"gid":4248,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6833/2590175074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":2590175074},{"type":"v1","addr":"172.21.15.37:6833","nonce":2590175074}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-11T17:09:44.643511+0000","modified":"2023-12-11T17:10:12.829357+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":4251},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4251":{"gid":4251,"name":"a","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.37:6835/2348606057","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":2348606057},{"type":"v1","addr":"172.21.15.37:6835","nonce":2348606057}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-11T17:11:12.566 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 8 2023-12-11T17:11:12.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.567+0000 7f8025725640 1 -- 172.21.15.37:0/1231571020 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f800006ae70 msgr2=0x7f800006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:12.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.567+0000 7f8025725640 1 --2- 172.21.15.37:0/1231571020 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f800006ae70 0x7f800006d330 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8010004c80 tx=0x7f8010009040 comp rx=0 tx=0).stop 2023-12-11T17:11:12.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.567+0000 7f8025725640 1 -- 172.21.15.37:0/1231571020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8020139710 msgr2=0x7f8020139b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:12.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.567+0000 7f8025725640 1 --2- 172.21.15.37:0/1231571020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8020139710 0x7f8020139b70 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f80080114e0 tx=0x7f80080119a0 comp rx=0 tx=0).stop 2023-12-11T17:11:12.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.568+0000 7f8025725640 1 -- 172.21.15.37:0/1231571020 shutdown_connections 2023-12-11T17:11:12.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.568+0000 7f8025725640 1 --2- 172.21.15.37:0/1231571020 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f800006ae70 0x7f800006d330 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:12.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.568+0000 7f8025725640 1 --2- 172.21.15.37:0/1231571020 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f802013bb90 0x7f802013bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:12.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.568+0000 7f8025725640 1 --2- 172.21.15.37:0/1231571020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8020139710 0x7f8020139b70 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:12.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.568+0000 7f8025725640 1 --2- 172.21.15.37:0/1231571020 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f800c005180 0x7f80201e85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:12.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.568+0000 7f8025725640 1 -- 172.21.15.37:0/1231571020 >> 172.21.15.37:0/1231571020 conn(0x7f80200b0a90 msgr2=0x7f8020071080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:12.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.568+0000 7f8025725640 1 -- 172.21.15.37:0/1231571020 shutdown_connections 2023-12-11T17:11:12.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.568+0000 7f8025725640 1 -- 172.21.15.37:0/1231571020 wait complete. 2023-12-11T17:11:12.589 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:11:12.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.815+0000 7f4291a9f640 1 Processor -- start 2023-12-11T17:11:12.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.815+0000 7f4291a9f640 1 -- start start 2023-12-11T17:11:12.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.817+0000 7f4291a9f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f428c15d390 0x7f428c0b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:12.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.817+0000 7f4291a9f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f428c0d1b20 0x7f428c0b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:12.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.817+0000 7f4291a9f640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f428c0b0a00 con 0x7f428c0d0c10 2023-12-11T17:11:12.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.817+0000 7f4291a9f640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f428c0ceea0 con 0x7f428c15d390 2023-12-11T17:11:12.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.817+0000 7f4291a9f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c15d770 con 0x7f428c0d1b20 2023-12-11T17:11:12.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.818+0000 7f4290a9d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f428c15d390 0x7f428c0b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:12.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.818+0000 7f429129e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f428c0d1b20 0x7f428c0b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:12.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.818+0000 7f4290a9d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f428c15d390 0x7f428c0b1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:55228/0 (socket says 172.21.15.37:55228) 2023-12-11T17:11:12.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.818+0000 7f4290a9d640 1 -- 172.21.15.37:0/4286020316 learned_addr learned my addr 172.21.15.37:0/4286020316 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:12.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.819+0000 7f4290a9d640 1 -- 172.21.15.37:0/4286020316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f428c0d1b20 msgr2=0x7f428c0b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:12.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.819+0000 7f4290a9d640 1 --2- 172.21.15.37:0/4286020316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f428c0d1b20 0x7f428c0b04c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:12.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.819+0000 7f4290a9d640 1 -- 172.21.15.37:0/4286020316 >> v1:172.21.15.151:6789/0 conn(0x7f428c0d0c10 legacy=0x7f428c0d1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:12.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.819+0000 7f4290a9d640 1 -- 172.21.15.37:0/4286020316 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c0b1840 con 0x7f428c15d390 2023-12-11T17:11:12.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.820+0000 7f4290a9d640 1 --2- 172.21.15.37:0/4286020316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f428c15d390 0x7f428c0b1cd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4280009870 tx=0x7f428002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=68d073d8f78d8a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:12.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.820+0000 7f428b7fe640 1 -- 172.21.15.37:0/4286020316 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4280031640 con 0x7f428c15d390 2023-12-11T17:11:12.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.820+0000 7f428b7fe640 1 -- 172.21.15.37:0/4286020316 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42800317a0 con 0x7f428c15d390 2023-12-11T17:11:12.821 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.820+0000 7f428b7fe640 1 -- 172.21.15.37:0/4286020316 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4280031b30 con 0x7f428c15d390 2023-12-11T17:11:12.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.821+0000 7f4291a9f640 1 -- 172.21.15.37:0/4286020316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f428c15d390 msgr2=0x7f428c0b1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:12.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.821+0000 7f4291a9f640 1 --2- 172.21.15.37:0/4286020316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f428c15d390 0x7f428c0b1cd0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4280009870 tx=0x7f428002b8f0 comp rx=0 tx=0).stop 2023-12-11T17:11:12.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.821+0000 7f4291a9f640 1 -- 172.21.15.37:0/4286020316 shutdown_connections 2023-12-11T17:11:12.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.821+0000 7f4291a9f640 1 --2- 172.21.15.37:0/4286020316 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f428c0d1b20 0x7f428c0b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:12.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.821+0000 7f4291a9f640 1 --2- 172.21.15.37:0/4286020316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f428c15d390 0x7f428c0b1cd0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:12.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.821+0000 7f4291a9f640 1 -- 172.21.15.37:0/4286020316 >> 172.21.15.37:0/4286020316 conn(0x7f428c0d2ec0 msgr2=0x7f428c0d32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:12.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.821+0000 7f4291a9f640 1 -- 172.21.15.37:0/4286020316 shutdown_connections 2023-12-11T17:11:12.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.821+0000 7f4291a9f640 1 -- 172.21.15.37:0/4286020316 wait complete. 2023-12-11T17:11:12.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.823+0000 7f4291a9f640 1 Processor -- start 2023-12-11T17:11:12.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.823+0000 7f4291a9f640 1 -- start start 2023-12-11T17:11:12.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.824+0000 7f4291a9f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f428c0d0c10 0x7f428c0b8780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:12.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.824+0000 7f4291a9f640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f428c0d1b20 0x7f428c15b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:12.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.824+0000 7f4291a9f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c15d390 0x7f428c09f900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:12.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.824+0000 7f4291a9f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c15b540 con 0x7f428c15d390 2023-12-11T17:11:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.824+0000 7f4291a9f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f428c0a07d0 con 0x7f428c0d0c10 2023-12-11T17:11:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.824+0000 7f4291a9f640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f428c0a0ab0 con 0x7f428c0d1b20 2023-12-11T17:11:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.825+0000 7f429129e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c15d390 0x7f428c09f900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.825+0000 7f429129e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c15d390 0x7f428c09f900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35206/0 (socket says 172.21.15.37:35206) 2023-12-11T17:11:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.825+0000 7f429129e640 1 -- 172.21.15.37:0/3781279662 learned_addr learned my addr 172.21.15.37:0/3781279662 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.825+0000 7f428bfff640 1 --2- 172.21.15.37:0/3781279662 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f428c0d1b20 0x7f428c15b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.825+0000 7f429129e640 1 -- 172.21.15.37:0/3781279662 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f428c0d1b20 msgr2=0x7f428c15b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.825+0000 7f429129e640 1 --2- 172.21.15.37:0/3781279662 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f428c0d1b20 0x7f428c15b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.825+0000 7f429129e640 1 -- 172.21.15.37:0/3781279662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f428c0d0c10 msgr2=0x7f428c0b8780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.825+0000 7f429129e640 1 --2- 172.21.15.37:0/3781279662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f428c0d0c10 0x7f428c0b8780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.825+0000 7f429129e640 1 -- 172.21.15.37:0/3781279662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42800094d0 con 0x7f428c15d390 2023-12-11T17:11:12.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.826+0000 7f429129e640 1 --2- 172.21.15.37:0/3781279662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c15d390 0x7f428c09f900 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f428400ef90 tx=0x7f428400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:12.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.826+0000 7f42897fa640 1 -- 172.21.15.37:0/3781279662 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4284009ca0 con 0x7f428c15d390 2023-12-11T17:11:12.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.826+0000 7f42897fa640 1 -- 172.21.15.37:0/3781279662 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f428400f040 con 0x7f428c15d390 2023-12-11T17:11:12.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.826+0000 7f42897fa640 1 -- 172.21.15.37:0/3781279662 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42840146c0 con 0x7f428c15d390 2023-12-11T17:11:12.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.826+0000 7f4291a9f640 1 -- 172.21.15.37:0/3781279662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f428c0b2340 con 0x7f428c15d390 2023-12-11T17:11:12.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.826+0000 7f4291a9f640 1 -- 172.21.15.37:0/3781279662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f428c0b2900 con 0x7f428c15d390 2023-12-11T17:11:12.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.827+0000 7f4291a9f640 1 -- 172.21.15.37:0/3781279662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f428c074450 con 0x7f428c15d390 2023-12-11T17:11:12.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.828+0000 7f42897fa640 1 -- 172.21.15.37:0/3781279662 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4284014820 con 0x7f428c15d390 2023-12-11T17:11:12.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.830+0000 7f42897fa640 1 --2- 172.21.15.37:0/3781279662 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f427006ae40 0x7f427006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:12.830 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.830+0000 7f42897fa640 1 -- 172.21.15.37:0/3781279662 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f428408ab20 con 0x7f428c15d390 2023-12-11T17:11:12.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.830+0000 7f4290a9d640 1 --2- 172.21.15.37:0/3781279662 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f427006ae40 0x7f427006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:12.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.831+0000 7f4290a9d640 1 --2- 172.21.15.37:0/3781279662 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f427006ae40 0x7f427006d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4280036000 tx=0x7f4280030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:12.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:12.834+0000 7f42897fa640 1 -- 172.21.15.37:0/3781279662 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f42840556c0 con 0x7f428c15d390 2023-12-11T17:11:13.031 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.030+0000 7f4291a9f640 1 -- 172.21.15.37:0/3781279662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f428c0d11f0 con 0x7f428c15d390 2023-12-11T17:11:13.033 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.033+0000 7f42897fa640 1 -- 172.21.15.37:0/3781279662 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v27) v1 ==== 74+0+18779 (secure 0 0 0) 0x7f4284018070 con 0x7f428c15d390 2023-12-11T17:11:13.034 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:11:13.034 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":27,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:10:32.309274+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:09:42.786774+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-11T17:09:43.660585+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2023-12-11T17:09:47.272351+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.c","mappings":[{"from":5,"to":2}]},{"pgid":"3.d","mappings":[{"from":5,"to":1}]},{"pgid":"3.23","mappings":[{"from":3,"to":1}]},{"pgid":"3.26","mappings":[{"from":7,"to":2}]},{"pgid":"3.2f","mappings":[{"from":5,"to":2}]},{"pgid":"4.2","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":1,"to":2}]},{"pgid":"4.e","mappings":[{"from":1,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:11:13.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.035+0000 7f4291a9f640 1 -- 172.21.15.37:0/3781279662 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f427006ae40 msgr2=0x7f427006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:13.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.035+0000 7f4291a9f640 1 --2- 172.21.15.37:0/3781279662 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f427006ae40 0x7f427006d300 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4280036000 tx=0x7f4280030000 comp rx=0 tx=0).stop 2023-12-11T17:11:13.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.035+0000 7f4291a9f640 1 -- 172.21.15.37:0/3781279662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c15d390 msgr2=0x7f428c09f900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:13.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.035+0000 7f4291a9f640 1 --2- 172.21.15.37:0/3781279662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c15d390 0x7f428c09f900 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f428400ef90 tx=0x7f428400c490 comp rx=0 tx=0).stop 2023-12-11T17:11:13.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.036+0000 7f4291a9f640 1 -- 172.21.15.37:0/3781279662 shutdown_connections 2023-12-11T17:11:13.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.036+0000 7f4291a9f640 1 --2- 172.21.15.37:0/3781279662 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f427006ae40 0x7f427006d300 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.036+0000 7f4291a9f640 1 --2- 172.21.15.37:0/3781279662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f428c15d390 0x7f428c09f900 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.036+0000 7f4291a9f640 1 --2- 172.21.15.37:0/3781279662 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f428c0d1b20 0x7f428c15b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.036+0000 7f4291a9f640 1 --2- 172.21.15.37:0/3781279662 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f428c0d0c10 0x7f428c0b8780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.036+0000 7f4291a9f640 1 -- 172.21.15.37:0/3781279662 >> 172.21.15.37:0/3781279662 conn(0x7f428c0d2ec0 msgr2=0x7f428c0c92f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:13.037 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.036+0000 7f4291a9f640 1 -- 172.21.15.37:0/3781279662 shutdown_connections 2023-12-11T17:11:13.038 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.036+0000 7f4291a9f640 1 -- 172.21.15.37:0/3781279662 wait complete. 2023-12-11T17:11:13.057 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-11T17:11:13.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.280+0000 7f3fee553640 1 Processor -- start 2023-12-11T17:11:13.281 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.280+0000 7f3fee553640 1 -- start start 2023-12-11T17:11:13.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.282+0000 7f3fee553640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3fe81467c0 0x7f3fe80cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:13.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.282+0000 7f3fee553640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe806cef0 0x7f3fe80cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:13.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.282+0000 7f3fee553640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fe806d510 con 0x7f3fe8146ba0 2023-12-11T17:11:13.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.282+0000 7f3fee553640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fe80ac860 con 0x7f3fe81467c0 2023-12-11T17:11:13.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.282+0000 7f3fee553640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe806d7f0 con 0x7f3fe806cef0 2023-12-11T17:11:13.283 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.282+0000 7f3fdffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3fe8146ba0 0x7f3fe806c7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38730/0 (socket says 172.21.15.37:38730) 2023-12-11T17:11:13.284 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.282+0000 7f3fdffff640 1 -- 172.21.15.37:0/2812360670 learned_addr learned my addr 172.21.15.37:0/2812360670 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:13.285 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.283+0000 7f3fe7fff640 1 --2- 172.21.15.37:0/2812360670 >> v2:172.21.15.151:3300/0 conn(0x7f3fe81467c0 0x7f3fe80cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:13.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.283+0000 7f3fecaf0640 1 --2- 172.21.15.37:0/2812360670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe806cef0 0x7f3fe80cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:13.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.283+0000 7f3fe77fe640 1 -- 172.21.15.37:0/2812360670 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163356691 0 0) 0x7f3fe806d510 con 0x7f3fe8146ba0 2023-12-11T17:11:13.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.283+0000 7f3fe77fe640 1 -- 172.21.15.37:0/2812360670 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3fd4003520 con 0x7f3fe8146ba0 2023-12-11T17:11:13.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.283+0000 7f3fe77fe640 1 -- 172.21.15.37:0/2812360670 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2334530168 0 0) 0x7f3fd4003520 con 0x7f3fe8146ba0 2023-12-11T17:11:13.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.283+0000 7f3fe77fe640 1 -- 172.21.15.37:0/2812360670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe806cef0 msgr2=0x7f3fe80cce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:13.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.283+0000 7f3fe77fe640 1 --2- 172.21.15.37:0/2812360670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe806cef0 0x7f3fe80cce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.283+0000 7f3fe77fe640 1 -- 172.21.15.37:0/2812360670 >> v2:172.21.15.151:3300/0 conn(0x7f3fe81467c0 msgr2=0x7f3fe80cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:13.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.283+0000 7f3fe77fe640 1 --2- 172.21.15.37:0/2812360670 >> v2:172.21.15.151:3300/0 conn(0x7f3fe81467c0 0x7f3fe80cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.283+0000 7f3fe77fe640 1 -- 172.21.15.37:0/2812360670 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe806dad0 con 0x7f3fe8146ba0 2023-12-11T17:11:13.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.283+0000 7f3fe77fe640 1 -- 172.21.15.37:0/2812360670 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f3fd0001670 con 0x7f3fe8146ba0 2023-12-11T17:11:13.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.283+0000 7f3fe77fe640 1 -- 172.21.15.37:0/2812360670 >> v1:172.21.15.37:6789/0 conn(0x7f3fe8146ba0 legacy=0x7f3fe806c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:13.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.284+0000 7f3fe77fe640 1 --2- 172.21.15.37:0/2812360670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fd4003970 0x7f3fd4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:13.286 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.284+0000 7f3fe77fe640 1 --2- 172.21.15.37:0/2812360670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd40047c0 0x7f3fd4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:13.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.284+0000 7f3fe77fe640 1 --2- 172.21.15.37:0/2812360670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe806cef0 0x7f3fd4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:13.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.284+0000 7f3fe77fe640 1 -- 172.21.15.37:0/2812360670 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe80ac860 con 0x7f3fd40047c0 2023-12-11T17:11:13.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.284+0000 7f3fe77fe640 1 -- 172.21.15.37:0/2812360670 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe806d7f0 con 0x7f3fd4003970 2023-12-11T17:11:13.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.284+0000 7f3fe77fe640 1 -- 172.21.15.37:0/2812360670 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fd400b980 con 0x7f3fe806cef0 2023-12-11T17:11:13.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.284+0000 7f3fdffff640 1 --2- 172.21.15.37:0/2812360670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd40047c0 0x7f3fd4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:13.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.284+0000 7f3fecaf0640 1 --2- 172.21.15.37:0/2812360670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe806cef0 0x7f3fd4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:13.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.284+0000 7f3fe7fff640 1 --2- 172.21.15.37:0/2812360670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fd4003970 0x7f3fd4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:13.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.284+0000 7f3fdffff640 1 -- 172.21.15.37:0/2812360670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe806cef0 msgr2=0x7f3fd4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:13.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.284+0000 7f3fdffff640 1 --2- 172.21.15.37:0/2812360670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe806cef0 0x7f3fd4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.284+0000 7f3fdffff640 1 -- 172.21.15.37:0/2812360670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fd4003970 msgr2=0x7f3fd4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:13.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.284+0000 7f3fdffff640 1 --2- 172.21.15.37:0/2812360670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fd4003970 0x7f3fd4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.284+0000 7f3fdffff640 1 -- 172.21.15.37:0/2812360670 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd4003520 con 0x7f3fd40047c0 2023-12-11T17:11:13.287 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.284+0000 7f3fecaf0640 1 --2- 172.21.15.37:0/2812360670 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe806cef0 0x7f3fd4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:13.288 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.284+0000 7f3fe7fff640 1 --2- 172.21.15.37:0/2812360670 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fd4003970 0x7f3fd4003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:13.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.286+0000 7f3fdffff640 1 --2- 172.21.15.37:0/2812360670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd40047c0 0x7f3fd4004c40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3fd000c290 tx=0x7f3fd40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b6bcc2436a01e3e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:13.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.286+0000 7f3fe77fe640 1 -- 172.21.15.37:0/2812360670 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd0005ad0 con 0x7f3fd40047c0 2023-12-11T17:11:13.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.286+0000 7f3fe77fe640 1 -- 172.21.15.37:0/2812360670 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd0005c30 con 0x7f3fd40047c0 2023-12-11T17:11:13.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.286+0000 7f3fe77fe640 1 -- 172.21.15.37:0/2812360670 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd002c8d0 con 0x7f3fd40047c0 2023-12-11T17:11:13.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.287+0000 7f3fee553640 1 -- 172.21.15.37:0/2812360670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd40047c0 msgr2=0x7f3fd4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:13.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.287+0000 7f3fee553640 1 --2- 172.21.15.37:0/2812360670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd40047c0 0x7f3fd4004c40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3fd000c290 tx=0x7f3fd40057f0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.287+0000 7f3fecaf0640 1 -- 172.21.15.37:0/2812360670 reap_dead start 2023-12-11T17:11:13.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.287+0000 7f3fee553640 1 -- 172.21.15.37:0/2812360670 shutdown_connections 2023-12-11T17:11:13.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.287+0000 7f3fee553640 1 -- 172.21.15.37:0/2812360670 >> 172.21.15.37:0/2812360670 conn(0x7f3fe80b0a90 msgr2=0x7f3fe80b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:13.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.287+0000 7f3fee553640 1 -- 172.21.15.37:0/2812360670 shutdown_connections 2023-12-11T17:11:13.289 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.287+0000 7f3fee553640 1 -- 172.21.15.37:0/2812360670 wait complete. 2023-12-11T17:11:13.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.289+0000 7f3fee553640 1 Processor -- start 2023-12-11T17:11:13.290 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.289+0000 7f3fee553640 1 -- start start 2023-12-11T17:11:13.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.290+0000 7f3fee553640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd40047c0 0x7f3fe80b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:13.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.290+0000 7f3fee553640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe815e2a0 0x7f3fe813fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:13.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.290+0000 7f3fee553640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe8142a20 0x7f3fe8142ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:13.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.290+0000 7f3fee553640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe815fe30 con 0x7f3fd40047c0 2023-12-11T17:11:13.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.290+0000 7f3fee553640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe81433e0 con 0x7f3fe8142a20 2023-12-11T17:11:13.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.290+0000 7f3fee553640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe80b2300 con 0x7f3fe815e2a0 2023-12-11T17:11:13.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.290+0000 7f3fe7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd40047c0 0x7f3fe80b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:13.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.290+0000 7f3fe7fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd40047c0 0x7f3fe80b1dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35218/0 (socket says 172.21.15.37:35218) 2023-12-11T17:11:13.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.290+0000 7f3fe7fff640 1 -- 172.21.15.37:0/4020800163 learned_addr learned my addr 172.21.15.37:0/4020800163 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:13.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.291+0000 7f3fdffff640 1 --2- 172.21.15.37:0/4020800163 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe815e2a0 0x7f3fe813fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:13.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.291+0000 7f3fe7fff640 1 -- 172.21.15.37:0/4020800163 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe815e2a0 msgr2=0x7f3fe813fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:13.292 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.291+0000 7f3fe7fff640 1 --2- 172.21.15.37:0/4020800163 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe815e2a0 0x7f3fe813fa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.291+0000 7f3fe7fff640 1 -- 172.21.15.37:0/4020800163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe8142a20 msgr2=0x7f3fe8142ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:13.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.291+0000 7f3fecaf0640 1 --2- 172.21.15.37:0/4020800163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe8142a20 0x7f3fe8142ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:13.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.291+0000 7f3fe7fff640 1 --2- 172.21.15.37:0/4020800163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe8142a20 0x7f3fe8142ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.291+0000 7f3fe7fff640 1 -- 172.21.15.37:0/4020800163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe81e7c60 con 0x7f3fd40047c0 2023-12-11T17:11:13.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.291+0000 7f3fdffff640 1 --2- 172.21.15.37:0/4020800163 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe815e2a0 0x7f3fe813fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:13.293 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.291+0000 7f3fe7fff640 1 --2- 172.21.15.37:0/4020800163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd40047c0 0x7f3fe80b1dc0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8010a00 tx=0x7f3fd8010ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:13.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.291+0000 7f3fe57fa640 1 -- 172.21.15.37:0/4020800163 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd800ebc0 con 0x7f3fd40047c0 2023-12-11T17:11:13.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.291+0000 7f3fe57fa640 1 -- 172.21.15.37:0/4020800163 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fd800ed20 con 0x7f3fd40047c0 2023-12-11T17:11:13.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.291+0000 7f3fe57fa640 1 -- 172.21.15.37:0/4020800163 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fd801c620 con 0x7f3fd40047c0 2023-12-11T17:11:13.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.291+0000 7f3fee553640 1 -- 172.21.15.37:0/4020800163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe81e8220 con 0x7f3fd40047c0 2023-12-11T17:11:13.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.292+0000 7f3fee553640 1 -- 172.21.15.37:0/4020800163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe813ff40 con 0x7f3fd40047c0 2023-12-11T17:11:13.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.293+0000 7f3fee553640 1 -- 172.21.15.37:0/4020800163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe80745d0 con 0x7f3fd40047c0 2023-12-11T17:11:13.294 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.294+0000 7f3fe57fa640 1 -- 172.21.15.37:0/4020800163 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3fd801c780 con 0x7f3fd40047c0 2023-12-11T17:11:13.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.294+0000 7f3fe57fa640 1 --2- 172.21.15.37:0/4020800163 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3fc806ae70 0x7f3fc806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:13.295 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.295+0000 7f3fe57fa640 1 -- 172.21.15.37:0/4020800163 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(27..27 src has 1..27) v4 ==== 6692+0+0 (secure 0 0 0) 0x7f3fd8089fb0 con 0x7f3fd40047c0 2023-12-11T17:11:13.296 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.295+0000 7f3fdffff640 1 --2- 172.21.15.37:0/4020800163 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3fc806ae70 0x7f3fc806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:13.297 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.296+0000 7f3fdffff640 1 --2- 172.21.15.37:0/4020800163 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3fc806ae70 0x7f3fc806d330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0034000 tx=0x7f3fd0007000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:13.300 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.299+0000 7f3fe57fa640 1 -- 172.21.15.37:0/4020800163 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3fd80bce90 con 0x7f3fd40047c0 2023-12-11T17:11:13.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.537+0000 7f3fee553640 1 -- 172.21.15.37:0/4020800163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3fe80726a0 con 0x7f3fd40047c0 2023-12-11T17:11:13.539 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-12-11T17:11:13.538+0000 7f321afd9640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-11T17:11:13.542 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.541+0000 7f3fe57fa640 1 -- 172.21.15.37:0/4020800163 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3fd8054d10 con 0x7f3fd40047c0 2023-12-11T17:11:13.542 INFO:teuthology.orchestra.run.smithi037.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-11T17:11:13.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.546+0000 7f3fee553640 1 -- 172.21.15.37:0/4020800163 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3fc806ae70 msgr2=0x7f3fc806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:13.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.546+0000 7f3fee553640 1 --2- 172.21.15.37:0/4020800163 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3fc806ae70 0x7f3fc806d330 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3fd0034000 tx=0x7f3fd0007000 comp rx=0 tx=0).stop 2023-12-11T17:11:13.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.546+0000 7f3fee553640 1 -- 172.21.15.37:0/4020800163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd40047c0 msgr2=0x7f3fe80b1dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:13.547 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.546+0000 7f3fee553640 1 --2- 172.21.15.37:0/4020800163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd40047c0 0x7f3fe80b1dc0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3fd8010a00 tx=0x7f3fd8010ec0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.546+0000 7f3fee553640 1 -- 172.21.15.37:0/4020800163 shutdown_connections 2023-12-11T17:11:13.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.546+0000 7f3fee553640 1 --2- 172.21.15.37:0/4020800163 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3fc806ae70 0x7f3fc806d330 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.546+0000 7f3fee553640 1 --2- 172.21.15.37:0/4020800163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fe8142a20 0x7f3fe8142ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.546+0000 7f3fee553640 1 --2- 172.21.15.37:0/4020800163 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3fe815e2a0 0x7f3fe813fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.546+0000 7f3fee553640 1 --2- 172.21.15.37:0/4020800163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3fd40047c0 0x7f3fe80b1dc0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.546+0000 7f3fee553640 1 -- 172.21.15.37:0/4020800163 >> 172.21.15.37:0/4020800163 conn(0x7f3fe80b0a90 msgr2=0x7f3fe80acbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:13.548 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.547+0000 7f3fee553640 1 -- 172.21.15.37:0/4020800163 shutdown_connections 2023-12-11T17:11:13.549 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.547+0000 7f3fee553640 1 -- 172.21.15.37:0/4020800163 wait complete. 2023-12-11T17:11:13.556 INFO:tasks.ceph.mds.a.smithi037.stderr: -6028> 2023-12-11T17:09:48.669+0000 7f60414dc640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-11T17:11:13.567 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-11T17:11:13.612 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-12-11T17:11:13.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.761+0000 7f0639eca640 1 Processor -- start 2023-12-11T17:11:13.762 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.761+0000 7f0639eca640 1 -- start start 2023-12-11T17:11:13.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.762+0000 7f0639eca640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06340b3350 0x7f06340b3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:13.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.762+0000 7f0639eca640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f06340b3730 0x7f06340cf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:13.763 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.762+0000 7f0639eca640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06340b40e0 0x7f06340cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:13.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.762+0000 7f0639eca640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06340c6b80 con 0x7f06340b3350 2023-12-11T17:11:13.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.762+0000 7f0639eca640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06340d3bf0 con 0x7f06340b3730 2023-12-11T17:11:13.764 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.762+0000 7f0639eca640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06340d3ed0 con 0x7f06340b40e0 2023-12-11T17:11:13.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.763+0000 7f0638ec8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06340b3350 0x7f06340b3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:13.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.763+0000 7f0638ec8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f06340b3350 0x7f06340b3ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35252/0 (socket says 172.21.15.37:35252) 2023-12-11T17:11:13.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.763+0000 7f0638ec8640 1 -- 172.21.15.37:0/1202115679 learned_addr learned my addr 172.21.15.37:0/1202115679 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:13.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.763+0000 7f0633fff640 1 --2- 172.21.15.37:0/1202115679 >> v2:172.21.15.151:3300/0 conn(0x7f06340b3730 0x7f06340cf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:13.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.763+0000 7f06396c9640 1 --2- 172.21.15.37:0/1202115679 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06340b40e0 0x7f06340cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:13.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.763+0000 7f0638ec8640 1 -- 172.21.15.37:0/1202115679 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06340b40e0 msgr2=0x7f06340cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:13.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.763+0000 7f0638ec8640 1 --2- 172.21.15.37:0/1202115679 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06340b40e0 0x7f06340cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.763+0000 7f0638ec8640 1 -- 172.21.15.37:0/1202115679 >> v2:172.21.15.151:3300/0 conn(0x7f06340b3730 msgr2=0x7f06340cf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:13.765 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.763+0000 7f0638ec8640 1 --2- 172.21.15.37:0/1202115679 >> v2:172.21.15.151:3300/0 conn(0x7f06340b3730 0x7f06340cf760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.763+0000 7f0638ec8640 1 -- 172.21.15.37:0/1202115679 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06340d18c0 con 0x7f06340b3350 2023-12-11T17:11:13.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.765+0000 7f0638ec8640 1 --2- 172.21.15.37:0/1202115679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06340b3350 0x7f06340b3ba0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f06340cf3a0 tx=0x7f062402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68df39760aefb1ed server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:13.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.765+0000 7f06337fe640 1 -- 172.21.15.37:0/1202115679 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062402ca70 con 0x7f06340b3350 2023-12-11T17:11:13.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.765+0000 7f06337fe640 1 -- 172.21.15.37:0/1202115679 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062402cbd0 con 0x7f06340b3350 2023-12-11T17:11:13.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.765+0000 7f06337fe640 1 -- 172.21.15.37:0/1202115679 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06240343f0 con 0x7f06340b3350 2023-12-11T17:11:13.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.765+0000 7f0639eca640 1 -- 172.21.15.37:0/1202115679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06340b3350 msgr2=0x7f06340b3ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:13.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.765+0000 7f0639eca640 1 --2- 172.21.15.37:0/1202115679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06340b3350 0x7f06340b3ba0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f06340cf3a0 tx=0x7f062402bed0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.766+0000 7f0639eca640 1 -- 172.21.15.37:0/1202115679 shutdown_connections 2023-12-11T17:11:13.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.766+0000 7f0639eca640 1 --2- 172.21.15.37:0/1202115679 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06340b40e0 0x7f06340cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.766+0000 7f0639eca640 1 --2- 172.21.15.37:0/1202115679 >> v2:172.21.15.151:3300/0 conn(0x7f06340b3730 0x7f06340cf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.766+0000 7f0639eca640 1 --2- 172.21.15.37:0/1202115679 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06340b3350 0x7f06340b3ba0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.766+0000 7f0639eca640 1 -- 172.21.15.37:0/1202115679 >> 172.21.15.37:0/1202115679 conn(0x7f06340d3030 msgr2=0x7f06340d3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:13.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.766+0000 7f0639eca640 1 -- 172.21.15.37:0/1202115679 shutdown_connections 2023-12-11T17:11:13.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.766+0000 7f0639eca640 1 -- 172.21.15.37:0/1202115679 wait complete. 2023-12-11T17:11:13.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.767+0000 7f0639eca640 1 Processor -- start 2023-12-11T17:11:13.768 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.768+0000 7f0639eca640 1 -- start start 2023-12-11T17:11:13.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.769+0000 7f0639eca640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06340b3350 0x7f06340cf050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:13.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.769+0000 7f0639eca640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06340b3730 0x7f06340cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:13.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.769+0000 7f0639eca640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06340b40e0 0x7f06340cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:13.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.769+0000 7f0639eca640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06340cd0f0 con 0x7f06340b40e0 2023-12-11T17:11:13.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.769+0000 7f0639eca640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06340cce50 con 0x7f06340b3350 2023-12-11T17:11:13.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.769+0000 7f0639eca640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06340ca280 con 0x7f06340b3730 2023-12-11T17:11:13.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.769+0000 7f06396c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06340b40e0 0x7f06340cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:13.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.769+0000 7f06396c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06340b40e0 0x7f06340cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35266/0 (socket says 172.21.15.37:35266) 2023-12-11T17:11:13.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.769+0000 7f06396c9640 1 -- 172.21.15.37:0/2985953428 learned_addr learned my addr 172.21.15.37:0/2985953428 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:13.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.769+0000 7f0638ec8640 1 --2- 172.21.15.37:0/2985953428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06340b3350 0x7f06340cf050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:13.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.769+0000 7f06396c9640 1 -- 172.21.15.37:0/2985953428 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06340b3730 msgr2=0x7f06340cc910 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-11T17:11:13.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.769+0000 7f06396c9640 1 --2- 172.21.15.37:0/2985953428 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06340b3730 0x7f06340cc910 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.769+0000 7f06396c9640 1 -- 172.21.15.37:0/2985953428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06340b3350 msgr2=0x7f06340cf050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:13.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.769+0000 7f06396c9640 1 --2- 172.21.15.37:0/2985953428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06340b3350 0x7f06340cf050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:13.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.769+0000 7f06396c9640 1 -- 172.21.15.37:0/2985953428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0624009b30 con 0x7f06340b40e0 2023-12-11T17:11:13.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.770+0000 7f06396c9640 1 --2- 172.21.15.37:0/2985953428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06340b40e0 0x7f06340cddf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f062c00d5d0 tx=0x7f062c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:13.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.770+0000 7f06317fa640 1 -- 172.21.15.37:0/2985953428 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c0125f0 con 0x7f06340b40e0 2023-12-11T17:11:13.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.770+0000 7f06317fa640 1 -- 172.21.15.37:0/2985953428 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f062c012770 con 0x7f06340b40e0 2023-12-11T17:11:13.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.770+0000 7f06317fa640 1 -- 172.21.15.37:0/2985953428 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f062c012b20 con 0x7f06340b40e0 2023-12-11T17:11:13.772 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.770+0000 7f0639eca640 1 -- 172.21.15.37:0/2985953428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06340b48a0 con 0x7f06340b40e0 2023-12-11T17:11:13.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.770+0000 7f0639eca640 1 -- 172.21.15.37:0/2985953428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f063414ab70 con 0x7f06340b40e0 2023-12-11T17:11:13.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.771+0000 7f0639eca640 1 -- 172.21.15.37:0/2985953428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0634074450 con 0x7f06340b40e0 2023-12-11T17:11:13.773 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.772+0000 7f06317fa640 1 -- 172.21.15.37:0/2985953428 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f062c012c80 con 0x7f06340b40e0 2023-12-11T17:11:13.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.773+0000 7f06317fa640 1 --2- 172.21.15.37:0/2985953428 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f061406ae40 0x7f061406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:13.774 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.773+0000 7f06317fa640 1 -- 172.21.15.37:0/2985953428 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f062c089fb0 con 0x7f06340b40e0 2023-12-11T17:11:13.775 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.774+0000 7f0638ec8640 1 --2- 172.21.15.37:0/2985953428 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f061406ae40 0x7f061406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:13.776 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.775+0000 7f0638ec8640 1 --2- 172.21.15.37:0/2985953428 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f061406ae40 0x7f061406d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0624035000 tx=0x7f0624030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:13.779 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:13.779+0000 7f06317fa640 1 -- 172.21.15.37:0/2985953428 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f062c054ba0 con 0x7f06340b40e0 2023-12-11T17:11:14.015 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.014+0000 7f0639eca640 1 -- 172.21.15.37:0/2985953428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f06340ced30 con 0x7f06340b40e0 2023-12-11T17:11:14.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.545+0000 7f06317fa640 1 -- 172.21.15.37:0/2985953428 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f062c0581c0 con 0x7f06340b40e0 2023-12-11T17:11:14.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.549+0000 7f0639eca640 1 -- 172.21.15.37:0/2985953428 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f061406ae40 msgr2=0x7f061406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:14.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.549+0000 7f0639eca640 1 --2- 172.21.15.37:0/2985953428 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f061406ae40 0x7f061406d300 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f0624035000 tx=0x7f0624030000 comp rx=0 tx=0).stop 2023-12-11T17:11:14.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.549+0000 7f0639eca640 1 -- 172.21.15.37:0/2985953428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06340b40e0 msgr2=0x7f06340cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:14.553 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.549+0000 7f0639eca640 1 --2- 172.21.15.37:0/2985953428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06340b40e0 0x7f06340cddf0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f062c00d5d0 tx=0x7f062c00da90 comp rx=0 tx=0).stop 2023-12-11T17:11:14.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.549+0000 7f0639eca640 1 -- 172.21.15.37:0/2985953428 shutdown_connections 2023-12-11T17:11:14.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.549+0000 7f0639eca640 1 --2- 172.21.15.37:0/2985953428 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f061406ae40 0x7f061406d300 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:14.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.549+0000 7f0639eca640 1 --2- 172.21.15.37:0/2985953428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f06340b40e0 0x7f06340cddf0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:14.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.549+0000 7f0639eca640 1 --2- 172.21.15.37:0/2985953428 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f06340b3730 0x7f06340cc910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:14.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.549+0000 7f0639eca640 1 --2- 172.21.15.37:0/2985953428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06340b3350 0x7f06340cf050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:14.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.549+0000 7f0639eca640 1 -- 172.21.15.37:0/2985953428 >> 172.21.15.37:0/2985953428 conn(0x7f06340d3030 msgr2=0x7f063415e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:14.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.549+0000 7f0639eca640 1 -- 172.21.15.37:0/2985953428 shutdown_connections 2023-12-11T17:11:14.554 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.549+0000 7f0639eca640 1 -- 172.21.15.37:0/2985953428 wait complete. 2023-12-11T17:11:14.572 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-11T17:11:14.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.852+0000 7f4db6593640 1 Processor -- start 2023-12-11T17:11:14.854 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.852+0000 7f4db6593640 1 -- start start 2023-12-11T17:11:14.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.854+0000 7f4db6593640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4db00b3770 0x7f4db00cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:14.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.854+0000 7f4db6593640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4db00cf6c0 0x7f4db00b1f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:14.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.854+0000 7f4db6593640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4db015c4b0 con 0x7f4db00ce1b0 2023-12-11T17:11:14.855 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.854+0000 7f4db6593640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4db00cd750 con 0x7f4db00cf6c0 2023-12-11T17:11:14.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.854+0000 7f4db6593640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db00cb700 con 0x7f4db00b3770 2023-12-11T17:11:14.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.855+0000 7f4db4d90640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4db00ce1b0 0x7f4db00cefb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38744/0 (socket says 172.21.15.37:38744) 2023-12-11T17:11:14.856 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.855+0000 7f4db4d90640 1 -- 172.21.15.37:0/3455211579 learned_addr learned my addr 172.21.15.37:0/3455211579 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:14.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.855+0000 7f4db5591640 1 --2- 172.21.15.37:0/3455211579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4db00b3770 0x7f4db00cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:14.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.855+0000 7f4db5d92640 1 --2- 172.21.15.37:0/3455211579 >> v2:172.21.15.151:3300/0 conn(0x7f4db00cf6c0 0x7f4db00b1f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:14.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.855+0000 7f4da3fff640 1 -- 172.21.15.37:0/3455211579 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1754678241 0 0) 0x7f4da4001110 con 0x7f4db00ce1b0 2023-12-11T17:11:14.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.855+0000 7f4da3fff640 1 -- 172.21.15.37:0/3455211579 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d9c003520 con 0x7f4db00ce1b0 2023-12-11T17:11:14.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.856+0000 7f4db5591640 1 -- 172.21.15.37:0/3455211579 >> v2:172.21.15.151:3300/0 conn(0x7f4db00cf6c0 msgr2=0x7f4db00b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:14.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.856+0000 7f4db5591640 1 --2- 172.21.15.37:0/3455211579 >> v2:172.21.15.151:3300/0 conn(0x7f4db00cf6c0 0x7f4db00b1f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:14.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.856+0000 7f4db5591640 1 -- 172.21.15.37:0/3455211579 >> v1:172.21.15.37:6789/0 conn(0x7f4db00ce1b0 legacy=0x7f4db00cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:14.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.856+0000 7f4da3fff640 1 -- 172.21.15.37:0/3455211579 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 811839102 0 0) 0x7f4d9c003520 con 0x7f4db00ce1b0 2023-12-11T17:11:14.857 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.856+0000 7f4db5591640 1 -- 172.21.15.37:0/3455211579 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4db00b3b50 con 0x7f4db00b3770 2023-12-11T17:11:14.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.857+0000 7f4db5591640 1 --2- 172.21.15.37:0/3455211579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4db00b3770 0x7f4db00cb1c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4dac0097a0 tx=0x7f4dac02b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d10488983d38ec79 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:14.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.858+0000 7f4da3fff640 1 -- 172.21.15.37:0/3455211579 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da4001800 con 0x7f4db00b3770 2023-12-11T17:11:14.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.858+0000 7f4da3fff640 1 -- 172.21.15.37:0/3455211579 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dac02e050 con 0x7f4db00b3770 2023-12-11T17:11:14.858 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.858+0000 7f4da3fff640 1 -- 172.21.15.37:0/3455211579 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac030730 con 0x7f4db00b3770 2023-12-11T17:11:14.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.858+0000 7f4db6593640 1 -- 172.21.15.37:0/3455211579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4db00b3770 msgr2=0x7f4db00cb1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:14.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.858+0000 7f4db6593640 1 --2- 172.21.15.37:0/3455211579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4db00b3770 0x7f4db00cb1c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f4dac0097a0 tx=0x7f4dac02b790 comp rx=0 tx=0).stop 2023-12-11T17:11:14.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.858+0000 7f4db6593640 1 -- 172.21.15.37:0/3455211579 shutdown_connections 2023-12-11T17:11:14.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.858+0000 7f4db6593640 1 --2- 172.21.15.37:0/3455211579 >> v2:172.21.15.151:3300/0 conn(0x7f4db00cf6c0 0x7f4db00b1f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:14.859 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.858+0000 7f4db6593640 1 --2- 172.21.15.37:0/3455211579 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4db00b3770 0x7f4db00cb1c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:14.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.858+0000 7f4db6593640 1 -- 172.21.15.37:0/3455211579 >> 172.21.15.37:0/3455211579 conn(0x7f4db006a880 msgr2=0x7f4db006ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:14.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.858+0000 7f4db6593640 1 -- 172.21.15.37:0/3455211579 shutdown_connections 2023-12-11T17:11:14.860 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.858+0000 7f4db6593640 1 -- 172.21.15.37:0/3455211579 wait complete. 2023-12-11T17:11:14.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.860+0000 7f4db6593640 1 Processor -- start 2023-12-11T17:11:14.861 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.861+0000 7f4db6593640 1 -- start start 2023-12-11T17:11:14.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.861+0000 7f4db6593640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db00b3770 0x7f4db0155b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:14.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.862+0000 7f4db6593640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4db00ce1b0 0x7f4db0070aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:14.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.862+0000 7f4db6593640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4db00cf6c0 0x7f4db00ae7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:14.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.862+0000 7f4db6593640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db00c7ee0 con 0x7f4db00b3770 2023-12-11T17:11:14.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.862+0000 7f4db6593640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4db00720e0 con 0x7f4db00ce1b0 2023-12-11T17:11:14.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.862+0000 7f4db6593640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4db0071560 con 0x7f4db00cf6c0 2023-12-11T17:11:14.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.862+0000 7f4db5591640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db00b3770 0x7f4db0155b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:14.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.862+0000 7f4db5591640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db00b3770 0x7f4db0155b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35278/0 (socket says 172.21.15.37:35278) 2023-12-11T17:11:14.863 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.862+0000 7f4db5591640 1 -- 172.21.15.37:0/2293995024 learned_addr learned my addr 172.21.15.37:0/2293995024 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:14.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.862+0000 7f4db5d92640 1 --2- 172.21.15.37:0/2293995024 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4db00cf6c0 0x7f4db00ae7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:14.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.862+0000 7f4db4d90640 1 --2- 172.21.15.37:0/2293995024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4db00ce1b0 0x7f4db0070aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:14.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.862+0000 7f4db5591640 1 -- 172.21.15.37:0/2293995024 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4db00cf6c0 msgr2=0x7f4db00ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:14.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.862+0000 7f4db5591640 1 --2- 172.21.15.37:0/2293995024 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4db00cf6c0 0x7f4db00ae7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:14.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.862+0000 7f4db5591640 1 -- 172.21.15.37:0/2293995024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4db00ce1b0 msgr2=0x7f4db0070aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:14.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.862+0000 7f4db5591640 1 --2- 172.21.15.37:0/2293995024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4db00ce1b0 0x7f4db0070aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:14.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.862+0000 7f4db5591640 1 -- 172.21.15.37:0/2293995024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dac009400 con 0x7f4db00b3770 2023-12-11T17:11:14.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.862+0000 7f4db5d92640 1 --2- 172.21.15.37:0/2293995024 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4db00cf6c0 0x7f4db00ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:14.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.862+0000 7f4db4d90640 1 --2- 172.21.15.37:0/2293995024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4db00ce1b0 0x7f4db0070aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:14.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.863+0000 7f4db5591640 1 --2- 172.21.15.37:0/2293995024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db00b3770 0x7f4db0155b30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4dac0098c0 tx=0x7f4dac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:14.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.863+0000 7f4da1ffb640 1 -- 172.21.15.37:0/2293995024 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac03d890 con 0x7f4db00b3770 2023-12-11T17:11:14.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.863+0000 7f4da1ffb640 1 -- 172.21.15.37:0/2293995024 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4dac03d9f0 con 0x7f4db00b3770 2023-12-11T17:11:14.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.863+0000 7f4da1ffb640 1 -- 172.21.15.37:0/2293995024 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4dac03dd80 con 0x7f4db00b3770 2023-12-11T17:11:14.865 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.863+0000 7f4db6593640 1 -- 172.21.15.37:0/2293995024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4db0071840 con 0x7f4db00b3770 2023-12-11T17:11:14.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.863+0000 7f4db6593640 1 -- 172.21.15.37:0/2293995024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4db0071e00 con 0x7f4db00b3770 2023-12-11T17:11:14.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.865+0000 7f4db6593640 1 -- 172.21.15.37:0/2293995024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4db0074450 con 0x7f4db00b3770 2023-12-11T17:11:14.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.865+0000 7f4da1ffb640 1 -- 172.21.15.37:0/2293995024 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4dac039040 con 0x7f4db00b3770 2023-12-11T17:11:14.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.866+0000 7f4da1ffb640 1 --2- 172.21.15.37:0/2293995024 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4d9406ae40 0x7f4d9406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:14.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.866+0000 7f4da1ffb640 1 -- 172.21.15.37:0/2293995024 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 6778+0+0 (secure 0 0 0) 0x7f4dac0abb90 con 0x7f4db00b3770 2023-12-11T17:11:14.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.867+0000 7f4db4d90640 1 --2- 172.21.15.37:0/2293995024 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4d9406ae40 0x7f4d9406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:14.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.868+0000 7f4db4d90640 1 --2- 172.21.15.37:0/2293995024 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4d9406ae40 0x7f4d9406d300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4da4001930 tx=0x7f4da4009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:14.871 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:14.871+0000 7f4da1ffb640 1 -- 172.21.15.37:0/2293995024 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4dac076890 con 0x7f4db00b3770 2023-12-11T17:11:15.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.064+0000 7f4db6593640 1 -- 172.21.15.37:0/2293995024 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4db00c8020 con 0x7f4db00b3770 2023-12-11T17:11:15.559 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.557+0000 7f4da1ffb640 1 -- 172.21.15.37:0/2293995024 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v29) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4dac04d0d0 con 0x7f4db00b3770 2023-12-11T17:11:15.559 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' removed 2023-12-11T17:11:15.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.561+0000 7f4db6593640 1 -- 172.21.15.37:0/2293995024 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4d9406ae40 msgr2=0x7f4d9406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:15.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.561+0000 7f4db6593640 1 --2- 172.21.15.37:0/2293995024 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4d9406ae40 0x7f4d9406d300 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f4da4001930 tx=0x7f4da4009040 comp rx=0 tx=0).stop 2023-12-11T17:11:15.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.561+0000 7f4db6593640 1 -- 172.21.15.37:0/2293995024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db00b3770 msgr2=0x7f4db0155b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:15.562 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.561+0000 7f4db6593640 1 --2- 172.21.15.37:0/2293995024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db00b3770 0x7f4db0155b30 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f4dac0098c0 tx=0x7f4dac0046c0 comp rx=0 tx=0).stop 2023-12-11T17:11:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.561+0000 7f4db6593640 1 -- 172.21.15.37:0/2293995024 shutdown_connections 2023-12-11T17:11:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.561+0000 7f4db6593640 1 --2- 172.21.15.37:0/2293995024 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4d9406ae40 0x7f4d9406d300 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.561+0000 7f4db6593640 1 --2- 172.21.15.37:0/2293995024 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4db00ce1b0 0x7f4db0070aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.561+0000 7f4db6593640 1 --2- 172.21.15.37:0/2293995024 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4db00cf6c0 0x7f4db00ae7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.561+0000 7f4db6593640 1 --2- 172.21.15.37:0/2293995024 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4db00b3770 0x7f4db0155b30 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.561+0000 7f4db6593640 1 -- 172.21.15.37:0/2293995024 >> 172.21.15.37:0/2293995024 conn(0x7f4db006a880 msgr2=0x7f4db00730f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.561+0000 7f4db6593640 1 -- 172.21.15.37:0/2293995024 shutdown_connections 2023-12-11T17:11:15.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.561+0000 7f4db6593640 1 -- 172.21.15.37:0/2293995024 wait complete. 2023-12-11T17:11:15.589 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-11T17:11:15.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.793+0000 7f575b36c640 1 Processor -- start 2023-12-11T17:11:15.794 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.793+0000 7f575b36c640 1 -- start start 2023-12-11T17:11:15.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.795+0000 7f575b36c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f57540b1b70 0x7f575415c960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:15.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.795+0000 7f575b36c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57540d03e0 con 0x7f57540cdab0 2023-12-11T17:11:15.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.795+0000 7f575b36c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57540cfe20 con 0x7f57540cde90 2023-12-11T17:11:15.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.795+0000 7f575b36c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57540ce6e0 con 0x7f57540b1b70 2023-12-11T17:11:15.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.795+0000 7f575a36a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f57540cdab0 0x7f575406bc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38750/0 (socket says 172.21.15.37:38750) 2023-12-11T17:11:15.796 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.795+0000 7f575a36a640 1 -- 172.21.15.37:0/3736614927 learned_addr learned my addr 172.21.15.37:0/3736614927 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.795+0000 7f575ab6b640 1 --2- 172.21.15.37:0/3736614927 >> v2:172.21.15.37:3300/0 conn(0x7f57540b1b70 0x7f575415c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.796+0000 7f5759368640 1 -- 172.21.15.37:0/3736614927 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4120030516 0 0) 0x7f57540d03e0 con 0x7f57540cdab0 2023-12-11T17:11:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.796+0000 7f5759368640 1 -- 172.21.15.37:0/3736614927 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5740003520 con 0x7f57540cdab0 2023-12-11T17:11:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.796+0000 7f575ab6b640 1 -- 172.21.15.37:0/3736614927 >> v1:172.21.15.151:6789/0 conn(0x7f57540cde90 legacy=0x7f575406c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.796+0000 7f575ab6b640 1 -- 172.21.15.37:0/3736614927 >> v1:172.21.15.37:6789/0 conn(0x7f57540cdab0 legacy=0x7f575406bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:15.797 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.796+0000 7f575ab6b640 1 -- 172.21.15.37:0/3736614927 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57540d0100 con 0x7f57540b1b70 2023-12-11T17:11:15.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.797+0000 7f575ab6b640 1 --2- 172.21.15.37:0/3736614927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57540b1b70 0x7f575415c960 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f574c009d90 tx=0x7f574c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24b99e6b19b934e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:15.798 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.798+0000 7f5759368640 1 -- 172.21.15.37:0/3736614927 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c02cc60 con 0x7f57540b1b70 2023-12-11T17:11:15.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.798+0000 7f5759368640 1 -- 172.21.15.37:0/3736614927 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574c02cdc0 con 0x7f57540b1b70 2023-12-11T17:11:15.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.798+0000 7f5759368640 1 -- 172.21.15.37:0/3736614927 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574c034660 con 0x7f57540b1b70 2023-12-11T17:11:15.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.798+0000 7f575b36c640 1 -- 172.21.15.37:0/3736614927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57540b1b70 msgr2=0x7f575415c960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:15.799 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.798+0000 7f575b36c640 1 --2- 172.21.15.37:0/3736614927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57540b1b70 0x7f575415c960 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f574c009d90 tx=0x7f574c02beb0 comp rx=0 tx=0).stop 2023-12-11T17:11:15.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.798+0000 7f575b36c640 1 -- 172.21.15.37:0/3736614927 shutdown_connections 2023-12-11T17:11:15.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.798+0000 7f575b36c640 1 --2- 172.21.15.37:0/3736614927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57540b1b70 0x7f575415c960 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:15.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.798+0000 7f575b36c640 1 -- 172.21.15.37:0/3736614927 >> 172.21.15.37:0/3736614927 conn(0x7f57540d0cf0 msgr2=0x7f57540d1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:15.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.799+0000 7f575b36c640 1 -- 172.21.15.37:0/3736614927 shutdown_connections 2023-12-11T17:11:15.800 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.799+0000 7f575b36c640 1 -- 172.21.15.37:0/3736614927 wait complete. 2023-12-11T17:11:15.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.801+0000 7f575b36c640 1 Processor -- start 2023-12-11T17:11:15.802 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.801+0000 7f575b36c640 1 -- start start 2023-12-11T17:11:15.803 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.802+0000 7f575b36c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57540b1b70 0x7f57541d5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.802+0000 7f575b36c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57540cdab0 0x7f575409abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.802+0000 7f575b36c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57540cde90 0x7f575409b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.802+0000 7f575b36c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575409e8c0 con 0x7f57540b1b70 2023-12-11T17:11:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.802+0000 7f575b36c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57541d5680 con 0x7f57540cdab0 2023-12-11T17:11:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.802+0000 7f575b36c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f575409dd40 con 0x7f57540cde90 2023-12-11T17:11:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.802+0000 7f575a36a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57540b1b70 0x7f57541d5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.802+0000 7f575a36a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57540b1b70 0x7f57541d5140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35286/0 (socket says 172.21.15.37:35286) 2023-12-11T17:11:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.802+0000 7f575a36a640 1 -- 172.21.15.37:0/3270503832 learned_addr learned my addr 172.21.15.37:0/3270503832 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.803+0000 7f575ab6b640 1 --2- 172.21.15.37:0/3270503832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57540cde90 0x7f575409b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.803+0000 7f5759b69640 1 --2- 172.21.15.37:0/3270503832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57540cdab0 0x7f575409abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.803+0000 7f575a36a640 1 -- 172.21.15.37:0/3270503832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57540cde90 msgr2=0x7f575409b110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:15.804 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.803+0000 7f575a36a640 1 --2- 172.21.15.37:0/3270503832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57540cde90 0x7f575409b110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:15.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.803+0000 7f575a36a640 1 -- 172.21.15.37:0/3270503832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57540cdab0 msgr2=0x7f575409abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:15.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.803+0000 7f575a36a640 1 --2- 172.21.15.37:0/3270503832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57540cdab0 0x7f575409abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:15.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.803+0000 7f575a36a640 1 -- 172.21.15.37:0/3270503832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f574c009a70 con 0x7f57540b1b70 2023-12-11T17:11:15.805 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.803+0000 7f5759b69640 1 --2- 172.21.15.37:0/3270503832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57540cdab0 0x7f575409abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:15.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.803+0000 7f575a36a640 1 --2- 172.21.15.37:0/3270503832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57540b1b70 0x7f57541d5140 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f575000c530 tx=0x7f575000c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:15.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.803+0000 7f574affd640 1 -- 172.21.15.37:0/3270503832 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5750005ce0 con 0x7f57540b1b70 2023-12-11T17:11:15.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.803+0000 7f574affd640 1 -- 172.21.15.37:0/3270503832 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5750005e40 con 0x7f57540b1b70 2023-12-11T17:11:15.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.803+0000 7f574affd640 1 -- 172.21.15.37:0/3270503832 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57500072b0 con 0x7f57540b1b70 2023-12-11T17:11:15.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.803+0000 7f575b36c640 1 -- 172.21.15.37:0/3270503832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575409e020 con 0x7f57540b1b70 2023-12-11T17:11:15.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.804+0000 7f575b36c640 1 -- 172.21.15.37:0/3270503832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575409e5e0 con 0x7f57540b1b70 2023-12-11T17:11:15.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.805+0000 7f575b36c640 1 -- 172.21.15.37:0/3270503832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575406cbd0 con 0x7f57540b1b70 2023-12-11T17:11:15.806 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.806+0000 7f574affd640 1 -- 172.21.15.37:0/3270503832 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5750007410 con 0x7f57540b1b70 2023-12-11T17:11:15.807 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.807+0000 7f574affd640 1 --2- 172.21.15.37:0/3270503832 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f573806ae90 0x7f573806d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:15.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.807+0000 7f574affd640 1 -- 172.21.15.37:0/3270503832 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 6340+0+0 (secure 0 0 0) 0x7f5750088ee0 con 0x7f57540b1b70 2023-12-11T17:11:15.808 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.807+0000 7f5759b69640 1 --2- 172.21.15.37:0/3270503832 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f573806ae90 0x7f573806d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:15.809 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.809+0000 7f5759b69640 1 --2- 172.21.15.37:0/3270503832 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f573806ae90 0x7f573806d350 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f57541f6b50 tx=0x7f5744009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:15.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:15.811+0000 7f574affd640 1 -- 172.21.15.37:0/3270503832 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5750053db0 con 0x7f57540b1b70 2023-12-11T17:11:16.004 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.003+0000 7f575b36c640 1 -- 172.21.15.37:0/3270503832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f57540d07c0 con 0x7f57540b1b70 2023-12-11T17:11:16.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.568+0000 7f574affd640 1 -- 172.21.15.37:0/3270503832 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v30) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5750017020 con 0x7f57540b1b70 2023-12-11T17:11:16.570 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' removed 2023-12-11T17:11:16.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.572+0000 7f575b36c640 1 -- 172.21.15.37:0/3270503832 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f573806ae90 msgr2=0x7f573806d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:16.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.572+0000 7f575b36c640 1 --2- 172.21.15.37:0/3270503832 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f573806ae90 0x7f573806d350 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f57541f6b50 tx=0x7f5744009040 comp rx=0 tx=0).stop 2023-12-11T17:11:16.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.572+0000 7f575b36c640 1 -- 172.21.15.37:0/3270503832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57540b1b70 msgr2=0x7f57541d5140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:16.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.572+0000 7f575b36c640 1 --2- 172.21.15.37:0/3270503832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57540b1b70 0x7f57541d5140 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f575000c530 tx=0x7f575000c9f0 comp rx=0 tx=0).stop 2023-12-11T17:11:16.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.572+0000 7f575b36c640 1 -- 172.21.15.37:0/3270503832 shutdown_connections 2023-12-11T17:11:16.574 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.572+0000 7f575b36c640 1 --2- 172.21.15.37:0/3270503832 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f573806ae90 0x7f573806d350 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:16.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.572+0000 7f575b36c640 1 --2- 172.21.15.37:0/3270503832 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57540cdab0 0x7f575409abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:16.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.572+0000 7f575b36c640 1 --2- 172.21.15.37:0/3270503832 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f57540cde90 0x7f575409b110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:16.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.572+0000 7f575b36c640 1 --2- 172.21.15.37:0/3270503832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f57540b1b70 0x7f57541d5140 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:16.575 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.572+0000 7f575b36c640 1 -- 172.21.15.37:0/3270503832 >> 172.21.15.37:0/3270503832 conn(0x7f57540d0cf0 msgr2=0x7f57541e7b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:16.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.575+0000 7f575b36c640 1 -- 172.21.15.37:0/3270503832 shutdown_connections 2023-12-11T17:11:16.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.577+0000 7f575b36c640 1 -- 172.21.15.37:0/3270503832 wait complete. 2023-12-11T17:11:16.604 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2023-12-11T17:11:16.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.810+0000 7fa55ffff640 1 Processor -- start 2023-12-11T17:11:16.812 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.811+0000 7fa55ffff640 1 -- start start 2023-12-11T17:11:16.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.813+0000 7fa55ffff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fa5600b3770 0x7fa5600cb1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:16.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.813+0000 7fa55ffff640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa56015c4b0 con 0x7fa5600ce1b0 2023-12-11T17:11:16.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.813+0000 7fa55ffff640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa5600cb700 con 0x7fa5600cf6c0 2023-12-11T17:11:16.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.813+0000 7fa55ffff640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5600cd750 con 0x7fa5600b3770 2023-12-11T17:11:16.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.813+0000 7fa557fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa5600ce1b0 0x7fa5600cefb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38766/0 (socket says 172.21.15.37:38766) 2023-12-11T17:11:16.814 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.813+0000 7fa557fff640 1 -- 172.21.15.37:0/2505261159 learned_addr learned my addr 172.21.15.37:0/2505261159 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:16.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.814+0000 7fa55e7fc640 1 -- 172.21.15.37:0/2505261159 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3644637646 0 0) 0x7fa548001110 con 0x7fa5600ce1b0 2023-12-11T17:11:16.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.814+0000 7fa55e7fc640 1 -- 172.21.15.37:0/2505261159 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa54c003520 con 0x7fa5600ce1b0 2023-12-11T17:11:16.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.814+0000 7fa55e7fc640 1 -- 172.21.15.37:0/2505261159 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2249847398 0 0) 0x7fa54c003520 con 0x7fa5600ce1b0 2023-12-11T17:11:16.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.814+0000 7fa55e7fc640 1 -- 172.21.15.37:0/2505261159 >> v2:172.21.15.151:3300/0 conn(0x7fa5600b3770 msgr2=0x7fa5600cb1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:16.816 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.814+0000 7fa55e7fc640 1 --2- 172.21.15.37:0/2505261159 >> v2:172.21.15.151:3300/0 conn(0x7fa5600b3770 0x7fa5600cb1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.814+0000 7fa55e7fc640 1 -- 172.21.15.37:0/2505261159 >> v1:172.21.15.151:6789/0 conn(0x7fa5600cf6c0 legacy=0x7fa5600b1f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.814+0000 7fa55e7fc640 1 -- 172.21.15.37:0/2505261159 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5600b3b50 con 0x7fa5600ce1b0 2023-12-11T17:11:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.814+0000 7fa55e7fc640 1 -- 172.21.15.37:0/2505261159 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7fa548001800 con 0x7fa5600ce1b0 2023-12-11T17:11:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.814+0000 7fa55e7fc640 1 -- 172.21.15.37:0/2505261159 >> v1:172.21.15.37:6789/0 conn(0x7fa5600ce1b0 legacy=0x7fa5600cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.814+0000 7fa55e7fc640 1 --2- 172.21.15.37:0/2505261159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa54c0039c0 0x7fa54c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.814+0000 7fa55e7fc640 1 --2- 172.21.15.37:0/2505261159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa54c0047c0 0x7fa54c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.815+0000 7fa55e7fc640 1 --2- 172.21.15.37:0/2505261159 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa54c005380 0x7fa54c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.815+0000 7fa55e7fc640 1 -- 172.21.15.37:0/2505261159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5600cd750 con 0x7fa54c0047c0 2023-12-11T17:11:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.815+0000 7fa55e7fc640 1 -- 172.21.15.37:0/2505261159 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c00c1f0 con 0x7fa54c0039c0 2023-12-11T17:11:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.815+0000 7fa55e7fc640 1 -- 172.21.15.37:0/2505261159 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa54c00c3b0 con 0x7fa54c005380 2023-12-11T17:11:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.815+0000 7fa557fff640 1 --2- 172.21.15.37:0/2505261159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa54c0047c0 0x7fa54c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.815+0000 7fa55effd640 1 --2- 172.21.15.37:0/2505261159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa54c0039c0 0x7fa54c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.815+0000 7fa557fff640 1 -- 172.21.15.37:0/2505261159 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa54c005380 msgr2=0x7fa54c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.815+0000 7fa557fff640 1 --2- 172.21.15.37:0/2505261159 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa54c005380 0x7fa54c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:16.817 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.815+0000 7fa557fff640 1 -- 172.21.15.37:0/2505261159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa54c0039c0 msgr2=0x7fa54c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:16.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.815+0000 7fa557fff640 1 --2- 172.21.15.37:0/2505261159 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa54c0039c0 0x7fa54c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:16.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.815+0000 7fa557fff640 1 -- 172.21.15.37:0/2505261159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c003520 con 0x7fa54c0047c0 2023-12-11T17:11:16.818 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.815+0000 7fa55f7fe640 1 -- 172.21.15.37:0/2505261159 reap_dead start 2023-12-11T17:11:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.817+0000 7fa557fff640 1 --2- 172.21.15.37:0/2505261159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa54c0047c0 0x7fa54c004c40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa548007fc0 tx=0x7fa54c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fe7e5fbc3b9c768 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.817+0000 7fa55e7fc640 1 -- 172.21.15.37:0/2505261159 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa548005ad0 con 0x7fa54c0047c0 2023-12-11T17:11:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.817+0000 7fa55e7fc640 1 -- 172.21.15.37:0/2505261159 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa548005c50 con 0x7fa54c0047c0 2023-12-11T17:11:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.817+0000 7fa55e7fc640 1 -- 172.21.15.37:0/2505261159 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa54802c7e0 con 0x7fa54c0047c0 2023-12-11T17:11:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.817+0000 7fa55ffff640 1 -- 172.21.15.37:0/2505261159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa54c0047c0 msgr2=0x7fa54c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.817+0000 7fa55ffff640 1 --2- 172.21.15.37:0/2505261159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa54c0047c0 0x7fa54c004c40 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fa548007fc0 tx=0x7fa54c0057f0 comp rx=0 tx=0).stop 2023-12-11T17:11:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.817+0000 7fa55ffff640 1 -- 172.21.15.37:0/2505261159 shutdown_connections 2023-12-11T17:11:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.817+0000 7fa55ffff640 1 --2- 172.21.15.37:0/2505261159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa54c0047c0 0x7fa54c004c40 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.817+0000 7fa55ffff640 1 -- 172.21.15.37:0/2505261159 >> 172.21.15.37:0/2505261159 conn(0x7fa56006a880 msgr2=0x7fa56006ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.818+0000 7fa55ffff640 1 -- 172.21.15.37:0/2505261159 shutdown_connections 2023-12-11T17:11:16.819 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.818+0000 7fa55ffff640 1 -- 172.21.15.37:0/2505261159 wait complete. 2023-12-11T17:11:16.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.819+0000 7fa55ffff640 1 Processor -- start 2023-12-11T17:11:16.820 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.820+0000 7fa55ffff640 1 -- start start 2023-12-11T17:11:16.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.821+0000 7fa55ffff640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa54c0047c0 0x7fa56014b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:16.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.821+0000 7fa55ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5600c3ad0 0x7fa56009c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:16.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.821+0000 7fa55ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa56009c620 0x7fa5600acd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:16.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.821+0000 7fa55ffff640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5601f31e0 con 0x7fa56009c620 2023-12-11T17:11:16.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.821+0000 7fa55ffff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa560158b20 con 0x7fa5600c3ad0 2023-12-11T17:11:16.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.821+0000 7fa55ffff640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5601f2560 con 0x7fa54c0047c0 2023-12-11T17:11:16.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.821+0000 7fa55f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa56009c620 0x7fa5600acd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:16.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.821+0000 7fa55f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa56009c620 0x7fa5600acd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35298/0 (socket says 172.21.15.37:35298) 2023-12-11T17:11:16.822 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.821+0000 7fa55f7fe640 1 -- 172.21.15.37:0/1444921805 learned_addr learned my addr 172.21.15.37:0/1444921805 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:16.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.821+0000 7fa557fff640 1 --2- 172.21.15.37:0/1444921805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5600c3ad0 0x7fa56009c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:16.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.821+0000 7fa55f7fe640 1 -- 172.21.15.37:0/1444921805 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa54c0047c0 msgr2=0x7fa56014b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:16.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.821+0000 7fa55f7fe640 1 --2- 172.21.15.37:0/1444921805 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa54c0047c0 0x7fa56014b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:16.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.821+0000 7fa55f7fe640 1 -- 172.21.15.37:0/1444921805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5600c3ad0 msgr2=0x7fa56009c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:16.823 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.821+0000 7fa55f7fe640 1 --2- 172.21.15.37:0/1444921805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5600c3ad0 0x7fa56009c0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:16.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.821+0000 7fa55f7fe640 1 -- 172.21.15.37:0/1444921805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5601f2840 con 0x7fa56009c620 2023-12-11T17:11:16.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.822+0000 7fa55f7fe640 1 --2- 172.21.15.37:0/1444921805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa56009c620 0x7fa5600acd70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa5600ae780 tx=0x7fa55800cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:16.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.822+0000 7fa5577fe640 1 -- 172.21.15.37:0/1444921805 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa558005d40 con 0x7fa56009c620 2023-12-11T17:11:16.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.822+0000 7fa5577fe640 1 -- 172.21.15.37:0/1444921805 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55800ced0 con 0x7fa56009c620 2023-12-11T17:11:16.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.822+0000 7fa5577fe640 1 -- 172.21.15.37:0/1444921805 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa558005ea0 con 0x7fa56009c620 2023-12-11T17:11:16.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.822+0000 7fa55ffff640 1 -- 172.21.15.37:0/1444921805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5601f2b20 con 0x7fa56009c620 2023-12-11T17:11:16.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.822+0000 7fa55ffff640 1 -- 172.21.15.37:0/1444921805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa56014ba40 con 0x7fa56009c620 2023-12-11T17:11:16.824 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.823+0000 7fa55ffff640 1 -- 172.21.15.37:0/1444921805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5601f3320 con 0x7fa56009c620 2023-12-11T17:11:16.825 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.824+0000 7fa5577fe640 1 -- 172.21.15.37:0/1444921805 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa55800a830 con 0x7fa56009c620 2023-12-11T17:11:16.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.825+0000 7fa5577fe640 1 --2- 172.21.15.37:0/1444921805 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa54006ae40 0x7fa54006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:16.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.825+0000 7fa5577fe640 1 -- 172.21.15.37:0/1444921805 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5781+0+0 (secure 0 0 0) 0x7fa5580885c0 con 0x7fa56009c620 2023-12-11T17:11:16.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.826+0000 7fa55effd640 1 --2- 172.21.15.37:0/1444921805 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa54006ae40 0x7fa54006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:16.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.828+0000 7fa55effd640 1 --2- 172.21.15.37:0/1444921805 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa54006ae40 0x7fa54006d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa55000b770 tx=0x7fa550008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:16.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:16.830+0000 7fa5577fe640 1 -- 172.21.15.37:0/1444921805 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa5601f3320 con 0x7fa56009c620 2023-12-11T17:11:17.041 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.040+0000 7fa55ffff640 1 -- 172.21.15.37:0/1444921805 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa5601f3320 con 0x7fa56009c620 2023-12-11T17:11:17.573 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.572+0000 7fa5577fe640 1 -- 172.21.15.37:0/1444921805 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v31) v1 ==== 178+0+0 (secure 0 0 0) 0x7fa5601f3320 con 0x7fa56009c620 2023-12-11T17:11:17.573 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data_ec' removed 2023-12-11T17:11:17.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.576+0000 7fa55ffff640 1 -- 172.21.15.37:0/1444921805 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa54006ae40 msgr2=0x7fa54006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:17.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.576+0000 7fa55ffff640 1 --2- 172.21.15.37:0/1444921805 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa54006ae40 0x7fa54006d300 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fa55000b770 tx=0x7fa550008040 comp rx=0 tx=0).stop 2023-12-11T17:11:17.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.576+0000 7fa55ffff640 1 -- 172.21.15.37:0/1444921805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa56009c620 msgr2=0x7fa5600acd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:17.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.576+0000 7fa55ffff640 1 --2- 172.21.15.37:0/1444921805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa56009c620 0x7fa5600acd70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fa5600ae780 tx=0x7fa55800cb90 comp rx=0 tx=0).stop 2023-12-11T17:11:17.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.576+0000 7fa55ffff640 1 -- 172.21.15.37:0/1444921805 shutdown_connections 2023-12-11T17:11:17.577 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.576+0000 7fa55ffff640 1 --2- 172.21.15.37:0/1444921805 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa54006ae40 0x7fa54006d300 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:17.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.576+0000 7fa55ffff640 1 --2- 172.21.15.37:0/1444921805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa5600c3ad0 0x7fa56009c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:17.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.576+0000 7fa55ffff640 1 --2- 172.21.15.37:0/1444921805 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa56009c620 0x7fa5600acd70 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:17.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.576+0000 7fa55ffff640 1 --2- 172.21.15.37:0/1444921805 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa54c0047c0 0x7fa56014b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:17.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.576+0000 7fa55ffff640 1 -- 172.21.15.37:0/1444921805 >> 172.21.15.37:0/1444921805 conn(0x7fa56006a880 msgr2=0x7fa5600aea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:17.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.576+0000 7fa55ffff640 1 -- 172.21.15.37:0/1444921805 shutdown_connections 2023-12-11T17:11:17.578 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.576+0000 7fa55ffff640 1 -- 172.21.15.37:0/1444921805 wait complete. 2023-12-11T17:11:17.601 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-11T17:11:17.601 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-11T17:11:17.601 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-11T17:11:17.601 INFO:teuthology.orchestra.run:waiting for 300 2023-12-11T17:11:17.601 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-11T17:11:17.601 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-11T17:11:17.602 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-11T17:11:17.602 INFO:teuthology.orchestra.run:waiting for 300 2023-12-11T17:11:17.602 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-11T17:11:17.602 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-11T17:11:17.602 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-11T17:11:17.602 INFO:teuthology.orchestra.run:waiting for 300 2023-12-11T17:11:17.602 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-11T17:11:17.603 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-11T17:11:17.603 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-11T17:11:17.603 INFO:teuthology.orchestra.run:waiting for 300 2023-12-11T17:11:17.621 INFO:tasks.ceph.mds.a:Stopped 2023-12-11T17:11:17.621 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-11T17:11:17.622 INFO:tasks.ceph.mds.c:Stopped 2023-12-11T17:11:17.622 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-11T17:11:17.623 INFO:tasks.ceph.mds.b:Stopped 2023-12-11T17:11:17.623 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-11T17:11:17.626 INFO:tasks.ceph.mds.d:Stopped 2023-12-11T17:11:17.626 DEBUG:teuthology.orchestra.run.smithi151:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-11T17:11:17.671 INFO:tasks.ceph.mds.a:Started 2023-12-11T17:11:17.671 DEBUG:teuthology.parallel:result is None 2023-12-11T17:11:17.674 INFO:tasks.ceph.mds.b:Started 2023-12-11T17:11:17.674 DEBUG:teuthology.parallel:result is None 2023-12-11T17:11:17.679 INFO:tasks.ceph.mds.c:Started 2023-12-11T17:11:17.679 DEBUG:teuthology.parallel:result is None 2023-12-11T17:11:17.680 INFO:tasks.ceph.mds.d:Started 2023-12-11T17:11:17.680 DEBUG:teuthology.parallel:result is None 2023-12-11T17:11:17.681 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-11T17:11:17.833 INFO:tasks.ceph.mds.b.smithi151.stdout:starting mds.b at 2023-12-11T17:11:17.835 INFO:tasks.ceph.mds.a.smithi037.stdout:starting mds.a at 2023-12-11T17:11:17.836 INFO:tasks.ceph.mds.d.smithi151.stdout:starting mds.d at 2023-12-11T17:11:17.838 INFO:tasks.ceph.mds.c.smithi037.stdout:starting mds.c at 2023-12-11T17:11:17.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.879+0000 7f4a9dd97640 1 Processor -- start 2023-12-11T17:11:17.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.879+0000 7f4a9dd97640 1 -- start start 2023-12-11T17:11:17.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.881+0000 7f4a9dd97640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a9815f260 0x7f4a980ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:17.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.881+0000 7f4a9dd97640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a980cde40 con 0x7f4a981626b0 2023-12-11T17:11:17.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.881+0000 7f4a9dd97640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a98162b10 con 0x7f4a980708d0 2023-12-11T17:11:17.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.881+0000 7f4a9dd97640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a980cd040 con 0x7f4a9815f260 2023-12-11T17:11:17.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.882+0000 7f4a96ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4a981626b0 0x7f4a980701c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:38786/0 (socket says 172.21.15.37:38786) 2023-12-11T17:11:17.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.882+0000 7f4a96ffd640 1 -- 172.21.15.37:0/544432731 learned_addr learned my addr 172.21.15.37:0/544432731 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:17.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.883+0000 7f4a967fc640 1 -- 172.21.15.37:0/544432731 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2262965083 0 0) 0x7f4a980cde40 con 0x7f4a981626b0 2023-12-11T17:11:17.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.883+0000 7f4a967fc640 1 -- 172.21.15.37:0/544432731 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a80003520 con 0x7f4a981626b0 2023-12-11T17:11:17.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.883+0000 7f4a977fe640 1 --2- 172.21.15.37:0/544432731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a9815f260 0x7f4a980ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:17.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.884+0000 7f4a967fc640 1 -- 172.21.15.37:0/544432731 <== mon.1 v1:172.21.15.151:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122743020 0 0) 0x7f4a98162b10 con 0x7f4a980708d0 2023-12-11T17:11:17.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.884+0000 7f4a967fc640 1 -- 172.21.15.37:0/544432731 --> v1:172.21.15.151:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4a980cde40 con 0x7f4a980708d0 2023-12-11T17:11:17.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.884+0000 7f4a967fc640 1 -- 172.21.15.37:0/544432731 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 511205719 0 0) 0x7f4a80003520 con 0x7f4a981626b0 2023-12-11T17:11:17.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.884+0000 7f4a967fc640 1 -- 172.21.15.37:0/544432731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a9815f260 msgr2=0x7f4a980ccb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:17.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.884+0000 7f4a967fc640 1 --2- 172.21.15.37:0/544432731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a9815f260 0x7f4a980ccb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:17.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.884+0000 7f4a967fc640 1 -- 172.21.15.37:0/544432731 >> v1:172.21.15.151:6789/0 conn(0x7f4a980708d0 legacy=0x7f4a9816b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:17.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.884+0000 7f4a967fc640 1 -- 172.21.15.37:0/544432731 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a980cd230 con 0x7f4a981626b0 2023-12-11T17:11:17.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.884+0000 7f4a967fc640 1 -- 172.21.15.37:0/544432731 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f4a880019f0 con 0x7f4a981626b0 2023-12-11T17:11:17.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.884+0000 7f4a967fc640 1 -- 172.21.15.37:0/544432731 >> v1:172.21.15.37:6789/0 conn(0x7f4a981626b0 legacy=0x7f4a980701c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:17.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.884+0000 7f4a967fc640 1 --2- 172.21.15.37:0/544432731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a80003b30 0x7f4a80003f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:17.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.884+0000 7f4a967fc640 1 --2- 172.21.15.37:0/544432731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a800047c0 0x7f4a80004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:17.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.884+0000 7f4a967fc640 1 --2- 172.21.15.37:0/544432731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a80005180 0x7f4a8000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:17.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.884+0000 7f4a967fc640 1 -- 172.21.15.37:0/544432731 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8000bf70 con 0x7f4a80003b30 2023-12-11T17:11:17.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.884+0000 7f4a967fc640 1 -- 172.21.15.37:0/544432731 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8000c0e0 con 0x7f4a80005180 2023-12-11T17:11:17.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.884+0000 7f4a967fc640 1 -- 172.21.15.37:0/544432731 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a8000c2a0 con 0x7f4a800047c0 2023-12-11T17:11:17.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.885+0000 7f4a97fff640 1 --2- 172.21.15.37:0/544432731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a80005180 0x7f4a8000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:17.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.885+0000 7f4a96ffd640 1 --2- 172.21.15.37:0/544432731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a800047c0 0x7f4a80004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:17.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.886+0000 7f4a977fe640 1 --2- 172.21.15.37:0/544432731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a80003b30 0x7f4a80003f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:17.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.886+0000 7f4a97fff640 1 -- 172.21.15.37:0/544432731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a800047c0 msgr2=0x7f4a80004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:17.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.886+0000 7f4a97fff640 1 --2- 172.21.15.37:0/544432731 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a800047c0 0x7f4a80004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:17.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.886+0000 7f4a97fff640 1 -- 172.21.15.37:0/544432731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a80003b30 msgr2=0x7f4a80003f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:17.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.886+0000 7f4a97fff640 1 --2- 172.21.15.37:0/544432731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a80003b30 0x7f4a80003f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:17.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.886+0000 7f4a97fff640 1 -- 172.21.15.37:0/544432731 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a980cd230 con 0x7f4a80005180 2023-12-11T17:11:17.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.888+0000 7f4a977fe640 1 --2- 172.21.15.37:0/544432731 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a80003b30 0x7f4a80003f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:17.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.888+0000 7f4a97fff640 1 --2- 172.21.15.37:0/544432731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a80005180 0x7f4a8000b980 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4a90001910 tx=0x7f4a800057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=df9507d7641b009f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:17.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.889+0000 7f4a967fc640 1 -- 172.21.15.37:0/544432731 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a90036070 con 0x7f4a80005180 2023-12-11T17:11:17.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.889+0000 7f4a967fc640 1 -- 172.21.15.37:0/544432731 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a90007020 con 0x7f4a80005180 2023-12-11T17:11:17.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.889+0000 7f4a967fc640 1 -- 172.21.15.37:0/544432731 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a90007450 con 0x7f4a80005180 2023-12-11T17:11:17.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.890+0000 7f4a9dd97640 1 -- 172.21.15.37:0/544432731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a80005180 msgr2=0x7f4a8000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:17.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.890+0000 7f4a9dd97640 1 --2- 172.21.15.37:0/544432731 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a80005180 0x7f4a8000b980 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4a90001910 tx=0x7f4a800057f0 comp rx=0 tx=0).stop 2023-12-11T17:11:17.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.890+0000 7f4a97fff640 1 -- 172.21.15.37:0/544432731 reap_dead start 2023-12-11T17:11:17.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.890+0000 7f4a9dd97640 1 -- 172.21.15.37:0/544432731 shutdown_connections 2023-12-11T17:11:17.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.890+0000 7f4a9dd97640 1 -- 172.21.15.37:0/544432731 >> 172.21.15.37:0/544432731 conn(0x7f4a980b0a90 msgr2=0x7f4a980b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:17.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.890+0000 7f4a9dd97640 1 -- 172.21.15.37:0/544432731 shutdown_connections 2023-12-11T17:11:17.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.890+0000 7f4a9dd97640 1 -- 172.21.15.37:0/544432731 wait complete. 2023-12-11T17:11:17.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.894+0000 7f4a9dd97640 1 Processor -- start 2023-12-11T17:11:17.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.894+0000 7f4a9dd97640 1 -- start start 2023-12-11T17:11:17.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.896+0000 7f4a9dd97640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a80005180 0x7f4a98153980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:17.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.896+0000 7f4a9dd97640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a980ae090 0x7f4a981fa530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:17.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.896+0000 7f4a9dd97640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a981f7850 0x7f4a9815f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:17.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.896+0000 7f4a9dd97640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a981f73c0 con 0x7f4a80005180 2023-12-11T17:11:17.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.896+0000 7f4a9dd97640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a98153ec0 con 0x7f4a981f7850 2023-12-11T17:11:17.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.896+0000 7f4a9dd97640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a981fae30 con 0x7f4a980ae090 2023-12-11T17:11:17.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.896+0000 7f4a97fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a981f7850 0x7f4a9815f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:17.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.896+0000 7f4a96ffd640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a980ae090 0x7f4a981fa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:17.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.896+0000 7f4a97fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a981f7850 0x7f4a9815f7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:55416/0 (socket says 172.21.15.37:55416) 2023-12-11T17:11:17.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.896+0000 7f4a97fff640 1 -- 172.21.15.37:0/1260884127 learned_addr learned my addr 172.21.15.37:0/1260884127 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:17.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.897+0000 7f4a977fe640 1 --2- 172.21.15.37:0/1260884127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a80005180 0x7f4a98153980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:17.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.897+0000 7f4a96ffd640 1 -- 172.21.15.37:0/1260884127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a981f7850 msgr2=0x7f4a9815f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:17.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.897+0000 7f4a96ffd640 1 --2- 172.21.15.37:0/1260884127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a981f7850 0x7f4a9815f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:17.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.897+0000 7f4a96ffd640 1 -- 172.21.15.37:0/1260884127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a80005180 msgr2=0x7f4a98153980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:17.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.897+0000 7f4a96ffd640 1 --2- 172.21.15.37:0/1260884127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a80005180 0x7f4a98153980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:17.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.897+0000 7f4a96ffd640 1 -- 172.21.15.37:0/1260884127 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a981fb110 con 0x7f4a980ae090 2023-12-11T17:11:17.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.897+0000 7f4a977fe640 1 --2- 172.21.15.37:0/1260884127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a80005180 0x7f4a98153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:11:17.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.898+0000 7f4a96ffd640 1 --2- 172.21.15.37:0/1260884127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a980ae090 0x7f4a981fa530 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4a88007940 tx=0x7f4a8800a6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:17.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.898+0000 7f4a7ffff640 1 -- 172.21.15.37:0/1260884127 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a8800ae30 con 0x7f4a980ae090 2023-12-11T17:11:17.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.898+0000 7f4a7ffff640 1 -- 172.21.15.37:0/1260884127 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a880133f0 con 0x7f4a980ae090 2023-12-11T17:11:17.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.898+0000 7f4a9dd97640 1 -- 172.21.15.37:0/1260884127 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a981f7050 con 0x7f4a980ae090 2023-12-11T17:11:17.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.898+0000 7f4a7ffff640 1 -- 172.21.15.37:0/1260884127 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a880137a0 con 0x7f4a980ae090 2023-12-11T17:11:17.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.898+0000 7f4a9dd97640 1 -- 172.21.15.37:0/1260884127 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a981faa70 con 0x7f4a980ae090 2023-12-11T17:11:17.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.899+0000 7f4a9dd97640 1 -- 172.21.15.37:0/1260884127 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a980745d0 con 0x7f4a980ae090 2023-12-11T17:11:17.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.901+0000 7f4a7ffff640 1 -- 172.21.15.37:0/1260884127 <== mon.2 v2:172.21.15.151:3301/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4a88013900 con 0x7f4a980ae090 2023-12-11T17:11:17.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.902+0000 7f4a7ffff640 1 --2- 172.21.15.37:0/1260884127 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4a8406aec0 0x7f4a8406d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:17.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.902+0000 7f4a7ffff640 1 -- 172.21.15.37:0/1260884127 <== mon.2 v2:172.21.15.151:3301/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5263+0+0 (secure 0 0 0) 0x7f4a88089f50 con 0x7f4a980ae090 2023-12-11T17:11:17.903 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.902+0000 7f4a977fe640 1 --2- 172.21.15.37:0/1260884127 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4a8406aec0 0x7f4a8406d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:17.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.903+0000 7f4a977fe640 1 --2- 172.21.15.37:0/1260884127 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4a8406aec0 0x7f4a8406d380 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c006fd0 tx=0x7f4a8c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:17.910 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:17.909+0000 7f4a7ffff640 1 -- 172.21.15.37:0/1260884127 <== mon.2 v2:172.21.15.151:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4a880551a0 con 0x7f4a980ae090 2023-12-11T17:11:18.119 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.119+0000 7f4a9dd97640 1 -- 172.21.15.37:0/1260884127 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4a9806c940 con 0x7f4a980ae090 2023-12-11T17:11:18.625 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.624+0000 7f4a7ffff640 1 -- 172.21.15.37:0/1260884127 <== mon.2 v2:172.21.15.151:3301/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v33) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4a88017080 con 0x7f4a980ae090 2023-12-11T17:11:18.625 INFO:teuthology.orchestra.run.smithi037.stderr: removed all blocklist entries 2023-12-11T17:11:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.627+0000 7f4a9dd97640 1 -- 172.21.15.37:0/1260884127 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4a8406aec0 msgr2=0x7f4a8406d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.627+0000 7f4a9dd97640 1 --2- 172.21.15.37:0/1260884127 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4a8406aec0 0x7f4a8406d380 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f4a8c006fd0 tx=0x7f4a8c008040 comp rx=0 tx=0).stop 2023-12-11T17:11:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.627+0000 7f4a9dd97640 1 -- 172.21.15.37:0/1260884127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a980ae090 msgr2=0x7f4a981fa530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.627+0000 7f4a9dd97640 1 --2- 172.21.15.37:0/1260884127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a980ae090 0x7f4a981fa530 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f4a88007940 tx=0x7f4a8800a6e0 comp rx=0 tx=0).stop 2023-12-11T17:11:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.628+0000 7f4a9dd97640 1 -- 172.21.15.37:0/1260884127 shutdown_connections 2023-12-11T17:11:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.628+0000 7f4a9dd97640 1 --2- 172.21.15.37:0/1260884127 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4a8406aec0 0x7f4a8406d380 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.628+0000 7f4a9dd97640 1 --2- 172.21.15.37:0/1260884127 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4a981f7850 0x7f4a9815f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.628+0000 7f4a9dd97640 1 --2- 172.21.15.37:0/1260884127 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4a980ae090 0x7f4a981fa530 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.628+0000 7f4a9dd97640 1 --2- 172.21.15.37:0/1260884127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4a80005180 0x7f4a98153980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:18.629 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.628+0000 7f4a9dd97640 1 -- 172.21.15.37:0/1260884127 >> 172.21.15.37:0/1260884127 conn(0x7f4a980b0a90 msgr2=0x7f4a9815e500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:18.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.628+0000 7f4a9dd97640 1 -- 172.21.15.37:0/1260884127 shutdown_connections 2023-12-11T17:11:18.630 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.628+0000 7f4a9dd97640 1 -- 172.21.15.37:0/1260884127 wait complete. 2023-12-11T17:11:18.652 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-11T17:11:18.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.873+0000 7f7496be5640 1 Processor -- start 2023-12-11T17:11:18.874 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.873+0000 7f7496be5640 1 -- start start 2023-12-11T17:11:18.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.875+0000 7f7496be5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7490143e00 0x7f74900b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:18.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.875+0000 7f7496be5640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7490072180 0x7f74900b4580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:18.876 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.875+0000 7f7496be5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f749006c410 0x7f74900b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:18.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.875+0000 7f7496be5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74900b3bb0 con 0x7f7490143e00 2023-12-11T17:11:18.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.875+0000 7f7496be5640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74901441e0 con 0x7f7490072180 2023-12-11T17:11:18.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.875+0000 7f7496be5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7490072680 con 0x7f749006c410 2023-12-11T17:11:18.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.876+0000 7f7494981640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7490143e00 0x7f74900b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:18.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.876+0000 7f7494981640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7490143e00 0x7f74900b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35366/0 (socket says 172.21.15.37:35366) 2023-12-11T17:11:18.877 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.876+0000 7f7494981640 1 -- 172.21.15.37:0/1442402845 learned_addr learned my addr 172.21.15.37:0/1442402845 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:18.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.876+0000 7f748ffff640 1 --2- 172.21.15.37:0/1442402845 >> v2:172.21.15.151:3300/0 conn(0x7f7490072180 0x7f74900b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:18.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.876+0000 7f7495182640 1 --2- 172.21.15.37:0/1442402845 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f749006c410 0x7f74900b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:18.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.876+0000 7f7494981640 1 -- 172.21.15.37:0/1442402845 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f749006c410 msgr2=0x7f74900b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:18.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.876+0000 7f7494981640 1 --2- 172.21.15.37:0/1442402845 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f749006c410 0x7f74900b4ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:18.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.876+0000 7f7494981640 1 -- 172.21.15.37:0/1442402845 >> v2:172.21.15.151:3300/0 conn(0x7f7490072180 msgr2=0x7f74900b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:18.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.876+0000 7f7494981640 1 --2- 172.21.15.37:0/1442402845 >> v2:172.21.15.151:3300/0 conn(0x7f7490072180 0x7f74900b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:18.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.876+0000 7f7494981640 1 -- 172.21.15.37:0/1442402845 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74900b1e30 con 0x7f7490143e00 2023-12-11T17:11:18.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.878+0000 7f7494981640 1 --2- 172.21.15.37:0/1442402845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7490143e00 0x7f74900b4040 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7490067da0 tx=0x7f748402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ad5dd2d92386bd server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:18.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.878+0000 7f748f7fe640 1 -- 172.21.15.37:0/1442402845 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484031870 con 0x7f7490143e00 2023-12-11T17:11:18.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.878+0000 7f748f7fe640 1 -- 172.21.15.37:0/1442402845 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74840319d0 con 0x7f7490143e00 2023-12-11T17:11:18.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.878+0000 7f748f7fe640 1 -- 172.21.15.37:0/1442402845 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7484031d60 con 0x7f7490143e00 2023-12-11T17:11:18.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.879+0000 7f7496be5640 1 -- 172.21.15.37:0/1442402845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7490143e00 msgr2=0x7f74900b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:18.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.879+0000 7f7496be5640 1 --2- 172.21.15.37:0/1442402845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7490143e00 0x7f74900b4040 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7490067da0 tx=0x7f748402b910 comp rx=0 tx=0).stop 2023-12-11T17:11:18.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.879+0000 7f7496be5640 1 -- 172.21.15.37:0/1442402845 shutdown_connections 2023-12-11T17:11:18.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.879+0000 7f7496be5640 1 --2- 172.21.15.37:0/1442402845 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f749006c410 0x7f74900b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:18.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.879+0000 7f7496be5640 1 --2- 172.21.15.37:0/1442402845 >> v2:172.21.15.151:3300/0 conn(0x7f7490072180 0x7f74900b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:18.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.879+0000 7f7496be5640 1 --2- 172.21.15.37:0/1442402845 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7490143e00 0x7f74900b4040 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:18.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.879+0000 7f7496be5640 1 -- 172.21.15.37:0/1442402845 >> 172.21.15.37:0/1442402845 conn(0x7f74900b0a90 msgr2=0x7f74900b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:18.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.879+0000 7f7496be5640 1 -- 172.21.15.37:0/1442402845 shutdown_connections 2023-12-11T17:11:18.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.879+0000 7f7496be5640 1 -- 172.21.15.37:0/1442402845 wait complete. 2023-12-11T17:11:18.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.881+0000 7f7496be5640 1 Processor -- start 2023-12-11T17:11:18.882 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.881+0000 7f7496be5640 1 -- start start 2023-12-11T17:11:18.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.882+0000 7f7496be5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f749006c410 0x7f74900ce420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:18.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.882+0000 7f7496be5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7490072180 0x7f74900ac860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:18.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.882+0000 7f7496be5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7490143e00 0x7f749013e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:18.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.882+0000 7f7496be5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74900acda0 con 0x7f749006c410 2023-12-11T17:11:18.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.882+0000 7f7496be5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74900ad070 con 0x7f7490072180 2023-12-11T17:11:18.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.882+0000 7f7496be5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74900ad350 con 0x7f7490143e00 2023-12-11T17:11:18.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.883+0000 7f7494981640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f749006c410 0x7f74900ce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:18.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.883+0000 7f7494981640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f749006c410 0x7f74900ce420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:35378/0 (socket says 172.21.15.37:35378) 2023-12-11T17:11:18.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.883+0000 7f7494981640 1 -- 172.21.15.37:0/646877003 learned_addr learned my addr 172.21.15.37:0/646877003 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:18.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.883+0000 7f7494981640 1 -- 172.21.15.37:0/646877003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7490143e00 msgr2=0x7f749013e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:18.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.883+0000 7f7494981640 1 --2- 172.21.15.37:0/646877003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7490143e00 0x7f749013e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:18.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.883+0000 7f7494981640 1 -- 172.21.15.37:0/646877003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7490072180 msgr2=0x7f74900ac860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:18.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.883+0000 7f7494981640 1 --2- 172.21.15.37:0/646877003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7490072180 0x7f74900ac860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:18.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.883+0000 7f7494981640 1 -- 172.21.15.37:0/646877003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74840094d0 con 0x7f749006c410 2023-12-11T17:11:18.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.883+0000 7f7494981640 1 --2- 172.21.15.37:0/646877003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f749006c410 0x7f74900ce420 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f748402b950 tx=0x7f74840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:18.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.884+0000 7f748d7fa640 1 -- 172.21.15.37:0/646877003 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f748403ad30 con 0x7f749006c410 2023-12-11T17:11:18.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.884+0000 7f748d7fa640 1 -- 172.21.15.37:0/646877003 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74840443f0 con 0x7f749006c410 2023-12-11T17:11:18.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.884+0000 7f748d7fa640 1 -- 172.21.15.37:0/646877003 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74840447a0 con 0x7f749006c410 2023-12-11T17:11:18.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.884+0000 7f7496be5640 1 -- 172.21.15.37:0/646877003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74900ad630 con 0x7f749006c410 2023-12-11T17:11:18.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.884+0000 7f7496be5640 1 -- 172.21.15.37:0/646877003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74900adbf0 con 0x7f749006c410 2023-12-11T17:11:18.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.885+0000 7f7496be5640 1 -- 172.21.15.37:0/646877003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74900adde0 con 0x7f749006c410 2023-12-11T17:11:18.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.886+0000 7f748d7fa640 1 -- 172.21.15.37:0/646877003 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f748404d450 con 0x7f749006c410 2023-12-11T17:11:18.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.887+0000 7f748d7fa640 1 --2- 172.21.15.37:0/646877003 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f747406ae40 0x7f747406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:18.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.887+0000 7f748d7fa640 1 -- 172.21.15.37:0/646877003 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f748402d040 con 0x7f749006c410 2023-12-11T17:11:18.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.888+0000 7f748ffff640 1 --2- 172.21.15.37:0/646877003 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f747406ae40 0x7f747406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:18.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.889+0000 7f748ffff640 1 --2- 172.21.15.37:0/646877003 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f747406ae40 0x7f747406d300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f74900cade0 tx=0x7f747c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:18.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:18.891+0000 7f748d7fa640 1 -- 172.21.15.37:0/646877003 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7484076c30 con 0x7f749006c410 2023-12-11T17:11:19.159 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.158+0000 7f7496be5640 1 -- 172.21.15.37:0/646877003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f74900745d0 con 0x7f749006c410 2023-12-11T17:11:19.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.159+0000 7f748d7fa640 1 -- 172.21.15.37:0/646877003 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7f7484035020 con 0x7f749006c410 2023-12-11T17:11:19.160 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:11:19.160 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-12-11T17:11:19.160 INFO:teuthology.orchestra.run.smithi037.stdout: "auth_dump": [ 2023-12-11T17:11:19.160 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.160 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.a", 2023-12-11T17:11:19.160 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAbQndlungdFRAABbCcncYp6gDHgsDrmGgQEg==", 2023-12-11T17:11:19.161 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.161 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-12-11T17:11:19.161 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-12-11T17:11:19.161 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-12-11T17:11:19.161 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-11T17:11:19.161 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.161 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.161 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.161 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.b", 2023-12-11T17:11:19.161 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAbQndlPNdUORAAKJejhmXAmDJFHfHHCShAOw==", 2023-12-11T17:11:19.161 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.161 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-12-11T17:11:19.161 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-12-11T17:11:19.162 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-12-11T17:11:19.162 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-11T17:11:19.162 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.162 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.162 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.162 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.c", 2023-12-11T17:11:19.162 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAbQndlwMSfJxAA0kjI/HBNFPN893ojKAUSew==", 2023-12-11T17:11:19.162 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.162 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-12-11T17:11:19.162 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-12-11T17:11:19.162 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-12-11T17:11:19.162 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-11T17:11:19.162 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.163 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.163 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.163 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mds.d", 2023-12-11T17:11:19.163 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAcQndl+gjGDRAAjZGXzxk3B/uu+pwIae/3rw==", 2023-12-11T17:11:19.163 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.163 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-12-11T17:11:19.163 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-12-11T17:11:19.163 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-12-11T17:11:19.163 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-11T17:11:19.163 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.163 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.163 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.164 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.0", 2023-12-11T17:11:19.164 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAhQndlQDPFDhAAeg8Nh2I/UzL8yGnqJFl4rA==", 2023-12-11T17:11:19.164 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.164 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-12-11T17:11:19.164 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-12-11T17:11:19.164 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-11T17:11:19.164 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.164 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.164 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.164 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.1", 2023-12-11T17:11:19.164 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAkQndlU/udKhAAuf/IqblDxe+gz5gT9EPRlg==", 2023-12-11T17:11:19.164 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.164 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-12-11T17:11:19.164 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-12-11T17:11:19.165 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-11T17:11:19.165 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.165 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.165 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.165 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.2", 2023-12-11T17:11:19.165 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAoQndlZlLhCBAACHd34bOcIQtXSdk6lNkFgg==", 2023-12-11T17:11:19.165 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.165 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-12-11T17:11:19.165 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-12-11T17:11:19.165 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-11T17:11:19.165 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.165 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.165 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.166 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.3", 2023-12-11T17:11:19.166 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQArQndlI76AIxAALcb2soN0pQIlJYRJzuCx2g==", 2023-12-11T17:11:19.166 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.166 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-12-11T17:11:19.166 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-12-11T17:11:19.166 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-11T17:11:19.166 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.166 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.166 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.166 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.4", 2023-12-11T17:11:19.166 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAyQndlknnbIhAAVWP7erZ6EMjNVJcs6xTLWA==", 2023-12-11T17:11:19.166 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.166 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-12-11T17:11:19.166 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-12-11T17:11:19.166 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-11T17:11:19.167 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.167 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.167 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.167 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.5", 2023-12-11T17:11:19.167 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA1QndlAjpPLRAAnfrommkI81tsCJYmcpMq5w==", 2023-12-11T17:11:19.167 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.167 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-12-11T17:11:19.167 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-12-11T17:11:19.167 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-11T17:11:19.167 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.167 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.167 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.167 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.6", 2023-12-11T17:11:19.167 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA5Qndl61syCxAApiq3q/BjWOVYjdl2R6uvAw==", 2023-12-11T17:11:19.167 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.168 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-12-11T17:11:19.168 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-12-11T17:11:19.168 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-11T17:11:19.168 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.168 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.168 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.168 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "osd.7", 2023-12-11T17:11:19.168 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQA8QndltjRnFRAA4PicSbwdLxQ9d5eoxXSIVg==", 2023-12-11T17:11:19.168 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.168 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow profile osd", 2023-12-11T17:11:19.168 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile osd", 2023-12-11T17:11:19.168 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-11T17:11:19.168 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.168 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.168 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.169 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.0", 2023-12-11T17:11:19.169 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAcQndliHmLGxAA+EpFpS2I98RG7SN1gAiRLQ==", 2023-12-11T17:11:19.169 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.169 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-12-11T17:11:19.169 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-12-11T17:11:19.169 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-12-11T17:11:19.169 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-12-11T17:11:19.169 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.169 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.169 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.169 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.1", 2023-12-11T17:11:19.169 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAcQndlAhjgMRAA6B/hthYWw1PyyXvVVitHnw==", 2023-12-11T17:11:19.169 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.169 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-12-11T17:11:19.169 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-12-11T17:11:19.170 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-12-11T17:11:19.170 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-12-11T17:11:19.170 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.170 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.170 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.170 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.2", 2023-12-11T17:11:19.170 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAcQndlwnniJhAAesgB3OB2+RW3+7K3w2TCWw==", 2023-12-11T17:11:19.170 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.170 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-12-11T17:11:19.170 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-12-11T17:11:19.170 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-12-11T17:11:19.170 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-12-11T17:11:19.170 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.170 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.170 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.171 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.3", 2023-12-11T17:11:19.171 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAdQndlOdm1ARAANlOZ9dzSBs4+CsEQM5Yf2Q==", 2023-12-11T17:11:19.171 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.171 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow", 2023-12-11T17:11:19.171 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow r", 2023-12-11T17:11:19.171 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow rw", 2023-12-11T17:11:19.171 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow rwx" 2023-12-11T17:11:19.171 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.171 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.171 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.171 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.admin", 2023-12-11T17:11:19.171 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw==", 2023-12-11T17:11:19.171 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.171 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-12-11T17:11:19.172 INFO:teuthology.orchestra.run.smithi037.stdout: "mgr": "allow *", 2023-12-11T17:11:19.172 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow *", 2023-12-11T17:11:19.172 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-11T17:11:19.172 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.172 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.172 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.172 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-mds", 2023-12-11T17:11:19.172 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBFQndluMD0ERAAMYLKCiel+h1cwaMzKtNmtQ==", 2023-12-11T17:11:19.172 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.172 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-mds" 2023-12-11T17:11:19.172 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.172 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.172 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.172 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-mgr", 2023-12-11T17:11:19.172 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBFQndlj8r0ERAA48zX3axSIyUeD5PZivO1JQ==", 2023-12-11T17:11:19.173 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.173 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-11T17:11:19.173 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.173 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.173 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.173 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-osd", 2023-12-11T17:11:19.173 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBFQndlNNP0ERAADou02gBBFz0v+WrUvWkVLg==", 2023-12-11T17:11:19.173 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.173 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-osd" 2023-12-11T17:11:19.173 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.173 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.173 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.173 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rbd", 2023-12-11T17:11:19.174 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBFQndl2dv0ERAAbCtCU32JAsnlcJQnH30wxQ==", 2023-12-11T17:11:19.174 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.174 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-11T17:11:19.174 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.174 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.174 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.174 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-11T17:11:19.174 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBFQndl3+T0ERAAxGN0VXrKY/SwRbdz9WqV2w==", 2023-12-11T17:11:19.174 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.174 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-11T17:11:19.174 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.174 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.174 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.174 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "client.bootstrap-rgw", 2023-12-11T17:11:19.174 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQBFQndlC/H0ERAA2eEtJBBq0wiezkPb/flGAg==", 2023-12-11T17:11:19.175 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.175 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-11T17:11:19.175 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.175 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.175 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.175 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.x", 2023-12-11T17:11:19.175 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAbQndlZ8IJCBAAFvb+ICfIlsMnDvvLp8VyOA==", 2023-12-11T17:11:19.175 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.175 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-12-11T17:11:19.175 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-12-11T17:11:19.175 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-11T17:11:19.175 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.175 INFO:teuthology.orchestra.run.smithi037.stdout: }, 2023-12-11T17:11:19.175 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:19.176 INFO:teuthology.orchestra.run.smithi037.stdout: "entity": "mgr.y", 2023-12-11T17:11:19.176 INFO:teuthology.orchestra.run.smithi037.stdout: "key": "AQAaQndlWY7TORAAJ5A6MvYYIo/S1P2z7SGSsw==", 2023-12-11T17:11:19.176 INFO:teuthology.orchestra.run.smithi037.stdout: "caps": { 2023-12-11T17:11:19.176 INFO:teuthology.orchestra.run.smithi037.stdout: "mds": "allow *", 2023-12-11T17:11:19.176 INFO:teuthology.orchestra.run.smithi037.stdout: "mon": "allow profile mgr", 2023-12-11T17:11:19.176 INFO:teuthology.orchestra.run.smithi037.stdout: "osd": "allow *" 2023-12-11T17:11:19.176 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.176 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:19.176 INFO:teuthology.orchestra.run.smithi037.stdout: ] 2023-12-11T17:11:19.176 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-12-11T17:11:19.177 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.162+0000 7f7496be5640 1 -- 172.21.15.37:0/646877003 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f747406ae40 msgr2=0x7f747406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:19.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.162+0000 7f7496be5640 1 --2- 172.21.15.37:0/646877003 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f747406ae40 0x7f747406d300 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f74900cade0 tx=0x7f747c008040 comp rx=0 tx=0).stop 2023-12-11T17:11:19.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.162+0000 7f7496be5640 1 -- 172.21.15.37:0/646877003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f749006c410 msgr2=0x7f74900ce420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:19.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.162+0000 7f7496be5640 1 --2- 172.21.15.37:0/646877003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f749006c410 0x7f74900ce420 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f748402b950 tx=0x7f74840046c0 comp rx=0 tx=0).stop 2023-12-11T17:11:19.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.162+0000 7f7496be5640 1 -- 172.21.15.37:0/646877003 shutdown_connections 2023-12-11T17:11:19.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.162+0000 7f7496be5640 1 --2- 172.21.15.37:0/646877003 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f747406ae40 0x7f747406d300 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:19.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.162+0000 7f7496be5640 1 --2- 172.21.15.37:0/646877003 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7490072180 0x7f74900ac860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:19.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.162+0000 7f7496be5640 1 --2- 172.21.15.37:0/646877003 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7490143e00 0x7f749013e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:19.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.162+0000 7f7496be5640 1 --2- 172.21.15.37:0/646877003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f749006c410 0x7f74900ce420 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:19.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.162+0000 7f7496be5640 1 -- 172.21.15.37:0/646877003 >> 172.21.15.37:0/646877003 conn(0x7f74900b0a90 msgr2=0x7f74900afa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:19.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.162+0000 7f7496be5640 1 -- 172.21.15.37:0/646877003 shutdown_connections 2023-12-11T17:11:19.178 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.162+0000 7f7496be5640 1 -- 172.21.15.37:0/646877003 wait complete. 2023-12-11T17:11:19.182 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-11T17:11:19.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.411+0000 7f7ae0c7c640 1 Processor -- start 2023-12-11T17:11:19.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.411+0000 7f7ae0c7c640 1 -- start start 2023-12-11T17:11:19.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.413+0000 7f7ae0c7c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7adc0cd000 0x7f7adc06c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:19.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.413+0000 7f7ae0c7c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7adc146ba0 0x7f7adc06cd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:19.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.413+0000 7f7ae0c7c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7adc06d260 con 0x7f7adc1467c0 2023-12-11T17:11:19.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.413+0000 7f7ae0c7c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7adc0ac860 con 0x7f7adc0cd000 2023-12-11T17:11:19.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.413+0000 7f7ae0c7c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc06d510 con 0x7f7adc146ba0 2023-12-11T17:11:19.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.414+0000 7f7ad3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7adc0cd000 0x7f7adc06c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:19.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.414+0000 7f7ad3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7adc0cd000 0x7f7adc06c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44314/0 (socket says 172.21.15.37:44314) 2023-12-11T17:11:19.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.414+0000 7f7ad3fff640 1 -- 172.21.15.37:0/4273373601 learned_addr learned my addr 172.21.15.37:0/4273373601 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:19.462 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.414+0000 7f7adad9d640 1 --2- 172.21.15.37:0/4273373601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7adc146ba0 0x7f7adc06cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.414+0000 7f7ad3fff640 1 -- 172.21.15.37:0/4273373601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7adc146ba0 msgr2=0x7f7adc06cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.414+0000 7f7ad3fff640 1 --2- 172.21.15.37:0/4273373601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7adc146ba0 0x7f7adc06cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.414+0000 7f7ad3fff640 1 -- 172.21.15.37:0/4273373601 >> v1:172.21.15.151:6789/0 conn(0x7f7adc1467c0 legacy=0x7f7adc0cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.414+0000 7f7ad3fff640 1 -- 172.21.15.37:0/4273373601 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc06d7f0 con 0x7f7adc0cd000 2023-12-11T17:11:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.416+0000 7f7ad3fff640 1 --2- 172.21.15.37:0/4273373601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc0cd000 0x7f7adc06c7e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4009870 tx=0x7f7ac402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf7d4afe77cfcff server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.416+0000 7f7ad9d9b640 1 -- 172.21.15.37:0/4273373601 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4031640 con 0x7f7adc0cd000 2023-12-11T17:11:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.416+0000 7f7ad9d9b640 1 -- 172.21.15.37:0/4273373601 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac40317a0 con 0x7f7adc0cd000 2023-12-11T17:11:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.416+0000 7f7ad9d9b640 1 -- 172.21.15.37:0/4273373601 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4031b30 con 0x7f7adc0cd000 2023-12-11T17:11:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.417+0000 7f7ae0c7c640 1 -- 172.21.15.37:0/4273373601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc0cd000 msgr2=0x7f7adc06c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.417+0000 7f7ae0c7c640 1 --2- 172.21.15.37:0/4273373601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc0cd000 0x7f7adc06c7e0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4009870 tx=0x7f7ac402b8f0 comp rx=0 tx=0).stop 2023-12-11T17:11:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.417+0000 7f7ae0c7c640 1 -- 172.21.15.37:0/4273373601 shutdown_connections 2023-12-11T17:11:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.417+0000 7f7ae0c7c640 1 --2- 172.21.15.37:0/4273373601 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7adc146ba0 0x7f7adc06cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.417+0000 7f7ae0c7c640 1 --2- 172.21.15.37:0/4273373601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc0cd000 0x7f7adc06c7e0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:19.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.417+0000 7f7ae0c7c640 1 -- 172.21.15.37:0/4273373601 >> 172.21.15.37:0/4273373601 conn(0x7f7adc0b0a90 msgr2=0x7f7adc0b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.417+0000 7f7ae0c7c640 1 -- 172.21.15.37:0/4273373601 shutdown_connections 2023-12-11T17:11:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.417+0000 7f7ae0c7c640 1 -- 172.21.15.37:0/4273373601 wait complete. 2023-12-11T17:11:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.419+0000 7f7ae0c7c640 1 Processor -- start 2023-12-11T17:11:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.419+0000 7f7ae0c7c640 1 -- start start 2023-12-11T17:11:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.420+0000 7f7ae0c7c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7adc0cd000 0x7f7adc157e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.420+0000 7f7ae0c7c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc1467c0 0x7f7adc144ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.420+0000 7f7ae0c7c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7adc146ba0 0x7f7adc1f34d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.420+0000 7f7ae0c7c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc0b2c70 con 0x7f7adc1467c0 2023-12-11T17:11:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.420+0000 7f7ae0c7c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc158350 con 0x7f7adc0cd000 2023-12-11T17:11:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.420+0000 7f7ae0c7c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc0b49d0 con 0x7f7adc146ba0 2023-12-11T17:11:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.420+0000 7f7ad3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc1467c0 0x7f7adc144ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.420+0000 7f7ad3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc1467c0 0x7f7adc144ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44326/0 (socket says 172.21.15.37:44326) 2023-12-11T17:11:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.420+0000 7f7ad3fff640 1 -- 172.21.15.37:0/1811090958 learned_addr learned my addr 172.21.15.37:0/1811090958 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.421+0000 7f7ad3fff640 1 -- 172.21.15.37:0/1811090958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7adc146ba0 msgr2=0x7f7adc1f34d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:19.464 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.421+0000 7f7ad3fff640 1 --2- 172.21.15.37:0/1811090958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7adc146ba0 0x7f7adc1f34d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.421+0000 7f7ad3fff640 1 -- 172.21.15.37:0/1811090958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7adc0cd000 msgr2=0x7f7adc157e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.421+0000 7f7ad3fff640 1 --2- 172.21.15.37:0/1811090958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7adc0cd000 0x7f7adc157e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.421+0000 7f7ad3fff640 1 -- 172.21.15.37:0/1811090958 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ac40094d0 con 0x7f7adc1467c0 2023-12-11T17:11:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.421+0000 7f7ad3fff640 1 --2- 172.21.15.37:0/1811090958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc1467c0 0x7f7adc144ac0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4000c00 tx=0x7f7ac40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.421+0000 7f7ad2ffd640 1 -- 172.21.15.37:0/1811090958 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac403ac60 con 0x7f7adc1467c0 2023-12-11T17:11:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.421+0000 7f7ad2ffd640 1 -- 172.21.15.37:0/1811090958 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ac403adc0 con 0x7f7adc1467c0 2023-12-11T17:11:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.421+0000 7f7ad2ffd640 1 -- 172.21.15.37:0/1811090958 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4044630 con 0x7f7adc1467c0 2023-12-11T17:11:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.421+0000 7f7ae0c7c640 1 -- 172.21.15.37:0/1811090958 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7adc0b4cb0 con 0x7f7adc1467c0 2023-12-11T17:11:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.422+0000 7f7ae0c7c640 1 -- 172.21.15.37:0/1811090958 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7adc0b3160 con 0x7f7adc1467c0 2023-12-11T17:11:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.423+0000 7f7ae0c7c640 1 -- 172.21.15.37:0/1811090958 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7adc0745d0 con 0x7f7adc1467c0 2023-12-11T17:11:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.424+0000 7f7ad2ffd640 1 -- 172.21.15.37:0/1811090958 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7ac402f050 con 0x7f7adc1467c0 2023-12-11T17:11:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.425+0000 7f7ad2ffd640 1 --2- 172.21.15.37:0/1811090958 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7abc06ae40 0x7f7abc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.425+0000 7f7ad2ffd640 1 -- 172.21.15.37:0/1811090958 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7ac40ab320 con 0x7f7adc1467c0 2023-12-11T17:11:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.426+0000 7f7ada59c640 1 --2- 172.21.15.37:0/1811090958 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7abc06ae40 0x7f7abc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:19.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.427+0000 7f7ada59c640 1 --2- 172.21.15.37:0/1811090958 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7abc06ae40 0x7f7abc06d300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7acc003cc0 tx=0x7f7acc0079b0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:19.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.430+0000 7f7ad2ffd640 1 -- 172.21.15.37:0/1811090958 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7ac40765d0 con 0x7f7adc1467c0 2023-12-11T17:11:19.691 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.690+0000 7f7ae0c7c640 1 -- 172.21.15.37:0/1811090958 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f7adc0726a0 con 0x7f7adc1467c0 2023-12-11T17:11:19.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.695+0000 7f7ad2ffd640 1 -- 172.21.15.37:0/1811090958 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7ac4031e60 con 0x7f7adc1467c0 2023-12-11T17:11:19.698 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.697+0000 7f7ae0c7c640 1 -- 172.21.15.37:0/1811090958 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7abc06ae40 msgr2=0x7f7abc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:19.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.697+0000 7f7ae0c7c640 1 --2- 172.21.15.37:0/1811090958 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7abc06ae40 0x7f7abc06d300 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7acc003cc0 tx=0x7f7acc0079b0 comp rx=0 tx=0).stop 2023-12-11T17:11:19.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.697+0000 7f7ae0c7c640 1 -- 172.21.15.37:0/1811090958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc1467c0 msgr2=0x7f7adc144ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:19.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.697+0000 7f7ae0c7c640 1 --2- 172.21.15.37:0/1811090958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc1467c0 0x7f7adc144ac0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4000c00 tx=0x7f7ac40046c0 comp rx=0 tx=0).stop 2023-12-11T17:11:19.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.697+0000 7f7ae0c7c640 1 -- 172.21.15.37:0/1811090958 shutdown_connections 2023-12-11T17:11:19.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.697+0000 7f7ae0c7c640 1 --2- 172.21.15.37:0/1811090958 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7abc06ae40 0x7f7abc06d300 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:19.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.697+0000 7f7ae0c7c640 1 --2- 172.21.15.37:0/1811090958 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7adc146ba0 0x7f7adc1f34d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:19.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.697+0000 7f7ae0c7c640 1 --2- 172.21.15.37:0/1811090958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7adc1467c0 0x7f7adc144ac0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:19.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.697+0000 7f7ae0c7c640 1 --2- 172.21.15.37:0/1811090958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7adc0cd000 0x7f7adc157e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:19.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.697+0000 7f7ae0c7c640 1 -- 172.21.15.37:0/1811090958 >> 172.21.15.37:0/1811090958 conn(0x7f7adc0b0a90 msgr2=0x7f7adc0cec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:19.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.698+0000 7f7ae0c7c640 1 -- 172.21.15.37:0/1811090958 shutdown_connections 2023-12-11T17:11:19.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.698+0000 7f7ae0c7c640 1 -- 172.21.15.37:0/1811090958 wait complete. 2023-12-11T17:11:19.718 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-11T17:11:19.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.925+0000 7fb22b81e640 1 Processor -- start 2023-12-11T17:11:19.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.925+0000 7fb22b81e640 1 -- start start 2023-12-11T17:11:19.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.927+0000 7fb22b81e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb22415f170 0x7fb22415f600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:19.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.927+0000 7fb22b81e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2240cabd0 con 0x7fb22406a460 2023-12-11T17:11:19.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.927+0000 7fb22b81e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2240caeb0 con 0x7fb22406d1c0 2023-12-11T17:11:19.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.927+0000 7fb22b81e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2240cb190 con 0x7fb22415f170 2023-12-11T17:11:19.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.928+0000 7fb229dbb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb22415f170 0x7fb22415f600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:19.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.928+0000 7fb2295ba640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb22406a460 0x7fb22406a840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57234/0 (socket says 172.21.15.37:57234) 2023-12-11T17:11:19.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.928+0000 7fb2295ba640 1 -- 172.21.15.37:0/923693736 learned_addr learned my addr 172.21.15.37:0/923693736 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:19.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.928+0000 7fb229dbb640 1 -- 172.21.15.37:0/923693736 >> v1:172.21.15.151:6789/0 conn(0x7fb22406d1c0 legacy=0x7fb2240aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:19.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.928+0000 7fb229dbb640 1 -- 172.21.15.37:0/923693736 >> v1:172.21.15.37:6789/0 conn(0x7fb22406a460 legacy=0x7fb22406a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:19.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.928+0000 7fb21bfff640 1 -- 172.21.15.37:0/923693736 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1085305139 0 0) 0x7fb2240cabd0 con 0x7fb22406a460 2023-12-11T17:11:19.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.928+0000 7fb229dbb640 1 -- 172.21.15.37:0/923693736 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2240cb470 con 0x7fb22415f170 2023-12-11T17:11:19.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.929+0000 7fb229dbb640 1 --2- 172.21.15.37:0/923693736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb22415f170 0x7fb22415f600 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0097a0 tx=0x7fb21c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1531698c699204 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:19.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.930+0000 7fb21bfff640 1 -- 172.21.15.37:0/923693736 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c031830 con 0x7fb22415f170 2023-12-11T17:11:19.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.930+0000 7fb21bfff640 1 -- 172.21.15.37:0/923693736 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb21c031990 con 0x7fb22415f170 2023-12-11T17:11:19.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.930+0000 7fb21bfff640 1 -- 172.21.15.37:0/923693736 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb21c031d20 con 0x7fb22415f170 2023-12-11T17:11:19.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.930+0000 7fb22b81e640 1 -- 172.21.15.37:0/923693736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb22415f170 msgr2=0x7fb22415f600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:19.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.930+0000 7fb22b81e640 1 --2- 172.21.15.37:0/923693736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb22415f170 0x7fb22415f600 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7fb21c0097a0 tx=0x7fb21c02b8d0 comp rx=0 tx=0).stop 2023-12-11T17:11:19.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.930+0000 7fb22b81e640 1 -- 172.21.15.37:0/923693736 shutdown_connections 2023-12-11T17:11:19.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.930+0000 7fb22b81e640 1 --2- 172.21.15.37:0/923693736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb22415f170 0x7fb22415f600 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:19.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.930+0000 7fb22b81e640 1 -- 172.21.15.37:0/923693736 >> 172.21.15.37:0/923693736 conn(0x7fb2240cc7d0 msgr2=0x7fb2240ccbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:19.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.930+0000 7fb22b81e640 1 -- 172.21.15.37:0/923693736 shutdown_connections 2023-12-11T17:11:19.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.930+0000 7fb22b81e640 1 -- 172.21.15.37:0/923693736 wait complete. 2023-12-11T17:11:19.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.932+0000 7fb22b81e640 1 Processor -- start 2023-12-11T17:11:19.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.932+0000 7fb22b81e640 1 -- start start 2023-12-11T17:11:19.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.933+0000 7fb22b81e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb22406a460 0x7fb2240c67f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:19.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.933+0000 7fb22b81e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb22406d1c0 0x7fb2240c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:19.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.933+0000 7fb22b81e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb22415f170 0x7fb2240c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.933+0000 7fb22b81e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240c93f0 con 0x7fb22406d1c0 2023-12-11T17:11:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.933+0000 7fb22b81e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2240c96d0 con 0x7fb22406a460 2023-12-11T17:11:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.933+0000 7fb22b81e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb22415bd90 con 0x7fb22415f170 2023-12-11T17:11:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.933+0000 7fb228db9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb22406d1c0 0x7fb2240c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.933+0000 7fb228db9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb22406d1c0 0x7fb2240c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44334/0 (socket says 172.21.15.37:44334) 2023-12-11T17:11:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.933+0000 7fb228db9640 1 -- 172.21.15.37:0/4033212844 learned_addr learned my addr 172.21.15.37:0/4033212844 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.934+0000 7fb2295ba640 1 --2- 172.21.15.37:0/4033212844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb22406a460 0x7fb2240c67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.934+0000 7fb228db9640 1 -- 172.21.15.37:0/4033212844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb22415f170 msgr2=0x7fb2240c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.934+0000 7fb228db9640 1 --2- 172.21.15.37:0/4033212844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb22415f170 0x7fb2240c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.934+0000 7fb228db9640 1 -- 172.21.15.37:0/4033212844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb22406a460 msgr2=0x7fb2240c67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.934+0000 7fb228db9640 1 --2- 172.21.15.37:0/4033212844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb22406a460 0x7fb2240c67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:19.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.934+0000 7fb228db9640 1 -- 172.21.15.37:0/4033212844 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb21c009400 con 0x7fb22406d1c0 2023-12-11T17:11:19.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.934+0000 7fb228db9640 1 --2- 172.21.15.37:0/4033212844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb22406d1c0 0x7fb2240c8880 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb21400c430 tx=0x7fb21400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:19.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.935+0000 7fb219ffb640 1 -- 172.21.15.37:0/4033212844 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb214011790 con 0x7fb22406d1c0 2023-12-11T17:11:19.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.935+0000 7fb219ffb640 1 -- 172.21.15.37:0/4033212844 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2140118f0 con 0x7fb22406d1c0 2023-12-11T17:11:19.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.935+0000 7fb22b81e640 1 -- 172.21.15.37:0/4033212844 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb22415c070 con 0x7fb22406d1c0 2023-12-11T17:11:19.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.935+0000 7fb219ffb640 1 -- 172.21.15.37:0/4033212844 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb214011ce0 con 0x7fb22406d1c0 2023-12-11T17:11:19.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.935+0000 7fb22b81e640 1 -- 172.21.15.37:0/4033212844 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2241508e0 con 0x7fb22406d1c0 2023-12-11T17:11:19.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.936+0000 7fb22b81e640 1 -- 172.21.15.37:0/4033212844 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb22415c590 con 0x7fb22406d1c0 2023-12-11T17:11:19.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.937+0000 7fb219ffb640 1 -- 172.21.15.37:0/4033212844 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fb21401c460 con 0x7fb22406d1c0 2023-12-11T17:11:19.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.938+0000 7fb219ffb640 1 --2- 172.21.15.37:0/4033212844 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb20806ae40 0x7fb20806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:19.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.938+0000 7fb219ffb640 1 -- 172.21.15.37:0/4033212844 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fb2140893b0 con 0x7fb22406d1c0 2023-12-11T17:11:19.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.939+0000 7fb2295ba640 1 --2- 172.21.15.37:0/4033212844 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb20806ae40 0x7fb20806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:19.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.940+0000 7fb2295ba640 1 --2- 172.21.15.37:0/4033212844 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb20806ae40 0x7fb20806d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb2200012e0 tx=0x7fb220007ed0 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:19.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:19.942+0000 7fb219ffb640 1 -- 172.21.15.37:0/4033212844 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fb22415c590 con 0x7fb22406d1c0 2023-12-11T17:11:20.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.201+0000 7fb22b81e640 1 -- 172.21.15.37:0/4033212844 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fb22415c590 con 0x7fb22406d1c0 2023-12-11T17:11:20.206 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.205+0000 7fb219ffb640 1 -- 172.21.15.37:0/4033212844 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb22415c590 con 0x7fb22406d1c0 2023-12-11T17:11:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.208+0000 7fb22b81e640 1 -- 172.21.15.37:0/4033212844 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb20806ae40 msgr2=0x7fb20806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.208+0000 7fb22b81e640 1 --2- 172.21.15.37:0/4033212844 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb20806ae40 0x7fb20806d300 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fb2200012e0 tx=0x7fb220007ed0 comp rx=0 tx=0).stop 2023-12-11T17:11:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.208+0000 7fb22b81e640 1 -- 172.21.15.37:0/4033212844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb22406d1c0 msgr2=0x7fb2240c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.208+0000 7fb22b81e640 1 --2- 172.21.15.37:0/4033212844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb22406d1c0 0x7fb2240c8880 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb21400c430 tx=0x7fb21400c8f0 comp rx=0 tx=0).stop 2023-12-11T17:11:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.208+0000 7fb22b81e640 1 -- 172.21.15.37:0/4033212844 shutdown_connections 2023-12-11T17:11:20.210 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.208+0000 7fb22b81e640 1 --2- 172.21.15.37:0/4033212844 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fb20806ae40 0x7fb20806d300 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:20.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.208+0000 7fb22b81e640 1 --2- 172.21.15.37:0/4033212844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fb22415f170 0x7fb2240c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:20.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.208+0000 7fb22b81e640 1 --2- 172.21.15.37:0/4033212844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb22406d1c0 0x7fb2240c8880 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:20.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.208+0000 7fb22b81e640 1 --2- 172.21.15.37:0/4033212844 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb22406a460 0x7fb2240c67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:20.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.208+0000 7fb22b81e640 1 -- 172.21.15.37:0/4033212844 >> 172.21.15.37:0/4033212844 conn(0x7fb2240cc7d0 msgr2=0x7fb22415a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:20.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.208+0000 7fb22b81e640 1 -- 172.21.15.37:0/4033212844 shutdown_connections 2023-12-11T17:11:20.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.208+0000 7fb22b81e640 1 -- 172.21.15.37:0/4033212844 wait complete. 2023-12-11T17:11:20.228 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-11T17:11:20.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.420+0000 7fc525231640 1 Processor -- start 2023-12-11T17:11:20.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.420+0000 7fc525231640 1 -- start start 2023-12-11T17:11:20.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.421+0000 7fc525231640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc5201467c0 0x7fc5200cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:20.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.421+0000 7fc525231640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc520146ba0 0x7fc5200cce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:20.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.422+0000 7fc525231640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc52006c7e0 0x7fc52006cc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:20.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.422+0000 7fc525231640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5200ac860 con 0x7fc520146ba0 2023-12-11T17:11:20.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.422+0000 7fc525231640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc52006d510 con 0x7fc5201467c0 2023-12-11T17:11:20.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.422+0000 7fc525231640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc52006d7f0 con 0x7fc52006c7e0 2023-12-11T17:11:20.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.422+0000 7fc517fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc520146ba0 0x7fc5200cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:20.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.422+0000 7fc517fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc520146ba0 0x7fc5200cce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44348/0 (socket says 172.21.15.37:44348) 2023-12-11T17:11:20.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.422+0000 7fc517fff640 1 -- 172.21.15.37:0/3769083552 learned_addr learned my addr 172.21.15.37:0/3769083552 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:20.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.422+0000 7fc51ed9d640 1 --2- 172.21.15.37:0/3769083552 >> v2:172.21.15.151:3300/0 conn(0x7fc5201467c0 0x7fc5200cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:20.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.422+0000 7fc51f59e640 1 --2- 172.21.15.37:0/3769083552 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc52006c7e0 0x7fc52006cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:20.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.422+0000 7fc517fff640 1 -- 172.21.15.37:0/3769083552 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc52006c7e0 msgr2=0x7fc52006cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:20.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.422+0000 7fc517fff640 1 --2- 172.21.15.37:0/3769083552 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc52006c7e0 0x7fc52006cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:20.424 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.422+0000 7fc517fff640 1 -- 172.21.15.37:0/3769083552 >> v2:172.21.15.151:3300/0 conn(0x7fc5201467c0 msgr2=0x7fc5200cc8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:20.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.422+0000 7fc517fff640 1 --2- 172.21.15.37:0/3769083552 >> v2:172.21.15.151:3300/0 conn(0x7fc5201467c0 0x7fc5200cc8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:20.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.422+0000 7fc517fff640 1 -- 172.21.15.37:0/3769083552 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52006dad0 con 0x7fc520146ba0 2023-12-11T17:11:20.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.423+0000 7fc51ed9d640 1 --2- 172.21.15.37:0/3769083552 >> v2:172.21.15.151:3300/0 conn(0x7fc5201467c0 0x7fc5200cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:20.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.423+0000 7fc51f59e640 1 --2- 172.21.15.37:0/3769083552 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc52006c7e0 0x7fc52006cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:20.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.424+0000 7fc517fff640 1 --2- 172.21.15.37:0/3769083552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc520146ba0 0x7fc5200cce30 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc5200cc830 tx=0x7fc50802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8964b86c41e8d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:20.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.424+0000 7fc51e59c640 1 -- 172.21.15.37:0/3769083552 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc508031870 con 0x7fc520146ba0 2023-12-11T17:11:20.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.424+0000 7fc51e59c640 1 -- 172.21.15.37:0/3769083552 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5080319d0 con 0x7fc520146ba0 2023-12-11T17:11:20.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.424+0000 7fc51e59c640 1 -- 172.21.15.37:0/3769083552 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc508031d60 con 0x7fc520146ba0 2023-12-11T17:11:20.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.425+0000 7fc525231640 1 -- 172.21.15.37:0/3769083552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc520146ba0 msgr2=0x7fc5200cce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:20.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.425+0000 7fc525231640 1 --2- 172.21.15.37:0/3769083552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc520146ba0 0x7fc5200cce30 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc5200cc830 tx=0x7fc50802b910 comp rx=0 tx=0).stop 2023-12-11T17:11:20.426 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.425+0000 7fc525231640 1 -- 172.21.15.37:0/3769083552 shutdown_connections 2023-12-11T17:11:20.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.425+0000 7fc525231640 1 --2- 172.21.15.37:0/3769083552 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc52006c7e0 0x7fc52006cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:20.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.425+0000 7fc525231640 1 --2- 172.21.15.37:0/3769083552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc520146ba0 0x7fc5200cce30 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:20.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.425+0000 7fc525231640 1 --2- 172.21.15.37:0/3769083552 >> v2:172.21.15.151:3300/0 conn(0x7fc5201467c0 0x7fc5200cc8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:20.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.425+0000 7fc525231640 1 -- 172.21.15.37:0/3769083552 >> 172.21.15.37:0/3769083552 conn(0x7fc5200b0a90 msgr2=0x7fc5200b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:20.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.425+0000 7fc525231640 1 -- 172.21.15.37:0/3769083552 shutdown_connections 2023-12-11T17:11:20.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.425+0000 7fc525231640 1 -- 172.21.15.37:0/3769083552 wait complete. 2023-12-11T17:11:20.427 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.427+0000 7fc525231640 1 Processor -- start 2023-12-11T17:11:20.428 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.427+0000 7fc525231640 1 -- start start 2023-12-11T17:11:20.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.428+0000 7fc525231640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc52006c7e0 0x7fc52015ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:20.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.428+0000 7fc525231640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5201467c0 0x7fc5200b44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:20.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.428+0000 7fc525231640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc520146ba0 0x7fc5200b4a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:20.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.428+0000 7fc525231640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc520132cb0 con 0x7fc5201467c0 2023-12-11T17:11:20.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.428+0000 7fc525231640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5201e95d0 con 0x7fc520146ba0 2023-12-11T17:11:20.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.428+0000 7fc525231640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc520132310 con 0x7fc52006c7e0 2023-12-11T17:11:20.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.428+0000 7fc517fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5201467c0 0x7fc5200b44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:20.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.428+0000 7fc517fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5201467c0 0x7fc5200b44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44364/0 (socket says 172.21.15.37:44364) 2023-12-11T17:11:20.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.428+0000 7fc517fff640 1 -- 172.21.15.37:0/3240878340 learned_addr learned my addr 172.21.15.37:0/3240878340 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:20.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.428+0000 7fc51ed9d640 1 --2- 172.21.15.37:0/3240878340 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc52006c7e0 0x7fc52015ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:20.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.429+0000 7fc51f59e640 1 --2- 172.21.15.37:0/3240878340 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc520146ba0 0x7fc5200b4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:20.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.429+0000 7fc517fff640 1 -- 172.21.15.37:0/3240878340 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc52006c7e0 msgr2=0x7fc52015ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:20.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.429+0000 7fc517fff640 1 --2- 172.21.15.37:0/3240878340 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc52006c7e0 0x7fc52015ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:20.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.429+0000 7fc517fff640 1 -- 172.21.15.37:0/3240878340 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc520146ba0 msgr2=0x7fc5200b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:20.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.429+0000 7fc517fff640 1 --2- 172.21.15.37:0/3240878340 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc520146ba0 0x7fc5200b4a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:20.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.429+0000 7fc517fff640 1 -- 172.21.15.37:0/3240878340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5080094d0 con 0x7fc5201467c0 2023-12-11T17:11:20.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.429+0000 7fc517fff640 1 --2- 172.21.15.37:0/3240878340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5201467c0 0x7fc5200b44c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc50802b950 tx=0x7fc5080046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:20.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.430+0000 7fc5177fe640 1 -- 172.21.15.37:0/3240878340 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc508031860 con 0x7fc5201467c0 2023-12-11T17:11:20.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.430+0000 7fc525231640 1 -- 172.21.15.37:0/3240878340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5201325f0 con 0x7fc5201467c0 2023-12-11T17:11:20.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.430+0000 7fc5177fe640 1 -- 172.21.15.37:0/3240878340 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5080443f0 con 0x7fc5201467c0 2023-12-11T17:11:20.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.430+0000 7fc5177fe640 1 -- 172.21.15.37:0/3240878340 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5080447a0 con 0x7fc5201467c0 2023-12-11T17:11:20.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.430+0000 7fc525231640 1 -- 172.21.15.37:0/3240878340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5200b1b80 con 0x7fc5201467c0 2023-12-11T17:11:20.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.431+0000 7fc525231640 1 -- 172.21.15.37:0/3240878340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc520132df0 con 0x7fc5201467c0 2023-12-11T17:11:20.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.432+0000 7fc5177fe640 1 -- 172.21.15.37:0/3240878340 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc50804d450 con 0x7fc5201467c0 2023-12-11T17:11:20.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.433+0000 7fc5177fe640 1 --2- 172.21.15.37:0/3240878340 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc50006ae40 0x7fc50006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:20.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.433+0000 7fc5177fe640 1 -- 172.21.15.37:0/3240878340 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fc50802d040 con 0x7fc5201467c0 2023-12-11T17:11:20.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.433+0000 7fc51ed9d640 1 --2- 172.21.15.37:0/3240878340 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc50006ae40 0x7fc50006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:20.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.435+0000 7fc51ed9d640 1 --2- 172.21.15.37:0/3240878340 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc50006ae40 0x7fc50006d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc51000a910 tx=0x7fc510008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:20.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.438+0000 7fc5177fe640 1 -- 172.21.15.37:0/3240878340 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc520132df0 con 0x7fc5201467c0 2023-12-11T17:11:20.707 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.706+0000 7fc525231640 1 -- 172.21.15.37:0/3240878340 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fc520132df0 con 0x7fc5201467c0 2023-12-11T17:11:20.711 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.710+0000 7fc5177fe640 1 -- 172.21.15.37:0/3240878340 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7fc520132df0 con 0x7fc5201467c0 2023-12-11T17:11:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.713+0000 7fc525231640 1 -- 172.21.15.37:0/3240878340 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc50006ae40 msgr2=0x7fc50006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.713+0000 7fc525231640 1 --2- 172.21.15.37:0/3240878340 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc50006ae40 0x7fc50006d300 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fc51000a910 tx=0x7fc510008040 comp rx=0 tx=0).stop 2023-12-11T17:11:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.713+0000 7fc525231640 1 -- 172.21.15.37:0/3240878340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5201467c0 msgr2=0x7fc5200b44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.713+0000 7fc525231640 1 --2- 172.21.15.37:0/3240878340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5201467c0 0x7fc5200b44c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fc50802b950 tx=0x7fc5080046c0 comp rx=0 tx=0).stop 2023-12-11T17:11:20.714 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.713+0000 7fc525231640 1 -- 172.21.15.37:0/3240878340 shutdown_connections 2023-12-11T17:11:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.713+0000 7fc525231640 1 --2- 172.21.15.37:0/3240878340 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc50006ae40 0x7fc50006d300 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.713+0000 7fc525231640 1 --2- 172.21.15.37:0/3240878340 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc520146ba0 0x7fc5200b4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.713+0000 7fc525231640 1 --2- 172.21.15.37:0/3240878340 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc5201467c0 0x7fc5200b44c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.713+0000 7fc525231640 1 --2- 172.21.15.37:0/3240878340 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc52006c7e0 0x7fc52015ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.713+0000 7fc525231640 1 -- 172.21.15.37:0/3240878340 >> 172.21.15.37:0/3240878340 conn(0x7fc5200b0a90 msgr2=0x7fc5200cebd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.713+0000 7fc525231640 1 -- 172.21.15.37:0/3240878340 shutdown_connections 2023-12-11T17:11:20.715 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.713+0000 7fc525231640 1 -- 172.21.15.37:0/3240878340 wait complete. 2023-12-11T17:11:20.732 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-11T17:11:20.932 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.931+0000 7f7b3679a640 1 Processor -- start 2023-12-11T17:11:20.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.932+0000 7f7b3679a640 1 -- start start 2023-12-11T17:11:20.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.933+0000 7f7b3679a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b3015b0a0 0x7f7b300d18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:20.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.933+0000 7f7b3679a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b300cde20 0x7f7b300b48d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:20.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.933+0000 7f7b3679a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b300b4440 con 0x7f7b300cf2e0 2023-12-11T17:11:20.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.933+0000 7f7b3679a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b300b3b50 con 0x7f7b3015b0a0 2023-12-11T17:11:20.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.933+0000 7f7b3679a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b300cfb10 con 0x7f7b300cde20 2023-12-11T17:11:20.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.933+0000 7f7b35798640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b3015b0a0 0x7f7b300d18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:20.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.934+0000 7f7b35798640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7b3015b0a0 0x7f7b300d18b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44376/0 (socket says 172.21.15.37:44376) 2023-12-11T17:11:20.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.934+0000 7f7b35798640 1 -- 172.21.15.37:0/3802725369 learned_addr learned my addr 172.21.15.37:0/3802725369 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:20.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.934+0000 7f7b35f99640 1 --2- 172.21.15.37:0/3802725369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b300cde20 0x7f7b300b48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:20.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.934+0000 7f7b35798640 1 -- 172.21.15.37:0/3802725369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b300cde20 msgr2=0x7f7b300b48d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:20.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.934+0000 7f7b35798640 1 --2- 172.21.15.37:0/3802725369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b300cde20 0x7f7b300b48d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:20.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.934+0000 7f7b35798640 1 -- 172.21.15.37:0/3802725369 >> v1:172.21.15.37:6789/0 conn(0x7f7b300cf2e0 legacy=0x7f7b300cd710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:20.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.934+0000 7f7b35798640 1 -- 172.21.15.37:0/3802725369 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b300b3df0 con 0x7f7b3015b0a0 2023-12-11T17:11:20.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.935+0000 7f7b35798640 1 --2- 172.21.15.37:0/3802725369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b3015b0a0 0x7f7b300d18b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c009870 tx=0x7f7b2c02ba10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b525b3c8a7eb2aa server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:20.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.935+0000 7f7b27fff640 1 -- 172.21.15.37:0/3802725369 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c02f830 con 0x7f7b3015b0a0 2023-12-11T17:11:20.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.936+0000 7f7b27fff640 1 -- 172.21.15.37:0/3802725369 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2c02f990 con 0x7f7b3015b0a0 2023-12-11T17:11:20.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.936+0000 7f7b27fff640 1 -- 172.21.15.37:0/3802725369 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2c02fd20 con 0x7f7b3015b0a0 2023-12-11T17:11:20.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.936+0000 7f7b3679a640 1 -- 172.21.15.37:0/3802725369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b3015b0a0 msgr2=0x7f7b300d18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:20.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.936+0000 7f7b3679a640 1 --2- 172.21.15.37:0/3802725369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b3015b0a0 0x7f7b300d18b0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c009870 tx=0x7f7b2c02ba10 comp rx=0 tx=0).stop 2023-12-11T17:11:20.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.936+0000 7f7b3679a640 1 -- 172.21.15.37:0/3802725369 shutdown_connections 2023-12-11T17:11:20.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.936+0000 7f7b3679a640 1 --2- 172.21.15.37:0/3802725369 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b300cde20 0x7f7b300b48d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:20.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.936+0000 7f7b3679a640 1 --2- 172.21.15.37:0/3802725369 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b3015b0a0 0x7f7b300d18b0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:20.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.936+0000 7f7b3679a640 1 -- 172.21.15.37:0/3802725369 >> 172.21.15.37:0/3802725369 conn(0x7f7b300d0d00 msgr2=0x7f7b300d1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:20.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.936+0000 7f7b3679a640 1 -- 172.21.15.37:0/3802725369 shutdown_connections 2023-12-11T17:11:20.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.936+0000 7f7b3679a640 1 -- 172.21.15.37:0/3802725369 wait complete. 2023-12-11T17:11:20.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.938+0000 7f7b3679a640 1 Processor -- start 2023-12-11T17:11:20.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.938+0000 7f7b3679a640 1 -- start start 2023-12-11T17:11:20.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.939+0000 7f7b3679a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b300cde20 0x7f7b3015d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:20.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.939+0000 7f7b3679a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300cf2e0 0x7f7b30151000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:20.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.939+0000 7f7b3679a640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b3015b0a0 0x7f7b3015e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:20.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.939+0000 7f7b3679a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3015d250 con 0x7f7b300cf2e0 2023-12-11T17:11:20.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.939+0000 7f7b3679a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3015c680 con 0x7f7b300cde20 2023-12-11T17:11:20.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.939+0000 7f7b3679a640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b3015c920 con 0x7f7b3015b0a0 2023-12-11T17:11:20.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.939+0000 7f7b34f97640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300cf2e0 0x7f7b30151000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:20.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.940+0000 7f7b34f97640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300cf2e0 0x7f7b30151000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44380/0 (socket says 172.21.15.37:44380) 2023-12-11T17:11:20.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.940+0000 7f7b34f97640 1 -- 172.21.15.37:0/1278198929 learned_addr learned my addr 172.21.15.37:0/1278198929 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:20.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.940+0000 7f7b35798640 1 --2- 172.21.15.37:0/1278198929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b300cde20 0x7f7b3015d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:20.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.940+0000 7f7b35f99640 1 --2- 172.21.15.37:0/1278198929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b3015b0a0 0x7f7b3015e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:20.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.940+0000 7f7b34f97640 1 -- 172.21.15.37:0/1278198929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b3015b0a0 msgr2=0x7f7b3015e330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:20.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.940+0000 7f7b34f97640 1 --2- 172.21.15.37:0/1278198929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b3015b0a0 0x7f7b3015e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:20.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.940+0000 7f7b34f97640 1 -- 172.21.15.37:0/1278198929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b300cde20 msgr2=0x7f7b3015d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:20.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.940+0000 7f7b34f97640 1 --2- 172.21.15.37:0/1278198929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b300cde20 0x7f7b3015d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:20.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.940+0000 7f7b34f97640 1 -- 172.21.15.37:0/1278198929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b2c0094d0 con 0x7f7b300cf2e0 2023-12-11T17:11:20.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.940+0000 7f7b35798640 1 --2- 172.21.15.37:0/1278198929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b300cde20 0x7f7b3015d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:20.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.940+0000 7f7b34f97640 1 --2- 172.21.15.37:0/1278198929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300cf2e0 0x7f7b30151000 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000c450 tx=0x7f7b2000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:20.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.940+0000 7f7b25ffb640 1 -- 172.21.15.37:0/1278198929 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b200052d0 con 0x7f7b300cf2e0 2023-12-11T17:11:20.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.941+0000 7f7b25ffb640 1 -- 172.21.15.37:0/1278198929 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b20005430 con 0x7f7b300cf2e0 2023-12-11T17:11:20.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.941+0000 7f7b25ffb640 1 -- 172.21.15.37:0/1278198929 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b20012870 con 0x7f7b300cf2e0 2023-12-11T17:11:20.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.941+0000 7f7b3679a640 1 -- 172.21.15.37:0/1278198929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b3015cc00 con 0x7f7b300cf2e0 2023-12-11T17:11:20.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.941+0000 7f7b3679a640 1 -- 172.21.15.37:0/1278198929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b30151540 con 0x7f7b300cf2e0 2023-12-11T17:11:20.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.942+0000 7f7b3679a640 1 -- 172.21.15.37:0/1278198929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b300673f0 con 0x7f7b300cf2e0 2023-12-11T17:11:20.944 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.943+0000 7f7b25ffb640 1 -- 172.21.15.37:0/1278198929 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7b200129d0 con 0x7f7b300cf2e0 2023-12-11T17:11:20.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.944+0000 7f7b25ffb640 1 --2- 172.21.15.37:0/1278198929 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7b1406ae40 0x7f7b1406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:20.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.944+0000 7f7b25ffb640 1 -- 172.21.15.37:0/1278198929 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7b20089060 con 0x7f7b300cf2e0 2023-12-11T17:11:20.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.944+0000 7f7b35798640 1 --2- 172.21.15.37:0/1278198929 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7b1406ae40 0x7f7b1406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:20.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.945+0000 7f7b35798640 1 --2- 172.21.15.37:0/1278198929 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7b1406ae40 0x7f7b1406d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c036000 tx=0x7f7b2c039040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:20.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:20.951+0000 7f7b25ffb640 1 -- 172.21.15.37:0/1278198929 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7b200bbe90 con 0x7f7b300cf2e0 2023-12-11T17:11:21.213 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.212+0000 7f7b3679a640 1 -- 172.21.15.37:0/1278198929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f7b30073360 con 0x7f7b300cf2e0 2023-12-11T17:11:21.216 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.215+0000 7f7b25ffb640 1 -- 172.21.15.37:0/1278198929 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f7b200541f0 con 0x7f7b300cf2e0 2023-12-11T17:11:21.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.218+0000 7f7b3679a640 1 -- 172.21.15.37:0/1278198929 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7b1406ae40 msgr2=0x7f7b1406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:21.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.218+0000 7f7b3679a640 1 --2- 172.21.15.37:0/1278198929 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7b1406ae40 0x7f7b1406d300 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7b2c036000 tx=0x7f7b2c039040 comp rx=0 tx=0).stop 2023-12-11T17:11:21.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.218+0000 7f7b3679a640 1 -- 172.21.15.37:0/1278198929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300cf2e0 msgr2=0x7f7b30151000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:21.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.218+0000 7f7b3679a640 1 --2- 172.21.15.37:0/1278198929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300cf2e0 0x7f7b30151000 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000c450 tx=0x7f7b2000c910 comp rx=0 tx=0).stop 2023-12-11T17:11:21.219 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.218+0000 7f7b3679a640 1 -- 172.21.15.37:0/1278198929 shutdown_connections 2023-12-11T17:11:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.218+0000 7f7b3679a640 1 --2- 172.21.15.37:0/1278198929 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7b1406ae40 0x7f7b1406d300 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.218+0000 7f7b3679a640 1 --2- 172.21.15.37:0/1278198929 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7b3015b0a0 0x7f7b3015e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.218+0000 7f7b3679a640 1 --2- 172.21.15.37:0/1278198929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7b300cf2e0 0x7f7b30151000 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.218+0000 7f7b3679a640 1 --2- 172.21.15.37:0/1278198929 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b300cde20 0x7f7b3015d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.218+0000 7f7b3679a640 1 -- 172.21.15.37:0/1278198929 >> 172.21.15.37:0/1278198929 conn(0x7f7b300d0d00 msgr2=0x7f7b300b5b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.218+0000 7f7b3679a640 1 -- 172.21.15.37:0/1278198929 shutdown_connections 2023-12-11T17:11:21.220 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.218+0000 7f7b3679a640 1 -- 172.21.15.37:0/1278198929 wait complete. 2023-12-11T17:11:21.236 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-11T17:11:21.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.446+0000 7f7e4f33c640 1 Processor -- start 2023-12-11T17:11:21.448 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.447+0000 7f7e4f33c640 1 -- start start 2023-12-11T17:11:21.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.448+0000 7f7e4f33c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f7e480ae200 0x7f7e48070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:21.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.448+0000 7f7e4f33c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7e480abd20 0x7f7e48071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:21.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.448+0000 7f7e4f33c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e48071f90 con 0x7f7e4815e5d0 2023-12-11T17:11:21.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.448+0000 7f7e4f33c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e48072270 con 0x7f7e480abd20 2023-12-11T17:11:21.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.448+0000 7f7e4f33c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e48070070 con 0x7f7e480ae200 2023-12-11T17:11:21.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.448+0000 7f7e4eb3b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7e480abd20 0x7f7e48071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:21.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.448+0000 7f7e4eb3b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7e480abd20 0x7f7e48071090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44390/0 (socket says 172.21.15.37:44390) 2023-12-11T17:11:21.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.448+0000 7f7e4eb3b640 1 -- 172.21.15.37:0/2191165990 learned_addr learned my addr 172.21.15.37:0/2191165990 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:21.450 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.448+0000 7f7e4e33a640 1 --1- 172.21.15.37:0/2191165990 >> v1:172.21.15.37:6789/0 conn(0x7f7e4815e5d0 0x7f7e4806bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57262/0 (socket says 172.21.15.37:57262) 2023-12-11T17:11:21.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.449+0000 7f7e4eb3b640 1 -- 172.21.15.37:0/2191165990 >> v2:172.21.15.151:3300/0 conn(0x7f7e480ae200 msgr2=0x7f7e48070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:21.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.449+0000 7f7e4eb3b640 1 --2- 172.21.15.37:0/2191165990 >> v2:172.21.15.151:3300/0 conn(0x7f7e480ae200 0x7f7e48070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:21.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.449+0000 7f7e4eb3b640 1 -- 172.21.15.37:0/2191165990 >> v1:172.21.15.37:6789/0 conn(0x7f7e4815e5d0 legacy=0x7f7e4806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:21.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.449+0000 7f7e4eb3b640 1 -- 172.21.15.37:0/2191165990 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e48070350 con 0x7f7e480abd20 2023-12-11T17:11:21.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.450+0000 7f7e4eb3b640 1 --2- 172.21.15.37:0/2191165990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e480abd20 0x7f7e48071090 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7e480739e0 tx=0x7f7e4002be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd8502ac58d7f56 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:21.451 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.450+0000 7f7e4d338640 1 -- 172.21.15.37:0/2191165990 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e4002c9f0 con 0x7f7e480abd20 2023-12-11T17:11:21.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.450+0000 7f7e4d338640 1 -- 172.21.15.37:0/2191165990 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e4002cb50 con 0x7f7e480abd20 2023-12-11T17:11:21.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.450+0000 7f7e4d338640 1 -- 172.21.15.37:0/2191165990 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e400343f0 con 0x7f7e480abd20 2023-12-11T17:11:21.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.451+0000 7f7e4f33c640 1 -- 172.21.15.37:0/2191165990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e480abd20 msgr2=0x7f7e48071090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:21.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.451+0000 7f7e4f33c640 1 --2- 172.21.15.37:0/2191165990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e480abd20 0x7f7e48071090 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7e480739e0 tx=0x7f7e4002be50 comp rx=0 tx=0).stop 2023-12-11T17:11:21.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.451+0000 7f7e4f33c640 1 -- 172.21.15.37:0/2191165990 shutdown_connections 2023-12-11T17:11:21.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.451+0000 7f7e4f33c640 1 --2- 172.21.15.37:0/2191165990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e480abd20 0x7f7e48071090 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:21.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.451+0000 7f7e4f33c640 1 --2- 172.21.15.37:0/2191165990 >> v2:172.21.15.151:3300/0 conn(0x7f7e480ae200 0x7f7e48070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:21.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.451+0000 7f7e4f33c640 1 -- 172.21.15.37:0/2191165990 >> 172.21.15.37:0/2191165990 conn(0x7f7e480b0860 msgr2=0x7f7e480b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:21.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.451+0000 7f7e4f33c640 1 -- 172.21.15.37:0/2191165990 shutdown_connections 2023-12-11T17:11:21.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.451+0000 7f7e4f33c640 1 -- 172.21.15.37:0/2191165990 wait complete. 2023-12-11T17:11:21.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.453+0000 7f7e4f33c640 1 Processor -- start 2023-12-11T17:11:21.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.453+0000 7f7e4f33c640 1 -- start start 2023-12-11T17:11:21.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.454+0000 7f7e4f33c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e480abd20 0x7f7e480999f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:21.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.454+0000 7f7e4f33c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e480ae200 0x7f7e4809b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:21.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.454+0000 7f7e4f33c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e4815e5d0 0x7f7e4809ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:21.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.454+0000 7f7e4f33c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4815c670 con 0x7f7e480ae200 2023-12-11T17:11:21.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.454+0000 7f7e4f33c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4815c910 con 0x7f7e4815e5d0 2023-12-11T17:11:21.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.454+0000 7f7e4f33c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e4815cbf0 con 0x7f7e480abd20 2023-12-11T17:11:21.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.454+0000 7f7e4db39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e480ae200 0x7f7e4809b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:21.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.454+0000 7f7e4db39640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e480ae200 0x7f7e4809b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44400/0 (socket says 172.21.15.37:44400) 2023-12-11T17:11:21.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.454+0000 7f7e4db39640 1 -- 172.21.15.37:0/645739183 learned_addr learned my addr 172.21.15.37:0/645739183 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:21.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.455+0000 7f7e4eb3b640 1 --2- 172.21.15.37:0/645739183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e4815e5d0 0x7f7e4809ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:21.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.455+0000 7f7e4e33a640 1 --2- 172.21.15.37:0/645739183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e480abd20 0x7f7e480999f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:21.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.455+0000 7f7e4db39640 1 -- 172.21.15.37:0/645739183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e480abd20 msgr2=0x7f7e480999f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:21.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.455+0000 7f7e4db39640 1 --2- 172.21.15.37:0/645739183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e480abd20 0x7f7e480999f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:21.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.455+0000 7f7e4db39640 1 -- 172.21.15.37:0/645739183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e4815e5d0 msgr2=0x7f7e4809ba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:21.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.455+0000 7f7e4db39640 1 --2- 172.21.15.37:0/645739183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e4815e5d0 0x7f7e4809ba90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:21.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.455+0000 7f7e4db39640 1 -- 172.21.15.37:0/645739183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e40009b30 con 0x7f7e480ae200 2023-12-11T17:11:21.457 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.455+0000 7f7e4db39640 1 --2- 172.21.15.37:0/645739183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e480ae200 0x7f7e4809b550 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800b4a0 tx=0x7f7e3800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:21.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.455+0000 7f7e3effd640 1 -- 172.21.15.37:0/645739183 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38010610 con 0x7f7e480ae200 2023-12-11T17:11:21.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.455+0000 7f7e3effd640 1 -- 172.21.15.37:0/645739183 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e38010770 con 0x7f7e480ae200 2023-12-11T17:11:21.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.455+0000 7f7e3effd640 1 -- 172.21.15.37:0/645739183 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e38010b20 con 0x7f7e480ae200 2023-12-11T17:11:21.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.455+0000 7f7e4f33c640 1 -- 172.21.15.37:0/645739183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e4806c680 con 0x7f7e480ae200 2023-12-11T17:11:21.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.455+0000 7f7e4f33c640 1 -- 172.21.15.37:0/645739183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e4815d1b0 con 0x7f7e480ae200 2023-12-11T17:11:21.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.457+0000 7f7e4f33c640 1 -- 172.21.15.37:0/645739183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e4815d3a0 con 0x7f7e480ae200 2023-12-11T17:11:21.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.458+0000 7f7e3effd640 1 -- 172.21.15.37:0/645739183 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f7e38010c80 con 0x7f7e480ae200 2023-12-11T17:11:21.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.459+0000 7f7e3effd640 1 --2- 172.21.15.37:0/645739183 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7e2c06ae40 0x7f7e2c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:21.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.459+0000 7f7e3effd640 1 -- 172.21.15.37:0/645739183 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f7e38089070 con 0x7f7e480ae200 2023-12-11T17:11:21.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.460+0000 7f7e4e33a640 1 --2- 172.21.15.37:0/645739183 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7e2c06ae40 0x7f7e2c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:21.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.461+0000 7f7e4e33a640 1 --2- 172.21.15.37:0/645739183 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7e2c06ae40 0x7f7e2c06d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7e44007fd0 tx=0x7f7e44009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:21.465 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.464+0000 7f7e3effd640 1 -- 172.21.15.37:0/645739183 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f7e38054330 con 0x7f7e480ae200 2023-12-11T17:11:21.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.716+0000 7f7e4f33c640 1 -- 172.21.15.37:0/645739183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f7e48074450 con 0x7f7e480ae200 2023-12-11T17:11:21.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.719+0000 7f7e3effd640 1 -- 172.21.15.37:0/645739183 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7e38057950 con 0x7f7e480ae200 2023-12-11T17:11:21.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.722+0000 7f7e4f33c640 1 -- 172.21.15.37:0/645739183 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7e2c06ae40 msgr2=0x7f7e2c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:21.723 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.722+0000 7f7e4f33c640 1 --2- 172.21.15.37:0/645739183 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7e2c06ae40 0x7f7e2c06d300 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7e44007fd0 tx=0x7f7e44009040 comp rx=0 tx=0).stop 2023-12-11T17:11:21.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.722+0000 7f7e4f33c640 1 -- 172.21.15.37:0/645739183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e480ae200 msgr2=0x7f7e4809b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:21.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.722+0000 7f7e4f33c640 1 --2- 172.21.15.37:0/645739183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e480ae200 0x7f7e4809b550 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f7e3800b4a0 tx=0x7f7e3800b960 comp rx=0 tx=0).stop 2023-12-11T17:11:21.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.722+0000 7f7e4f33c640 1 -- 172.21.15.37:0/645739183 shutdown_connections 2023-12-11T17:11:21.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.722+0000 7f7e4f33c640 1 --2- 172.21.15.37:0/645739183 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f7e2c06ae40 0x7f7e2c06d300 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:21.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.722+0000 7f7e4f33c640 1 --2- 172.21.15.37:0/645739183 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7e4815e5d0 0x7f7e4809ba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:21.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.722+0000 7f7e4f33c640 1 --2- 172.21.15.37:0/645739183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7e480ae200 0x7f7e4809b550 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:21.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.722+0000 7f7e4f33c640 1 --2- 172.21.15.37:0/645739183 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f7e480abd20 0x7f7e480999f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:21.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.722+0000 7f7e4f33c640 1 -- 172.21.15.37:0/645739183 >> 172.21.15.37:0/645739183 conn(0x7f7e480b0860 msgr2=0x7f7e480ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:21.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.722+0000 7f7e4f33c640 1 -- 172.21.15.37:0/645739183 shutdown_connections 2023-12-11T17:11:21.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.723+0000 7f7e4f33c640 1 -- 172.21.15.37:0/645739183 wait complete. 2023-12-11T17:11:21.739 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-11T17:11:21.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.957+0000 7f415abae640 1 Processor -- start 2023-12-11T17:11:21.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.958+0000 7f415abae640 1 -- start start 2023-12-11T17:11:21.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.959+0000 7f415abae640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41540d13c0 0x7f41540ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:21.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.959+0000 7f415abae640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f41540b0760 0x7f41540b0bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:21.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.959+0000 7f415abae640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41540b2280 con 0x7f41540d0d70 2023-12-11T17:11:21.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.959+0000 7f415abae640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41540cee70 con 0x7f41540b0760 2023-12-11T17:11:21.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.959+0000 7f415abae640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41540d1190 con 0x7f41540d13c0 2023-12-11T17:11:21.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.960+0000 7f415a3ad640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f41540b0760 0x7f41540b0bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:21.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.960+0000 7f415a3ad640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f41540b0760 0x7f41540b0bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44404/0 (socket says 172.21.15.37:44404) 2023-12-11T17:11:21.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.960+0000 7f415a3ad640 1 -- 172.21.15.37:0/2471335152 learned_addr learned my addr 172.21.15.37:0/2471335152 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:21.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.960+0000 7f4159bac640 1 --2- 172.21.15.37:0/2471335152 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41540d13c0 0x7f41540ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:21.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.960+0000 7f415a3ad640 1 -- 172.21.15.37:0/2471335152 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41540d13c0 msgr2=0x7f41540ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:21.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.960+0000 7f415a3ad640 1 --2- 172.21.15.37:0/2471335152 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41540d13c0 0x7f41540ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:21.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.960+0000 7f415a3ad640 1 -- 172.21.15.37:0/2471335152 >> v1:172.21.15.151:6789/0 conn(0x7f41540d0d70 legacy=0x7f41540d17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:21.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.960+0000 7f415a3ad640 1 -- 172.21.15.37:0/2471335152 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41540ceb90 con 0x7f41540b0760 2023-12-11T17:11:21.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.962+0000 7f415a3ad640 1 --2- 172.21.15.37:0/2471335152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41540b0760 0x7f41540b0bf0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f414c009870 tx=0x7f414c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250c76fb967dc080 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:21.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.962+0000 7f4158baa640 1 -- 172.21.15.37:0/2471335152 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414c031640 con 0x7f41540b0760 2023-12-11T17:11:21.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.962+0000 7f4158baa640 1 -- 172.21.15.37:0/2471335152 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f414c0317a0 con 0x7f41540b0760 2023-12-11T17:11:21.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.962+0000 7f4158baa640 1 -- 172.21.15.37:0/2471335152 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f414c031b30 con 0x7f41540b0760 2023-12-11T17:11:21.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.962+0000 7f415abae640 1 -- 172.21.15.37:0/2471335152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41540b0760 msgr2=0x7f41540b0bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:21.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.962+0000 7f415abae640 1 --2- 172.21.15.37:0/2471335152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41540b0760 0x7f41540b0bf0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f414c009870 tx=0x7f414c02b8f0 comp rx=0 tx=0).stop 2023-12-11T17:11:21.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.963+0000 7f415abae640 1 -- 172.21.15.37:0/2471335152 shutdown_connections 2023-12-11T17:11:21.964 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.963+0000 7f415abae640 1 --2- 172.21.15.37:0/2471335152 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41540b0760 0x7f41540b0bf0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:21.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.963+0000 7f415abae640 1 --2- 172.21.15.37:0/2471335152 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41540d13c0 0x7f41540ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:21.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.963+0000 7f415abae640 1 -- 172.21.15.37:0/2471335152 >> 172.21.15.37:0/2471335152 conn(0x7f415409c260 msgr2=0x7f41540d2f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:21.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.963+0000 7f415abae640 1 -- 172.21.15.37:0/2471335152 shutdown_connections 2023-12-11T17:11:21.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.963+0000 7f415abae640 1 -- 172.21.15.37:0/2471335152 wait complete. 2023-12-11T17:11:21.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.964+0000 7f415abae640 1 Processor -- start 2023-12-11T17:11:21.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.965+0000 7f415abae640 1 -- start start 2023-12-11T17:11:21.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.965+0000 7f415abae640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41540b0760 0x7f41540ccc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:21.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.966+0000 7f415abae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41540d0d70 0x7f4154153270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:21.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.966+0000 7f415abae640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41540d13c0 0x7f41540b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:21.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.966+0000 7f415abae640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41540c9e10 con 0x7f41540d0d70 2023-12-11T17:11:21.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.966+0000 7f415abae640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41540c9370 con 0x7f41540d13c0 2023-12-11T17:11:21.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.966+0000 7f415abae640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41540c6940 con 0x7f41540b0760 2023-12-11T17:11:21.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.966+0000 7f41593ab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41540d0d70 0x7f4154153270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:21.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.966+0000 7f41593ab640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41540d0d70 0x7f4154153270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44420/0 (socket says 172.21.15.37:44420) 2023-12-11T17:11:21.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.966+0000 7f41593ab640 1 -- 172.21.15.37:0/2722280783 learned_addr learned my addr 172.21.15.37:0/2722280783 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:21.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.966+0000 7f4159bac640 1 --2- 172.21.15.37:0/2722280783 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41540b0760 0x7f41540ccc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:21.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.966+0000 7f415a3ad640 1 --2- 172.21.15.37:0/2722280783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41540d13c0 0x7f41540b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:21.968 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.966+0000 7f41593ab640 1 -- 172.21.15.37:0/2722280783 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41540b0760 msgr2=0x7f41540ccc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:21.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.966+0000 7f41593ab640 1 --2- 172.21.15.37:0/2722280783 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41540b0760 0x7f41540ccc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:21.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.966+0000 7f41593ab640 1 -- 172.21.15.37:0/2722280783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41540d13c0 msgr2=0x7f41540b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:21.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.966+0000 7f41593ab640 1 --2- 172.21.15.37:0/2722280783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41540d13c0 0x7f41540b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:21.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.966+0000 7f41593ab640 1 -- 172.21.15.37:0/2722280783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f414c0094d0 con 0x7f41540d0d70 2023-12-11T17:11:21.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.967+0000 7f41593ab640 1 --2- 172.21.15.37:0/2722280783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41540d0d70 0x7f4154153270 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f414800c450 tx=0x7f414800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:21.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.967+0000 7f41527fc640 1 -- 172.21.15.37:0/2722280783 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41480052d0 con 0x7f41540d0d70 2023-12-11T17:11:21.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.967+0000 7f41527fc640 1 -- 172.21.15.37:0/2722280783 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4148005430 con 0x7f41540d0d70 2023-12-11T17:11:21.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.967+0000 7f41527fc640 1 -- 172.21.15.37:0/2722280783 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4148012870 con 0x7f41540d0d70 2023-12-11T17:11:21.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.967+0000 7f415abae640 1 -- 172.21.15.37:0/2722280783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41540c9610 con 0x7f41540d0d70 2023-12-11T17:11:21.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.967+0000 7f415abae640 1 -- 172.21.15.37:0/2722280783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41541537b0 con 0x7f41540d0d70 2023-12-11T17:11:21.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.968+0000 7f415abae640 1 -- 172.21.15.37:0/2722280783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41540c9b30 con 0x7f41540d0d70 2023-12-11T17:11:21.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.969+0000 7f41527fc640 1 -- 172.21.15.37:0/2722280783 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f41480129d0 con 0x7f41540d0d70 2023-12-11T17:11:21.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.970+0000 7f41527fc640 1 --2- 172.21.15.37:0/2722280783 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f414006ae40 0x7f414006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:21.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.970+0000 7f41527fc640 1 -- 172.21.15.37:0/2722280783 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f4148088f50 con 0x7f41540d0d70 2023-12-11T17:11:21.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.971+0000 7f4159bac640 1 --2- 172.21.15.37:0/2722280783 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f414006ae40 0x7f414006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:21.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.972+0000 7f4159bac640 1 --2- 172.21.15.37:0/2722280783 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f414006ae40 0x7f414006d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f41440099c0 tx=0x7f4144003990 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:21.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:21.975+0000 7f41527fc640 1 -- 172.21.15.37:0/2722280783 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f41540c9b30 con 0x7f41540d0d70 2023-12-11T17:11:22.241 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.240+0000 7f415abae640 1 -- 172.21.15.37:0/2722280783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f41540c9b30 con 0x7f41540d0d70 2023-12-11T17:11:22.245 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.244+0000 7f41527fc640 1 -- 172.21.15.37:0/2722280783 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f41540c9b30 con 0x7f41540d0d70 2023-12-11T17:11:22.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.247+0000 7f415abae640 1 -- 172.21.15.37:0/2722280783 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f414006ae40 msgr2=0x7f414006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:22.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.247+0000 7f415abae640 1 --2- 172.21.15.37:0/2722280783 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f414006ae40 0x7f414006d300 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f41440099c0 tx=0x7f4144003990 comp rx=0 tx=0).stop 2023-12-11T17:11:22.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.247+0000 7f415abae640 1 -- 172.21.15.37:0/2722280783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41540d0d70 msgr2=0x7f4154153270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:22.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.247+0000 7f415abae640 1 --2- 172.21.15.37:0/2722280783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41540d0d70 0x7f4154153270 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f414800c450 tx=0x7f414800c910 comp rx=0 tx=0).stop 2023-12-11T17:11:22.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.247+0000 7f415abae640 1 -- 172.21.15.37:0/2722280783 shutdown_connections 2023-12-11T17:11:22.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.247+0000 7f415abae640 1 --2- 172.21.15.37:0/2722280783 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f414006ae40 0x7f414006d300 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:22.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.247+0000 7f415abae640 1 --2- 172.21.15.37:0/2722280783 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f41540d13c0 0x7f41540b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:22.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.247+0000 7f415abae640 1 --2- 172.21.15.37:0/2722280783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f41540d0d70 0x7f4154153270 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:22.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.247+0000 7f415abae640 1 --2- 172.21.15.37:0/2722280783 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f41540b0760 0x7f41540ccc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:22.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.248+0000 7f415abae640 1 -- 172.21.15.37:0/2722280783 >> 172.21.15.37:0/2722280783 conn(0x7f415409c260 msgr2=0x7f41540b6340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:22.249 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.248+0000 7f415abae640 1 -- 172.21.15.37:0/2722280783 shutdown_connections 2023-12-11T17:11:22.250 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.248+0000 7f415abae640 1 -- 172.21.15.37:0/2722280783 wait complete. 2023-12-11T17:11:22.267 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:11:22.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.491+0000 7f4ad707e640 1 Processor -- start 2023-12-11T17:11:22.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.492+0000 7f4ad707e640 1 -- start start 2023-12-11T17:11:22.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.493+0000 7f4ad707e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad015e5d0 0x7f4ad006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:22.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.493+0000 7f4ad707e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f4ad00ae200 0x7f4ad0070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:22.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.493+0000 7f4ad707e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ad0071f90 con 0x7f4ad006c330 2023-12-11T17:11:22.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.493+0000 7f4ad707e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ad0072270 con 0x7f4ad00ae200 2023-12-11T17:11:22.494 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.493+0000 7f4ad707e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad0070070 con 0x7f4ad015e5d0 2023-12-11T17:11:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.493+0000 7f4ad687d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f4ad006c330 0x7f4ad00cded0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57276/0 (socket says 172.21.15.37:57276) 2023-12-11T17:11:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.493+0000 7f4ad687d640 1 -- 172.21.15.37:0/914155406 learned_addr learned my addr 172.21.15.37:0/914155406 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.494+0000 7f4ad607c640 1 --2- 172.21.15.37:0/914155406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad015e5d0 0x7f4ad006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.494+0000 7f4ad587b640 1 --2- 172.21.15.37:0/914155406 >> v2:172.21.15.151:3300/0 conn(0x7f4ad00ae200 0x7f4ad0070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.494+0000 7f4ad507a640 1 -- 172.21.15.37:0/914155406 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3223537921 0 0) 0x7f4ad0071f90 con 0x7f4ad006c330 2023-12-11T17:11:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.494+0000 7f4ad507a640 1 -- 172.21.15.37:0/914155406 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4abc003520 con 0x7f4ad006c330 2023-12-11T17:11:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.494+0000 7f4ad507a640 1 -- 172.21.15.37:0/914155406 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3445860718 0 0) 0x7f4abc003520 con 0x7f4ad006c330 2023-12-11T17:11:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.494+0000 7f4ad507a640 1 -- 172.21.15.37:0/914155406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad015e5d0 msgr2=0x7f4ad006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.494+0000 7f4ad507a640 1 --2- 172.21.15.37:0/914155406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad015e5d0 0x7f4ad006bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.494+0000 7f4ad507a640 1 -- 172.21.15.37:0/914155406 >> v2:172.21.15.151:3300/0 conn(0x7f4ad00ae200 msgr2=0x7f4ad0070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.494+0000 7f4ad507a640 1 --2- 172.21.15.37:0/914155406 >> v2:172.21.15.151:3300/0 conn(0x7f4ad00ae200 0x7f4ad0070b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.494+0000 7f4ad507a640 1 -- 172.21.15.37:0/914155406 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad0070350 con 0x7f4ad006c330 2023-12-11T17:11:22.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.494+0000 7f4ad507a640 1 -- 172.21.15.37:0/914155406 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f4ac80019f0 con 0x7f4ad006c330 2023-12-11T17:11:22.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.494+0000 7f4ad507a640 1 -- 172.21.15.37:0/914155406 >> v1:172.21.15.37:6789/0 conn(0x7f4ad006c330 legacy=0x7f4ad00cded0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:22.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.495+0000 7f4ad507a640 1 --2- 172.21.15.37:0/914155406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc003970 0x7f4abc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:22.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.495+0000 7f4ad507a640 1 --2- 172.21.15.37:0/914155406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4abc0047c0 0x7f4abc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:22.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.495+0000 7f4ad507a640 1 --2- 172.21.15.37:0/914155406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad015e5d0 0x7f4abc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:22.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.495+0000 7f4ad507a640 1 -- 172.21.15.37:0/914155406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad0072270 con 0x7f4abc0047c0 2023-12-11T17:11:22.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.495+0000 7f4ad507a640 1 -- 172.21.15.37:0/914155406 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad0070070 con 0x7f4abc003970 2023-12-11T17:11:22.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.495+0000 7f4ad507a640 1 -- 172.21.15.37:0/914155406 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4abc00b980 con 0x7f4ad015e5d0 2023-12-11T17:11:22.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.495+0000 7f4ad587b640 1 --2- 172.21.15.37:0/914155406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4abc0047c0 0x7f4abc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:22.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.495+0000 7f4ad607c640 1 --2- 172.21.15.37:0/914155406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc003970 0x7f4abc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:22.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.495+0000 7f4ad587b640 1 -- 172.21.15.37:0/914155406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad015e5d0 msgr2=0x7f4abc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.495+0000 7f4ad587b640 1 --2- 172.21.15.37:0/914155406 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad015e5d0 0x7f4abc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.495+0000 7f4ad587b640 1 -- 172.21.15.37:0/914155406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc003970 msgr2=0x7f4abc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.495+0000 7f4ad587b640 1 --2- 172.21.15.37:0/914155406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc003970 0x7f4abc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.495+0000 7f4ad587b640 1 -- 172.21.15.37:0/914155406 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4abc003520 con 0x7f4abc0047c0 2023-12-11T17:11:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.495+0000 7f4ad607c640 1 --2- 172.21.15.37:0/914155406 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc003970 0x7f4abc003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.496+0000 7f4ad587b640 1 --2- 172.21.15.37:0/914155406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4abc0047c0 0x7f4abc004c40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0009af0 tx=0x7f4abc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5816ed363204d636 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.497+0000 7f4ad507a640 1 -- 172.21.15.37:0/914155406 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac002c710 con 0x7f4abc0047c0 2023-12-11T17:11:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.497+0000 7f4ad507a640 1 -- 172.21.15.37:0/914155406 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac002c870 con 0x7f4abc0047c0 2023-12-11T17:11:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.497+0000 7f4ad507a640 1 -- 172.21.15.37:0/914155406 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac002cc00 con 0x7f4abc0047c0 2023-12-11T17:11:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.497+0000 7f4ad707e640 1 -- 172.21.15.37:0/914155406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4abc0047c0 msgr2=0x7f4abc004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.497+0000 7f4ad707e640 1 --2- 172.21.15.37:0/914155406 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4abc0047c0 0x7f4abc004c40 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4ac0009af0 tx=0x7f4abc0057f0 comp rx=0 tx=0).stop 2023-12-11T17:11:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.497+0000 7f4ad687d640 1 -- 172.21.15.37:0/914155406 reap_dead start 2023-12-11T17:11:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.497+0000 7f4ad707e640 1 -- 172.21.15.37:0/914155406 shutdown_connections 2023-12-11T17:11:22.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.497+0000 7f4ad707e640 1 -- 172.21.15.37:0/914155406 >> 172.21.15.37:0/914155406 conn(0x7f4ad00b0860 msgr2=0x7f4ad00b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:22.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.497+0000 7f4ad707e640 1 -- 172.21.15.37:0/914155406 shutdown_connections 2023-12-11T17:11:22.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.497+0000 7f4ad707e640 1 -- 172.21.15.37:0/914155406 wait complete. 2023-12-11T17:11:22.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.499+0000 7f4ad707e640 1 Processor -- start 2023-12-11T17:11:22.500 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.499+0000 7f4ad707e640 1 -- start start 2023-12-11T17:11:22.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.500+0000 7f4ad707e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc0047c0 0x7f4ad0153570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:22.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.500+0000 7f4ad707e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad015dc70 0x7f4ad015c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:22.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.500+0000 7f4ad707e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ad0147480 0x7f4ad015a1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:22.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.500+0000 7f4ad707e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad0153e10 con 0x7f4ad0147480 2023-12-11T17:11:22.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.500+0000 7f4ad707e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad015c910 con 0x7f4abc0047c0 2023-12-11T17:11:22.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.500+0000 7f4ad707e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad015cbd0 con 0x7f4ad015dc70 2023-12-11T17:11:22.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.500+0000 7f4ad687d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ad0147480 0x7f4ad015a1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:22.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.501+0000 7f4ad687d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ad0147480 0x7f4ad015a1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44432/0 (socket says 172.21.15.37:44432) 2023-12-11T17:11:22.502 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.501+0000 7f4ad687d640 1 -- 172.21.15.37:0/3287600308 learned_addr learned my addr 172.21.15.37:0/3287600308 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:22.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.501+0000 7f4ad587b640 1 --2- 172.21.15.37:0/3287600308 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad015dc70 0x7f4ad015c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:22.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.501+0000 7f4ad687d640 1 -- 172.21.15.37:0/3287600308 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad015dc70 msgr2=0x7f4ad015c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:22.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.501+0000 7f4ad687d640 1 --2- 172.21.15.37:0/3287600308 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad015dc70 0x7f4ad015c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:22.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.501+0000 7f4ad607c640 1 --2- 172.21.15.37:0/3287600308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc0047c0 0x7f4ad0153570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:22.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.501+0000 7f4ad687d640 1 -- 172.21.15.37:0/3287600308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc0047c0 msgr2=0x7f4ad0153570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:22.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.501+0000 7f4ad687d640 1 --2- 172.21.15.37:0/3287600308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc0047c0 0x7f4ad0153570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:22.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.501+0000 7f4ad687d640 1 -- 172.21.15.37:0/3287600308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad015ceb0 con 0x7f4ad0147480 2023-12-11T17:11:22.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.501+0000 7f4ad687d640 1 --2- 172.21.15.37:0/3287600308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ad0147480 0x7f4ad015a1b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80012e0 tx=0x7f4ac800cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:22.503 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.502+0000 7f4ac6ffd640 1 -- 172.21.15.37:0/3287600308 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac800a610 con 0x7f4ad0147480 2023-12-11T17:11:22.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.502+0000 7f4ac6ffd640 1 -- 172.21.15.37:0/3287600308 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ac800a770 con 0x7f4ad0147480 2023-12-11T17:11:22.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.502+0000 7f4ad707e640 1 -- 172.21.15.37:0/3287600308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad015d190 con 0x7f4ad0147480 2023-12-11T17:11:22.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.502+0000 7f4ac6ffd640 1 -- 172.21.15.37:0/3287600308 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ac800ab20 con 0x7f4ad0147480 2023-12-11T17:11:22.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.502+0000 7f4ad707e640 1 -- 172.21.15.37:0/3287600308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad015d750 con 0x7f4ad0147480 2023-12-11T17:11:22.504 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.503+0000 7f4ad707e640 1 -- 172.21.15.37:0/3287600308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad006bdf0 con 0x7f4ad0147480 2023-12-11T17:11:22.505 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.504+0000 7f4ac6ffd640 1 -- 172.21.15.37:0/3287600308 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f4ac800ac80 con 0x7f4ad0147480 2023-12-11T17:11:22.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.505+0000 7f4ac6ffd640 1 --2- 172.21.15.37:0/3287600308 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4ab406ae40 0x7f4ab406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:22.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.505+0000 7f4ac6ffd640 1 -- 172.21.15.37:0/3287600308 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f4ac8089160 con 0x7f4ad0147480 2023-12-11T17:11:22.506 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.506+0000 7f4ad607c640 1 --2- 172.21.15.37:0/3287600308 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4ab406ae40 0x7f4ab406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:22.508 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.507+0000 7f4ad607c640 1 --2- 172.21.15.37:0/3287600308 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4ab406ae40 0x7f4ab406d300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00adb20 tx=0x7f4acc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:22.510 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.509+0000 7f4ac6ffd640 1 -- 172.21.15.37:0/3287600308 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f4ac8054420 con 0x7f4ad0147480 2023-12-11T17:11:22.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.703+0000 7f4ad707e640 1 -- 172.21.15.37:0/3287600308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ad00add90 con 0x7f4ad0147480 2023-12-11T17:11:22.705 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.705+0000 7f4ac6ffd640 1 -- 172.21.15.37:0/3287600308 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+13062 (secure 0 0 0) 0x7f4ac8057a40 con 0x7f4ad0147480 2023-12-11T17:11:22.706 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:11:22.706 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":35,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:11:18.633754+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":23,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":26,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:11:22.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.707+0000 7f4ad707e640 1 -- 172.21.15.37:0/3287600308 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4ab406ae40 msgr2=0x7f4ab406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:22.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.707+0000 7f4ad707e640 1 --2- 172.21.15.37:0/3287600308 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4ab406ae40 0x7f4ab406d300 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4ad00adb20 tx=0x7f4acc008040 comp rx=0 tx=0).stop 2023-12-11T17:11:22.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.707+0000 7f4ad707e640 1 -- 172.21.15.37:0/3287600308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ad0147480 msgr2=0x7f4ad015a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:22.708 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.707+0000 7f4ad707e640 1 --2- 172.21.15.37:0/3287600308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ad0147480 0x7f4ad015a1b0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f4ac80012e0 tx=0x7f4ac800cf00 comp rx=0 tx=0).stop 2023-12-11T17:11:22.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.707+0000 7f4ad707e640 1 -- 172.21.15.37:0/3287600308 shutdown_connections 2023-12-11T17:11:22.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.707+0000 7f4ad707e640 1 --2- 172.21.15.37:0/3287600308 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f4ab406ae40 0x7f4ab406d300 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:22.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.707+0000 7f4ad707e640 1 --2- 172.21.15.37:0/3287600308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f4ad0147480 0x7f4ad015a1b0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:22.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.707+0000 7f4ad707e640 1 --2- 172.21.15.37:0/3287600308 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f4ad015dc70 0x7f4ad015c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:22.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.707+0000 7f4ad707e640 1 --2- 172.21.15.37:0/3287600308 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4abc0047c0 0x7f4ad0153570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:22.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.707+0000 7f4ad707e640 1 -- 172.21.15.37:0/3287600308 >> 172.21.15.37:0/3287600308 conn(0x7f4ad00b0860 msgr2=0x7f4ad00cea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:22.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.708+0000 7f4ad707e640 1 -- 172.21.15.37:0/3287600308 shutdown_connections 2023-12-11T17:11:22.709 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.708+0000 7f4ad707e640 1 -- 172.21.15.37:0/3287600308 wait complete. 2023-12-11T17:11:22.727 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T17:09:38.415636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-11T17:11:22.728 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-11T17:11:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.945+0000 7fbfc9052640 1 Processor -- start 2023-12-11T17:11:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.945+0000 7fbfc9052640 1 -- start start 2023-12-11T17:11:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.947+0000 7fbfc9052640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbfc40cf500 0x7fbfc40ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.947+0000 7fbfc9052640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc406c500 con 0x7fbfc4155400 2023-12-11T17:11:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.947+0000 7fbfc9052640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfc415b4a0 con 0x7fbfc40ce150 2023-12-11T17:11:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.947+0000 7fbfc9052640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfc40adbb0 con 0x7fbfc40cf500 2023-12-11T17:11:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.947+0000 7fbfc3fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fbfc4155400 0x7fbfc406bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57282/0 (socket says 172.21.15.37:57282) 2023-12-11T17:11:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.947+0000 7fbfc3fff640 1 -- 172.21.15.37:0/1312024250 learned_addr learned my addr 172.21.15.37:0/1312024250 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.947+0000 7fbfc8851640 1 --2- 172.21.15.37:0/1312024250 >> v2:172.21.15.37:3300/0 conn(0x7fbfc40cf500 0x7fbfc40ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.948+0000 7fbfc8851640 1 -- 172.21.15.37:0/1312024250 >> v1:172.21.15.151:6789/0 conn(0x7fbfc40ce150 legacy=0x7fbfc40cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.948+0000 7fbfc8851640 1 -- 172.21.15.37:0/1312024250 >> v1:172.21.15.37:6789/0 conn(0x7fbfc4155400 legacy=0x7fbfc406bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.948+0000 7fbfc8851640 1 -- 172.21.15.37:0/1312024250 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfc40ade90 con 0x7fbfc40cf500 2023-12-11T17:11:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.949+0000 7fbfc8851640 1 --2- 172.21.15.37:0/1312024250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfc40cf500 0x7fbfc40ce5b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc0097a0 tx=0x7fbfbc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41624b0f32d3a900 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.949+0000 7fbfc37fe640 1 -- 172.21.15.37:0/1312024250 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc031830 con 0x7fbfc40cf500 2023-12-11T17:11:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.949+0000 7fbfc37fe640 1 -- 172.21.15.37:0/1312024250 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfbc031990 con 0x7fbfc40cf500 2023-12-11T17:11:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.949+0000 7fbfc37fe640 1 -- 172.21.15.37:0/1312024250 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfbc031d20 con 0x7fbfc40cf500 2023-12-11T17:11:22.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.950+0000 7fbfc9052640 1 -- 172.21.15.37:0/1312024250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfc40cf500 msgr2=0x7fbfc40ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:22.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.950+0000 7fbfc9052640 1 --2- 172.21.15.37:0/1312024250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfc40cf500 0x7fbfc40ce5b0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fbfbc0097a0 tx=0x7fbfbc02b8d0 comp rx=0 tx=0).stop 2023-12-11T17:11:22.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.950+0000 7fbfc9052640 1 -- 172.21.15.37:0/1312024250 shutdown_connections 2023-12-11T17:11:22.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.950+0000 7fbfc9052640 1 --2- 172.21.15.37:0/1312024250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfc40cf500 0x7fbfc40ce5b0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:22.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.950+0000 7fbfc9052640 1 -- 172.21.15.37:0/1312024250 >> 172.21.15.37:0/1312024250 conn(0x7fbfc406a640 msgr2=0x7fbfc406aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:22.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.950+0000 7fbfc9052640 1 -- 172.21.15.37:0/1312024250 shutdown_connections 2023-12-11T17:11:22.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.950+0000 7fbfc9052640 1 -- 172.21.15.37:0/1312024250 wait complete. 2023-12-11T17:11:22.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.952+0000 7fbfc9052640 1 Processor -- start 2023-12-11T17:11:22.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.952+0000 7fbfc9052640 1 -- start start 2023-12-11T17:11:22.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.953+0000 7fbfc9052640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfc40ce150 0x7fbfc4145500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:22.955 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.953+0000 7fbfc9052640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfc40cf500 0x7fbfc41503d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.953+0000 7fbfc9052640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfc4155400 0x7fbfc4150910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.953+0000 7fbfc9052640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc4151ed0 con 0x7fbfc40ce150 2023-12-11T17:11:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.953+0000 7fbfc9052640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc41512c0 con 0x7fbfc40cf500 2023-12-11T17:11:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.953+0000 7fbfc9052640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfc41515a0 con 0x7fbfc4155400 2023-12-11T17:11:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.953+0000 7fbfc3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfc40ce150 0x7fbfc4145500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.953+0000 7fbfc3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfc40ce150 0x7fbfc4145500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44458/0 (socket says 172.21.15.37:44458) 2023-12-11T17:11:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.953+0000 7fbfc3fff640 1 -- 172.21.15.37:0/1369528022 learned_addr learned my addr 172.21.15.37:0/1369528022 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.954+0000 7fbfbb7fe640 1 --2- 172.21.15.37:0/1369528022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfc40cf500 0x7fbfc41503d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.954+0000 7fbfc3fff640 1 -- 172.21.15.37:0/1369528022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfc4155400 msgr2=0x7fbfc4150910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.954+0000 7fbfc3fff640 1 --2- 172.21.15.37:0/1369528022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfc4155400 0x7fbfc4150910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.954+0000 7fbfc3fff640 1 -- 172.21.15.37:0/1369528022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfc40cf500 msgr2=0x7fbfc41503d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.954+0000 7fbfc3fff640 1 --2- 172.21.15.37:0/1369528022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfc40cf500 0x7fbfc41503d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.954+0000 7fbfc3fff640 1 -- 172.21.15.37:0/1369528022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfbc009400 con 0x7fbfc40ce150 2023-12-11T17:11:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.954+0000 7fbfc3fff640 1 --2- 172.21.15.37:0/1369528022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfc40ce150 0x7fbfc4145500 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400cba0 tx=0x7fbfb400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.954+0000 7fbfc17fa640 1 -- 172.21.15.37:0/1369528022 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb400ad40 con 0x7fbfc40ce150 2023-12-11T17:11:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.955+0000 7fbfc17fa640 1 -- 172.21.15.37:0/1369528022 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfb4012400 con 0x7fbfc40ce150 2023-12-11T17:11:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.955+0000 7fbfc17fa640 1 -- 172.21.15.37:0/1369528022 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfb400aea0 con 0x7fbfc40ce150 2023-12-11T17:11:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.955+0000 7fbfc9052640 1 -- 172.21.15.37:0/1369528022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfc4151880 con 0x7fbfc40ce150 2023-12-11T17:11:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.955+0000 7fbfc9052640 1 -- 172.21.15.37:0/1369528022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfc4145a40 con 0x7fbfc40ce150 2023-12-11T17:11:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.956+0000 7fbfc9052640 1 -- 172.21.15.37:0/1369528022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfc4074450 con 0x7fbfc40ce150 2023-12-11T17:11:22.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.957+0000 7fbfc17fa640 1 -- 172.21.15.37:0/1369528022 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbfb4007070 con 0x7fbfc40ce150 2023-12-11T17:11:22.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.958+0000 7fbfc17fa640 1 --2- 172.21.15.37:0/1369528022 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbfa406ae70 0x7fbfa406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:22.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.958+0000 7fbfc17fa640 1 -- 172.21.15.37:0/1369528022 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7fbfb40892c0 con 0x7fbfc40ce150 2023-12-11T17:11:22.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.958+0000 7fbfbb7fe640 1 --2- 172.21.15.37:0/1369528022 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbfa406ae70 0x7fbfa406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:22.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.959+0000 7fbfbb7fe640 1 --2- 172.21.15.37:0/1369528022 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbfa406ae70 0x7fbfa406d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbfc409a7d0 tx=0x7fbfac008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:22.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:22.962+0000 7fbfc17fa640 1 -- 172.21.15.37:0/1369528022 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbfb4054590 con 0x7fbfc40ce150 2023-12-11T17:11:23.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.159+0000 7fbfc9052640 1 -- 172.21.15.37:0/1369528022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbfc415ad40 con 0x7fbfc40ce150 2023-12-11T17:11:23.160 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.159+0000 7fbfc17fa640 1 -- 172.21.15.37:0/1369528022 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbfb4057bb0 con 0x7fbfc40ce150 2023-12-11T17:11:23.161 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-11T17:11:23.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.162+0000 7fbfc9052640 1 -- 172.21.15.37:0/1369528022 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbfa406ae70 msgr2=0x7fbfa406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:23.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.162+0000 7fbfc9052640 1 --2- 172.21.15.37:0/1369528022 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbfa406ae70 0x7fbfa406d330 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fbfc409a7d0 tx=0x7fbfac008040 comp rx=0 tx=0).stop 2023-12-11T17:11:23.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.162+0000 7fbfc9052640 1 -- 172.21.15.37:0/1369528022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfc40ce150 msgr2=0x7fbfc4145500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:23.163 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.162+0000 7fbfc9052640 1 --2- 172.21.15.37:0/1369528022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfc40ce150 0x7fbfc4145500 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fbfb400cba0 tx=0x7fbfb400a430 comp rx=0 tx=0).stop 2023-12-11T17:11:23.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.162+0000 7fbfc9052640 1 -- 172.21.15.37:0/1369528022 shutdown_connections 2023-12-11T17:11:23.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.162+0000 7fbfc9052640 1 --2- 172.21.15.37:0/1369528022 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbfa406ae70 0x7fbfa406d330 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:23.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.162+0000 7fbfc9052640 1 --2- 172.21.15.37:0/1369528022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfc40cf500 0x7fbfc41503d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:23.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.162+0000 7fbfc9052640 1 --2- 172.21.15.37:0/1369528022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbfc4155400 0x7fbfc4150910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:23.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.162+0000 7fbfc9052640 1 --2- 172.21.15.37:0/1369528022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbfc40ce150 0x7fbfc4145500 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:23.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.162+0000 7fbfc9052640 1 -- 172.21.15.37:0/1369528022 >> 172.21.15.37:0/1369528022 conn(0x7fbfc406a640 msgr2=0x7fbfc406bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:23.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.162+0000 7fbfc9052640 1 -- 172.21.15.37:0/1369528022 shutdown_connections 2023-12-11T17:11:23.164 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.162+0000 7fbfc9052640 1 -- 172.21.15.37:0/1369528022 wait complete. 2023-12-11T17:11:23.182 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-11T17:11:23.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.407+0000 7f8fbf4ef640 1 Processor -- start 2023-12-11T17:11:23.409 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.408+0000 7f8fbf4ef640 1 -- start start 2023-12-11T17:11:23.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.409+0000 7f8fbf4ef640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8fb8159fd0 0x7f8fb80ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:23.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.409+0000 7f8fbf4ef640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fb80713b0 0x7f8fb80b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:23.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.409+0000 7f8fbf4ef640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fb8070070 con 0x7f8fb8070750 2023-12-11T17:11:23.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.409+0000 7f8fbf4ef640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb80705f0 con 0x7f8fb8159fd0 2023-12-11T17:11:23.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.409+0000 7f8fbf4ef640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb8070310 con 0x7f8fb80713b0 2023-12-11T17:11:23.410 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.409+0000 7f8fbe4ed640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8fb8159fd0 0x7f8fb80ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:23.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.409+0000 7f8fbe4ed640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8fb8159fd0 0x7f8fb80ae1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44468/0 (socket says 172.21.15.37:44468) 2023-12-11T17:11:23.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.409+0000 7f8fbe4ed640 1 -- 172.21.15.37:0/3133620844 learned_addr learned my addr 172.21.15.37:0/3133620844 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:23.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.410+0000 7f8fbecee640 1 --2- 172.21.15.37:0/3133620844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fb80713b0 0x7f8fb80b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:23.411 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.410+0000 7f8fbe4ed640 1 -- 172.21.15.37:0/3133620844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fb80713b0 msgr2=0x7f8fb80b27e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:23.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.410+0000 7f8fbe4ed640 1 --2- 172.21.15.37:0/3133620844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fb80713b0 0x7f8fb80b27e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:23.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.410+0000 7f8fbe4ed640 1 -- 172.21.15.37:0/3133620844 >> v1:172.21.15.37:6789/0 conn(0x7f8fb8070750 legacy=0x7f8fb8070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:23.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.410+0000 7f8fbe4ed640 1 -- 172.21.15.37:0/3133620844 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb80b1d00 con 0x7f8fb8159fd0 2023-12-11T17:11:23.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.410+0000 7f8fbecee640 1 --2- 172.21.15.37:0/3133620844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fb80713b0 0x7f8fb80b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:23.412 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.411+0000 7f8fbe4ed640 1 --2- 172.21.15.37:0/3133620844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fb8159fd0 0x7f8fb80ae1d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009e50 tx=0x7f8fb402bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab9010474ffbc6b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.411+0000 7f8fbd4eb640 1 -- 172.21.15.37:0/3133620844 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb402cb90 con 0x7f8fb8159fd0 2023-12-11T17:11:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.411+0000 7f8fbd4eb640 1 -- 172.21.15.37:0/3133620844 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb402ccf0 con 0x7f8fb8159fd0 2023-12-11T17:11:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.411+0000 7f8fbd4eb640 1 -- 172.21.15.37:0/3133620844 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4034610 con 0x7f8fb8159fd0 2023-12-11T17:11:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.412+0000 7f8fbf4ef640 1 -- 172.21.15.37:0/3133620844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fb8159fd0 msgr2=0x7f8fb80ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.412+0000 7f8fbf4ef640 1 --2- 172.21.15.37:0/3133620844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fb8159fd0 0x7f8fb80ae1d0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009e50 tx=0x7f8fb402bff0 comp rx=0 tx=0).stop 2023-12-11T17:11:23.413 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.412+0000 7f8fbf4ef640 1 -- 172.21.15.37:0/3133620844 shutdown_connections 2023-12-11T17:11:23.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.412+0000 7f8fbf4ef640 1 --2- 172.21.15.37:0/3133620844 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fb80713b0 0x7f8fb80b27e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:23.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.412+0000 7f8fbf4ef640 1 --2- 172.21.15.37:0/3133620844 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fb8159fd0 0x7f8fb80ae1d0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:23.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.412+0000 7f8fbf4ef640 1 -- 172.21.15.37:0/3133620844 >> 172.21.15.37:0/3133620844 conn(0x7f8fb80b0860 msgr2=0x7f8fb80b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:23.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.412+0000 7f8fbf4ef640 1 -- 172.21.15.37:0/3133620844 shutdown_connections 2023-12-11T17:11:23.414 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.412+0000 7f8fbf4ef640 1 -- 172.21.15.37:0/3133620844 wait complete. 2023-12-11T17:11:23.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.414+0000 7f8fbf4ef640 1 Processor -- start 2023-12-11T17:11:23.415 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.414+0000 7f8fbf4ef640 1 -- start start 2023-12-11T17:11:23.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.415+0000 7f8fbf4ef640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fb8070750 0x7f8fb815a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:23.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.415+0000 7f8fbf4ef640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fb80713b0 0x7f8fb813f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:23.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.415+0000 7f8fbf4ef640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fb8159fd0 0x7f8fb809c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:23.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.415+0000 7f8fbf4ef640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb815d880 con 0x7f8fb8070750 2023-12-11T17:11:23.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.415+0000 7f8fbf4ef640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb815c9f0 con 0x7f8fb8159fd0 2023-12-11T17:11:23.416 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.415+0000 7f8fbf4ef640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb815aa70 con 0x7f8fb80713b0 2023-12-11T17:11:23.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.415+0000 7f8fbe4ed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fb8070750 0x7f8fb815a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:23.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.415+0000 7f8fbe4ed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fb8070750 0x7f8fb815a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44472/0 (socket says 172.21.15.37:44472) 2023-12-11T17:11:23.417 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.415+0000 7f8fbe4ed640 1 -- 172.21.15.37:0/2058291499 learned_addr learned my addr 172.21.15.37:0/2058291499 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:23.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.416+0000 7f8fbe4ed640 1 -- 172.21.15.37:0/2058291499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fb80713b0 msgr2=0x7f8fb813f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:23.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.416+0000 7f8fbe4ed640 1 --2- 172.21.15.37:0/2058291499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fb80713b0 0x7f8fb813f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:23.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.416+0000 7f8fbe4ed640 1 -- 172.21.15.37:0/2058291499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fb8159fd0 msgr2=0x7f8fb809c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:23.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.416+0000 7f8fbe4ed640 1 --2- 172.21.15.37:0/2058291499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fb8159fd0 0x7f8fb809c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:23.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.416+0000 7f8fbe4ed640 1 -- 172.21.15.37:0/2058291499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb4009b30 con 0x7f8fb8070750 2023-12-11T17:11:23.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.416+0000 7f8fbe4ed640 1 --2- 172.21.15.37:0/2058291499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fb8070750 0x7f8fb815a530 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009e50 tx=0x7f8fb4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:23.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.416+0000 7f8faeffd640 1 -- 172.21.15.37:0/2058291499 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb403e450 con 0x7f8fb8070750 2023-12-11T17:11:23.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.417+0000 7f8faeffd640 1 -- 172.21.15.37:0/2058291499 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb403e5f0 con 0x7f8fb8070750 2023-12-11T17:11:23.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.417+0000 7f8fbf4ef640 1 -- 172.21.15.37:0/2058291499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb815cc00 con 0x7f8fb8070750 2023-12-11T17:11:23.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.417+0000 7f8faeffd640 1 -- 172.21.15.37:0/2058291499 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb403e9a0 con 0x7f8fb8070750 2023-12-11T17:11:23.418 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.417+0000 7f8fbf4ef640 1 -- 172.21.15.37:0/2058291499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb815d1c0 con 0x7f8fb8070750 2023-12-11T17:11:23.419 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.418+0000 7f8fbf4ef640 1 -- 172.21.15.37:0/2058291499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb8074450 con 0x7f8fb8070750 2023-12-11T17:11:23.420 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.419+0000 7f8faeffd640 1 -- 172.21.15.37:0/2058291499 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8fb403eb00 con 0x7f8fb8070750 2023-12-11T17:11:23.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.420+0000 7f8faeffd640 1 --2- 172.21.15.37:0/2058291499 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8f9c06ae40 0x7f8f9c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:23.421 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.420+0000 7f8faeffd640 1 -- 172.21.15.37:0/2058291499 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7f8fb40ac1d0 con 0x7f8fb8070750 2023-12-11T17:11:23.422 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.421+0000 7f8fbdcec640 1 --2- 172.21.15.37:0/2058291499 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8f9c06ae40 0x7f8f9c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:23.423 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.422+0000 7f8fbdcec640 1 --2- 172.21.15.37:0/2058291499 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8f9c06ae40 0x7f8f9c06d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8099c00 tx=0x7f8fa8007950 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:23.425 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.425+0000 7f8faeffd640 1 -- 172.21.15.37:0/2058291499 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8fb40775a0 con 0x7f8fb8070750 2023-12-11T17:11:23.622 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.621+0000 7f8fbf4ef640 1 -- 172.21.15.37:0/2058291499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f8fb8166b90 con 0x7f8fb8070750 2023-12-11T17:11:23.623 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.622+0000 7f8faeffd640 1 -- 172.21.15.37:0/2058291499 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v35) v1 ==== 84+0+65 (secure 0 0 0) 0x7f8fb402ce60 con 0x7f8fb8070750 2023-12-11T17:11:23.623 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:11:23.623 INFO:teuthology.orchestra.run.smithi037.stdout:[ 2023-12-11T17:11:23.623 INFO:teuthology.orchestra.run.smithi037.stdout: { 2023-12-11T17:11:23.623 INFO:teuthology.orchestra.run.smithi037.stdout: "poolnum": 1, 2023-12-11T17:11:23.623 INFO:teuthology.orchestra.run.smithi037.stdout: "poolname": ".mgr" 2023-12-11T17:11:23.623 INFO:teuthology.orchestra.run.smithi037.stdout: } 2023-12-11T17:11:23.623 INFO:teuthology.orchestra.run.smithi037.stdout:] 2023-12-11T17:11:23.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.624+0000 7f8fbf4ef640 1 -- 172.21.15.37:0/2058291499 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8f9c06ae40 msgr2=0x7f8f9c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:23.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.624+0000 7f8fbf4ef640 1 --2- 172.21.15.37:0/2058291499 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8f9c06ae40 0x7f8f9c06d300 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8fb8099c00 tx=0x7f8fa8007950 comp rx=0 tx=0).stop 2023-12-11T17:11:23.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.624+0000 7f8fbf4ef640 1 -- 172.21.15.37:0/2058291499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fb8070750 msgr2=0x7f8fb815a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:23.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.624+0000 7f8fbf4ef640 1 --2- 172.21.15.37:0/2058291499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fb8070750 0x7f8fb815a530 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f8fb4009e50 tx=0x7f8fb4004a40 comp rx=0 tx=0).stop 2023-12-11T17:11:23.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.625+0000 7f8fbf4ef640 1 -- 172.21.15.37:0/2058291499 shutdown_connections 2023-12-11T17:11:23.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.625+0000 7f8fbf4ef640 1 --2- 172.21.15.37:0/2058291499 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8f9c06ae40 0x7f8f9c06d300 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:23.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.625+0000 7f8fbf4ef640 1 --2- 172.21.15.37:0/2058291499 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8fb8159fd0 0x7f8fb809c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:23.626 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.625+0000 7f8fbf4ef640 1 --2- 172.21.15.37:0/2058291499 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8fb80713b0 0x7f8fb813f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:23.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.625+0000 7f8fbf4ef640 1 --2- 172.21.15.37:0/2058291499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8fb8070750 0x7f8fb815a530 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:23.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.625+0000 7f8fbf4ef640 1 -- 172.21.15.37:0/2058291499 >> 172.21.15.37:0/2058291499 conn(0x7f8fb80b0860 msgr2=0x7f8fb80af350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:23.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.625+0000 7f8fbf4ef640 1 -- 172.21.15.37:0/2058291499 shutdown_connections 2023-12-11T17:11:23.627 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.625+0000 7f8fbf4ef640 1 -- 172.21.15.37:0/2058291499 wait complete. 2023-12-11T17:11:23.645 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-11T17:11:23.645 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-11T17:11:23.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.863+0000 7ff60b4f3640 1 Processor -- start 2023-12-11T17:11:23.864 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.863+0000 7ff60b4f3640 1 -- start start 2023-12-11T17:11:23.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.864+0000 7ff60b4f3640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7ff6040cfd40 0x7ff60415d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:23.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.864+0000 7ff60b4f3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff6040d0120 0x7ff60415d780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:23.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.865+0000 7ff60b4f3640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6040d1a20 con 0x7ff6040b0740 2023-12-11T17:11:23.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.865+0000 7ff60b4f3640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6040d2230 con 0x7ff6040d0120 2023-12-11T17:11:23.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.865+0000 7ff60b4f3640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6040d1c70 con 0x7ff6040cfd40 2023-12-11T17:11:23.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.865+0000 7ff608a8e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff6040d0120 0x7ff60415d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:23.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.865+0000 7ff608a8e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff6040d0120 0x7ff60415d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44476/0 (socket says 172.21.15.37:44476) 2023-12-11T17:11:23.866 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.865+0000 7ff608a8e640 1 -- 172.21.15.37:0/1536707296 learned_addr learned my addr 172.21.15.37:0/1536707296 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:23.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.865+0000 7ff60928f640 1 --2- 172.21.15.37:0/1536707296 >> v2:172.21.15.151:3300/0 conn(0x7ff6040cfd40 0x7ff60415d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:23.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.866+0000 7ff608a8e640 1 -- 172.21.15.37:0/1536707296 >> v2:172.21.15.151:3300/0 conn(0x7ff6040cfd40 msgr2=0x7ff60415d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:23.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.866+0000 7ff608a8e640 1 --2- 172.21.15.37:0/1536707296 >> v2:172.21.15.151:3300/0 conn(0x7ff6040cfd40 0x7ff60415d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:23.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.866+0000 7ff608a8e640 1 -- 172.21.15.37:0/1536707296 >> v1:172.21.15.151:6789/0 conn(0x7ff6040b0740 legacy=0x7ff6040b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:23.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.866+0000 7ff608a8e640 1 -- 172.21.15.37:0/1536707296 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6040d1f50 con 0x7ff6040d0120 2023-12-11T17:11:23.867 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.866+0000 7ff60928f640 1 --2- 172.21.15.37:0/1536707296 >> v2:172.21.15.151:3300/0 conn(0x7ff6040cfd40 0x7ff60415d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:11:23.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.867+0000 7ff608a8e640 1 --2- 172.21.15.37:0/1536707296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6040d0120 0x7ff60415d780 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff60408bf90 tx=0x7ff5f402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b6d6c222bf8b053 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:23.868 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.868+0000 7ff5fbfff640 1 -- 172.21.15.37:0/1536707296 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4031870 con 0x7ff6040d0120 2023-12-11T17:11:23.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.868+0000 7ff5fbfff640 1 -- 172.21.15.37:0/1536707296 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5f40319d0 con 0x7ff6040d0120 2023-12-11T17:11:23.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.868+0000 7ff5fbfff640 1 -- 172.21.15.37:0/1536707296 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5f4031d60 con 0x7ff6040d0120 2023-12-11T17:11:23.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.868+0000 7ff60b4f3640 1 -- 172.21.15.37:0/1536707296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6040d0120 msgr2=0x7ff60415d780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:23.869 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.868+0000 7ff60b4f3640 1 --2- 172.21.15.37:0/1536707296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6040d0120 0x7ff60415d780 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff60408bf90 tx=0x7ff5f402b910 comp rx=0 tx=0).stop 2023-12-11T17:11:23.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.869+0000 7ff60b4f3640 1 -- 172.21.15.37:0/1536707296 shutdown_connections 2023-12-11T17:11:23.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.869+0000 7ff60b4f3640 1 --2- 172.21.15.37:0/1536707296 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6040d0120 0x7ff60415d780 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:23.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.869+0000 7ff60b4f3640 1 --2- 172.21.15.37:0/1536707296 >> v2:172.21.15.151:3300/0 conn(0x7ff6040cfd40 0x7ff60415d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:23.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.869+0000 7ff60b4f3640 1 -- 172.21.15.37:0/1536707296 >> 172.21.15.37:0/1536707296 conn(0x7ff60409c440 msgr2=0x7ff6040d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:23.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.869+0000 7ff60b4f3640 1 -- 172.21.15.37:0/1536707296 shutdown_connections 2023-12-11T17:11:23.870 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.869+0000 7ff60b4f3640 1 -- 172.21.15.37:0/1536707296 wait complete. 2023-12-11T17:11:23.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.871+0000 7ff60b4f3640 1 Processor -- start 2023-12-11T17:11:23.872 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.871+0000 7ff60b4f3640 1 -- start start 2023-12-11T17:11:23.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.872+0000 7ff60b4f3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6040b0740 0x7ff6040c89a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:23.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.872+0000 7ff60b4f3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6040cfd40 0x7ff6041555d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:23.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.872+0000 7ff60b4f3640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6040d0120 0x7ff6040b7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:23.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.872+0000 7ff60b4f3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60415a980 con 0x7ff6040b0740 2023-12-11T17:11:23.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.872+0000 7ff60b4f3640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6040c8ff0 con 0x7ff6040d0120 2023-12-11T17:11:23.873 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.872+0000 7ff60b4f3640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6040c76b0 con 0x7ff6040cfd40 2023-12-11T17:11:23.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.872+0000 7ff60928f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6040b0740 0x7ff6040c89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:23.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.873+0000 7ff60928f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6040b0740 0x7ff6040c89a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44490/0 (socket says 172.21.15.37:44490) 2023-12-11T17:11:23.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.873+0000 7ff60928f640 1 -- 172.21.15.37:0/2629166476 learned_addr learned my addr 172.21.15.37:0/2629166476 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:23.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.873+0000 7ff609a90640 1 --2- 172.21.15.37:0/2629166476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6040d0120 0x7ff6040b7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:23.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.873+0000 7ff608a8e640 1 --2- 172.21.15.37:0/2629166476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6040cfd40 0x7ff6041555d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:23.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.873+0000 7ff60928f640 1 -- 172.21.15.37:0/2629166476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6040cfd40 msgr2=0x7ff6041555d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:23.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.873+0000 7ff60928f640 1 --2- 172.21.15.37:0/2629166476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6040cfd40 0x7ff6041555d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:23.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.873+0000 7ff60928f640 1 -- 172.21.15.37:0/2629166476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6040d0120 msgr2=0x7ff6040b7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:23.878 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.873+0000 7ff60928f640 1 --2- 172.21.15.37:0/2629166476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6040d0120 0x7ff6040b7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:23.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.873+0000 7ff60928f640 1 -- 172.21.15.37:0/2629166476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5f40094d0 con 0x7ff6040b0740 2023-12-11T17:11:23.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.873+0000 7ff60928f640 1 --2- 172.21.15.37:0/2629166476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6040b0740 0x7ff6040c89a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff600009fc0 tx=0x7ff60000d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:23.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.874+0000 7ff5f9ffb640 1 -- 172.21.15.37:0/2629166476 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff600003b90 con 0x7ff6040b0740 2023-12-11T17:11:23.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.874+0000 7ff5f9ffb640 1 -- 172.21.15.37:0/2629166476 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60000f040 con 0x7ff6040b0740 2023-12-11T17:11:23.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.874+0000 7ff5f9ffb640 1 -- 172.21.15.37:0/2629166476 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff600004030 con 0x7ff6040b0740 2023-12-11T17:11:23.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.874+0000 7ff60b4f3640 1 -- 172.21.15.37:0/2629166476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6040c7990 con 0x7ff6040b0740 2023-12-11T17:11:23.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.874+0000 7ff60b4f3640 1 -- 172.21.15.37:0/2629166476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6040c7f50 con 0x7ff6040b0740 2023-12-11T17:11:23.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.875+0000 7ff60b4f3640 1 -- 172.21.15.37:0/2629166476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6040b4a00 con 0x7ff6040b0740 2023-12-11T17:11:23.879 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.876+0000 7ff5f9ffb640 1 -- 172.21.15.37:0/2629166476 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7ff600004190 con 0x7ff6040b0740 2023-12-11T17:11:23.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.878+0000 7ff5f9ffb640 1 --2- 172.21.15.37:0/2629166476 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff5e806ae40 0x7ff5e806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:23.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.878+0000 7ff5f9ffb640 1 -- 172.21.15.37:0/2629166476 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5177+0+0 (secure 0 0 0) 0x7ff6000897a0 con 0x7ff6040b0740 2023-12-11T17:11:23.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.879+0000 7ff608a8e640 1 --2- 172.21.15.37:0/2629166476 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff5e806ae40 0x7ff5e806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:23.880 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.880+0000 7ff608a8e640 1 --2- 172.21.15.37:0/2629166476 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff5e806ae40 0x7ff5e806d300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4036000 tx=0x7ff5f403c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:23.883 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:23.883+0000 7ff5f9ffb640 1 -- 172.21.15.37:0/2629166476 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7ff600054a70 con 0x7ff6040b0740 2023-12-11T17:11:24.076 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.075+0000 7ff60b4f3640 1 -- 172.21.15.37:0/2629166476 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7ff6040c9160 con 0x7ff6040b0740 2023-12-11T17:11:24.642 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.641+0000 7ff5f9ffb640 1 -- 172.21.15.37:0/2629166476 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v36) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff600058090 con 0x7ff6040b0740 2023-12-11T17:11:24.643 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_metadata' created 2023-12-11T17:11:24.645 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.645+0000 7ff60b4f3640 1 -- 172.21.15.37:0/2629166476 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff5e806ae40 msgr2=0x7ff5e806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:24.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.645+0000 7ff60b4f3640 1 --2- 172.21.15.37:0/2629166476 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff5e806ae40 0x7ff5e806d300 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff5f4036000 tx=0x7ff5f403c040 comp rx=0 tx=0).stop 2023-12-11T17:11:24.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.645+0000 7ff60b4f3640 1 -- 172.21.15.37:0/2629166476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6040b0740 msgr2=0x7ff6040c89a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:24.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.645+0000 7ff60b4f3640 1 --2- 172.21.15.37:0/2629166476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6040b0740 0x7ff6040c89a0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff600009fc0 tx=0x7ff60000d560 comp rx=0 tx=0).stop 2023-12-11T17:11:24.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.645+0000 7ff60b4f3640 1 -- 172.21.15.37:0/2629166476 shutdown_connections 2023-12-11T17:11:24.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.645+0000 7ff60b4f3640 1 --2- 172.21.15.37:0/2629166476 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7ff5e806ae40 0x7ff5e806d300 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:24.646 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.645+0000 7ff60b4f3640 1 --2- 172.21.15.37:0/2629166476 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff6040d0120 0x7ff6040b7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:24.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.645+0000 7ff60b4f3640 1 --2- 172.21.15.37:0/2629166476 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7ff6040cfd40 0x7ff6041555d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:24.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.645+0000 7ff60b4f3640 1 --2- 172.21.15.37:0/2629166476 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6040b0740 0x7ff6040c89a0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:24.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.645+0000 7ff60b4f3640 1 -- 172.21.15.37:0/2629166476 >> 172.21.15.37:0/2629166476 conn(0x7ff60409c440 msgr2=0x7ff6040cc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:24.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.645+0000 7ff60b4f3640 1 -- 172.21.15.37:0/2629166476 shutdown_connections 2023-12-11T17:11:24.647 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.645+0000 7ff60b4f3640 1 -- 172.21.15.37:0/2629166476 wait complete. 2023-12-11T17:11:24.675 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-11T17:11:24.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.887+0000 7efe2359e640 1 Processor -- start 2023-12-11T17:11:24.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.888+0000 7efe2359e640 1 -- start start 2023-12-11T17:11:24.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.889+0000 7efe2359e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efe240cc9e0 0x7efe240ce3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:24.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.889+0000 7efe2359e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe24070770 0x7efe2415c5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:24.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.889+0000 7efe2359e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe2415caf0 con 0x7efe240b3fa0 2023-12-11T17:11:24.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.889+0000 7efe2359e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe2415b3f0 con 0x7efe240cc9e0 2023-12-11T17:11:24.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.889+0000 7efe2359e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe240714c0 con 0x7efe24070770 2023-12-11T17:11:24.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.890+0000 7efe2259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efe240cc9e0 0x7efe240ce3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:24.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.890+0000 7efe2259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efe240cc9e0 0x7efe240ce3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44494/0 (socket says 172.21.15.37:44494) 2023-12-11T17:11:24.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.890+0000 7efe2259c640 1 -- 172.21.15.37:0/2154624708 learned_addr learned my addr 172.21.15.37:0/2154624708 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:24.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.890+0000 7efe22d9d640 1 --1- 172.21.15.37:0/2154624708 >> v1:172.21.15.37:6789/0 conn(0x7efe240b3fa0 0x7efe240b43c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57296/0 (socket says 172.21.15.37:57296) 2023-12-11T17:11:24.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.890+0000 7efe21d9b640 1 --2- 172.21.15.37:0/2154624708 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe24070770 0x7efe2415c5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:24.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.890+0000 7efe2259c640 1 -- 172.21.15.37:0/2154624708 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe24070770 msgr2=0x7efe2415c5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:24.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.890+0000 7efe2259c640 1 --2- 172.21.15.37:0/2154624708 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe24070770 0x7efe2415c5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:24.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.890+0000 7efe2259c640 1 -- 172.21.15.37:0/2154624708 >> v1:172.21.15.37:6789/0 conn(0x7efe240b3fa0 legacy=0x7efe240b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:24.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.890+0000 7efe2259c640 1 -- 172.21.15.37:0/2154624708 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe240717a0 con 0x7efe240cc9e0 2023-12-11T17:11:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.891+0000 7efe2259c640 1 --2- 172.21.15.37:0/2154624708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe240cc9e0 0x7efe240ce3e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7efe14009e50 tx=0x7efe1402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55da0e3de6533695 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.892+0000 7efe2159a640 1 -- 172.21.15.37:0/2154624708 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1402ca80 con 0x7efe240cc9e0 2023-12-11T17:11:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.892+0000 7efe2159a640 1 -- 172.21.15.37:0/2154624708 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1402cbe0 con 0x7efe240cc9e0 2023-12-11T17:11:24.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.892+0000 7efe2159a640 1 -- 172.21.15.37:0/2154624708 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe140343f0 con 0x7efe240cc9e0 2023-12-11T17:11:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.892+0000 7efe2359e640 1 -- 172.21.15.37:0/2154624708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe240cc9e0 msgr2=0x7efe240ce3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.892+0000 7efe2359e640 1 --2- 172.21.15.37:0/2154624708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe240cc9e0 0x7efe240ce3e0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7efe14009e50 tx=0x7efe1402bee0 comp rx=0 tx=0).stop 2023-12-11T17:11:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.893+0000 7efe2359e640 1 -- 172.21.15.37:0/2154624708 shutdown_connections 2023-12-11T17:11:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.893+0000 7efe2359e640 1 --2- 172.21.15.37:0/2154624708 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe24070770 0x7efe2415c5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.893+0000 7efe2359e640 1 --2- 172.21.15.37:0/2154624708 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe240cc9e0 0x7efe240ce3e0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:24.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.893+0000 7efe2359e640 1 -- 172.21.15.37:0/2154624708 >> 172.21.15.37:0/2154624708 conn(0x7efe240b0990 msgr2=0x7efe240b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.893+0000 7efe2359e640 1 -- 172.21.15.37:0/2154624708 shutdown_connections 2023-12-11T17:11:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.893+0000 7efe2359e640 1 -- 172.21.15.37:0/2154624708 wait complete. 2023-12-11T17:11:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.895+0000 7efe2359e640 1 Processor -- start 2023-12-11T17:11:24.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.895+0000 7efe2359e640 1 -- start start 2023-12-11T17:11:24.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.896+0000 7efe2359e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe24070770 0x7efe2413d520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:24.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.896+0000 7efe2359e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe240b3fa0 0x7efe241e3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:24.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.896+0000 7efe2359e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe240cc9e0 0x7efe241e3780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:24.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.896+0000 7efe2359e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2413da60 con 0x7efe24070770 2023-12-11T17:11:24.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.896+0000 7efe2359e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe241e6080 con 0x7efe240b3fa0 2023-12-11T17:11:24.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.896+0000 7efe2359e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe241e6360 con 0x7efe240cc9e0 2023-12-11T17:11:24.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.896+0000 7efe2259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe24070770 0x7efe2413d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:24.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.896+0000 7efe2259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe24070770 0x7efe2413d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44504/0 (socket says 172.21.15.37:44504) 2023-12-11T17:11:24.897 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.896+0000 7efe2259c640 1 -- 172.21.15.37:0/2976543007 learned_addr learned my addr 172.21.15.37:0/2976543007 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:24.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.896+0000 7efe21d9b640 1 --2- 172.21.15.37:0/2976543007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe240b3fa0 0x7efe241e3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.896+0000 7efe2259c640 1 -- 172.21.15.37:0/2976543007 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe240cc9e0 msgr2=0x7efe241e3780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.896+0000 7efe2259c640 1 --2- 172.21.15.37:0/2976543007 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe240cc9e0 0x7efe241e3780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.896+0000 7efe2259c640 1 -- 172.21.15.37:0/2976543007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe240b3fa0 msgr2=0x7efe241e3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.896+0000 7efe2259c640 1 --2- 172.21.15.37:0/2976543007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe240b3fa0 0x7efe241e3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.897+0000 7efe2259c640 1 -- 172.21.15.37:0/2976543007 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe14009b30 con 0x7efe24070770 2023-12-11T17:11:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.897+0000 7efe21d9b640 1 --2- 172.21.15.37:0/2976543007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe240b3fa0 0x7efe241e3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.897+0000 7efe2259c640 1 --2- 172.21.15.37:0/2976543007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe24070770 0x7efe2413d520 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7efe14000f80 tx=0x7efe14004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.897+0000 7efe1affd640 1 -- 172.21.15.37:0/2976543007 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe14009510 con 0x7efe24070770 2023-12-11T17:11:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.897+0000 7efe1affd640 1 -- 172.21.15.37:0/2976543007 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe1403e450 con 0x7efe24070770 2023-12-11T17:11:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.897+0000 7efe1affd640 1 -- 172.21.15.37:0/2976543007 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe1403e800 con 0x7efe24070770 2023-12-11T17:11:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.897+0000 7efe2359e640 1 -- 172.21.15.37:0/2976543007 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe241e6640 con 0x7efe24070770 2023-12-11T17:11:24.899 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.897+0000 7efe2359e640 1 -- 172.21.15.37:0/2976543007 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe241e6c00 con 0x7efe24070770 2023-12-11T17:11:24.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.899+0000 7efe2359e640 1 -- 172.21.15.37:0/2976543007 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2414c7f0 con 0x7efe24070770 2023-12-11T17:11:24.900 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.900+0000 7efe1affd640 1 -- 172.21.15.37:0/2976543007 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7efe1402cd50 con 0x7efe24070770 2023-12-11T17:11:24.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.901+0000 7efe1affd640 1 --2- 172.21.15.37:0/2976543007 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efe0406ae90 0x7efe0406d350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:24.901 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.901+0000 7efe1affd640 1 -- 172.21.15.37:0/2976543007 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5547+0+0 (secure 0 0 0) 0x7efe140ac0f0 con 0x7efe24070770 2023-12-11T17:11:24.902 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.901+0000 7efe21d9b640 1 --2- 172.21.15.37:0/2976543007 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efe0406ae90 0x7efe0406d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:24.904 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.903+0000 7efe21d9b640 1 --2- 172.21.15.37:0/2976543007 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efe0406ae90 0x7efe0406d350 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efe241f4110 tx=0x7efe0c008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:24.909 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:24.906+0000 7efe1affd640 1 -- 172.21.15.37:0/2976543007 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7efe2414c7f0 con 0x7efe24070770 2023-12-11T17:11:25.103 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.102+0000 7efe2359e640 1 -- 172.21.15.37:0/2976543007 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efe2414c7f0 con 0x7efe24070770 2023-12-11T17:11:25.649 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.647+0000 7efe1affd640 1 -- 172.21.15.37:0/2976543007 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v37) v1 ==== 170+0+0 (secure 0 0 0) 0x7efe2414c7f0 con 0x7efe24070770 2023-12-11T17:11:25.649 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'cephfs_data' created 2023-12-11T17:11:25.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.652+0000 7efe2359e640 1 -- 172.21.15.37:0/2976543007 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efe0406ae90 msgr2=0x7efe0406d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:25.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.652+0000 7efe2359e640 1 --2- 172.21.15.37:0/2976543007 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efe0406ae90 0x7efe0406d350 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7efe241f4110 tx=0x7efe0c008040 comp rx=0 tx=0).stop 2023-12-11T17:11:25.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.652+0000 7efe2359e640 1 -- 172.21.15.37:0/2976543007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe24070770 msgr2=0x7efe2413d520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:25.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.652+0000 7efe2359e640 1 --2- 172.21.15.37:0/2976543007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe24070770 0x7efe2413d520 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7efe14000f80 tx=0x7efe14004a40 comp rx=0 tx=0).stop 2023-12-11T17:11:25.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.652+0000 7efe2359e640 1 -- 172.21.15.37:0/2976543007 shutdown_connections 2023-12-11T17:11:25.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.652+0000 7efe2359e640 1 --2- 172.21.15.37:0/2976543007 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7efe0406ae90 0x7efe0406d350 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:25.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.652+0000 7efe2359e640 1 --2- 172.21.15.37:0/2976543007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7efe240b3fa0 0x7efe241e3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:25.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.652+0000 7efe2359e640 1 --2- 172.21.15.37:0/2976543007 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7efe240cc9e0 0x7efe241e3780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:25.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.652+0000 7efe2359e640 1 --2- 172.21.15.37:0/2976543007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efe24070770 0x7efe2413d520 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:25.654 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.653+0000 7efe2359e640 1 -- 172.21.15.37:0/2976543007 >> 172.21.15.37:0/2976543007 conn(0x7efe240b0990 msgr2=0x7efe2406da50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:25.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.653+0000 7efe2359e640 1 -- 172.21.15.37:0/2976543007 shutdown_connections 2023-12-11T17:11:25.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.653+0000 7efe2359e640 1 -- 172.21.15.37:0/2976543007 wait complete. 2023-12-11T17:11:25.689 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-11T17:11:25.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.880+0000 7fcb8502e640 1 Processor -- start 2023-12-11T17:11:25.881 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.880+0000 7fcb8502e640 1 -- start start 2023-12-11T17:11:25.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.882+0000 7fcb8502e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcb80155400 0x7fcb8006bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:25.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.882+0000 7fcb8502e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fcb800cf500 0x7fcb800ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:25.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.882+0000 7fcb8502e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb8015b4a0 con 0x7fcb800ce150 2023-12-11T17:11:25.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.882+0000 7fcb8502e640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb800adbb0 con 0x7fcb80155400 2023-12-11T17:11:25.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.882+0000 7fcb8502e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb800ade90 con 0x7fcb800cf500 2023-12-11T17:11:25.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.882+0000 7fcb7ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcb80155400 0x7fcb8006bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:25.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.882+0000 7fcb7ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcb80155400 0x7fcb8006bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44510/0 (socket says 172.21.15.37:44510) 2023-12-11T17:11:25.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.882+0000 7fcb7ffff640 1 -- 172.21.15.37:0/3182132995 learned_addr learned my addr 172.21.15.37:0/3182132995 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:25.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.883+0000 7fcb8482d640 1 --2- 172.21.15.37:0/3182132995 >> v2:172.21.15.151:3300/0 conn(0x7fcb800cf500 0x7fcb800ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:25.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.883+0000 7fcb7ffff640 1 -- 172.21.15.37:0/3182132995 >> v2:172.21.15.151:3300/0 conn(0x7fcb800cf500 msgr2=0x7fcb800ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:25.884 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.883+0000 7fcb7ffff640 1 --2- 172.21.15.37:0/3182132995 >> v2:172.21.15.151:3300/0 conn(0x7fcb800cf500 0x7fcb800ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.883+0000 7fcb7ffff640 1 -- 172.21.15.37:0/3182132995 >> v1:172.21.15.37:6789/0 conn(0x7fcb800ce150 legacy=0x7fcb800cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.883+0000 7fcb7ffff640 1 -- 172.21.15.37:0/3182132995 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb800ae170 con 0x7fcb80155400 2023-12-11T17:11:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.883+0000 7fcb7effd640 1 -- 172.21.15.37:0/3182132995 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2717206284 0 0) 0x7fcb8015b4a0 con 0x7fcb800ce150 2023-12-11T17:11:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.883+0000 7fcb8482d640 1 --2- 172.21.15.37:0/3182132995 >> v2:172.21.15.151:3300/0 conn(0x7fcb800cf500 0x7fcb800ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.884+0000 7fcb7ffff640 1 --2- 172.21.15.37:0/3182132995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb80155400 0x7fcb8006bdf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcb8006e390 tx=0x7fcb7002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8f793ddc83e7528 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.884+0000 7fcb7effd640 1 -- 172.21.15.37:0/3182132995 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb70030860 con 0x7fcb80155400 2023-12-11T17:11:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.884+0000 7fcb7effd640 1 -- 172.21.15.37:0/3182132995 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb700309c0 con 0x7fcb80155400 2023-12-11T17:11:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.884+0000 7fcb7effd640 1 -- 172.21.15.37:0/3182132995 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb70030d50 con 0x7fcb80155400 2023-12-11T17:11:25.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.885+0000 7fcb8502e640 1 -- 172.21.15.37:0/3182132995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb80155400 msgr2=0x7fcb8006bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:25.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.885+0000 7fcb8502e640 1 --2- 172.21.15.37:0/3182132995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb80155400 0x7fcb8006bdf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcb8006e390 tx=0x7fcb7002b9a0 comp rx=0 tx=0).stop 2023-12-11T17:11:25.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.885+0000 7fcb8502e640 1 -- 172.21.15.37:0/3182132995 shutdown_connections 2023-12-11T17:11:25.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.885+0000 7fcb8502e640 1 --2- 172.21.15.37:0/3182132995 >> v2:172.21.15.151:3300/0 conn(0x7fcb800cf500 0x7fcb800ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:25.886 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.885+0000 7fcb8502e640 1 --2- 172.21.15.37:0/3182132995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb80155400 0x7fcb8006bdf0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:25.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.885+0000 7fcb8502e640 1 -- 172.21.15.37:0/3182132995 >> 172.21.15.37:0/3182132995 conn(0x7fcb8006a640 msgr2=0x7fcb8006aa50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:25.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.885+0000 7fcb8502e640 1 -- 172.21.15.37:0/3182132995 shutdown_connections 2023-12-11T17:11:25.887 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.885+0000 7fcb8502e640 1 -- 172.21.15.37:0/3182132995 wait complete. 2023-12-11T17:11:25.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.887+0000 7fcb8502e640 1 Processor -- start 2023-12-11T17:11:25.888 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.887+0000 7fcb8502e640 1 -- start start 2023-12-11T17:11:25.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.888+0000 7fcb8502e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb800ce150 0x7fcb800afbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:25.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.888+0000 7fcb8502e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb800cf500 0x7fcb8014cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:25.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.888+0000 7fcb8502e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb80155400 0x7fcb800b0bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:25.889 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.888+0000 7fcb8502e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb800b0100 con 0x7fcb800ce150 2023-12-11T17:11:25.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.888+0000 7fcb8502e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb800aeb20 con 0x7fcb800cf500 2023-12-11T17:11:25.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.888+0000 7fcb8502e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb800aee00 con 0x7fcb80155400 2023-12-11T17:11:25.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.888+0000 7fcb7ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb800ce150 0x7fcb800afbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:25.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.889+0000 7fcb7ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb800ce150 0x7fcb800afbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44516/0 (socket says 172.21.15.37:44516) 2023-12-11T17:11:25.890 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.889+0000 7fcb7ffff640 1 -- 172.21.15.37:0/855488422 learned_addr learned my addr 172.21.15.37:0/855488422 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.889+0000 7fcb7ffff640 1 -- 172.21.15.37:0/855488422 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb80155400 msgr2=0x7fcb800b0bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.889+0000 7fcb7ffff640 1 --2- 172.21.15.37:0/855488422 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb80155400 0x7fcb800b0bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.889+0000 7fcb7ffff640 1 -- 172.21.15.37:0/855488422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb800cf500 msgr2=0x7fcb8014cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.889+0000 7fcb7ffff640 1 --2- 172.21.15.37:0/855488422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb800cf500 0x7fcb8014cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.889+0000 7fcb7ffff640 1 -- 172.21.15.37:0/855488422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb700094d0 con 0x7fcb800ce150 2023-12-11T17:11:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.889+0000 7fcb7ffff640 1 --2- 172.21.15.37:0/855488422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb800ce150 0x7fcb800afbc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcb7002b9e0 tx=0x7fcb70004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.890+0000 7fcb7cff9640 1 -- 172.21.15.37:0/855488422 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb70030850 con 0x7fcb800ce150 2023-12-11T17:11:25.891 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.890+0000 7fcb7cff9640 1 -- 172.21.15.37:0/855488422 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb70043400 con 0x7fcb800ce150 2023-12-11T17:11:25.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.890+0000 7fcb7cff9640 1 -- 172.21.15.37:0/855488422 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb700437b0 con 0x7fcb800ce150 2023-12-11T17:11:25.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.890+0000 7fcb8502e640 1 -- 172.21.15.37:0/855488422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb800af0e0 con 0x7fcb800ce150 2023-12-11T17:11:25.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.890+0000 7fcb8502e640 1 -- 172.21.15.37:0/855488422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb800af6a0 con 0x7fcb800ce150 2023-12-11T17:11:25.892 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.891+0000 7fcb8502e640 1 -- 172.21.15.37:0/855488422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb800af890 con 0x7fcb800ce150 2023-12-11T17:11:25.893 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.892+0000 7fcb7cff9640 1 -- 172.21.15.37:0/855488422 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcb70043910 con 0x7fcb800ce150 2023-12-11T17:11:25.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.893+0000 7fcb7cff9640 1 --2- 172.21.15.37:0/855488422 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcb6c06ae40 0x7fcb6c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:25.894 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.893+0000 7fcb7cff9640 1 -- 172.21.15.37:0/855488422 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5929+0+0 (secure 0 0 0) 0x7fcb7003e070 con 0x7fcb800ce150 2023-12-11T17:11:25.895 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.894+0000 7fcb7f7fe640 1 --2- 172.21.15.37:0/855488422 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcb6c06ae40 0x7fcb6c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:25.896 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.895+0000 7fcb7f7fe640 1 --2- 172.21.15.37:0/855488422 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcb6c06ae40 0x7fcb6c06d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcb801f5fe0 tx=0x7fcb74007930 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:25.898 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:25.897+0000 7fcb7cff9640 1 -- 172.21.15.37:0/855488422 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcb70078560 con 0x7fcb800ce150 2023-12-11T17:11:26.129 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.128+0000 7fcb8502e640 1 -- 172.21.15.37:0/855488422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcb80074450 con 0x7fcb800ce150 2023-12-11T17:11:26.704 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.702+0000 7fcb7cff9640 1 -- 172.21.15.37:0/855488422 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 5 and data pool 6 v13) v1 ==== 172+0+0 (secure 0 0 0) 0x7fcb7007bb80 con 0x7fcb800ce150 2023-12-11T17:11:26.704 INFO:teuthology.orchestra.run.smithi037.stderr:new fs with metadata pool 5 and data pool 6 2023-12-11T17:11:26.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.716+0000 7fcb8502e640 1 -- 172.21.15.37:0/855488422 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcb6c06ae40 msgr2=0x7fcb6c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:26.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.716+0000 7fcb8502e640 1 --2- 172.21.15.37:0/855488422 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcb6c06ae40 0x7fcb6c06d300 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcb801f5fe0 tx=0x7fcb74007930 comp rx=0 tx=0).stop 2023-12-11T17:11:26.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.716+0000 7fcb8502e640 1 -- 172.21.15.37:0/855488422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb800ce150 msgr2=0x7fcb800afbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:26.718 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.716+0000 7fcb8502e640 1 --2- 172.21.15.37:0/855488422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb800ce150 0x7fcb800afbc0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcb7002b9e0 tx=0x7fcb70004730 comp rx=0 tx=0).stop 2023-12-11T17:11:26.719 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.718+0000 7fcb8502e640 1 -- 172.21.15.37:0/855488422 shutdown_connections 2023-12-11T17:11:26.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.718+0000 7fcb8502e640 1 --2- 172.21.15.37:0/855488422 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcb6c06ae40 0x7fcb6c06d300 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:26.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.718+0000 7fcb8502e640 1 --2- 172.21.15.37:0/855488422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcb800cf500 0x7fcb8014cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:26.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.718+0000 7fcb8502e640 1 --2- 172.21.15.37:0/855488422 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcb80155400 0x7fcb800b0bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:26.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.718+0000 7fcb8502e640 1 --2- 172.21.15.37:0/855488422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcb800ce150 0x7fcb800afbc0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:26.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.718+0000 7fcb8502e640 1 -- 172.21.15.37:0/855488422 >> 172.21.15.37:0/855488422 conn(0x7fcb8006a640 msgr2=0x7fcb800b2260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:26.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.719+0000 7fcb8502e640 1 -- 172.21.15.37:0/855488422 shutdown_connections 2023-12-11T17:11:26.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.719+0000 7fcb8502e640 1 -- 172.21.15.37:0/855488422 wait complete. 2023-12-11T17:11:26.748 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:11:26.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.935+0000 7f3dd501e640 1 Processor -- start 2023-12-11T17:11:26.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.935+0000 7f3dd501e640 1 -- start start 2023-12-11T17:11:26.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.937+0000 7f3dd501e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3dd015a0d0 0x7f3dd006df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:26.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.937+0000 7f3dd501e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dd00cf1c0 0x7f3dd00b3a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:26.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.937+0000 7f3dd501e640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd00cda10 con 0x7f3dd006e470 2023-12-11T17:11:26.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.937+0000 7f3dd501e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd00cdcf0 con 0x7f3dd015a0d0 2023-12-11T17:11:26.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.937+0000 7f3dd501e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00cdfd0 con 0x7f3dd00cf1c0 2023-12-11T17:11:26.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.938+0000 7f3dcf59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dd00cf1c0 0x7f3dd00b3a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:26.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.938+0000 7f3dced9d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3dd015a0d0 0x7f3dd006df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:26.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.938+0000 7f3dced9d640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f3dd015a0d0 0x7f3dd006df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:59214/0 (socket says 172.21.15.37:59214) 2023-12-11T17:11:26.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.938+0000 7f3dced9d640 1 -- 172.21.15.37:0/3701671330 learned_addr learned my addr 172.21.15.37:0/3701671330 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:26.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.939+0000 7f3dced9d640 1 -- 172.21.15.37:0/3701671330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dd00cf1c0 msgr2=0x7f3dd00b3a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:26.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.939+0000 7f3dced9d640 1 --2- 172.21.15.37:0/3701671330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dd00cf1c0 0x7f3dd00b3a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:26.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.939+0000 7f3dced9d640 1 -- 172.21.15.37:0/3701671330 >> v1:172.21.15.151:6789/0 conn(0x7f3dd006e470 legacy=0x7f3dd00ceab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:26.940 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.939+0000 7f3dced9d640 1 -- 172.21.15.37:0/3701671330 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd00ce2b0 con 0x7f3dd015a0d0 2023-12-11T17:11:26.941 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.940+0000 7f3dced9d640 1 --2- 172.21.15.37:0/3701671330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dd015a0d0 0x7f3dd006df30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009870 tx=0x7f3dc002b8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bf398145b3e2a67 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:26.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.941+0000 7f3dcdd9b640 1 -- 172.21.15.37:0/3701671330 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0031640 con 0x7f3dd015a0d0 2023-12-11T17:11:26.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.941+0000 7f3dcdd9b640 1 -- 172.21.15.37:0/3701671330 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc00317a0 con 0x7f3dd015a0d0 2023-12-11T17:11:26.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.941+0000 7f3dcdd9b640 1 -- 172.21.15.37:0/3701671330 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0031b30 con 0x7f3dd015a0d0 2023-12-11T17:11:26.942 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.942+0000 7f3dd501e640 1 -- 172.21.15.37:0/3701671330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dd015a0d0 msgr2=0x7f3dd006df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:26.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.942+0000 7f3dd501e640 1 --2- 172.21.15.37:0/3701671330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dd015a0d0 0x7f3dd006df30 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0009870 tx=0x7f3dc002b8f0 comp rx=0 tx=0).stop 2023-12-11T17:11:26.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.942+0000 7f3dd501e640 1 -- 172.21.15.37:0/3701671330 shutdown_connections 2023-12-11T17:11:26.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.942+0000 7f3dd501e640 1 --2- 172.21.15.37:0/3701671330 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dd00cf1c0 0x7f3dd00b3a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:26.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.942+0000 7f3dd501e640 1 --2- 172.21.15.37:0/3701671330 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dd015a0d0 0x7f3dd006df30 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:26.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.942+0000 7f3dd501e640 1 -- 172.21.15.37:0/3701671330 >> 172.21.15.37:0/3701671330 conn(0x7f3dd00cfe30 msgr2=0x7f3dd00d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:26.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.942+0000 7f3dd501e640 1 -- 172.21.15.37:0/3701671330 shutdown_connections 2023-12-11T17:11:26.943 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.942+0000 7f3dd501e640 1 -- 172.21.15.37:0/3701671330 wait complete. 2023-12-11T17:11:26.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.944+0000 7f3dd501e640 1 Processor -- start 2023-12-11T17:11:26.945 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.944+0000 7f3dd501e640 1 -- start start 2023-12-11T17:11:26.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.946+0000 7f3dd501e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dd006e470 0x7f3dd015b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:26.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.946+0000 7f3dd501e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd00cf1c0 0x7f3dd0152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:26.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.946+0000 7f3dd501e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dd015a0d0 0x7f3dd0142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:26.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.946+0000 7f3dd501e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd015bda0 con 0x7f3dd00cf1c0 2023-12-11T17:11:26.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.946+0000 7f3dd501e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd0151f00 con 0x7f3dd006e470 2023-12-11T17:11:26.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.946+0000 7f3dd501e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd01521e0 con 0x7f3dd015a0d0 2023-12-11T17:11:26.947 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.946+0000 7f3dce59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd00cf1c0 0x7f3dd0152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:26.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.946+0000 7f3dce59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd00cf1c0 0x7f3dd0152fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44522/0 (socket says 172.21.15.37:44522) 2023-12-11T17:11:26.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.946+0000 7f3dce59c640 1 -- 172.21.15.37:0/3550023745 learned_addr learned my addr 172.21.15.37:0/3550023745 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:26.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.946+0000 7f3dcf59e640 1 --2- 172.21.15.37:0/3550023745 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dd015a0d0 0x7f3dd0142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:26.948 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.946+0000 7f3dced9d640 1 --2- 172.21.15.37:0/3550023745 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dd006e470 0x7f3dd015b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.947+0000 7f3dce59c640 1 -- 172.21.15.37:0/3550023745 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dd015a0d0 msgr2=0x7f3dd0142750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.947+0000 7f3dce59c640 1 --2- 172.21.15.37:0/3550023745 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dd015a0d0 0x7f3dd0142750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.947+0000 7f3dce59c640 1 -- 172.21.15.37:0/3550023745 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dd006e470 msgr2=0x7f3dd015b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.947+0000 7f3dce59c640 1 --2- 172.21.15.37:0/3550023745 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dd006e470 0x7f3dd015b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.947+0000 7f3dce59c640 1 -- 172.21.15.37:0/3550023745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc00094d0 con 0x7f3dd00cf1c0 2023-12-11T17:11:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.947+0000 7f3dce59c640 1 --2- 172.21.15.37:0/3550023745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd00cf1c0 0x7f3dd0152fa0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400c400 tx=0x7f3dc400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.947+0000 7f3db77fe640 1 -- 172.21.15.37:0/3550023745 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc40052d0 con 0x7f3dd00cf1c0 2023-12-11T17:11:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.947+0000 7f3db77fe640 1 -- 172.21.15.37:0/3550023745 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc4005430 con 0x7f3dd00cf1c0 2023-12-11T17:11:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.947+0000 7f3db77fe640 1 -- 172.21.15.37:0/3550023745 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc4003830 con 0x7f3dd00cf1c0 2023-12-11T17:11:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.947+0000 7f3dd501e640 1 -- 172.21.15.37:0/3550023745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd01524c0 con 0x7f3dd00cf1c0 2023-12-11T17:11:26.949 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.948+0000 7f3dd501e640 1 -- 172.21.15.37:0/3550023745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd0152a80 con 0x7f3dd00cf1c0 2023-12-11T17:11:26.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.949+0000 7f3dd501e640 1 -- 172.21.15.37:0/3550023745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd00745d0 con 0x7f3dd00cf1c0 2023-12-11T17:11:26.950 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.950+0000 7f3db77fe640 1 -- 172.21.15.37:0/3550023745 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f3dc4003990 con 0x7f3dd00cf1c0 2023-12-11T17:11:26.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.950+0000 7f3db77fe640 1 --2- 172.21.15.37:0/3550023745 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3dbc06ae40 0x7f3dbc06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:26.951 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.951+0000 7f3db77fe640 1 -- 172.21.15.37:0/3550023745 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f3dc4088c90 con 0x7f3dd00cf1c0 2023-12-11T17:11:26.952 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.951+0000 7f3dced9d640 1 --2- 172.21.15.37:0/3550023745 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3dbc06ae40 0x7f3dbc06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:26.953 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.952+0000 7f3dced9d640 1 --2- 172.21.15.37:0/3550023745 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3dbc06ae40 0x7f3dbc06d300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0036000 tx=0x7f3dc003c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:26.956 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:26.955+0000 7f3db77fe640 1 -- 172.21.15.37:0/3550023745 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f3dc4053c90 con 0x7f3dd00cf1c0 2023-12-11T17:11:27.145 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.144+0000 7f3dd501e640 1 -- 172.21.15.37:0/3550023745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3dd006eed0 con 0x7f3dd00cf1c0 2023-12-11T17:11:27.149 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.148+0000 7f3db77fe640 1 -- 172.21.15.37:0/3550023745 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16787 (secure 0 0 0) 0x7f3dc4017090 con 0x7f3dd00cf1c0 2023-12-11T17:11:27.149 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:11:27.149 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":38,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:11:26.130309+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:11:24.128757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-11T17:11:25.159839+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:11:27.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.150+0000 7f3dd501e640 1 -- 172.21.15.37:0/3550023745 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3dbc06ae40 msgr2=0x7f3dbc06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:27.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.150+0000 7f3dd501e640 1 --2- 172.21.15.37:0/3550023745 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3dbc06ae40 0x7f3dbc06d300 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f3dc0036000 tx=0x7f3dc003c040 comp rx=0 tx=0).stop 2023-12-11T17:11:27.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.150+0000 7f3dd501e640 1 -- 172.21.15.37:0/3550023745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd00cf1c0 msgr2=0x7f3dd0152fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:27.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.150+0000 7f3dd501e640 1 --2- 172.21.15.37:0/3550023745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd00cf1c0 0x7f3dd0152fa0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400c400 tx=0x7f3dc400c8c0 comp rx=0 tx=0).stop 2023-12-11T17:11:27.151 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.150+0000 7f3dd501e640 1 -- 172.21.15.37:0/3550023745 shutdown_connections 2023-12-11T17:11:27.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.150+0000 7f3dd501e640 1 --2- 172.21.15.37:0/3550023745 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f3dbc06ae40 0x7f3dbc06d300 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:27.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.150+0000 7f3dd501e640 1 --2- 172.21.15.37:0/3550023745 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f3dd015a0d0 0x7f3dd0142750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:27.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.150+0000 7f3dd501e640 1 --2- 172.21.15.37:0/3550023745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3dd00cf1c0 0x7f3dd0152fa0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:27.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.150+0000 7f3dd501e640 1 --2- 172.21.15.37:0/3550023745 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3dd006e470 0x7f3dd015b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:27.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.150+0000 7f3dd501e640 1 -- 172.21.15.37:0/3550023745 >> 172.21.15.37:0/3550023745 conn(0x7f3dd00cfe30 msgr2=0x7f3dd00afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:27.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.150+0000 7f3dd501e640 1 -- 172.21.15.37:0/3550023745 shutdown_connections 2023-12-11T17:11:27.152 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.150+0000 7f3dd501e640 1 -- 172.21.15.37:0/3550023745 wait complete. 2023-12-11T17:11:27.169 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:11:27.381 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.380+0000 7fa3055e5640 1 Processor -- start 2023-12-11T17:11:27.382 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.381+0000 7fa3055e5640 1 -- start start 2023-12-11T17:11:27.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.382+0000 7fa3055e5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa30015b440 0x7fa3000ce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:27.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.382+0000 7fa3055e5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa3000d1b40 0x7fa3000cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:27.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.382+0000 7fa3055e5640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3000aec70 con 0x7fa3000cf540 2023-12-11T17:11:27.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.382+0000 7fa3055e5640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3000cf9f0 con 0x7fa3000d1b40 2023-12-11T17:11:27.383 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.382+0000 7fa3055e5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000cb9a0 con 0x7fa30015b440 2023-12-11T17:11:27.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.383+0000 7fa2fe7fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa3000d1b40 0x7fa3000cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:27.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.383+0000 7fa2fe7fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa3000d1b40 0x7fa3000cf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44530/0 (socket says 172.21.15.37:44530) 2023-12-11T17:11:27.384 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.383+0000 7fa2fe7fc640 1 -- 172.21.15.37:0/2327168265 learned_addr learned my addr 172.21.15.37:0/2327168265 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:27.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.383+0000 7fa2feffd640 1 --2- 172.21.15.37:0/2327168265 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa30015b440 0x7fa3000ce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:27.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.383+0000 7fa2fe7fc640 1 -- 172.21.15.37:0/2327168265 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa30015b440 msgr2=0x7fa3000ce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:27.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.383+0000 7fa2fe7fc640 1 --2- 172.21.15.37:0/2327168265 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa30015b440 0x7fa3000ce120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:27.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.383+0000 7fa2fe7fc640 1 -- 172.21.15.37:0/2327168265 >> v1:172.21.15.151:6789/0 conn(0x7fa3000cf540 legacy=0x7fa30015ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:27.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.383+0000 7fa2fe7fc640 1 -- 172.21.15.37:0/2327168265 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3000cbc40 con 0x7fa3000d1b40 2023-12-11T17:11:27.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.383+0000 7fa2feffd640 1 --2- 172.21.15.37:0/2327168265 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa30015b440 0x7fa3000ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:27.385 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.384+0000 7fa2fe7fc640 1 --2- 172.21.15.37:0/2327168265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3000d1b40 0x7fa3000cf000 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009870 tx=0x7fa2e802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=126f4aac47622fed server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:27.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.385+0000 7fa2fdffb640 1 -- 172.21.15.37:0/2327168265 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8031640 con 0x7fa3000d1b40 2023-12-11T17:11:27.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.385+0000 7fa2fdffb640 1 -- 172.21.15.37:0/2327168265 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e80317a0 con 0x7fa3000d1b40 2023-12-11T17:11:27.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.385+0000 7fa2fdffb640 1 -- 172.21.15.37:0/2327168265 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8031b30 con 0x7fa3000d1b40 2023-12-11T17:11:27.386 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.385+0000 7fa3055e5640 1 -- 172.21.15.37:0/2327168265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3000d1b40 msgr2=0x7fa3000cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:27.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.385+0000 7fa3055e5640 1 --2- 172.21.15.37:0/2327168265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3000d1b40 0x7fa3000cf000 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009870 tx=0x7fa2e802b8f0 comp rx=0 tx=0).stop 2023-12-11T17:11:27.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.385+0000 7fa3055e5640 1 -- 172.21.15.37:0/2327168265 shutdown_connections 2023-12-11T17:11:27.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.385+0000 7fa3055e5640 1 --2- 172.21.15.37:0/2327168265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3000d1b40 0x7fa3000cf000 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:27.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.385+0000 7fa3055e5640 1 --2- 172.21.15.37:0/2327168265 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa30015b440 0x7fa3000ce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:27.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.385+0000 7fa3055e5640 1 -- 172.21.15.37:0/2327168265 >> 172.21.15.37:0/2327168265 conn(0x7fa3000d0e90 msgr2=0x7fa3000d12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:27.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.386+0000 7fa3055e5640 1 -- 172.21.15.37:0/2327168265 shutdown_connections 2023-12-11T17:11:27.387 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.386+0000 7fa3055e5640 1 -- 172.21.15.37:0/2327168265 wait complete. 2023-12-11T17:11:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.387+0000 7fa3055e5640 1 Processor -- start 2023-12-11T17:11:27.388 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.387+0000 7fa3055e5640 1 -- start start 2023-12-11T17:11:27.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.388+0000 7fa3055e5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3000cf540 0x7fa300159de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:27.389 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.388+0000 7fa3055e5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3000d1b40 0x7fa3000b1f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:27.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.388+0000 7fa3055e5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa30015b440 0x7fa3000b1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:27.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.388+0000 7fa3055e5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000b27f0 con 0x7fa3000cf540 2023-12-11T17:11:27.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.388+0000 7fa3055e5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000c6ad0 con 0x7fa30015b440 2023-12-11T17:11:27.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.388+0000 7fa3055e5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3000c6d70 con 0x7fa3000d1b40 2023-12-11T17:11:27.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.389+0000 7fa2feffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3000cf540 0x7fa300159de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:27.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.389+0000 7fa2feffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3000cf540 0x7fa300159de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44546/0 (socket says 172.21.15.37:44546) 2023-12-11T17:11:27.390 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.389+0000 7fa2feffd640 1 -- 172.21.15.37:0/2981016997 learned_addr learned my addr 172.21.15.37:0/2981016997 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:27.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.389+0000 7fa2feffd640 1 -- 172.21.15.37:0/2981016997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3000d1b40 msgr2=0x7fa3000b1f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:27.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.389+0000 7fa2feffd640 1 --2- 172.21.15.37:0/2981016997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3000d1b40 0x7fa3000b1f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:27.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.389+0000 7fa2feffd640 1 -- 172.21.15.37:0/2981016997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa30015b440 msgr2=0x7fa3000b1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:27.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.389+0000 7fa2feffd640 1 --2- 172.21.15.37:0/2981016997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa30015b440 0x7fa3000b1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:27.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.389+0000 7fa2feffd640 1 -- 172.21.15.37:0/2981016997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e80094d0 con 0x7fa3000cf540 2023-12-11T17:11:27.391 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.389+0000 7fa2feffd640 1 --2- 172.21.15.37:0/2981016997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3000cf540 0x7fa300159de0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000cf60 tx=0x7fa2f000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:27.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.390+0000 7fa2f77fe640 1 -- 172.21.15.37:0/2981016997 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f000d840 con 0x7fa3000cf540 2023-12-11T17:11:27.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.390+0000 7fa2f77fe640 1 -- 172.21.15.37:0/2981016997 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2f000d9a0 con 0x7fa3000cf540 2023-12-11T17:11:27.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.390+0000 7fa2f77fe640 1 -- 172.21.15.37:0/2981016997 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2f000dd30 con 0x7fa3000cf540 2023-12-11T17:11:27.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.390+0000 7fa3055e5640 1 -- 172.21.15.37:0/2981016997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3000c7050 con 0x7fa3000cf540 2023-12-11T17:11:27.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.390+0000 7fa3055e5640 1 -- 172.21.15.37:0/2981016997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3000c7610 con 0x7fa3000cf540 2023-12-11T17:11:27.392 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.391+0000 7fa3055e5640 1 -- 172.21.15.37:0/2981016997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3000c7800 con 0x7fa3000cf540 2023-12-11T17:11:27.393 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.392+0000 7fa2f77fe640 1 -- 172.21.15.37:0/2981016997 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fa2f0015440 con 0x7fa3000cf540 2023-12-11T17:11:27.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.393+0000 7fa2f77fe640 1 --2- 172.21.15.37:0/2981016997 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa2e006ae40 0x7fa2e006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:27.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.393+0000 7fa2f77fe640 1 -- 172.21.15.37:0/2981016997 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fa2f008a1b0 con 0x7fa3000cf540 2023-12-11T17:11:27.394 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.394+0000 7fa2fe7fc640 1 --2- 172.21.15.37:0/2981016997 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa2e006ae40 0x7fa2e006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:27.395 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.395+0000 7fa2fe7fc640 1 --2- 172.21.15.37:0/2981016997 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa2e006ae40 0x7fa2e006d300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8036000 tx=0x7fa2e8030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:27.398 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.398+0000 7fa2f77fe640 1 -- 172.21.15.37:0/2981016997 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fa2f0055130 con 0x7fa3000cf540 2023-12-11T17:11:27.585 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.583+0000 7fa3055e5640 1 -- 172.21.15.37:0/2981016997 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa3000745d0 con 0x7fa3000cf540 2023-12-11T17:11:27.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.586+0000 7fa2f77fe640 1 -- 172.21.15.37:0/2981016997 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+16787 (secure 0 0 0) 0x7fa2f0058750 con 0x7fa3000cf540 2023-12-11T17:11:27.587 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:11:27.587 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":38,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:11:26.130309+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:11:24.128757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-11T17:11:25.159839+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:11:27.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.588+0000 7fa3055e5640 1 -- 172.21.15.37:0/2981016997 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa2e006ae40 msgr2=0x7fa2e006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:27.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.588+0000 7fa3055e5640 1 --2- 172.21.15.37:0/2981016997 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa2e006ae40 0x7fa2e006d300 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8036000 tx=0x7fa2e8030000 comp rx=0 tx=0).stop 2023-12-11T17:11:27.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.588+0000 7fa3055e5640 1 -- 172.21.15.37:0/2981016997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3000cf540 msgr2=0x7fa300159de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:27.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.588+0000 7fa3055e5640 1 --2- 172.21.15.37:0/2981016997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3000cf540 0x7fa300159de0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fa2f000cf60 tx=0x7fa2f000cf90 comp rx=0 tx=0).stop 2023-12-11T17:11:27.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.588+0000 7fa3055e5640 1 -- 172.21.15.37:0/2981016997 shutdown_connections 2023-12-11T17:11:27.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.588+0000 7fa3055e5640 1 --2- 172.21.15.37:0/2981016997 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fa2e006ae40 0x7fa2e006d300 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:27.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.588+0000 7fa3055e5640 1 --2- 172.21.15.37:0/2981016997 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa30015b440 0x7fa3000b1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:27.590 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.588+0000 7fa3055e5640 1 --2- 172.21.15.37:0/2981016997 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fa3000d1b40 0x7fa3000b1f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.588+0000 7fa3055e5640 1 --2- 172.21.15.37:0/2981016997 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3000cf540 0x7fa300159de0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.588+0000 7fa3055e5640 1 -- 172.21.15.37:0/2981016997 >> 172.21.15.37:0/2981016997 conn(0x7fa3000d0e90 msgr2=0x7fa30006e440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.588+0000 7fa3055e5640 1 -- 172.21.15.37:0/2981016997 shutdown_connections 2023-12-11T17:11:27.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.588+0000 7fa3055e5640 1 -- 172.21.15.37:0/2981016997 wait complete. 2023-12-11T17:11:27.608 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-11T17:11:27.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.824+0000 7f5e499bc640 1 Processor -- start 2023-12-11T17:11:27.826 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.825+0000 7f5e499bc640 1 -- start start 2023-12-11T17:11:27.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.826+0000 7f5e499bc640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5e440cece0 0x7f5e440d1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:27.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.826+0000 7f5e499bc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e440d1a70 0x7f5e440b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:27.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.826+0000 7f5e499bc640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e440d3d70 con 0x7f5e4415d360 2023-12-11T17:11:27.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.826+0000 7f5e499bc640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e440d1f00 con 0x7f5e440cece0 2023-12-11T17:11:27.827 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.826+0000 7f5e499bc640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e440cdf20 con 0x7f5e440d1a70 2023-12-11T17:11:27.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.827+0000 7f5e43fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5e440cece0 0x7f5e440d1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:27.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.827+0000 7f5e491bb640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e440d1a70 0x7f5e440b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:27.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.827+0000 7f5e43fff640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f5e440cece0 0x7f5e440d1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:59242/0 (socket says 172.21.15.37:59242) 2023-12-11T17:11:27.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.827+0000 7f5e43fff640 1 -- 172.21.15.37:0/953229144 learned_addr learned my addr 172.21.15.37:0/953229144 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:27.828 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.827+0000 7f5e489ba640 1 --1- 172.21.15.37:0/953229144 >> v1:172.21.15.151:6789/0 conn(0x7f5e4415d360 0x7f5e440d3660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.151:6789/0 says I am v1:172.21.15.37:35340/0 (socket says 172.21.15.37:35340) 2023-12-11T17:11:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.828+0000 7f5e43fff640 1 -- 172.21.15.37:0/953229144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e440d1a70 msgr2=0x7f5e440b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.828+0000 7f5e43fff640 1 --2- 172.21.15.37:0/953229144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e440d1a70 0x7f5e440b28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.828+0000 7f5e43fff640 1 -- 172.21.15.37:0/953229144 >> v1:172.21.15.151:6789/0 conn(0x7f5e4415d360 legacy=0x7f5e440d3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.828+0000 7f5e43fff640 1 -- 172.21.15.37:0/953229144 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e440ce200 con 0x7f5e440cece0 2023-12-11T17:11:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.828+0000 7f5e491bb640 1 --2- 172.21.15.37:0/953229144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e440d1a70 0x7f5e440b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:11:27.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.830+0000 7f5e43fff640 1 --2- 172.21.15.37:0/953229144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e440cece0 0x7f5e440d1530 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009870 tx=0x7f5e3802ba20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e02a320e63d35a1e server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.831+0000 7f5e437fe640 1 -- 172.21.15.37:0/953229144 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3802f840 con 0x7f5e440cece0 2023-12-11T17:11:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.831+0000 7f5e437fe640 1 -- 172.21.15.37:0/953229144 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3802f9a0 con 0x7f5e440cece0 2023-12-11T17:11:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.831+0000 7f5e437fe640 1 -- 172.21.15.37:0/953229144 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3802fd30 con 0x7f5e440cece0 2023-12-11T17:11:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.831+0000 7f5e499bc640 1 -- 172.21.15.37:0/953229144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e440cece0 msgr2=0x7f5e440d1530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.831+0000 7f5e499bc640 1 --2- 172.21.15.37:0/953229144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e440cece0 0x7f5e440d1530 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009870 tx=0x7f5e3802ba20 comp rx=0 tx=0).stop 2023-12-11T17:11:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.831+0000 7f5e499bc640 1 -- 172.21.15.37:0/953229144 shutdown_connections 2023-12-11T17:11:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.831+0000 7f5e499bc640 1 --2- 172.21.15.37:0/953229144 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e440d1a70 0x7f5e440b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.831+0000 7f5e499bc640 1 --2- 172.21.15.37:0/953229144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e440cece0 0x7f5e440d1530 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.831+0000 7f5e499bc640 1 -- 172.21.15.37:0/953229144 >> 172.21.15.37:0/953229144 conn(0x7f5e4409c230 msgr2=0x7f5e440d2f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.831+0000 7f5e499bc640 1 -- 172.21.15.37:0/953229144 shutdown_connections 2023-12-11T17:11:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.831+0000 7f5e499bc640 1 -- 172.21.15.37:0/953229144 wait complete. 2023-12-11T17:11:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.833+0000 7f5e499bc640 1 Processor -- start 2023-12-11T17:11:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.833+0000 7f5e499bc640 1 -- start start 2023-12-11T17:11:27.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.834+0000 7f5e499bc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e440cece0 0x7f5e4414f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:27.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.834+0000 7f5e499bc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e440d1a70 0x7f5e4415e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:27.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.834+0000 7f5e499bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e4415d360 0x7f5e440cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:27.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.834+0000 7f5e499bc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e440cce70 con 0x7f5e4415d360 2023-12-11T17:11:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.834+0000 7f5e499bc640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4415dec0 con 0x7f5e440cece0 2023-12-11T17:11:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.834+0000 7f5e499bc640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4414f8f0 con 0x7f5e440d1a70 2023-12-11T17:11:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.834+0000 7f5e491bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e4415d360 0x7f5e440cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.834+0000 7f5e491bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e4415d360 0x7f5e440cc110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:44562/0 (socket says 172.21.15.37:44562) 2023-12-11T17:11:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.834+0000 7f5e491bb640 1 -- 172.21.15.37:0/1931320555 learned_addr learned my addr 172.21.15.37:0/1931320555 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.835+0000 7f5e43fff640 1 --2- 172.21.15.37:0/1931320555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e440d1a70 0x7f5e4415e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.835+0000 7f5e489ba640 1 --2- 172.21.15.37:0/1931320555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e440cece0 0x7f5e4414f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.835+0000 7f5e491bb640 1 -- 172.21.15.37:0/1931320555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e440d1a70 msgr2=0x7f5e4415e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.835+0000 7f5e491bb640 1 --2- 172.21.15.37:0/1931320555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e440d1a70 0x7f5e4415e350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.835+0000 7f5e491bb640 1 -- 172.21.15.37:0/1931320555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e440cece0 msgr2=0x7f5e4414f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.835+0000 7f5e491bb640 1 --2- 172.21.15.37:0/1931320555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e440cece0 0x7f5e4414f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.835+0000 7f5e491bb640 1 -- 172.21.15.37:0/1931320555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e3c009a70 con 0x7f5e4415d360 2023-12-11T17:11:27.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.835+0000 7f5e489ba640 1 --2- 172.21.15.37:0/1931320555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e440cece0 0x7f5e4414f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.835+0000 7f5e491bb640 1 --2- 172.21.15.37:0/1931320555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e4415d360 0x7f5e440cc110 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009db0 tx=0x7f5e3c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.835+0000 7f5e417fa640 1 -- 172.21.15.37:0/1931320555 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c009c20 con 0x7f5e4415d360 2023-12-11T17:11:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.836+0000 7f5e417fa640 1 -- 172.21.15.37:0/1931320555 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c00f040 con 0x7f5e4415d360 2023-12-11T17:11:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.836+0000 7f5e417fa640 1 -- 172.21.15.37:0/1931320555 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c003990 con 0x7f5e4415d360 2023-12-11T17:11:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.836+0000 7f5e499bc640 1 -- 172.21.15.37:0/1931320555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e380094d0 con 0x7f5e4415d360 2023-12-11T17:11:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.836+0000 7f5e499bc640 1 -- 172.21.15.37:0/1931320555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4415d870 con 0x7f5e4415d360 2023-12-11T17:11:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.837+0000 7f5e499bc640 1 -- 172.21.15.37:0/1931320555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e440678e0 con 0x7f5e4415d360 2023-12-11T17:11:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.838+0000 7f5e417fa640 1 -- 172.21.15.37:0/1931320555 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5e3c014480 con 0x7f5e4415d360 2023-12-11T17:11:27.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.838+0000 7f5e417fa640 1 --2- 172.21.15.37:0/1931320555 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5e3006ae40 0x7f5e3006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:27.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.839+0000 7f5e417fa640 1 -- 172.21.15.37:0/1931320555 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f5e3c08a290 con 0x7f5e4415d360 2023-12-11T17:11:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.839+0000 7f5e489ba640 1 --2- 172.21.15.37:0/1931320555 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5e3006ae40 0x7f5e3006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:27.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.841+0000 7f5e489ba640 1 --2- 172.21.15.37:0/1931320555 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5e3006ae40 0x7f5e3006d300 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5e34000f60 tx=0x7f5e34009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:27.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:27.843+0000 7f5e417fa640 1 -- 172.21.15.37:0/1931320555 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5e3c0551f0 con 0x7f5e4415d360 2023-12-11T17:11:28.078 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.076+0000 7f5e499bc640 1 -- 172.21.15.37:0/1931320555 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5e440b1340 con 0x7f5e4415d360 2023-12-11T17:11:28.717 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.715+0000 7f5e417fa640 1 -- 172.21.15.37:0/1931320555 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5e3c058810 con 0x7f5e4415d360 2023-12-11T17:11:28.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.719+0000 7f5e499bc640 1 -- 172.21.15.37:0/1931320555 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5e3006ae40 msgr2=0x7f5e3006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:28.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.719+0000 7f5e499bc640 1 --2- 172.21.15.37:0/1931320555 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5e3006ae40 0x7f5e3006d300 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5e34000f60 tx=0x7f5e34009040 comp rx=0 tx=0).stop 2023-12-11T17:11:28.720 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.719+0000 7f5e499bc640 1 -- 172.21.15.37:0/1931320555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e4415d360 msgr2=0x7f5e440cc110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:28.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.719+0000 7f5e499bc640 1 --2- 172.21.15.37:0/1931320555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e4415d360 0x7f5e440cc110 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009db0 tx=0x7f5e3c00c490 comp rx=0 tx=0).stop 2023-12-11T17:11:28.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.719+0000 7f5e499bc640 1 -- 172.21.15.37:0/1931320555 shutdown_connections 2023-12-11T17:11:28.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.719+0000 7f5e499bc640 1 --2- 172.21.15.37:0/1931320555 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f5e3006ae40 0x7f5e3006d300 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:28.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.719+0000 7f5e499bc640 1 --2- 172.21.15.37:0/1931320555 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5e4415d360 0x7f5e440cc110 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:28.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.719+0000 7f5e499bc640 1 --2- 172.21.15.37:0/1931320555 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5e440d1a70 0x7f5e4415e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:28.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.719+0000 7f5e499bc640 1 --2- 172.21.15.37:0/1931320555 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e440cece0 0x7f5e4414f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:28.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.719+0000 7f5e499bc640 1 -- 172.21.15.37:0/1931320555 >> 172.21.15.37:0/1931320555 conn(0x7f5e4409c230 msgr2=0x7f5e440c9820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:28.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.719+0000 7f5e499bc640 1 -- 172.21.15.37:0/1931320555 shutdown_connections 2023-12-11T17:11:28.721 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.720+0000 7f5e499bc640 1 -- 172.21.15.37:0/1931320555 wait complete. 2023-12-11T17:11:28.739 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-11T17:11:28.740 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-11T17:11:28.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.956+0000 7fcf47990640 1 Processor -- start 2023-12-11T17:11:28.958 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.957+0000 7fcf47990640 1 -- start start 2023-12-11T17:11:28.959 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.958+0000 7fcf47990640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcf401588e0 0x7fcf400b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:28.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.958+0000 7fcf47990640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf40071e80 0x7fcf4006d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:28.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.959+0000 7fcf47990640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf40165bd0 con 0x7fcf40166060 2023-12-11T17:11:28.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.959+0000 7fcf47990640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf400b4f60 con 0x7fcf401588e0 2023-12-11T17:11:28.960 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.959+0000 7fcf47990640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf400b4c80 con 0x7fcf40071e80 2023-12-11T17:11:28.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.959+0000 7fcf4572c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcf401588e0 0x7fcf400b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:28.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.959+0000 7fcf4572c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fcf401588e0 0x7fcf400b43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57470/0 (socket says 172.21.15.37:57470) 2023-12-11T17:11:28.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.959+0000 7fcf4572c640 1 -- 172.21.15.37:0/4131561652 learned_addr learned my addr 172.21.15.37:0/4131561652 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:28.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.959+0000 7fcf44f2b640 1 --2- 172.21.15.37:0/4131561652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf40071e80 0x7fcf4006d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:28.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.960+0000 7fcf4572c640 1 -- 172.21.15.37:0/4131561652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf40071e80 msgr2=0x7fcf4006d500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:28.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.960+0000 7fcf4572c640 1 --2- 172.21.15.37:0/4131561652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf40071e80 0x7fcf4006d500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:28.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.960+0000 7fcf4572c640 1 -- 172.21.15.37:0/4131561652 >> v1:172.21.15.151:6789/0 conn(0x7fcf40166060 legacy=0x7fcf40070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:28.961 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.960+0000 7fcf4572c640 1 -- 172.21.15.37:0/4131561652 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf40165580 con 0x7fcf401588e0 2023-12-11T17:11:28.962 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.961+0000 7fcf4572c640 1 --2- 172.21.15.37:0/4131561652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf401588e0 0x7fcf400b43a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009870 tx=0x7fcf3c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b576c6ec3c234d31 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:28.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.962+0000 7fcf37fff640 1 -- 172.21.15.37:0/4131561652 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c031640 con 0x7fcf401588e0 2023-12-11T17:11:28.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.962+0000 7fcf37fff640 1 -- 172.21.15.37:0/4131561652 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c0317a0 con 0x7fcf401588e0 2023-12-11T17:11:28.963 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.962+0000 7fcf37fff640 1 -- 172.21.15.37:0/4131561652 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c031b30 con 0x7fcf401588e0 2023-12-11T17:11:28.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.963+0000 7fcf47990640 1 -- 172.21.15.37:0/4131561652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf401588e0 msgr2=0x7fcf400b43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:28.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.963+0000 7fcf47990640 1 --2- 172.21.15.37:0/4131561652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf401588e0 0x7fcf400b43a0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009870 tx=0x7fcf3c02b8f0 comp rx=0 tx=0).stop 2023-12-11T17:11:28.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.963+0000 7fcf47990640 1 -- 172.21.15.37:0/4131561652 shutdown_connections 2023-12-11T17:11:28.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.963+0000 7fcf47990640 1 --2- 172.21.15.37:0/4131561652 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf40071e80 0x7fcf4006d500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:28.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.963+0000 7fcf47990640 1 --2- 172.21.15.37:0/4131561652 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf401588e0 0x7fcf400b43a0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:28.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.963+0000 7fcf47990640 1 -- 172.21.15.37:0/4131561652 >> 172.21.15.37:0/4131561652 conn(0x7fcf400cb850 msgr2=0x7fcf400cbc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:28.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.963+0000 7fcf47990640 1 -- 172.21.15.37:0/4131561652 shutdown_connections 2023-12-11T17:11:28.965 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.963+0000 7fcf47990640 1 -- 172.21.15.37:0/4131561652 wait complete. 2023-12-11T17:11:28.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.965+0000 7fcf47990640 1 Processor -- start 2023-12-11T17:11:28.966 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.965+0000 7fcf47990640 1 -- start start 2023-12-11T17:11:28.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.966+0000 7fcf47990640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf40071e80 0x7fcf401559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:28.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.966+0000 7fcf47990640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf401588e0 0x7fcf401ed120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:28.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.966+0000 7fcf47990640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf40166060 0x7fcf401ed660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:28.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.966+0000 7fcf47990640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf401f7890 con 0x7fcf40071e80 2023-12-11T17:11:28.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.966+0000 7fcf47990640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf401609f0 con 0x7fcf40166060 2023-12-11T17:11:28.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.966+0000 7fcf47990640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf40160cd0 con 0x7fcf401588e0 2023-12-11T17:11:28.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.966+0000 7fcf4572c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf40071e80 0x7fcf401559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:28.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.966+0000 7fcf4572c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf40071e80 0x7fcf401559c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57474/0 (socket says 172.21.15.37:57474) 2023-12-11T17:11:28.967 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.966+0000 7fcf4572c640 1 -- 172.21.15.37:0/2444735322 learned_addr learned my addr 172.21.15.37:0/2444735322 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.966+0000 7fcf4572c640 1 -- 172.21.15.37:0/2444735322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf401588e0 msgr2=0x7fcf401ed120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.966+0000 7fcf44f2b640 1 --2- 172.21.15.37:0/2444735322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf401588e0 0x7fcf401ed120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.967+0000 7fcf4572c640 1 --2- 172.21.15.37:0/2444735322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf401588e0 0x7fcf401ed120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.966+0000 7fcf45f2d640 1 --2- 172.21.15.37:0/2444735322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf40166060 0x7fcf401ed660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.967+0000 7fcf4572c640 1 -- 172.21.15.37:0/2444735322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf40166060 msgr2=0x7fcf401ed660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.967+0000 7fcf4572c640 1 --2- 172.21.15.37:0/2444735322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf40166060 0x7fcf401ed660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.967+0000 7fcf4572c640 1 -- 172.21.15.37:0/2444735322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf3c0094d0 con 0x7fcf40071e80 2023-12-11T17:11:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.967+0000 7fcf45f2d640 1 --2- 172.21.15.37:0/2444735322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf40166060 0x7fcf401ed660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.967+0000 7fcf4572c640 1 --2- 172.21.15.37:0/2444735322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf40071e80 0x7fcf401559c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009870 tx=0x7fcf3c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.967+0000 7fcf35ffb640 1 -- 172.21.15.37:0/2444735322 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c03ac60 con 0x7fcf40071e80 2023-12-11T17:11:28.969 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.967+0000 7fcf35ffb640 1 -- 172.21.15.37:0/2444735322 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c03adc0 con 0x7fcf40071e80 2023-12-11T17:11:28.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.967+0000 7fcf35ffb640 1 -- 172.21.15.37:0/2444735322 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c044610 con 0x7fcf40071e80 2023-12-11T17:11:28.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.967+0000 7fcf47990640 1 -- 172.21.15.37:0/2444735322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf40160fb0 con 0x7fcf40071e80 2023-12-11T17:11:28.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.967+0000 7fcf47990640 1 -- 172.21.15.37:0/2444735322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf4015fc80 con 0x7fcf40071e80 2023-12-11T17:11:28.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.968+0000 7fcf47990640 1 -- 172.21.15.37:0/2444735322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf400745d0 con 0x7fcf40071e80 2023-12-11T17:11:28.970 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.969+0000 7fcf35ffb640 1 -- 172.21.15.37:0/2444735322 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fcf3c02f050 con 0x7fcf40071e80 2023-12-11T17:11:28.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.970+0000 7fcf35ffb640 1 --2- 172.21.15.37:0/2444735322 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcf2406ae40 0x7fcf2406d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:28.971 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.970+0000 7fcf35ffb640 1 -- 172.21.15.37:0/2444735322 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fcf3c0ab590 con 0x7fcf40071e80 2023-12-11T17:11:28.972 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.971+0000 7fcf44f2b640 1 --2- 172.21.15.37:0/2444735322 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcf2406ae40 0x7fcf2406d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:28.973 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.972+0000 7fcf44f2b640 1 --2- 172.21.15.37:0/2444735322 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcf2406ae40 0x7fcf2406d300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcf401ec4c0 tx=0x7fcf30008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:28.976 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:28.975+0000 7fcf35ffb640 1 -- 172.21.15.37:0/2444735322 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fcf3c076590 con 0x7fcf40071e80 2023-12-11T17:11:29.211 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.210+0000 7fcf47990640 1 -- 172.21.15.37:0/2444735322 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fcf401ecf00 con 0x7fcf40071e80 2023-12-11T17:11:29.630 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-12-11T17:11:29.629+0000 7f93f0e35640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-11T17:11:29.724 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.719+0000 7fcf35ffb640 1 -- 172.21.15.37:0/2444735322 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v17) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcf3c079bb0 con 0x7fcf40071e80 2023-12-11T17:11:29.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.723+0000 7fcf47990640 1 -- 172.21.15.37:0/2444735322 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcf2406ae40 msgr2=0x7fcf2406d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:29.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.723+0000 7fcf47990640 1 --2- 172.21.15.37:0/2444735322 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcf2406ae40 0x7fcf2406d300 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fcf401ec4c0 tx=0x7fcf30008040 comp rx=0 tx=0).stop 2023-12-11T17:11:29.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.723+0000 7fcf47990640 1 -- 172.21.15.37:0/2444735322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf40071e80 msgr2=0x7fcf401559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:29.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.723+0000 7fcf47990640 1 --2- 172.21.15.37:0/2444735322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf40071e80 0x7fcf401559c0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009870 tx=0x7fcf3c0046c0 comp rx=0 tx=0).stop 2023-12-11T17:11:29.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.723+0000 7fcf47990640 1 -- 172.21.15.37:0/2444735322 shutdown_connections 2023-12-11T17:11:29.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.724+0000 7fcf47990640 1 --2- 172.21.15.37:0/2444735322 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fcf2406ae40 0x7fcf2406d300 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:29.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.724+0000 7fcf47990640 1 --2- 172.21.15.37:0/2444735322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf40166060 0x7fcf401ed660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:29.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.724+0000 7fcf47990640 1 --2- 172.21.15.37:0/2444735322 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fcf401588e0 0x7fcf401ed120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:29.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.724+0000 7fcf47990640 1 --2- 172.21.15.37:0/2444735322 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fcf40071e80 0x7fcf401559c0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:29.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.724+0000 7fcf47990640 1 -- 172.21.15.37:0/2444735322 >> 172.21.15.37:0/2444735322 conn(0x7fcf400cb850 msgr2=0x7fcf400b3f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:29.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.724+0000 7fcf47990640 1 -- 172.21.15.37:0/2444735322 shutdown_connections 2023-12-11T17:11:29.727 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.724+0000 7fcf47990640 1 -- 172.21.15.37:0/2444735322 wait complete. 2023-12-11T17:11:29.748 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-11T17:11:29.749 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T17:11:29.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.981+0000 7fdb7d5a7640 1 Processor -- start 2023-12-11T17:11:29.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.981+0000 7fdb7d5a7640 1 -- start start 2023-12-11T17:11:29.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.982+0000 7fdb7d5a7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdb7815d390 0x7fdb780b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:29.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.982+0000 7fdb7d5a7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb780d0c10 0x7fdb780b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:29.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.982+0000 7fdb7d5a7640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb780b0a00 con 0x7fdb780d1410 2023-12-11T17:11:29.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.982+0000 7fdb7d5a7640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb780ceea0 con 0x7fdb7815d390 2023-12-11T17:11:29.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.982+0000 7fdb7d5a7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7815d770 con 0x7fdb780d0c10 2023-12-11T17:11:29.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.982+0000 7fdb77fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdb7815d390 0x7fdb780b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:29.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.983+0000 7fdb7cda6640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdb780d1410 0x7fdb780b5d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35000/0 (socket says 172.21.15.37:35000) 2023-12-11T17:11:29.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.983+0000 7fdb7cda6640 1 -- 172.21.15.37:0/1124846356 learned_addr learned my addr 172.21.15.37:0/1124846356 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:29.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.983+0000 7fdb77fff640 1 -- 172.21.15.37:0/1124846356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb780d0c10 msgr2=0x7fdb780b04c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:29.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.983+0000 7fdb77fff640 1 --2- 172.21.15.37:0/1124846356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb780d0c10 0x7fdb780b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:29.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.983+0000 7fdb77fff640 1 -- 172.21.15.37:0/1124846356 >> v1:172.21.15.37:6789/0 conn(0x7fdb780d1410 legacy=0x7fdb780b5d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:29.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.983+0000 7fdb77fff640 1 -- 172.21.15.37:0/1124846356 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb780b1840 con 0x7fdb7815d390 2023-12-11T17:11:29.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.984+0000 7fdb77fff640 1 --2- 172.21.15.37:0/1124846356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb7815d390 0x7fdb780b1cd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009d90 tx=0x7fdb6802be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8cf28920de4d70 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:29.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.984+0000 7fdb76ffd640 1 -- 172.21.15.37:0/1124846356 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6802cbd0 con 0x7fdb7815d390 2023-12-11T17:11:29.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.985+0000 7fdb76ffd640 1 -- 172.21.15.37:0/1124846356 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb6802cd30 con 0x7fdb7815d390 2023-12-11T17:11:29.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.985+0000 7fdb76ffd640 1 -- 172.21.15.37:0/1124846356 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb6802cea0 con 0x7fdb7815d390 2023-12-11T17:11:29.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.985+0000 7fdb7d5a7640 1 -- 172.21.15.37:0/1124846356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb7815d390 msgr2=0x7fdb780b1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:29.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.985+0000 7fdb7d5a7640 1 --2- 172.21.15.37:0/1124846356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb7815d390 0x7fdb780b1cd0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fdb68009d90 tx=0x7fdb6802be20 comp rx=0 tx=0).stop 2023-12-11T17:11:29.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.985+0000 7fdb7d5a7640 1 -- 172.21.15.37:0/1124846356 shutdown_connections 2023-12-11T17:11:29.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.985+0000 7fdb7d5a7640 1 --2- 172.21.15.37:0/1124846356 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb780d0c10 0x7fdb780b04c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:29.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.985+0000 7fdb7d5a7640 1 --2- 172.21.15.37:0/1124846356 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb7815d390 0x7fdb780b1cd0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:29.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.985+0000 7fdb7d5a7640 1 -- 172.21.15.37:0/1124846356 >> 172.21.15.37:0/1124846356 conn(0x7fdb780d2ec0 msgr2=0x7fdb780d32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:29.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.985+0000 7fdb7d5a7640 1 -- 172.21.15.37:0/1124846356 shutdown_connections 2023-12-11T17:11:29.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.985+0000 7fdb7d5a7640 1 -- 172.21.15.37:0/1124846356 wait complete. 2023-12-11T17:11:29.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.987+0000 7fdb7d5a7640 1 Processor -- start 2023-12-11T17:11:29.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.987+0000 7fdb7d5a7640 1 -- start start 2023-12-11T17:11:29.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.988+0000 7fdb7d5a7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb780d0c10 0x7fdb781571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:29.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.988+0000 7fdb7d5a7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb780d1410 0x7fdb7809d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:29.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.988+0000 7fdb7d5a7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb7815d390 0x7fdb7806bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:29.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.988+0000 7fdb7d5a7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb780b2660 con 0x7fdb7815d390 2023-12-11T17:11:29.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.988+0000 7fdb7d5a7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb7809fb90 con 0x7fdb780d0c10 2023-12-11T17:11:29.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.988+0000 7fdb7d5a7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb780a0430 con 0x7fdb780d1410 2023-12-11T17:11:29.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.988+0000 7fdb7cda6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb7815d390 0x7fdb7806bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:29.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.989+0000 7fdb7cda6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb7815d390 0x7fdb7806bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57494/0 (socket says 172.21.15.37:57494) 2023-12-11T17:11:29.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.989+0000 7fdb7cda6640 1 -- 172.21.15.37:0/1528272028 learned_addr learned my addr 172.21.15.37:0/1528272028 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:29.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.989+0000 7fdb777fe640 1 --2- 172.21.15.37:0/1528272028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb780d1410 0x7fdb7809d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:29.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.989+0000 7fdb7cda6640 1 -- 172.21.15.37:0/1528272028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb780d1410 msgr2=0x7fdb7809d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:29.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.989+0000 7fdb7cda6640 1 --2- 172.21.15.37:0/1528272028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb780d1410 0x7fdb7809d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:29.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.989+0000 7fdb7cda6640 1 -- 172.21.15.37:0/1528272028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb780d0c10 msgr2=0x7fdb781571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:29.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.989+0000 7fdb7cda6640 1 --2- 172.21.15.37:0/1528272028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb780d0c10 0x7fdb781571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:29.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.989+0000 7fdb7cda6640 1 -- 172.21.15.37:0/1528272028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb68009a70 con 0x7fdb7815d390 2023-12-11T17:11:29.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.989+0000 7fdb777fe640 1 --2- 172.21.15.37:0/1528272028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb780d1410 0x7fdb7809d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:29.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.989+0000 7fdb7cda6640 1 --2- 172.21.15.37:0/1528272028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb7815d390 0x7fdb7806bfa0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000c450 tx=0x7fdb7000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:29.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.990+0000 7fdb74ff9640 1 -- 172.21.15.37:0/1528272028 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70005ce0 con 0x7fdb7815d390 2023-12-11T17:11:29.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.990+0000 7fdb74ff9640 1 -- 172.21.15.37:0/1528272028 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb70005e40 con 0x7fdb7815d390 2023-12-11T17:11:29.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.990+0000 7fdb74ff9640 1 -- 172.21.15.37:0/1528272028 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb70007270 con 0x7fdb7815d390 2023-12-11T17:11:29.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.990+0000 7fdb7d5a7640 1 -- 172.21.15.37:0/1528272028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb78157720 con 0x7fdb7815d390 2023-12-11T17:11:29.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.990+0000 7fdb7d5a7640 1 -- 172.21.15.37:0/1528272028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb7809fde0 con 0x7fdb7815d390 2023-12-11T17:11:29.993 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.991+0000 7fdb7d5a7640 1 -- 172.21.15.37:0/1528272028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb780678e0 con 0x7fdb7815d390 2023-12-11T17:11:29.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.992+0000 7fdb74ff9640 1 -- 172.21.15.37:0/1528272028 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fdb700073d0 con 0x7fdb7815d390 2023-12-11T17:11:29.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.993+0000 7fdb74ff9640 1 --2- 172.21.15.37:0/1528272028 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdb5806ae40 0x7fdb5806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:29.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.993+0000 7fdb74ff9640 1 -- 172.21.15.37:0/1528272028 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fdb70088bf0 con 0x7fdb7815d390 2023-12-11T17:11:29.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.994+0000 7fdb77fff640 1 --2- 172.21.15.37:0/1528272028 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdb5806ae40 0x7fdb5806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:29.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.995+0000 7fdb77fff640 1 --2- 172.21.15.37:0/1528272028 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdb5806ae40 0x7fdb5806d300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdb68036000 tx=0x7fdb6802e000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:29.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:29.998+0000 7fdb74ff9640 1 -- 172.21.15.37:0/1528272028 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fdb70053b70 con 0x7fdb7815d390 2023-12-11T17:11:30.231 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.230+0000 7fdb7d5a7640 1 -- 172.21.15.37:0/1528272028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb780a0570 con 0x7fdb7815d390 2023-12-11T17:11:30.233 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.232+0000 7fdb74ff9640 1 -- 172.21.15.37:0/1528272028 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4916 (secure 0 0 0) 0x7fdb780a0570 con 0x7fdb7815d390 2023-12-11T17:11:30.233 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:11:30.233 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/2560634941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":2560634941},{"type":"v1","addr":"172.21.15.151:6837","nonce":2560634941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1658416108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1658416108},{"type":"v1","addr":"172.21.15.37:6835","nonce":1658416108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4963,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/634584168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":634584168},{"type":"v1","addr":"172.21.15.151:6835","nonce":634584168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-11T17:11:26.130781+0000","modified":"2023-12-11T17:11:29.213218+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6833/4124618590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4124618590},{"type":"v1","addr":"172.21.15.37:6833","nonce":4124618590}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-11T17:11:30.233 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2023-12-11T17:11:30.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.234+0000 7fdb7d5a7640 1 -- 172.21.15.37:0/1528272028 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdb5806ae40 msgr2=0x7fdb5806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:30.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.234+0000 7fdb7d5a7640 1 --2- 172.21.15.37:0/1528272028 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdb5806ae40 0x7fdb5806d300 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdb68036000 tx=0x7fdb6802e000 comp rx=0 tx=0).stop 2023-12-11T17:11:30.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.235+0000 7fdb7d5a7640 1 -- 172.21.15.37:0/1528272028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb7815d390 msgr2=0x7fdb7806bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:30.236 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.235+0000 7fdb7d5a7640 1 --2- 172.21.15.37:0/1528272028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb7815d390 0x7fdb7806bfa0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fdb7000c450 tx=0x7fdb7000c910 comp rx=0 tx=0).stop 2023-12-11T17:11:30.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.235+0000 7fdb7d5a7640 1 -- 172.21.15.37:0/1528272028 shutdown_connections 2023-12-11T17:11:30.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.235+0000 7fdb7d5a7640 1 --2- 172.21.15.37:0/1528272028 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fdb5806ae40 0x7fdb5806d300 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:30.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.235+0000 7fdb7d5a7640 1 --2- 172.21.15.37:0/1528272028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdb7815d390 0x7fdb7806bfa0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:30.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.235+0000 7fdb7d5a7640 1 --2- 172.21.15.37:0/1528272028 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fdb780d1410 0x7fdb7809d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:30.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.235+0000 7fdb7d5a7640 1 --2- 172.21.15.37:0/1528272028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdb780d0c10 0x7fdb781571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:30.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.235+0000 7fdb7d5a7640 1 -- 172.21.15.37:0/1528272028 >> 172.21.15.37:0/1528272028 conn(0x7fdb780d2ec0 msgr2=0x7fdb780ce290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:30.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.235+0000 7fdb7d5a7640 1 -- 172.21.15.37:0/1528272028 shutdown_connections 2023-12-11T17:11:30.237 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.235+0000 7fdb7d5a7640 1 -- 172.21.15.37:0/1528272028 wait complete. 2023-12-11T17:11:30.256 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-11T17:11:30.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.482+0000 7f8cbab3c640 1 Processor -- start 2023-12-11T17:11:30.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.482+0000 7f8cbab3c640 1 -- start start 2023-12-11T17:11:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.484+0000 7f8cbab3c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cb41596a0 0x7f8cb406cca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.484+0000 7f8cbab3c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8cb40711c0 0x7f8cb406d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.484+0000 7f8cbab3c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cb4159a80 con 0x7f8cb40b1fd0 2023-12-11T17:11:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.484+0000 7f8cbab3c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cb40cd710 con 0x7f8cb40711c0 2023-12-11T17:11:30.485 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.484+0000 7f8cbab3c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb40ceb40 con 0x7f8cb41596a0 2023-12-11T17:11:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.484+0000 7f8cb88d8640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cb41596a0 0x7f8cb406cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.484+0000 7f8cb90d9640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f8cb40711c0 0x7f8cb406d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.485+0000 7f8cb88d8640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cb41596a0 0x7f8cb406cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3301/0 says I am v2:172.21.15.37:40398/0 (socket says 172.21.15.37:40398) 2023-12-11T17:11:30.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.485+0000 7f8cb88d8640 1 -- 172.21.15.37:0/22528120 learned_addr learned my addr 172.21.15.37:0/22528120 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.485+0000 7f8cb88d8640 1 -- 172.21.15.37:0/22528120 >> v2:172.21.15.151:3300/0 conn(0x7f8cb40711c0 msgr2=0x7f8cb406d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.485+0000 7f8cb88d8640 1 --2- 172.21.15.37:0/22528120 >> v2:172.21.15.151:3300/0 conn(0x7f8cb40711c0 0x7f8cb406d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.485+0000 7f8cb88d8640 1 -- 172.21.15.37:0/22528120 >> v1:172.21.15.151:6789/0 conn(0x7f8cb40b1fd0 legacy=0x7f8cb4070ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.486+0000 7f8cb88d8640 1 -- 172.21.15.37:0/22528120 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cb40cca90 con 0x7f8cb41596a0 2023-12-11T17:11:30.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.486+0000 7f8cb90d9640 1 --2- 172.21.15.37:0/22528120 >> v2:172.21.15.151:3300/0 conn(0x7f8cb40711c0 0x7f8cb406d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-11T17:11:30.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.487+0000 7f8cb88d8640 1 --2- 172.21.15.37:0/22528120 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cb41596a0 0x7f8cb406cca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009870 tx=0x7f8ca802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf54c16c4d7d0f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:30.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.487+0000 7f8cb37fe640 1 -- 172.21.15.37:0/22528120 <== mon.2 v2:172.21.15.151:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8030840 con 0x7f8cb41596a0 2023-12-11T17:11:30.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.487+0000 7f8cb37fe640 1 -- 172.21.15.37:0/22528120 <== mon.2 v2:172.21.15.151:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca80309a0 con 0x7f8cb41596a0 2023-12-11T17:11:30.488 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.487+0000 7f8cb37fe640 1 -- 172.21.15.37:0/22528120 <== mon.2 v2:172.21.15.151:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca8030d30 con 0x7f8cb41596a0 2023-12-11T17:11:30.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.488+0000 7f8cbab3c640 1 -- 172.21.15.37:0/22528120 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cb41596a0 msgr2=0x7f8cb406cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:30.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.488+0000 7f8cbab3c640 1 --2- 172.21.15.37:0/22528120 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cb41596a0 0x7f8cb406cca0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8009870 tx=0x7f8ca802b980 comp rx=0 tx=0).stop 2023-12-11T17:11:30.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.488+0000 7f8cbab3c640 1 -- 172.21.15.37:0/22528120 shutdown_connections 2023-12-11T17:11:30.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.488+0000 7f8cbab3c640 1 --2- 172.21.15.37:0/22528120 >> v2:172.21.15.151:3300/0 conn(0x7f8cb40711c0 0x7f8cb406d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:30.489 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.488+0000 7f8cbab3c640 1 --2- 172.21.15.37:0/22528120 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cb41596a0 0x7f8cb406cca0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:30.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.488+0000 7f8cbab3c640 1 -- 172.21.15.37:0/22528120 >> 172.21.15.37:0/22528120 conn(0x7f8cb40b0a90 msgr2=0x7f8cb40b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:30.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.488+0000 7f8cbab3c640 1 -- 172.21.15.37:0/22528120 shutdown_connections 2023-12-11T17:11:30.490 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.488+0000 7f8cbab3c640 1 -- 172.21.15.37:0/22528120 wait complete. 2023-12-11T17:11:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.490+0000 7f8cbab3c640 1 Processor -- start 2023-12-11T17:11:30.491 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.490+0000 7f8cbab3c640 1 -- start start 2023-12-11T17:11:30.492 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.491+0000 7f8cbab3c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cb40711c0 0x7f8cb415b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.491+0000 7f8cbab3c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cb40b1fd0 0x7f8cb40b2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.491+0000 7f8cbab3c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cb41596a0 0x7f8cb406d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.491+0000 7f8cbab3c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb4144dc0 con 0x7f8cb41596a0 2023-12-11T17:11:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.491+0000 7f8cbab3c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb40b3320 con 0x7f8cb40711c0 2023-12-11T17:11:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.491+0000 7f8cbab3c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cb40b3600 con 0x7f8cb40b1fd0 2023-12-11T17:11:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.492+0000 7f8cb90d9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cb41596a0 0x7f8cb406d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.492+0000 7f8cb90d9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cb41596a0 0x7f8cb406d180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57508/0 (socket says 172.21.15.37:57508) 2023-12-11T17:11:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.492+0000 7f8cb90d9640 1 -- 172.21.15.37:0/3372838837 learned_addr learned my addr 172.21.15.37:0/3372838837 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.492+0000 7f8cb88d8640 1 --2- 172.21.15.37:0/3372838837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cb40711c0 0x7f8cb415b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:30.493 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.492+0000 7f8cb3fff640 1 --2- 172.21.15.37:0/3372838837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cb40b1fd0 0x7f8cb40b2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.492+0000 7f8cb90d9640 1 -- 172.21.15.37:0/3372838837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cb40b1fd0 msgr2=0x7f8cb40b2a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.492+0000 7f8cb90d9640 1 --2- 172.21.15.37:0/3372838837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cb40b1fd0 0x7f8cb40b2a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.492+0000 7f8cb90d9640 1 -- 172.21.15.37:0/3372838837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cb40711c0 msgr2=0x7f8cb415b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.492+0000 7f8cb90d9640 1 --2- 172.21.15.37:0/3372838837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cb40711c0 0x7f8cb415b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.492+0000 7f8cb90d9640 1 -- 172.21.15.37:0/3372838837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac009a70 con 0x7f8cb41596a0 2023-12-11T17:11:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.492+0000 7f8cb88d8640 1 --2- 172.21.15.37:0/3372838837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cb40711c0 0x7f8cb415b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:11:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.493+0000 7f8cb90d9640 1 --2- 172.21.15.37:0/3372838837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cb41596a0 0x7f8cb406d180 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00efc0 tx=0x7f8cac009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.493+0000 7f8cb17fa640 1 -- 172.21.15.37:0/3372838837 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac009d70 con 0x7f8cb41596a0 2023-12-11T17:11:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.493+0000 7f8cb17fa640 1 -- 172.21.15.37:0/3372838837 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cac00f040 con 0x7f8cb41596a0 2023-12-11T17:11:30.495 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.493+0000 7f8cb17fa640 1 -- 172.21.15.37:0/3372838837 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cac003990 con 0x7f8cb41596a0 2023-12-11T17:11:30.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.493+0000 7f8cbab3c640 1 -- 172.21.15.37:0/3372838837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ca80094d0 con 0x7f8cb41596a0 2023-12-11T17:11:30.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.493+0000 7f8cbab3c640 1 -- 172.21.15.37:0/3372838837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cb40b3bc0 con 0x7f8cb41596a0 2023-12-11T17:11:30.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.494+0000 7f8cbab3c640 1 -- 172.21.15.37:0/3372838837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cb40745d0 con 0x7f8cb41596a0 2023-12-11T17:11:30.496 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.495+0000 7f8cb17fa640 1 -- 172.21.15.37:0/3372838837 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f8cac0144a0 con 0x7f8cb41596a0 2023-12-11T17:11:30.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.496+0000 7f8cb17fa640 1 --2- 172.21.15.37:0/3372838837 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8ca006ae40 0x7f8ca006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:30.497 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.496+0000 7f8cb17fa640 1 -- 172.21.15.37:0/3372838837 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f8cac08a3d0 con 0x7f8cb41596a0 2023-12-11T17:11:30.498 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.497+0000 7f8cb88d8640 1 --2- 172.21.15.37:0/3372838837 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8ca006ae40 0x7f8ca006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:30.499 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.498+0000 7f8cb88d8640 1 --2- 172.21.15.37:0/3372838837 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8ca006ae40 0x7f8ca006d300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8036000 tx=0x7f8ca803b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:30.501 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.501+0000 7f8cb17fa640 1 -- 172.21.15.37:0/3372838837 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f8cac055330 con 0x7f8cb41596a0 2023-12-11T17:11:30.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.694+0000 7f8cbab3c640 1 -- 172.21.15.37:0/3372838837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8cb4070e70 con 0x7f8cb41596a0 2023-12-11T17:11:30.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.697+0000 7f8cb17fa640 1 -- 172.21.15.37:0/3372838837 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+16774 (secure 0 0 0) 0x7f8cac058950 con 0x7f8cb41596a0 2023-12-11T17:11:30.698 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:11:30.698 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":39,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-11T17:11:27.696726+0000","last_up_change":"2023-12-11T17:09:37.390393+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:11:24.128757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-11T17:11:25.159839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists","up"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-11T17:11:30.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.699+0000 7f8cbab3c640 1 -- 172.21.15.37:0/3372838837 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8ca006ae40 msgr2=0x7f8ca006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:30.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.699+0000 7f8cbab3c640 1 --2- 172.21.15.37:0/3372838837 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8ca006ae40 0x7f8ca006d300 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f8ca8036000 tx=0x7f8ca803b040 comp rx=0 tx=0).stop 2023-12-11T17:11:30.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.700+0000 7f8cbab3c640 1 -- 172.21.15.37:0/3372838837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cb41596a0 msgr2=0x7f8cb406d180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:30.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.700+0000 7f8cbab3c640 1 --2- 172.21.15.37:0/3372838837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cb41596a0 0x7f8cb406d180 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f8cac00efc0 tx=0x7f8cac009f90 comp rx=0 tx=0).stop 2023-12-11T17:11:30.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.700+0000 7f8cbab3c640 1 -- 172.21.15.37:0/3372838837 shutdown_connections 2023-12-11T17:11:30.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.700+0000 7f8cbab3c640 1 --2- 172.21.15.37:0/3372838837 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f8ca006ae40 0x7f8ca006d300 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:30.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.700+0000 7f8cbab3c640 1 --2- 172.21.15.37:0/3372838837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8cb41596a0 0x7f8cb406d180 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:30.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.700+0000 7f8cbab3c640 1 --2- 172.21.15.37:0/3372838837 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f8cb40b1fd0 0x7f8cb40b2a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:30.701 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.700+0000 7f8cbab3c640 1 --2- 172.21.15.37:0/3372838837 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cb40711c0 0x7f8cb415b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:30.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.700+0000 7f8cbab3c640 1 -- 172.21.15.37:0/3372838837 >> 172.21.15.37:0/3372838837 conn(0x7f8cb40b0a90 msgr2=0x7f8cb40cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:30.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.700+0000 7f8cbab3c640 1 -- 172.21.15.37:0/3372838837 shutdown_connections 2023-12-11T17:11:30.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.700+0000 7f8cbab3c640 1 -- 172.21.15.37:0/3372838837 wait complete. 2023-12-11T17:11:30.721 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-11T17:11:30.722 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-11T17:11:30.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.921+0000 7f963d1a9640 1 Processor -- start 2023-12-11T17:11:30.922 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.921+0000 7f963d1a9640 1 -- start start 2023-12-11T17:11:30.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.923+0000 7f963d1a9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9638143e00 0x7f96380b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:30.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.923+0000 7f963d1a9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96380b3bb0 con 0x7f963806c410 2023-12-11T17:11:30.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.923+0000 7f963d1a9640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96381441e0 con 0x7f9638072180 2023-12-11T17:11:30.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.923+0000 7f963d1a9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9638072680 con 0x7f9638143e00 2023-12-11T17:11:30.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.923+0000 7f963759e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f963806c410 0x7f963815ecb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35004/0 (socket says 172.21.15.37:35004) 2023-12-11T17:11:30.924 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.923+0000 7f963759e640 1 -- 172.21.15.37:0/3112338205 learned_addr learned my addr 172.21.15.37:0/3112338205 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:30.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.923+0000 7f9636d9d640 1 --2- 172.21.15.37:0/3112338205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9638143e00 0x7f96380b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:30.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.924+0000 7f963659c640 1 -- 172.21.15.37:0/3112338205 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 993056531 0 0) 0x7f96380b3bb0 con 0x7f963806c410 2023-12-11T17:11:30.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.924+0000 7f963659c640 1 -- 172.21.15.37:0/3112338205 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9624003520 con 0x7f963806c410 2023-12-11T17:11:30.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.924+0000 7f963659c640 1 -- 172.21.15.37:0/3112338205 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3533986396 0 0) 0x7f9624003520 con 0x7f963806c410 2023-12-11T17:11:30.925 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.924+0000 7f963659c640 1 -- 172.21.15.37:0/3112338205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9638143e00 msgr2=0x7f96380b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:30.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.924+0000 7f963659c640 1 --2- 172.21.15.37:0/3112338205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9638143e00 0x7f96380b4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:30.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.924+0000 7f963659c640 1 -- 172.21.15.37:0/3112338205 >> v1:172.21.15.151:6789/0 conn(0x7f9638072180 legacy=0x7f96380b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:30.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.924+0000 7f963659c640 1 -- 172.21.15.37:0/3112338205 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96380b1e30 con 0x7f963806c410 2023-12-11T17:11:30.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.924+0000 7f963659c640 1 -- 172.21.15.37:0/3112338205 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f96300019f0 con 0x7f963806c410 2023-12-11T17:11:30.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.924+0000 7f963659c640 1 -- 172.21.15.37:0/3112338205 >> v1:172.21.15.37:6789/0 conn(0x7f963806c410 legacy=0x7f963815ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:30.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.924+0000 7f963659c640 1 --2- 172.21.15.37:0/3112338205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96240039a0 0x7f9624003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:30.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.924+0000 7f963659c640 1 --2- 172.21.15.37:0/3112338205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9638143e00 0x7f96240047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:30.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.924+0000 7f963659c640 1 --2- 172.21.15.37:0/3112338205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9624004d00 0x7f9624005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:30.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.924+0000 7f963659c640 1 -- 172.21.15.37:0/3112338205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9638072680 con 0x7f96240039a0 2023-12-11T17:11:30.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.924+0000 7f963659c640 1 -- 172.21.15.37:0/3112338205 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962400ba30 con 0x7f9624004d00 2023-12-11T17:11:30.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.924+0000 7f963659c640 1 -- 172.21.15.37:0/3112338205 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f962400bbf0 con 0x7f9638143e00 2023-12-11T17:11:30.926 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.924+0000 7f9636d9d640 1 --2- 172.21.15.37:0/3112338205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96240039a0 0x7f9624003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:30.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.925+0000 7f9636d9d640 1 -- 172.21.15.37:0/3112338205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9638143e00 msgr2=0x7f96240047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:30.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.925+0000 7f962ffff640 1 --2- 172.21.15.37:0/3112338205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9638143e00 0x7f96240047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:30.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.925+0000 7f963759e640 1 --2- 172.21.15.37:0/3112338205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9624004d00 0x7f9624005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:30.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.925+0000 7f9636d9d640 1 --2- 172.21.15.37:0/3112338205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9638143e00 0x7f96240047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:30.928 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.925+0000 7f9636d9d640 1 -- 172.21.15.37:0/3112338205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9624004d00 msgr2=0x7f9624005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:30.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.925+0000 7f9636d9d640 1 --2- 172.21.15.37:0/3112338205 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9624004d00 0x7f9624005180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:30.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.925+0000 7f9636d9d640 1 -- 172.21.15.37:0/3112338205 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9624003520 con 0x7f96240039a0 2023-12-11T17:11:30.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.925+0000 7f962ffff640 1 --2- 172.21.15.37:0/3112338205 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9638143e00 0x7f96240047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:30.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.926+0000 7f9636d9d640 1 --2- 172.21.15.37:0/3112338205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96240039a0 0x7f9624003dc0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9628009a90 tx=0x7f96240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b60e6ee602f19c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:30.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.926+0000 7f963659c640 1 -- 172.21.15.37:0/3112338205 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962802c680 con 0x7f96240039a0 2023-12-11T17:11:30.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.926+0000 7f963659c640 1 -- 172.21.15.37:0/3112338205 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f962802c7e0 con 0x7f96240039a0 2023-12-11T17:11:30.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.926+0000 7f963659c640 1 -- 172.21.15.37:0/3112338205 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f962802cb70 con 0x7f96240039a0 2023-12-11T17:11:30.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.927+0000 7f963d1a9640 1 -- 172.21.15.37:0/3112338205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96240039a0 msgr2=0x7f9624003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:30.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.927+0000 7f963d1a9640 1 --2- 172.21.15.37:0/3112338205 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f96240039a0 0x7f9624003dc0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f9628009a90 tx=0x7f96240057f0 comp rx=0 tx=0).stop 2023-12-11T17:11:30.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.927+0000 7f963759e640 1 -- 172.21.15.37:0/3112338205 reap_dead start 2023-12-11T17:11:30.929 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.927+0000 7f963d1a9640 1 -- 172.21.15.37:0/3112338205 shutdown_connections 2023-12-11T17:11:30.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.927+0000 7f963d1a9640 1 -- 172.21.15.37:0/3112338205 >> 172.21.15.37:0/3112338205 conn(0x7f96380b0a90 msgr2=0x7f96380b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:30.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.927+0000 7f963d1a9640 1 -- 172.21.15.37:0/3112338205 shutdown_connections 2023-12-11T17:11:30.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.927+0000 7f963d1a9640 1 -- 172.21.15.37:0/3112338205 wait complete. 2023-12-11T17:11:30.930 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.929+0000 7f963d1a9640 1 Processor -- start 2023-12-11T17:11:30.931 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.929+0000 7f963d1a9640 1 -- start start 2023-12-11T17:11:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.930+0000 7f963d1a9640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96240039a0 0x7f9638137860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.930+0000 7f963d1a9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9638136970 0x7f963815a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.930+0000 7f963d1a9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96380cd6a0 0x7f96380cdb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.930+0000 7f963d1a9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9638138350 con 0x7f9638136970 2023-12-11T17:11:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.930+0000 7f963d1a9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96380ce060 con 0x7f96380cd6a0 2023-12-11T17:11:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.930+0000 7f963d1a9640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f963815acf0 con 0x7f96240039a0 2023-12-11T17:11:30.933 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.930+0000 7f962ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9638136970 0x7f963815a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.930+0000 7f962ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9638136970 0x7f963815a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57516/0 (socket says 172.21.15.37:57516) 2023-12-11T17:11:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.930+0000 7f962ffff640 1 -- 172.21.15.37:0/1412455255 learned_addr learned my addr 172.21.15.37:0/1412455255 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.931+0000 7f9636d9d640 1 --2- 172.21.15.37:0/1412455255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96240039a0 0x7f9638137860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.931+0000 7f963759e640 1 --2- 172.21.15.37:0/1412455255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96380cd6a0 0x7f96380cdb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.931+0000 7f962ffff640 1 -- 172.21.15.37:0/1412455255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96240039a0 msgr2=0x7f9638137860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.931+0000 7f962ffff640 1 --2- 172.21.15.37:0/1412455255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96240039a0 0x7f9638137860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.931+0000 7f962ffff640 1 -- 172.21.15.37:0/1412455255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96380cd6a0 msgr2=0x7f96380cdb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.931+0000 7f962ffff640 1 --2- 172.21.15.37:0/1412455255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96380cd6a0 0x7f96380cdb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.931+0000 7f962ffff640 1 -- 172.21.15.37:0/1412455255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9638138560 con 0x7f9638136970 2023-12-11T17:11:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.931+0000 7f963759e640 1 --2- 172.21.15.37:0/1412455255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96380cd6a0 0x7f96380cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.931+0000 7f962ffff640 1 --2- 172.21.15.37:0/1412455255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9638136970 0x7f963815a7b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f962000d7d0 tx=0x7f962000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.931+0000 7f962f7fe640 1 -- 172.21.15.37:0/1412455255 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9620017070 con 0x7f9638136970 2023-12-11T17:11:30.934 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.931+0000 7f962f7fe640 1 -- 172.21.15.37:0/1412455255 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9620005070 con 0x7f9638136970 2023-12-11T17:11:30.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.931+0000 7f962f7fe640 1 -- 172.21.15.37:0/1412455255 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9620005440 con 0x7f9638136970 2023-12-11T17:11:30.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.931+0000 7f963d1a9640 1 -- 172.21.15.37:0/1412455255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9638138840 con 0x7f9638136970 2023-12-11T17:11:30.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.932+0000 7f963d1a9640 1 -- 172.21.15.37:0/1412455255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9638138e00 con 0x7f9638136970 2023-12-11T17:11:30.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.933+0000 7f963d1a9640 1 -- 172.21.15.37:0/1412455255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f963806d900 con 0x7f9638136970 2023-12-11T17:11:30.935 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.934+0000 7f962f7fe640 1 -- 172.21.15.37:0/1412455255 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9620007030 con 0x7f9638136970 2023-12-11T17:11:30.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.935+0000 7f962f7fe640 1 --2- 172.21.15.37:0/1412455255 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f961806ae70 0x7f961806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:30.936 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.935+0000 7f962f7fe640 1 -- 172.21.15.37:0/1412455255 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f9620088f30 con 0x7f9638136970 2023-12-11T17:11:30.937 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.936+0000 7f9636d9d640 1 --2- 172.21.15.37:0/1412455255 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f961806ae70 0x7f961806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:30.938 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.937+0000 7f9636d9d640 1 --2- 172.21.15.37:0/1412455255 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f961806ae70 0x7f961806d330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9628036000 tx=0x7f9628030000 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:30.939 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:30.939+0000 7f962f7fe640 1 -- 172.21.15.37:0/1412455255 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9620053ea0 con 0x7f9638136970 2023-12-11T17:11:31.131 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.130+0000 7f963d1a9640 1 -- 172.21.15.37:0/1412455255 --> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f96380b23f0 con 0x7f961806ae70 2023-12-11T17:11:31.158 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.157+0000 7f962f7fe640 1 -- 172.21.15.37:0/1412455255 <== mgr.4111 v2:172.21.15.151:6832/3081040918 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287076 (secure 0 0 0) 0x7f96280040c0 con 0x7f961806ae70 2023-12-11T17:11:31.163 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:11:31.164 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-12-11T17:11:31.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.163+0000 7f963d1a9640 1 -- 172.21.15.37:0/1412455255 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f961806ae70 msgr2=0x7f961806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:31.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.163+0000 7f963d1a9640 1 --2- 172.21.15.37:0/1412455255 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f961806ae70 0x7f961806d330 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9628036000 tx=0x7f9628030000 comp rx=0 tx=0).stop 2023-12-11T17:11:31.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.163+0000 7f963d1a9640 1 -- 172.21.15.37:0/1412455255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9638136970 msgr2=0x7f963815a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:31.166 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.163+0000 7f963d1a9640 1 --2- 172.21.15.37:0/1412455255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9638136970 0x7f963815a7b0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f962000d7d0 tx=0x7f962000dc90 comp rx=0 tx=0).stop 2023-12-11T17:11:31.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.163+0000 7f963d1a9640 1 -- 172.21.15.37:0/1412455255 shutdown_connections 2023-12-11T17:11:31.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.164+0000 7f963d1a9640 1 --2- 172.21.15.37:0/1412455255 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f961806ae70 0x7f961806d330 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:31.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.164+0000 7f963d1a9640 1 --2- 172.21.15.37:0/1412455255 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f96380cd6a0 0x7f96380cdb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:31.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.164+0000 7f963d1a9640 1 --2- 172.21.15.37:0/1412455255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9638136970 0x7f963815a7b0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:31.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.164+0000 7f963d1a9640 1 --2- 172.21.15.37:0/1412455255 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f96240039a0 0x7f9638137860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:31.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.164+0000 7f963d1a9640 1 -- 172.21.15.37:0/1412455255 >> 172.21.15.37:0/1412455255 conn(0x7f96380b0a90 msgr2=0x7f9638070690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:31.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.164+0000 7f963d1a9640 1 -- 172.21.15.37:0/1412455255 shutdown_connections 2023-12-11T17:11:31.167 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.164+0000 7f963d1a9640 1 -- 172.21.15.37:0/1412455255 wait complete. 2023-12-11T17:11:31.186 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2023-12-11T17:11:30.380854+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220788,"kb_used_data":4604,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753932,"statfs":{"total":773094113280,"available":772868026368,"internally_reserved":0,"allocated":4714496,"data_stored":2671572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.735074"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.896852+0000","last_change":"2023-12-11T17:11:26.722699+0000","last_active":"2023-12-11T17:11:27.896852+0000","last_peered":"2023-12-11T17:11:27.896852+0000","last_clean":"2023-12-11T17:11:27.896852+0000","last_became_active":"2023-12-11T17:11:26.722157+0000","last_became_peered":"2023-12-11T17:11:26.722157+0000","last_unstale":"2023-12-11T17:11:27.896852+0000","last_undegraded":"2023-12-11T17:11:27.896852+0000","last_fullsized":"2023-12-11T17:11:27.896852+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:06:08.503480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.896848+0000","last_change":"2023-12-11T17:11:26.706126+0000","last_active":"2023-12-11T17:11:27.896848+0000","last_peered":"2023-12-11T17:11:27.896848+0000","last_clean":"2023-12-11T17:11:27.896848+0000","last_became_active":"2023-12-11T17:11:26.705842+0000","last_became_peered":"2023-12-11T17:11:26.705842+0000","last_unstale":"2023-12-11T17:11:27.896848+0000","last_undegraded":"2023-12-11T17:11:27.896848+0000","last_fullsized":"2023-12-11T17:11:27.896848+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:45:05.383435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.729533+0000","last_change":"2023-12-11T17:11:26.727043+0000","last_active":"2023-12-11T17:11:26.729533+0000","last_peered":"2023-12-11T17:11:26.729533+0000","last_clean":"2023-12-11T17:11:26.729533+0000","last_became_active":"2023-12-11T17:11:26.726757+0000","last_became_peered":"2023-12-11T17:11:26.726757+0000","last_unstale":"2023-12-11T17:11:26.729533+0000","last_undegraded":"2023-12-11T17:11:26.729533+0000","last_fullsized":"2023-12-11T17:11:26.729533+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:20:28.132731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.722884+0000","last_change":"2023-12-11T17:11:26.715845+0000","last_active":"2023-12-11T17:11:26.722884+0000","last_peered":"2023-12-11T17:11:26.722884+0000","last_clean":"2023-12-11T17:11:26.722884+0000","last_became_active":"2023-12-11T17:11:26.714906+0000","last_became_peered":"2023-12-11T17:11:26.714906+0000","last_unstale":"2023-12-11T17:11:26.722884+0000","last_undegraded":"2023-12-11T17:11:26.722884+0000","last_fullsized":"2023-12-11T17:11:26.722884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:10:51.250661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.721023+0000","last_change":"2023-12-11T17:11:26.713131+0000","last_active":"2023-12-11T17:11:26.721023+0000","last_peered":"2023-12-11T17:11:26.721023+0000","last_clean":"2023-12-11T17:11:26.721023+0000","last_became_active":"2023-12-11T17:11:26.712619+0000","last_became_peered":"2023-12-11T17:11:26.712619+0000","last_unstale":"2023-12-11T17:11:26.721023+0000","last_undegraded":"2023-12-11T17:11:26.721023+0000","last_fullsized":"2023-12-11T17:11:26.721023+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:39:02.907182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.897085+0000","last_change":"2023-12-11T17:11:26.719084+0000","last_active":"2023-12-11T17:11:27.897085+0000","last_peered":"2023-12-11T17:11:27.897085+0000","last_clean":"2023-12-11T17:11:27.897085+0000","last_became_active":"2023-12-11T17:11:26.718771+0000","last_became_peered":"2023-12-11T17:11:26.718771+0000","last_unstale":"2023-12-11T17:11:27.897085+0000","last_undegraded":"2023-12-11T17:11:27.897085+0000","last_fullsized":"2023-12-11T17:11:27.897085+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:33:21.785462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.850641+0000","last_change":"2023-12-11T17:11:26.728711+0000","last_active":"2023-12-11T17:11:27.850641+0000","last_peered":"2023-12-11T17:11:27.850641+0000","last_clean":"2023-12-11T17:11:27.850641+0000","last_became_active":"2023-12-11T17:11:26.727998+0000","last_became_peered":"2023-12-11T17:11:26.727998+0000","last_unstale":"2023-12-11T17:11:27.850641+0000","last_undegraded":"2023-12-11T17:11:27.850641+0000","last_fullsized":"2023-12-11T17:11:27.850641+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:24:29.357095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.895086+0000","last_change":"2023-12-11T17:11:26.707787+0000","last_active":"2023-12-11T17:11:27.895086+0000","last_peered":"2023-12-11T17:11:27.895086+0000","last_clean":"2023-12-11T17:11:27.895086+0000","last_became_active":"2023-12-11T17:11:26.707488+0000","last_became_peered":"2023-12-11T17:11:26.707488+0000","last_unstale":"2023-12-11T17:11:27.895086+0000","last_undegraded":"2023-12-11T17:11:27.895086+0000","last_fullsized":"2023-12-11T17:11:27.895086+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:24:29.357095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.729456+0000","last_change":"2023-12-11T17:11:26.725811+0000","last_active":"2023-12-11T17:11:26.729456+0000","last_peered":"2023-12-11T17:11:26.729456+0000","last_clean":"2023-12-11T17:11:26.729456+0000","last_became_active":"2023-12-11T17:11:26.725557+0000","last_became_peered":"2023-12-11T17:11:26.725557+0000","last_unstale":"2023-12-11T17:11:26.729456+0000","last_undegraded":"2023-12-11T17:11:26.729456+0000","last_fullsized":"2023-12-11T17:11:26.729456+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:20:43.624803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.851919+0000","last_change":"2023-12-11T17:11:26.712468+0000","last_active":"2023-12-11T17:11:27.851919+0000","last_peered":"2023-12-11T17:11:27.851919+0000","last_clean":"2023-12-11T17:11:27.851919+0000","last_became_active":"2023-12-11T17:11:26.711680+0000","last_became_peered":"2023-12-11T17:11:26.711680+0000","last_unstale":"2023-12-11T17:11:27.851919+0000","last_undegraded":"2023-12-11T17:11:27.851919+0000","last_fullsized":"2023-12-11T17:11:27.851919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:06:08.503480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.851628+0000","last_change":"2023-12-11T17:11:26.722879+0000","last_active":"2023-12-11T17:11:27.851628+0000","last_peered":"2023-12-11T17:11:27.851628+0000","last_clean":"2023-12-11T17:11:27.851628+0000","last_became_active":"2023-12-11T17:11:26.716927+0000","last_became_peered":"2023-12-11T17:11:26.716927+0000","last_unstale":"2023-12-11T17:11:27.851628+0000","last_undegraded":"2023-12-11T17:11:27.851628+0000","last_fullsized":"2023-12-11T17:11:27.851628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:33:47.471050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.725176+0000","last_change":"2023-12-11T17:11:26.711132+0000","last_active":"2023-12-11T17:11:26.725176+0000","last_peered":"2023-12-11T17:11:26.725176+0000","last_clean":"2023-12-11T17:11:26.725176+0000","last_became_active":"2023-12-11T17:11:26.710802+0000","last_became_peered":"2023-12-11T17:11:26.710802+0000","last_unstale":"2023-12-11T17:11:26.725176+0000","last_undegraded":"2023-12-11T17:11:26.725176+0000","last_fullsized":"2023-12-11T17:11:26.725176+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:26:57.215725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.850915+0000","last_change":"2023-12-11T17:11:26.712632+0000","last_active":"2023-12-11T17:11:27.850915+0000","last_peered":"2023-12-11T17:11:27.850915+0000","last_clean":"2023-12-11T17:11:27.850915+0000","last_became_active":"2023-12-11T17:11:26.711581+0000","last_became_peered":"2023-12-11T17:11:26.711581+0000","last_unstale":"2023-12-11T17:11:27.850915+0000","last_undegraded":"2023-12-11T17:11:27.850915+0000","last_fullsized":"2023-12-11T17:11:27.850915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:44:24.531680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.716887+0000","last_change":"2023-12-11T17:11:26.711347+0000","last_active":"2023-12-11T17:11:26.716887+0000","last_peered":"2023-12-11T17:11:26.716887+0000","last_clean":"2023-12-11T17:11:26.716887+0000","last_became_active":"2023-12-11T17:11:26.711064+0000","last_became_peered":"2023-12-11T17:11:26.711064+0000","last_unstale":"2023-12-11T17:11:26.716887+0000","last_undegraded":"2023-12-11T17:11:26.716887+0000","last_fullsized":"2023-12-11T17:11:26.716887+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:44:17.226174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.850776+0000","last_change":"2023-12-11T17:11:26.715238+0000","last_active":"2023-12-11T17:11:27.850776+0000","last_peered":"2023-12-11T17:11:27.850776+0000","last_clean":"2023-12-11T17:11:27.850776+0000","last_became_active":"2023-12-11T17:11:26.714894+0000","last_became_peered":"2023-12-11T17:11:26.714894+0000","last_unstale":"2023-12-11T17:11:27.850776+0000","last_undegraded":"2023-12-11T17:11:27.850776+0000","last_fullsized":"2023-12-11T17:11:27.850776+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:42:11.341500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.725634+0000","last_change":"2023-12-11T17:11:26.722552+0000","last_active":"2023-12-11T17:11:26.725634+0000","last_peered":"2023-12-11T17:11:26.725634+0000","last_clean":"2023-12-11T17:11:26.725634+0000","last_became_active":"2023-12-11T17:11:26.721182+0000","last_became_peered":"2023-12-11T17:11:26.721182+0000","last_unstale":"2023-12-11T17:11:26.725634+0000","last_undegraded":"2023-12-11T17:11:26.725634+0000","last_fullsized":"2023-12-11T17:11:26.725634+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:44:32.834609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.735288+0000","last_change":"2023-12-11T17:11:26.732559+0000","last_active":"2023-12-11T17:11:26.735288+0000","last_peered":"2023-12-11T17:11:26.735288+0000","last_clean":"2023-12-11T17:11:26.735288+0000","last_became_active":"2023-12-11T17:11:26.732260+0000","last_became_peered":"2023-12-11T17:11:26.732260+0000","last_unstale":"2023-12-11T17:11:26.735288+0000","last_undegraded":"2023-12-11T17:11:26.735288+0000","last_fullsized":"2023-12-11T17:11:26.735288+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:23:34.611727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.716184+0000","last_change":"2023-12-11T17:11:26.720851+0000","last_active":"2023-12-11T17:11:27.716184+0000","last_peered":"2023-12-11T17:11:27.716184+0000","last_clean":"2023-12-11T17:11:27.716184+0000","last_became_active":"2023-12-11T17:11:26.717617+0000","last_became_peered":"2023-12-11T17:11:26.717617+0000","last_unstale":"2023-12-11T17:11:27.716184+0000","last_undegraded":"2023-12-11T17:11:27.716184+0000","last_fullsized":"2023-12-11T17:11:27.716184+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:30:32.031696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.723043+0000","last_change":"2023-12-11T17:11:26.715900+0000","last_active":"2023-12-11T17:11:26.723043+0000","last_peered":"2023-12-11T17:11:26.723043+0000","last_clean":"2023-12-11T17:11:26.723043+0000","last_became_active":"2023-12-11T17:11:26.715617+0000","last_became_peered":"2023-12-11T17:11:26.715617+0000","last_unstale":"2023-12-11T17:11:26.723043+0000","last_undegraded":"2023-12-11T17:11:26.723043+0000","last_fullsized":"2023-12-11T17:11:26.723043+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:47:11.799659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.715643+0000","last_change":"2023-12-11T17:11:26.718015+0000","last_active":"2023-12-11T17:11:27.715643+0000","last_peered":"2023-12-11T17:11:27.715643+0000","last_clean":"2023-12-11T17:11:27.715643+0000","last_became_active":"2023-12-11T17:11:26.717670+0000","last_became_peered":"2023-12-11T17:11:26.717670+0000","last_unstale":"2023-12-11T17:11:27.715643+0000","last_undegraded":"2023-12-11T17:11:27.715643+0000","last_fullsized":"2023-12-11T17:11:27.715643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:20:43.624803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.852079+0000","last_change":"2023-12-11T17:11:26.714593+0000","last_active":"2023-12-11T17:11:27.852079+0000","last_peered":"2023-12-11T17:11:27.852079+0000","last_clean":"2023-12-11T17:11:27.852079+0000","last_became_active":"2023-12-11T17:11:26.714331+0000","last_became_peered":"2023-12-11T17:11:26.714331+0000","last_unstale":"2023-12-11T17:11:27.852079+0000","last_undegraded":"2023-12-11T17:11:27.852079+0000","last_fullsized":"2023-12-11T17:11:27.852079+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:35:11.833704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.729748+0000","last_change":"2023-12-11T17:11:26.725547+0000","last_active":"2023-12-11T17:11:26.729748+0000","last_peered":"2023-12-11T17:11:26.729748+0000","last_clean":"2023-12-11T17:11:26.729748+0000","last_became_active":"2023-12-11T17:11:26.725247+0000","last_became_peered":"2023-12-11T17:11:26.725247+0000","last_unstale":"2023-12-11T17:11:26.729748+0000","last_undegraded":"2023-12-11T17:11:26.729748+0000","last_fullsized":"2023-12-11T17:11:26.729748+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:26:02.339725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.724529+0000","last_change":"2023-12-11T17:11:26.713258+0000","last_active":"2023-12-11T17:11:26.724529+0000","last_peered":"2023-12-11T17:11:26.724529+0000","last_clean":"2023-12-11T17:11:26.724529+0000","last_became_active":"2023-12-11T17:11:26.712973+0000","last_became_peered":"2023-12-11T17:11:26.712973+0000","last_unstale":"2023-12-11T17:11:26.724529+0000","last_undegraded":"2023-12-11T17:11:26.724529+0000","last_fullsized":"2023-12-11T17:11:26.724529+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:44:17.226174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.719732+0000","last_change":"2023-12-11T17:11:26.713973+0000","last_active":"2023-12-11T17:11:26.719732+0000","last_peered":"2023-12-11T17:11:26.719732+0000","last_clean":"2023-12-11T17:11:26.719732+0000","last_became_active":"2023-12-11T17:11:26.711496+0000","last_became_peered":"2023-12-11T17:11:26.711496+0000","last_unstale":"2023-12-11T17:11:26.719732+0000","last_undegraded":"2023-12-11T17:11:26.719732+0000","last_fullsized":"2023-12-11T17:11:26.719732+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:28:06.534444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.716267+0000","last_change":"2023-12-11T17:11:26.714885+0000","last_active":"2023-12-11T17:11:27.716267+0000","last_peered":"2023-12-11T17:11:27.716267+0000","last_clean":"2023-12-11T17:11:27.716267+0000","last_became_active":"2023-12-11T17:11:26.713575+0000","last_became_peered":"2023-12-11T17:11:26.713575+0000","last_unstale":"2023-12-11T17:11:27.716267+0000","last_undegraded":"2023-12-11T17:11:27.716267+0000","last_fullsized":"2023-12-11T17:11:27.716267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:23:34.611727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.897685+0000","last_change":"2023-12-11T17:11:26.728949+0000","last_active":"2023-12-11T17:11:27.897685+0000","last_peered":"2023-12-11T17:11:27.897685+0000","last_clean":"2023-12-11T17:11:27.897685+0000","last_became_active":"2023-12-11T17:11:26.728288+0000","last_became_peered":"2023-12-11T17:11:26.728288+0000","last_unstale":"2023-12-11T17:11:27.897685+0000","last_undegraded":"2023-12-11T17:11:27.897685+0000","last_fullsized":"2023-12-11T17:11:27.897685+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:14:56.584307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.715787+0000","last_change":"2023-12-11T17:11:26.695102+0000","last_active":"2023-12-11T17:11:27.715787+0000","last_peered":"2023-12-11T17:11:27.715787+0000","last_clean":"2023-12-11T17:11:27.715787+0000","last_became_active":"2023-12-11T17:11:26.693989+0000","last_became_peered":"2023-12-11T17:11:26.693989+0000","last_unstale":"2023-12-11T17:11:27.715787+0000","last_undegraded":"2023-12-11T17:11:27.715787+0000","last_fullsized":"2023-12-11T17:11:27.715787+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:43:13.982753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.851359+0000","last_change":"2023-12-11T17:11:26.714247+0000","last_active":"2023-12-11T17:11:27.851359+0000","last_peered":"2023-12-11T17:11:27.851359+0000","last_clean":"2023-12-11T17:11:27.851359+0000","last_became_active":"2023-12-11T17:11:26.713922+0000","last_became_peered":"2023-12-11T17:11:26.713922+0000","last_unstale":"2023-12-11T17:11:27.851359+0000","last_undegraded":"2023-12-11T17:11:27.851359+0000","last_fullsized":"2023-12-11T17:11:27.851359+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T17:30:17.644157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.716182+0000","last_change":"2023-12-11T17:11:26.713086+0000","last_active":"2023-12-11T17:11:27.716182+0000","last_peered":"2023-12-11T17:11:27.716182+0000","last_clean":"2023-12-11T17:11:27.716182+0000","last_became_active":"2023-12-11T17:11:26.712792+0000","last_became_peered":"2023-12-11T17:11:26.712792+0000","last_unstale":"2023-12-11T17:11:27.716182+0000","last_undegraded":"2023-12-11T17:11:27.716182+0000","last_fullsized":"2023-12-11T17:11:27.716182+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:19:15.838711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.714660+0000","last_change":"2023-12-11T17:11:26.691641+0000","last_active":"2023-12-11T17:11:27.714660+0000","last_peered":"2023-12-11T17:11:27.714660+0000","last_clean":"2023-12-11T17:11:27.714660+0000","last_became_active":"2023-12-11T17:11:26.690912+0000","last_became_peered":"2023-12-11T17:11:26.690912+0000","last_unstale":"2023-12-11T17:11:27.714660+0000","last_undegraded":"2023-12-11T17:11:27.714660+0000","last_fullsized":"2023-12-11T17:11:27.714660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T17:15:22.647845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.727139+0000","last_change":"2023-12-11T17:11:26.723280+0000","last_active":"2023-12-11T17:11:26.727139+0000","last_peered":"2023-12-11T17:11:26.727139+0000","last_clean":"2023-12-11T17:11:26.727139+0000","last_became_active":"2023-12-11T17:11:26.722932+0000","last_became_peered":"2023-12-11T17:11:26.722932+0000","last_unstale":"2023-12-11T17:11:26.727139+0000","last_undegraded":"2023-12-11T17:11:26.727139+0000","last_fullsized":"2023-12-11T17:11:26.727139+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:09:27.333941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.895587+0000","last_change":"2023-12-11T17:11:26.712943+0000","last_active":"2023-12-11T17:11:27.895587+0000","last_peered":"2023-12-11T17:11:27.895587+0000","last_clean":"2023-12-11T17:11:27.895587+0000","last_became_active":"2023-12-11T17:11:26.712645+0000","last_became_peered":"2023-12-11T17:11:26.712645+0000","last_unstale":"2023-12-11T17:11:27.895587+0000","last_undegraded":"2023-12-11T17:11:27.895587+0000","last_fullsized":"2023-12-11T17:11:27.895587+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:24:40.668465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.732190+0000","last_change":"2023-12-11T17:11:26.729701+0000","last_active":"2023-12-11T17:11:26.732190+0000","last_peered":"2023-12-11T17:11:26.732190+0000","last_clean":"2023-12-11T17:11:26.732190+0000","last_became_active":"2023-12-11T17:11:26.729441+0000","last_became_peered":"2023-12-11T17:11:26.729441+0000","last_unstale":"2023-12-11T17:11:26.732190+0000","last_undegraded":"2023-12-11T17:11:26.732190+0000","last_fullsized":"2023-12-11T17:11:26.732190+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:47:40.305060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.716146+0000","last_change":"2023-12-11T17:11:25.682109+0000","last_active":"2023-12-11T17:11:27.716146+0000","last_peered":"2023-12-11T17:11:27.716146+0000","last_clean":"2023-12-11T17:11:27.716146+0000","last_became_active":"2023-12-11T17:11:25.681636+0000","last_became_peered":"2023-12-11T17:11:25.681636+0000","last_unstale":"2023-12-11T17:11:27.716146+0000","last_undegraded":"2023-12-11T17:11:27.716146+0000","last_fullsized":"2023-12-11T17:11:27.716146+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:09:26.321412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.897789+0000","last_change":"2023-12-11T17:11:26.729263+0000","last_active":"2023-12-11T17:11:27.897789+0000","last_peered":"2023-12-11T17:11:27.897789+0000","last_clean":"2023-12-11T17:11:27.897789+0000","last_became_active":"2023-12-11T17:11:26.728998+0000","last_became_peered":"2023-12-11T17:11:26.728998+0000","last_unstale":"2023-12-11T17:11:27.897789+0000","last_undegraded":"2023-12-11T17:11:27.897789+0000","last_fullsized":"2023-12-11T17:11:27.897789+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:24:54.112967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.732147+0000","last_change":"2023-12-11T17:11:25.681530+0000","last_active":"2023-12-11T17:11:26.732147+0000","last_peered":"2023-12-11T17:11:26.732147+0000","last_clean":"2023-12-11T17:11:26.732147+0000","last_became_active":"2023-12-11T17:11:25.680265+0000","last_became_peered":"2023-12-11T17:11:25.680265+0000","last_unstale":"2023-12-11T17:11:26.732147+0000","last_undegraded":"2023-12-11T17:11:26.732147+0000","last_fullsized":"2023-12-11T17:11:26.732147+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:43:12.970223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.717099+0000","last_change":"2023-12-11T17:11:26.713254+0000","last_active":"2023-12-11T17:11:26.717099+0000","last_peered":"2023-12-11T17:11:26.717099+0000","last_clean":"2023-12-11T17:11:26.717099+0000","last_became_active":"2023-12-11T17:11:26.712972+0000","last_became_peered":"2023-12-11T17:11:26.712972+0000","last_unstale":"2023-12-11T17:11:26.717099+0000","last_undegraded":"2023-12-11T17:11:26.717099+0000","last_fullsized":"2023-12-11T17:11:26.717099+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:20:28.132731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.897997+0000","last_change":"2023-12-11T17:11:25.684696+0000","last_active":"2023-12-11T17:11:27.897997+0000","last_peered":"2023-12-11T17:11:27.897997+0000","last_clean":"2023-12-11T17:11:27.897997+0000","last_became_active":"2023-12-11T17:11:25.684387+0000","last_became_peered":"2023-12-11T17:11:25.684387+0000","last_unstale":"2023-12-11T17:11:27.897997+0000","last_undegraded":"2023-12-11T17:11:27.897997+0000","last_fullsized":"2023-12-11T17:11:27.897997+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:43:12.970223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.896837+0000","last_change":"2023-12-11T17:11:26.698454+0000","last_active":"2023-12-11T17:11:27.896837+0000","last_peered":"2023-12-11T17:11:27.896837+0000","last_clean":"2023-12-11T17:11:27.896837+0000","last_became_active":"2023-12-11T17:11:26.695184+0000","last_became_peered":"2023-12-11T17:11:26.695184+0000","last_unstale":"2023-12-11T17:11:27.896837+0000","last_undegraded":"2023-12-11T17:11:27.896837+0000","last_fullsized":"2023-12-11T17:11:27.896837+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:55:43.681557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.731682+0000","last_change":"2023-12-11T17:11:25.686771+0000","last_active":"2023-12-11T17:11:26.731682+0000","last_peered":"2023-12-11T17:11:26.731682+0000","last_clean":"2023-12-11T17:11:26.731682+0000","last_became_active":"2023-12-11T17:11:25.686323+0000","last_became_peered":"2023-12-11T17:11:25.686323+0000","last_unstale":"2023-12-11T17:11:26.731682+0000","last_undegraded":"2023-12-11T17:11:26.731682+0000","last_fullsized":"2023-12-11T17:11:26.731682+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:43:12.970223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.725561+0000","last_change":"2023-12-11T17:11:26.716070+0000","last_active":"2023-12-11T17:11:26.725561+0000","last_peered":"2023-12-11T17:11:26.725561+0000","last_clean":"2023-12-11T17:11:26.725561+0000","last_became_active":"2023-12-11T17:11:26.715769+0000","last_became_peered":"2023-12-11T17:11:26.715769+0000","last_unstale":"2023-12-11T17:11:26.725561+0000","last_undegraded":"2023-12-11T17:11:26.725561+0000","last_fullsized":"2023-12-11T17:11:26.725561+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:09:27.333941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.851493+0000","last_change":"2023-12-11T17:11:25.682920+0000","last_active":"2023-12-11T17:11:27.851493+0000","last_peered":"2023-12-11T17:11:27.851493+0000","last_clean":"2023-12-11T17:11:27.851493+0000","last_became_active":"2023-12-11T17:11:25.682613+0000","last_became_peered":"2023-12-11T17:11:25.682613+0000","last_unstale":"2023-12-11T17:11:27.851493+0000","last_undegraded":"2023-12-11T17:11:27.851493+0000","last_fullsized":"2023-12-11T17:11:27.851493+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:24:53.100438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.851118+0000","last_change":"2023-12-11T17:11:26.727390+0000","last_active":"2023-12-11T17:11:27.851118+0000","last_peered":"2023-12-11T17:11:27.851118+0000","last_clean":"2023-12-11T17:11:27.851118+0000","last_became_active":"2023-12-11T17:11:26.727113+0000","last_became_peered":"2023-12-11T17:11:26.727113+0000","last_unstale":"2023-12-11T17:11:27.851118+0000","last_undegraded":"2023-12-11T17:11:27.851118+0000","last_fullsized":"2023-12-11T17:11:27.851118+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:30.919622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.731164+0000","last_change":"2023-12-11T17:11:25.681312+0000","last_active":"2023-12-11T17:11:26.731164+0000","last_peered":"2023-12-11T17:11:26.731164+0000","last_clean":"2023-12-11T17:11:26.731164+0000","last_became_active":"2023-12-11T17:11:25.681055+0000","last_became_peered":"2023-12-11T17:11:25.681055+0000","last_unstale":"2023-12-11T17:11:26.731164+0000","last_undegraded":"2023-12-11T17:11:26.731164+0000","last_fullsized":"2023-12-11T17:11:26.731164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:43:12.970223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.727337+0000","last_change":"2023-12-11T17:11:26.720221+0000","last_active":"2023-12-11T17:11:26.727337+0000","last_peered":"2023-12-11T17:11:26.727337+0000","last_clean":"2023-12-11T17:11:26.727337+0000","last_became_active":"2023-12-11T17:11:26.719974+0000","last_became_peered":"2023-12-11T17:11:26.719974+0000","last_unstale":"2023-12-11T17:11:26.727337+0000","last_undegraded":"2023-12-11T17:11:26.727337+0000","last_fullsized":"2023-12-11T17:11:26.727337+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:26:57.215725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.897296+0000","last_change":"2023-12-11T17:11:25.690595+0000","last_active":"2023-12-11T17:11:27.897296+0000","last_peered":"2023-12-11T17:11:27.897296+0000","last_clean":"2023-12-11T17:11:27.897296+0000","last_became_active":"2023-12-11T17:11:25.690367+0000","last_became_peered":"2023-12-11T17:11:25.690367+0000","last_unstale":"2023-12-11T17:11:27.897296+0000","last_undegraded":"2023-12-11T17:11:27.897296+0000","last_fullsized":"2023-12-11T17:11:27.897296+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:20:42.612274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.896110+0000","last_change":"2023-12-11T17:11:26.710087+0000","last_active":"2023-12-11T17:11:27.896110+0000","last_peered":"2023-12-11T17:11:27.896110+0000","last_clean":"2023-12-11T17:11:27.896110+0000","last_became_active":"2023-12-11T17:11:26.709783+0000","last_became_peered":"2023-12-11T17:11:26.709783+0000","last_unstale":"2023-12-11T17:11:27.896110+0000","last_undegraded":"2023-12-11T17:11:27.896110+0000","last_fullsized":"2023-12-11T17:11:27.896110+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:41:35.312401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.714526+0000","last_change":"2023-12-11T17:11:25.688266+0000","last_active":"2023-12-11T17:11:26.714526+0000","last_peered":"2023-12-11T17:11:26.714526+0000","last_clean":"2023-12-11T17:11:26.714526+0000","last_became_active":"2023-12-11T17:11:25.687981+0000","last_became_peered":"2023-12-11T17:11:25.687981+0000","last_unstale":"2023-12-11T17:11:26.714526+0000","last_undegraded":"2023-12-11T17:11:26.714526+0000","last_fullsized":"2023-12-11T17:11:26.714526+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:19:14.826181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.723014+0000","last_change":"2023-12-11T17:11:26.715248+0000","last_active":"2023-12-11T17:11:26.723014+0000","last_peered":"2023-12-11T17:11:26.723014+0000","last_clean":"2023-12-11T17:11:26.723014+0000","last_became_active":"2023-12-11T17:11:26.714526+0000","last_became_peered":"2023-12-11T17:11:26.714526+0000","last_unstale":"2023-12-11T17:11:26.723014+0000","last_undegraded":"2023-12-11T17:11:26.723014+0000","last_fullsized":"2023-12-11T17:11:26.723014+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:43:16.878860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.897075+0000","last_change":"2023-12-11T17:11:25.676791+0000","last_active":"2023-12-11T17:11:27.897075+0000","last_peered":"2023-12-11T17:11:27.897075+0000","last_clean":"2023-12-11T17:11:27.897075+0000","last_became_active":"2023-12-11T17:11:25.676487+0000","last_became_peered":"2023-12-11T17:11:25.676487+0000","last_unstale":"2023-12-11T17:11:27.897075+0000","last_undegraded":"2023-12-11T17:11:27.897075+0000","last_fullsized":"2023-12-11T17:11:27.897075+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:46:18.699778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.727598+0000","last_change":"2023-12-11T17:11:26.723208+0000","last_active":"2023-12-11T17:11:26.727598+0000","last_peered":"2023-12-11T17:11:26.727598+0000","last_clean":"2023-12-11T17:11:26.727598+0000","last_became_active":"2023-12-11T17:11:26.720648+0000","last_became_peered":"2023-12-11T17:11:26.720648+0000","last_unstale":"2023-12-11T17:11:26.727598+0000","last_undegraded":"2023-12-11T17:11:26.727598+0000","last_fullsized":"2023-12-11T17:11:26.727598+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:30:32.031696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.851922+0000","last_change":"2023-12-11T17:11:25.689076+0000","last_active":"2023-12-11T17:11:27.851922+0000","last_peered":"2023-12-11T17:11:27.851922+0000","last_clean":"2023-12-11T17:11:27.851922+0000","last_became_active":"2023-12-11T17:11:25.687416+0000","last_became_peered":"2023-12-11T17:11:25.687416+0000","last_unstale":"2023-12-11T17:11:27.851922+0000","last_undegraded":"2023-12-11T17:11:27.851922+0000","last_fullsized":"2023-12-11T17:11:27.851922+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:46:18.699778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.726247+0000","last_change":"2023-12-11T17:11:26.714328+0000","last_active":"2023-12-11T17:11:26.726247+0000","last_peered":"2023-12-11T17:11:26.726247+0000","last_clean":"2023-12-11T17:11:26.726247+0000","last_became_active":"2023-12-11T17:11:26.714057+0000","last_became_peered":"2023-12-11T17:11:26.714057+0000","last_unstale":"2023-12-11T17:11:26.726247+0000","last_undegraded":"2023-12-11T17:11:26.726247+0000","last_fullsized":"2023-12-11T17:11:26.726247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:44:17.226174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.851913+0000","last_change":"2023-12-11T17:11:25.689841+0000","last_active":"2023-12-11T17:11:27.851913+0000","last_peered":"2023-12-11T17:11:27.851913+0000","last_clean":"2023-12-11T17:11:27.851913+0000","last_became_active":"2023-12-11T17:11:25.689562+0000","last_became_peered":"2023-12-11T17:11:25.689562+0000","last_unstale":"2023-12-11T17:11:27.851913+0000","last_undegraded":"2023-12-11T17:11:27.851913+0000","last_fullsized":"2023-12-11T17:11:27.851913+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:12:37.999620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.730842+0000","last_change":"2023-12-11T17:11:26.724038+0000","last_active":"2023-12-11T17:11:26.730842+0000","last_peered":"2023-12-11T17:11:26.730842+0000","last_clean":"2023-12-11T17:11:26.730842+0000","last_became_active":"2023-12-11T17:11:26.723730+0000","last_became_peered":"2023-12-11T17:11:26.723730+0000","last_unstale":"2023-12-11T17:11:26.730842+0000","last_undegraded":"2023-12-11T17:11:26.730842+0000","last_fullsized":"2023-12-11T17:11:26.730842+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:09:27.333941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.896391+0000","last_change":"2023-12-11T17:11:25.682816+0000","last_active":"2023-12-11T17:11:27.896391+0000","last_peered":"2023-12-11T17:11:27.896391+0000","last_clean":"2023-12-11T17:11:27.896391+0000","last_became_active":"2023-12-11T17:11:25.682559+0000","last_became_peered":"2023-12-11T17:11:25.682559+0000","last_unstale":"2023-12-11T17:11:27.896391+0000","last_undegraded":"2023-12-11T17:11:27.896391+0000","last_fullsized":"2023-12-11T17:11:27.896391+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:14:55.571777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.726739+0000","last_change":"2023-12-11T17:11:26.717222+0000","last_active":"2023-12-11T17:11:26.726739+0000","last_peered":"2023-12-11T17:11:26.726739+0000","last_clean":"2023-12-11T17:11:26.726739+0000","last_became_active":"2023-12-11T17:11:26.716868+0000","last_became_peered":"2023-12-11T17:11:26.716868+0000","last_unstale":"2023-12-11T17:11:26.726739+0000","last_undegraded":"2023-12-11T17:11:26.726739+0000","last_fullsized":"2023-12-11T17:11:26.726739+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:44:32.834609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.896489+0000","last_change":"2023-12-11T17:11:25.685811+0000","last_active":"2023-12-11T17:11:27.896489+0000","last_peered":"2023-12-11T17:11:27.896489+0000","last_clean":"2023-12-11T17:11:27.896489+0000","last_became_active":"2023-12-11T17:11:25.685412+0000","last_became_peered":"2023-12-11T17:11:25.685412+0000","last_unstale":"2023-12-11T17:11:27.896489+0000","last_undegraded":"2023-12-11T17:11:27.896489+0000","last_fullsized":"2023-12-11T17:11:27.896489+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:24:53.100438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.895771+0000","last_change":"2023-12-11T17:11:26.713206+0000","last_active":"2023-12-11T17:11:27.895771+0000","last_peered":"2023-12-11T17:11:27.895771+0000","last_clean":"2023-12-11T17:11:27.895771+0000","last_became_active":"2023-12-11T17:11:26.712899+0000","last_became_peered":"2023-12-11T17:11:26.712899+0000","last_unstale":"2023-12-11T17:11:27.895771+0000","last_undegraded":"2023-12-11T17:11:27.895771+0000","last_fullsized":"2023-12-11T17:11:27.895771+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:42:11.341500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.897344+0000","last_change":"2023-12-11T17:11:25.684512+0000","last_active":"2023-12-11T17:11:27.897344+0000","last_peered":"2023-12-11T17:11:27.897344+0000","last_clean":"2023-12-11T17:11:27.897344+0000","last_became_active":"2023-12-11T17:11:25.683900+0000","last_became_peered":"2023-12-11T17:11:25.683900+0000","last_unstale":"2023-12-11T17:11:27.897344+0000","last_undegraded":"2023-12-11T17:11:27.897344+0000","last_fullsized":"2023-12-11T17:11:27.897344+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:19:14.826181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.728040+0000","last_change":"2023-12-11T17:11:26.724419+0000","last_active":"2023-12-11T17:11:26.728040+0000","last_peered":"2023-12-11T17:11:26.728040+0000","last_clean":"2023-12-11T17:11:26.728040+0000","last_became_active":"2023-12-11T17:11:26.723917+0000","last_became_peered":"2023-12-11T17:11:26.723917+0000","last_unstale":"2023-12-11T17:11:26.728040+0000","last_undegraded":"2023-12-11T17:11:26.728040+0000","last_fullsized":"2023-12-11T17:11:26.728040+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:20:28.132731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.713337+0000","last_change":"2023-12-11T17:11:25.680602+0000","last_active":"2023-12-11T17:11:27.713337+0000","last_peered":"2023-12-11T17:11:27.713337+0000","last_clean":"2023-12-11T17:11:27.713337+0000","last_became_active":"2023-12-11T17:11:25.680288+0000","last_became_peered":"2023-12-11T17:11:25.680288+0000","last_unstale":"2023-12-11T17:11:27.713337+0000","last_undegraded":"2023-12-11T17:11:27.713337+0000","last_fullsized":"2023-12-11T17:11:27.713337+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:12:48.992756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.896245+0000","last_change":"2023-12-11T17:11:26.709840+0000","last_active":"2023-12-11T17:11:27.896245+0000","last_peered":"2023-12-11T17:11:27.896245+0000","last_clean":"2023-12-11T17:11:27.896245+0000","last_became_active":"2023-12-11T17:11:26.709386+0000","last_became_peered":"2023-12-11T17:11:26.709386+0000","last_unstale":"2023-12-11T17:11:27.896245+0000","last_undegraded":"2023-12-11T17:11:27.896245+0000","last_fullsized":"2023-12-11T17:11:27.896245+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:30.919622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.731509+0000","last_change":"2023-12-11T17:11:25.681586+0000","last_active":"2023-12-11T17:11:26.731509+0000","last_peered":"2023-12-11T17:11:26.731509+0000","last_clean":"2023-12-11T17:11:26.731509+0000","last_became_active":"2023-12-11T17:11:25.680658+0000","last_became_peered":"2023-12-11T17:11:25.680658+0000","last_unstale":"2023-12-11T17:11:26.731509+0000","last_undegraded":"2023-12-11T17:11:26.731509+0000","last_fullsized":"2023-12-11T17:11:26.731509+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:20:42.612274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.896199+0000","last_change":"2023-12-11T17:11:26.695102+0000","last_active":"2023-12-11T17:11:27.896199+0000","last_peered":"2023-12-11T17:11:27.896199+0000","last_clean":"2023-12-11T17:11:27.896199+0000","last_became_active":"2023-12-11T17:11:26.694487+0000","last_became_peered":"2023-12-11T17:11:26.694487+0000","last_unstale":"2023-12-11T17:11:27.896199+0000","last_undegraded":"2023-12-11T17:11:27.896199+0000","last_fullsized":"2023-12-11T17:11:27.896199+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:44:24.531680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.851671+0000","last_change":"2023-12-11T17:11:25.687522+0000","last_active":"2023-12-11T17:11:27.851671+0000","last_peered":"2023-12-11T17:11:27.851671+0000","last_clean":"2023-12-11T17:11:27.851671+0000","last_became_active":"2023-12-11T17:11:25.687083+0000","last_became_peered":"2023-12-11T17:11:25.687083+0000","last_unstale":"2023-12-11T17:11:27.851671+0000","last_undegraded":"2023-12-11T17:11:27.851671+0000","last_fullsized":"2023-12-11T17:11:27.851671+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:35:25.704016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.851810+0000","last_change":"2023-12-11T17:11:26.727488+0000","last_active":"2023-12-11T17:11:27.851810+0000","last_peered":"2023-12-11T17:11:27.851810+0000","last_clean":"2023-12-11T17:11:27.851810+0000","last_became_active":"2023-12-11T17:11:26.727182+0000","last_became_peered":"2023-12-11T17:11:26.727182+0000","last_unstale":"2023-12-11T17:11:27.851810+0000","last_undegraded":"2023-12-11T17:11:27.851810+0000","last_fullsized":"2023-12-11T17:11:27.851810+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:45:05.383435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.734230+0000","last_change":"2023-12-11T17:11:25.689884+0000","last_active":"2023-12-11T17:11:26.734230+0000","last_peered":"2023-12-11T17:11:26.734230+0000","last_clean":"2023-12-11T17:11:26.734230+0000","last_became_active":"2023-12-11T17:11:25.689616+0000","last_became_peered":"2023-12-11T17:11:25.689616+0000","last_unstale":"2023-12-11T17:11:26.734230+0000","last_undegraded":"2023-12-11T17:11:26.734230+0000","last_fullsized":"2023-12-11T17:11:26.734230+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:30:31.019166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.720567+0000","last_change":"2023-12-11T17:11:26.717782+0000","last_active":"2023-12-11T17:11:26.720567+0000","last_peered":"2023-12-11T17:11:26.720567+0000","last_clean":"2023-12-11T17:11:26.720567+0000","last_became_active":"2023-12-11T17:11:26.717464+0000","last_became_peered":"2023-12-11T17:11:26.717464+0000","last_unstale":"2023-12-11T17:11:26.720567+0000","last_undegraded":"2023-12-11T17:11:26.720567+0000","last_fullsized":"2023-12-11T17:11:26.720567+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T17:15:22.647845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.725389+0000","last_change":"2023-12-11T17:11:25.677121+0000","last_active":"2023-12-11T17:11:26.725389+0000","last_peered":"2023-12-11T17:11:26.725389+0000","last_clean":"2023-12-11T17:11:26.725389+0000","last_became_active":"2023-12-11T17:11:25.676809+0000","last_became_peered":"2023-12-11T17:11:25.676809+0000","last_unstale":"2023-12-11T17:11:26.725389+0000","last_undegraded":"2023-12-11T17:11:26.725389+0000","last_fullsized":"2023-12-11T17:11:26.725389+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:05:50.230664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.708221+0000","last_change":"2023-12-11T17:11:26.702504+0000","last_active":"2023-12-11T17:11:26.708221+0000","last_peered":"2023-12-11T17:11:26.708221+0000","last_clean":"2023-12-11T17:11:26.708221+0000","last_became_active":"2023-12-11T17:11:26.702193+0000","last_became_peered":"2023-12-11T17:11:26.702193+0000","last_unstale":"2023-12-11T17:11:26.708221+0000","last_undegraded":"2023-12-11T17:11:26.708221+0000","last_fullsized":"2023-12-11T17:11:26.708221+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:10:24.933247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.897135+0000","last_change":"2023-12-11T17:11:25.682408+0000","last_active":"2023-12-11T17:11:27.897135+0000","last_peered":"2023-12-11T17:11:27.897135+0000","last_clean":"2023-12-11T17:11:27.897135+0000","last_became_active":"2023-12-11T17:11:25.682135+0000","last_became_peered":"2023-12-11T17:11:25.682135+0000","last_unstale":"2023-12-11T17:11:27.897135+0000","last_undegraded":"2023-12-11T17:11:27.897135+0000","last_fullsized":"2023-12-11T17:11:27.897135+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T17:15:21.635315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.728084+0000","last_change":"2023-12-11T17:11:26.725460+0000","last_active":"2023-12-11T17:11:26.728084+0000","last_peered":"2023-12-11T17:11:26.728084+0000","last_clean":"2023-12-11T17:11:26.728084+0000","last_became_active":"2023-12-11T17:11:26.724612+0000","last_became_peered":"2023-12-11T17:11:26.724612+0000","last_unstale":"2023-12-11T17:11:26.728084+0000","last_undegraded":"2023-12-11T17:11:26.728084+0000","last_fullsized":"2023-12-11T17:11:26.728084+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:19:15.838711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.730698+0000","last_change":"2023-12-11T17:11:25.675366+0000","last_active":"2023-12-11T17:11:26.730698+0000","last_peered":"2023-12-11T17:11:26.730698+0000","last_clean":"2023-12-11T17:11:26.730698+0000","last_became_active":"2023-12-11T17:11:25.673658+0000","last_became_peered":"2023-12-11T17:11:25.673658+0000","last_unstale":"2023-12-11T17:11:26.730698+0000","last_undegraded":"2023-12-11T17:11:26.730698+0000","last_fullsized":"2023-12-11T17:11:26.730698+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:23:12.681818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.712268+0000","last_change":"2023-12-11T17:11:26.708315+0000","last_active":"2023-12-11T17:11:26.712268+0000","last_peered":"2023-12-11T17:11:26.712268+0000","last_clean":"2023-12-11T17:11:26.712268+0000","last_became_active":"2023-12-11T17:11:26.708033+0000","last_became_peered":"2023-12-11T17:11:26.708033+0000","last_unstale":"2023-12-11T17:11:26.712268+0000","last_undegraded":"2023-12-11T17:11:26.712268+0000","last_fullsized":"2023-12-11T17:11:26.712268+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T17:15:22.647845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.679142+0000","last_change":"2023-12-11T17:11:25.684451+0000","last_active":"2023-12-11T17:11:26.679142+0000","last_peered":"2023-12-11T17:11:26.679142+0000","last_clean":"2023-12-11T17:11:26.679142+0000","last_became_active":"2023-12-11T17:11:25.682930+0000","last_became_peered":"2023-12-11T17:11:25.682930+0000","last_unstale":"2023-12-11T17:11:26.679142+0000","last_undegraded":"2023-12-11T17:11:26.679142+0000","last_fullsized":"2023-12-11T17:11:26.679142+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:22:50.769156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.850907+0000","last_change":"2023-12-11T17:11:26.712126+0000","last_active":"2023-12-11T17:11:27.850907+0000","last_peered":"2023-12-11T17:11:27.850907+0000","last_clean":"2023-12-11T17:11:27.850907+0000","last_became_active":"2023-12-11T17:11:26.711523+0000","last_became_peered":"2023-12-11T17:11:26.711523+0000","last_unstale":"2023-12-11T17:11:27.850907+0000","last_undegraded":"2023-12-11T17:11:27.850907+0000","last_fullsized":"2023-12-11T17:11:27.850907+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:41:35.312401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.701336+0000","last_change":"2023-12-11T17:11:25.679783+0000","last_active":"2023-12-11T17:11:26.701336+0000","last_peered":"2023-12-11T17:11:26.701336+0000","last_clean":"2023-12-11T17:11:26.701336+0000","last_became_active":"2023-12-11T17:11:25.679449+0000","last_became_peered":"2023-12-11T17:11:25.679449+0000","last_unstale":"2023-12-11T17:11:26.701336+0000","last_undegraded":"2023-12-11T17:11:26.701336+0000","last_fullsized":"2023-12-11T17:11:26.701336+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T17:15:21.635315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.896382+0000","last_change":"2023-12-11T17:11:26.709987+0000","last_active":"2023-12-11T17:11:27.896382+0000","last_peered":"2023-12-11T17:11:27.896382+0000","last_clean":"2023-12-11T17:11:27.896382+0000","last_became_active":"2023-12-11T17:11:26.709532+0000","last_became_peered":"2023-12-11T17:11:26.709532+0000","last_unstale":"2023-12-11T17:11:27.896382+0000","last_undegraded":"2023-12-11T17:11:27.896382+0000","last_fullsized":"2023-12-11T17:11:27.896382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T17:30:17.644157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.679834+0000","last_change":"2023-12-11T17:11:25.672420+0000","last_active":"2023-12-11T17:11:26.679834+0000","last_peered":"2023-12-11T17:11:26.679834+0000","last_clean":"2023-12-11T17:11:26.679834+0000","last_became_active":"2023-12-11T17:11:25.672095+0000","last_became_peered":"2023-12-11T17:11:25.672095+0000","last_unstale":"2023-12-11T17:11:26.679834+0000","last_undegraded":"2023-12-11T17:11:26.679834+0000","last_fullsized":"2023-12-11T17:11:26.679834+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:47:08.927941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.897298+0000","last_change":"2023-12-11T17:11:26.716913+0000","last_active":"2023-12-11T17:11:27.897298+0000","last_peered":"2023-12-11T17:11:27.897298+0000","last_clean":"2023-12-11T17:11:27.897298+0000","last_became_active":"2023-12-11T17:11:26.716638+0000","last_became_peered":"2023-12-11T17:11:26.716638+0000","last_unstale":"2023-12-11T17:11:27.897298+0000","last_undegraded":"2023-12-11T17:11:27.897298+0000","last_fullsized":"2023-12-11T17:11:27.897298+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:35:26.716545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.851878+0000","last_change":"2023-12-11T17:11:25.687364+0000","last_active":"2023-12-11T17:11:27.851878+0000","last_peered":"2023-12-11T17:11:27.851878+0000","last_clean":"2023-12-11T17:11:27.851878+0000","last_became_active":"2023-12-11T17:11:25.686669+0000","last_became_peered":"2023-12-11T17:11:25.686669+0000","last_unstale":"2023-12-11T17:11:27.851878+0000","last_undegraded":"2023-12-11T17:11:27.851878+0000","last_fullsized":"2023-12-11T17:11:27.851878+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:14:55.571777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.727970+0000","last_change":"2023-12-11T17:11:26.723887+0000","last_active":"2023-12-11T17:11:26.727970+0000","last_peered":"2023-12-11T17:11:26.727970+0000","last_clean":"2023-12-11T17:11:26.727970+0000","last_became_active":"2023-12-11T17:11:26.723589+0000","last_became_peered":"2023-12-11T17:11:26.723589+0000","last_unstale":"2023-12-11T17:11:26.727970+0000","last_undegraded":"2023-12-11T17:11:26.727970+0000","last_fullsized":"2023-12-11T17:11:26.727970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:35:26.716545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.681351+0000","last_change":"2023-12-11T17:11:25.689254+0000","last_active":"2023-12-11T17:11:26.681351+0000","last_peered":"2023-12-11T17:11:26.681351+0000","last_clean":"2023-12-11T17:11:26.681351+0000","last_became_active":"2023-12-11T17:11:25.689058+0000","last_became_peered":"2023-12-11T17:11:25.689058+0000","last_unstale":"2023-12-11T17:11:26.681351+0000","last_undegraded":"2023-12-11T17:11:26.681351+0000","last_fullsized":"2023-12-11T17:11:26.681351+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:00:06.681773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.896848+0000","last_change":"2023-12-11T17:11:26.713896+0000","last_active":"2023-12-11T17:11:27.896848+0000","last_peered":"2023-12-11T17:11:27.896848+0000","last_clean":"2023-12-11T17:11:27.896848+0000","last_became_active":"2023-12-11T17:11:26.713591+0000","last_became_peered":"2023-12-11T17:11:26.713591+0000","last_unstale":"2023-12-11T17:11:27.896848+0000","last_undegraded":"2023-12-11T17:11:27.896848+0000","last_fullsized":"2023-12-11T17:11:27.896848+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:33:47.471050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.703038+0000","last_change":"2023-12-11T17:11:25.681014+0000","last_active":"2023-12-11T17:11:26.703038+0000","last_peered":"2023-12-11T17:11:26.703038+0000","last_clean":"2023-12-11T17:11:26.703038+0000","last_became_active":"2023-12-11T17:11:25.680711+0000","last_became_peered":"2023-12-11T17:11:25.680711+0000","last_unstale":"2023-12-11T17:11:26.703038+0000","last_undegraded":"2023-12-11T17:11:26.703038+0000","last_fullsized":"2023-12-11T17:11:26.703038+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:30:31.019166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.727343+0000","last_change":"2023-12-11T17:11:26.720619+0000","last_active":"2023-12-11T17:11:26.727343+0000","last_peered":"2023-12-11T17:11:26.727343+0000","last_clean":"2023-12-11T17:11:26.727343+0000","last_became_active":"2023-12-11T17:11:26.720264+0000","last_became_peered":"2023-12-11T17:11:26.720264+0000","last_unstale":"2023-12-11T17:11:26.727343+0000","last_undegraded":"2023-12-11T17:11:26.727343+0000","last_fullsized":"2023-12-11T17:11:26.727343+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:26:02.339725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.702850+0000","last_change":"2023-12-11T17:11:25.681604+0000","last_active":"2023-12-11T17:11:26.702850+0000","last_peered":"2023-12-11T17:11:26.702850+0000","last_clean":"2023-12-11T17:11:26.702850+0000","last_became_active":"2023-12-11T17:11:25.680648+0000","last_became_peered":"2023-12-11T17:11:25.680648+0000","last_unstale":"2023-12-11T17:11:26.702850+0000","last_undegraded":"2023-12-11T17:11:26.702850+0000","last_fullsized":"2023-12-11T17:11:26.702850+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:19:14.826181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.895820+0000","last_change":"2023-12-11T17:11:26.705750+0000","last_active":"2023-12-11T17:11:27.895820+0000","last_peered":"2023-12-11T17:11:27.895820+0000","last_clean":"2023-12-11T17:11:27.895820+0000","last_became_active":"2023-12-11T17:11:26.705414+0000","last_became_peered":"2023-12-11T17:11:26.705414+0000","last_unstale":"2023-12-11T17:11:27.895820+0000","last_undegraded":"2023-12-11T17:11:27.895820+0000","last_fullsized":"2023-12-11T17:11:27.895820+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:47:40.305060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.715969+0000","last_change":"2023-12-11T17:11:25.682555+0000","last_active":"2023-12-11T17:11:27.715969+0000","last_peered":"2023-12-11T17:11:27.715969+0000","last_clean":"2023-12-11T17:11:27.715969+0000","last_became_active":"2023-12-11T17:11:25.682195+0000","last_became_peered":"2023-12-11T17:11:25.682195+0000","last_unstale":"2023-12-11T17:11:27.715969+0000","last_undegraded":"2023-12-11T17:11:27.715969+0000","last_fullsized":"2023-12-11T17:11:27.715969+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:20:27.120201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.727259+0000","last_change":"2023-12-11T17:11:26.720169+0000","last_active":"2023-12-11T17:11:26.727259+0000","last_peered":"2023-12-11T17:11:26.727259+0000","last_clean":"2023-12-11T17:11:26.727259+0000","last_became_active":"2023-12-11T17:11:26.719593+0000","last_became_peered":"2023-12-11T17:11:26.719593+0000","last_unstale":"2023-12-11T17:11:26.727259+0000","last_undegraded":"2023-12-11T17:11:26.727259+0000","last_fullsized":"2023-12-11T17:11:26.727259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:44:32.834609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.713616+0000","last_change":"2023-12-11T17:11:25.684634+0000","last_active":"2023-12-11T17:11:26.713616+0000","last_peered":"2023-12-11T17:11:26.713616+0000","last_clean":"2023-12-11T17:11:26.713616+0000","last_became_active":"2023-12-11T17:11:25.683902+0000","last_became_peered":"2023-12-11T17:11:25.683902+0000","last_unstale":"2023-12-11T17:11:26.713616+0000","last_undegraded":"2023-12-11T17:11:26.713616+0000","last_fullsized":"2023-12-11T17:11:26.713616+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:20:42.612274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.725785+0000","last_change":"2023-12-11T17:11:26.720468+0000","last_active":"2023-12-11T17:11:26.725785+0000","last_peered":"2023-12-11T17:11:26.725785+0000","last_clean":"2023-12-11T17:11:26.725785+0000","last_became_active":"2023-12-11T17:11:26.720147+0000","last_became_peered":"2023-12-11T17:11:26.720147+0000","last_unstale":"2023-12-11T17:11:26.725785+0000","last_undegraded":"2023-12-11T17:11:26.725785+0000","last_fullsized":"2023-12-11T17:11:26.725785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:24:40.668465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.895529+0000","last_change":"2023-12-11T17:11:25.680109+0000","last_active":"2023-12-11T17:11:27.895529+0000","last_peered":"2023-12-11T17:11:27.895529+0000","last_clean":"2023-12-11T17:11:27.895529+0000","last_became_active":"2023-12-11T17:11:25.679825+0000","last_became_peered":"2023-12-11T17:11:25.679825+0000","last_unstale":"2023-12-11T17:11:27.895529+0000","last_undegraded":"2023-12-11T17:11:27.895529+0000","last_fullsized":"2023-12-11T17:11:27.895529+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:35:25.704016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.851471+0000","last_change":"2023-12-11T17:11:26.715881+0000","last_active":"2023-12-11T17:11:27.851471+0000","last_peered":"2023-12-11T17:11:27.851471+0000","last_clean":"2023-12-11T17:11:27.851471+0000","last_became_active":"2023-12-11T17:11:26.715618+0000","last_became_peered":"2023-12-11T17:11:26.715618+0000","last_unstale":"2023-12-11T17:11:27.851471+0000","last_undegraded":"2023-12-11T17:11:27.851471+0000","last_fullsized":"2023-12-11T17:11:27.851471+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:55:43.681557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.708369+0000","last_change":"2023-12-11T17:11:25.681625+0000","last_active":"2023-12-11T17:11:26.708369+0000","last_peered":"2023-12-11T17:11:26.708369+0000","last_clean":"2023-12-11T17:11:26.708369+0000","last_became_active":"2023-12-11T17:11:25.681136+0000","last_became_peered":"2023-12-11T17:11:25.681136+0000","last_unstale":"2023-12-11T17:11:26.708369+0000","last_undegraded":"2023-12-11T17:11:26.708369+0000","last_fullsized":"2023-12-11T17:11:26.708369+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:33:20.772932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-11T17:11:25.670329+0000","last_change":"2023-12-11T17:09:40.320298+0000","last_active":"2023-12-11T17:11:25.670329+0000","last_peered":"2023-12-11T17:11:25.670329+0000","last_clean":"2023-12-11T17:11:25.670329+0000","last_became_active":"2023-12-11T17:09:40.318118+0000","last_became_peered":"2023-12-11T17:09:40.318118+0000","last_unstale":"2023-12-11T17:11:25.670329+0000","last_undegraded":"2023-12-11T17:11:25.670329+0000","last_fullsized":"2023-12-11T17:11:25.670329+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:38.641841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:38.641841+0000","last_clean_scrub_stamp":"2023-12-11T17:09:38.641841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:36:05.856847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1015808,"data_stored":768602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.88},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.92100000000000004}]},{"osd":1,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.321}]},{"osd":2,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.4780000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.98499999999999999}]},{"osd":3,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.488,"5min":2.488,"15min":2.488},"last":1.0680000000000001}]},{"osd":4,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.5840000000000001,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":1.2549999999999999}]},{"osd":5,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":1.206,"5min":1.206,"15min":1.206},"max":{"1min":3.3410000000000002,"5min":3.3410000000000002,"15min":3.3410000000000002},"last":1.5740000000000001}]},{"osd":6,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"min":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"max":{"1min":2.2690000000000001,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"min":{"1min":1.222,"5min":1.222,"15min":1.222},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.6859999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542169,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":192531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.873},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.389}]},{"osd":1,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.7929999999999999}]},{"osd":2,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.5509999999999999}]},{"osd":3,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.0129999999999999}]},{"osd":4,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.518}]},{"osd":5,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.49},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":1.288,"5min":1.288,"15min":1.288},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":1.6519999999999999}]},{"osd":7,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.869},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"min":{"1min":1.139,"5min":1.139,"15min":1.139},"max":{"1min":2.871,"5min":2.871,"15min":2.871},"last":1.7629999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":185441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 17:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.139}]},{"osd":1,"last update":"Mon Dec 11 17:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1.393},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.413}]},{"osd":2,"last update":"Mon Dec 11 17:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.3919999999999999,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.2709999999999999}]},{"osd":3,"last update":"Mon Dec 11 17:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.034},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":3.133,"5min":3.133,"15min":3.133},"last":0.85499999999999998}]},{"osd":4,"last update":"Mon Dec 11 17:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.353}]},{"osd":6,"last update":"Mon Dec 11 17:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":3.6429999999999998,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.9630000000000001,"5min":2.9630000000000001,"15min":2.9630000000000001},"last":1.218}]},{"osd":7,"last update":"Mon Dec 11 17:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":3.274,"5min":3.274,"15min":3.274},"last":1.526}]}]},{"osd":4,"up_from":14,"seq":60129542169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":421888,"data_stored":178234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.6850000000000001}]},{"osd":1,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":1.117},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.621}]},{"osd":2,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.7150000000000001},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":1.4850000000000001}]},{"osd":3,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.655}]},{"osd":5,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.768},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.0700000000000001}]},{"osd":6,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.5860000000000001}]},{"osd":7,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.2370000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.353},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.528}]}]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":462848,"data_stored":193595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.6339999999999999,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":0.871},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.3300000000000001}]},{"osd":1,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":3.1120000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.6749999999999998,"5min":2.6749999999999998,"15min":2.6749999999999998},"last":0.76400000000000001}]},{"osd":2,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.595}]},{"osd":4,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.8090000000000002,"5min":2.8090000000000002,"15min":2.8090000000000002},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.516,"5min":1.516,"15min":1.516},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.512}]},{"osd":5,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":3.4889999999999999,"5min":3.4889999999999999,"15min":3.4889999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":1.5600000000000001}]},{"osd":6,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.5859999999999999,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":1.4419999999999999}]},{"osd":7,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.8759999999999999,"5min":2.8759999999999999,"15min":2.8759999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":2.6379999999999999,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":1.1240000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542168,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":185399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.90300000000000002}]},{"osd":1,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.226},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.1619999999999999}]},{"osd":3,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.97299999999999998}]},{"osd":4,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.353},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.454}]},{"osd":5,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.542}]},{"osd":6,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":2.278,"5min":2.278,"15min":2.278},"last":1.581},{"interface":"front","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.4079999999999999}]},{"osd":7,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":2.339,"5min":2.339,"15min":2.339},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.5}]}]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":192039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 17:10:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":4.9790000000000001,"5min":4.9790000000000001,"15min":4.9790000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.79400000000000004}]},{"osd":2,"last update":"Mon Dec 11 17:10:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.62}]},{"osd":3,"last update":"Mon Dec 11 17:10:40 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":0.497},{"interface":"front","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.669,"5min":2.669,"15min":2.669},"last":0.84499999999999997}]},{"osd":4,"last update":"Mon Dec 11 17:10:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.589,"5min":1.589,"15min":1.589},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":4.8630000000000004,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.75800000000000001}]},{"osd":5,"last update":"Mon Dec 11 17:10:40 2023","interfaces":[{"interface":"back","average":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":4.9450000000000003,"5min":4.9450000000000003,"15min":4.9450000000000003},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1.391}]},{"osd":6,"last update":"Mon Dec 11 17:10:40 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.304},{"interface":"front","average":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":4.9089999999999998,"5min":4.9089999999999998,"15min":4.9089999999999998},"last":0.92200000000000004}]},{"osd":7,"last update":"Mon Dec 11 17:10:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"min":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":1.115},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.3640000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1032192,"data_stored":775731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 11 17:10:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":3.8879999999999999,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":0.75},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":3.4089999999999998,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":0.51300000000000001}]},{"osd":2,"last update":"Mon Dec 11 17:10:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":3.7879999999999998,"5min":3.7879999999999998,"15min":3.7879999999999998},"last":0.59999999999999998}]},{"osd":3,"last update":"Mon Dec 11 17:10:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":1.0269999999999999}]},{"osd":4,"last update":"Mon Dec 11 17:10:41 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":3.6699999999999999,"5min":3.6699999999999999,"15min":3.6699999999999999},"last":1.052},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":2.9159999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":1.252}]},{"osd":5,"last update":"Mon Dec 11 17:10:41 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":3.5409999999999999,"5min":3.5409999999999999,"15min":3.5409999999999999},"last":1.163},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.8410000000000002,"5min":3.8410000000000002,"15min":3.8410000000000002},"last":1.216}]},{"osd":6,"last update":"Mon Dec 11 17:10:41 2023","interfaces":[{"interface":"back","average":{"1min":1.663,"5min":1.663,"15min":1.663},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":3.927,"5min":3.927,"15min":3.927},"last":1.288},{"interface":"front","average":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":3.7170000000000001,"5min":3.7170000000000001,"15min":3.7170000000000001},"last":1.1240000000000001}]},{"osd":7,"last update":"Mon Dec 11 17:10:41 2023","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":3.7519999999999998,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":3.0219999999999998,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":1.077}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-11T17:11:31.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-11T17:11:31.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.455+0000 7fc201f6c640 1 Processor -- start 2023-12-11T17:11:31.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.455+0000 7fc201f6c640 1 -- start start 2023-12-11T17:11:31.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.457+0000 7fc201f6c640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7fc1fc0ae200 0x7fc1fc070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:31.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.457+0000 7fc201f6c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc1fc0abd20 0x7fc1fc071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:31.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.457+0000 7fc201f6c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1fc071f90 con 0x7fc1fc15e5d0 2023-12-11T17:11:31.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.457+0000 7fc201f6c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1fc072270 con 0x7fc1fc0abd20 2023-12-11T17:11:31.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.457+0000 7fc201f6c640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1fc070070 con 0x7fc1fc0ae200 2023-12-11T17:11:31.458 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.457+0000 7fc20176b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc1fc0abd20 0x7fc1fc071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:31.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.457+0000 7fc20176b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fc1fc0abd20 0x7fc1fc071090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57528/0 (socket says 172.21.15.37:57528) 2023-12-11T17:11:31.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.457+0000 7fc20176b640 1 -- 172.21.15.37:0/1960829459 learned_addr learned my addr 172.21.15.37:0/1960829459 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:31.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.458+0000 7fc20176b640 1 -- 172.21.15.37:0/1960829459 >> v2:172.21.15.151:3300/0 conn(0x7fc1fc0ae200 msgr2=0x7fc1fc070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:31.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.458+0000 7fc20176b640 1 --2- 172.21.15.37:0/1960829459 >> v2:172.21.15.151:3300/0 conn(0x7fc1fc0ae200 0x7fc1fc070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:31.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.458+0000 7fc20176b640 1 -- 172.21.15.37:0/1960829459 >> v1:172.21.15.151:6789/0 conn(0x7fc1fc15e5d0 legacy=0x7fc1fc06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:31.459 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.458+0000 7fc20176b640 1 -- 172.21.15.37:0/1960829459 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1fc070350 con 0x7fc1fc0abd20 2023-12-11T17:11:31.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.459+0000 7fc20176b640 1 --2- 172.21.15.37:0/1960829459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1fc0abd20 0x7fc1fc071090 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc0739e0 tx=0x7fc1f402bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb993ef72587a7aa server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:31.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.459+0000 7fc1fb7fe640 1 -- 172.21.15.37:0/1960829459 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f402c960 con 0x7fc1fc0abd20 2023-12-11T17:11:31.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.459+0000 7fc1fb7fe640 1 -- 172.21.15.37:0/1960829459 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f402cac0 con 0x7fc1fc0abd20 2023-12-11T17:11:31.460 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.459+0000 7fc1fb7fe640 1 -- 172.21.15.37:0/1960829459 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f402ce50 con 0x7fc1fc0abd20 2023-12-11T17:11:31.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.460+0000 7fc201f6c640 1 -- 172.21.15.37:0/1960829459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1fc0abd20 msgr2=0x7fc1fc071090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:31.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.460+0000 7fc201f6c640 1 --2- 172.21.15.37:0/1960829459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1fc0abd20 0x7fc1fc071090 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc0739e0 tx=0x7fc1f402bdc0 comp rx=0 tx=0).stop 2023-12-11T17:11:31.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.460+0000 7fc201f6c640 1 -- 172.21.15.37:0/1960829459 shutdown_connections 2023-12-11T17:11:31.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.460+0000 7fc201f6c640 1 --2- 172.21.15.37:0/1960829459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1fc0abd20 0x7fc1fc071090 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:31.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.460+0000 7fc201f6c640 1 --2- 172.21.15.37:0/1960829459 >> v2:172.21.15.151:3300/0 conn(0x7fc1fc0ae200 0x7fc1fc070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:31.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.460+0000 7fc201f6c640 1 -- 172.21.15.37:0/1960829459 >> 172.21.15.37:0/1960829459 conn(0x7fc1fc0b0860 msgr2=0x7fc1fc0b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:31.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.460+0000 7fc201f6c640 1 -- 172.21.15.37:0/1960829459 shutdown_connections 2023-12-11T17:11:31.461 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.460+0000 7fc201f6c640 1 -- 172.21.15.37:0/1960829459 wait complete. 2023-12-11T17:11:31.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.462+0000 7fc201f6c640 1 Processor -- start 2023-12-11T17:11:31.463 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.463+0000 7fc201f6c640 1 -- start start 2023-12-11T17:11:31.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.464+0000 7fc201f6c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1fc0abd20 0x7fc1fc13f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:31.466 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.464+0000 7fc201f6c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1fc0ae200 0x7fc1fc1542c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:31.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.464+0000 7fc201f6c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1fc15e5d0 0x7fc1fc14e350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:31.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.464+0000 7fc201f6c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc153e30 con 0x7fc1fc0abd20 2023-12-11T17:11:31.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.464+0000 7fc201f6c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc153220 con 0x7fc1fc0ae200 2023-12-11T17:11:31.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.464+0000 7fc201f6c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1fc153500 con 0x7fc1fc15e5d0 2023-12-11T17:11:31.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.464+0000 7fc200f6a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1fc0abd20 0x7fc1fc13f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:31.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.464+0000 7fc200f6a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1fc0abd20 0x7fc1fc13f4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57540/0 (socket says 172.21.15.37:57540) 2023-12-11T17:11:31.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.464+0000 7fc200f6a640 1 -- 172.21.15.37:0/3111890658 learned_addr learned my addr 172.21.15.37:0/3111890658 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:31.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.464+0000 7fc20176b640 1 --2- 172.21.15.37:0/3111890658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1fc15e5d0 0x7fc1fc14e350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:31.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.464+0000 7fc200f6a640 1 -- 172.21.15.37:0/3111890658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1fc15e5d0 msgr2=0x7fc1fc14e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:31.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.465+0000 7fc200f6a640 1 --2- 172.21.15.37:0/3111890658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1fc15e5d0 0x7fc1fc14e350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:31.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.465+0000 7fc200f6a640 1 -- 172.21.15.37:0/3111890658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1fc0ae200 msgr2=0x7fc1fc1542c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:31.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.465+0000 7fc200f6a640 1 --2- 172.21.15.37:0/3111890658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1fc0ae200 0x7fc1fc1542c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:31.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.465+0000 7fc200f6a640 1 -- 172.21.15.37:0/3111890658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f4009b30 con 0x7fc1fc0abd20 2023-12-11T17:11:31.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.465+0000 7fc20176b640 1 --2- 172.21.15.37:0/3111890658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1fc15e5d0 0x7fc1fc14e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.465+0000 7fc200f6a640 1 --2- 172.21.15.37:0/3111890658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1fc0abd20 0x7fc1fc13f4c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc1f000c410 tx=0x7fc1f000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.465+0000 7fc1f97fa640 1 -- 172.21.15.37:0/3111890658 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f00035f0 con 0x7fc1fc0abd20 2023-12-11T17:11:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.465+0000 7fc1f97fa640 1 -- 172.21.15.37:0/3111890658 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1f0003750 con 0x7fc1fc0abd20 2023-12-11T17:11:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.465+0000 7fc1f97fa640 1 -- 172.21.15.37:0/3111890658 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1f0003b40 con 0x7fc1fc0abd20 2023-12-11T17:11:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.465+0000 7fc201f6c640 1 -- 172.21.15.37:0/3111890658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1fc06c680 con 0x7fc1fc0abd20 2023-12-11T17:11:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.465+0000 7fc201f6c640 1 -- 172.21.15.37:0/3111890658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1fc153ac0 con 0x7fc1fc0abd20 2023-12-11T17:11:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.466+0000 7fc201f6c640 1 -- 172.21.15.37:0/3111890658 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1fc09c9e0 con 0x7fc1fc0abd20 2023-12-11T17:11:31.468 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.467+0000 7fc1f97fa640 1 -- 172.21.15.37:0/3111890658 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fc1f0003ca0 con 0x7fc1fc0abd20 2023-12-11T17:11:31.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.468+0000 7fc1f97fa640 1 --2- 172.21.15.37:0/3111890658 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc1e006ae70 0x7fc1e006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:31.469 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.468+0000 7fc1f97fa640 1 -- 172.21.15.37:0/3111890658 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7fc1f00889d0 con 0x7fc1fc0abd20 2023-12-11T17:11:31.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.469+0000 7fc1fbfff640 1 --2- 172.21.15.37:0/3111890658 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc1e006ae70 0x7fc1e006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:31.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.470+0000 7fc1fbfff640 1 --2- 172.21.15.37:0/3111890658 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc1e006ae70 0x7fc1e006d330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc1f4230 tx=0x7fc1e8006c90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:31.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.472+0000 7fc1f97fa640 1 -- 172.21.15.37:0/3111890658 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fc1f0053810 con 0x7fc1fc0abd20 2023-12-11T17:11:31.655 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.654+0000 7fc201f6c640 1 -- 172.21.15.37:0/3111890658 --> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc1fc06c500 con 0x7fc1e006ae70 2023-12-11T17:11:31.679 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.677+0000 7fc1f97fa640 1 -- 172.21.15.37:0/3111890658 <== mgr.4111 v2:172.21.15.151:6832/3081040918 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+287076 (secure 0 0 0) 0x7fc1e8013400 con 0x7fc1e006ae70 2023-12-11T17:11:31.683 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:11:31.684 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2023-12-11T17:11:31.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.684+0000 7fc201f6c640 1 -- 172.21.15.37:0/3111890658 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc1e006ae70 msgr2=0x7fc1e006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:31.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.684+0000 7fc201f6c640 1 --2- 172.21.15.37:0/3111890658 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc1e006ae70 0x7fc1e006d330 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc1fc1f4230 tx=0x7fc1e8006c90 comp rx=0 tx=0).stop 2023-12-11T17:11:31.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.684+0000 7fc201f6c640 1 -- 172.21.15.37:0/3111890658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1fc0abd20 msgr2=0x7fc1fc13f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:31.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.684+0000 7fc201f6c640 1 --2- 172.21.15.37:0/3111890658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1fc0abd20 0x7fc1fc13f4c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc1f000c410 tx=0x7fc1f000c8d0 comp rx=0 tx=0).stop 2023-12-11T17:11:31.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.684+0000 7fc201f6c640 1 -- 172.21.15.37:0/3111890658 shutdown_connections 2023-12-11T17:11:31.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.684+0000 7fc201f6c640 1 --2- 172.21.15.37:0/3111890658 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fc1e006ae70 0x7fc1e006d330 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:31.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.684+0000 7fc201f6c640 1 --2- 172.21.15.37:0/3111890658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc1fc0ae200 0x7fc1fc1542c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:31.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.684+0000 7fc201f6c640 1 --2- 172.21.15.37:0/3111890658 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fc1fc15e5d0 0x7fc1fc14e350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:31.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.684+0000 7fc201f6c640 1 --2- 172.21.15.37:0/3111890658 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fc1fc0abd20 0x7fc1fc13f4c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:31.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.684+0000 7fc201f6c640 1 -- 172.21.15.37:0/3111890658 >> 172.21.15.37:0/3111890658 conn(0x7fc1fc0b0860 msgr2=0x7fc1fc06c810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:31.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.684+0000 7fc201f6c640 1 -- 172.21.15.37:0/3111890658 shutdown_connections 2023-12-11T17:11:31.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.684+0000 7fc201f6c640 1 -- 172.21.15.37:0/3111890658 wait complete. 2023-12-11T17:11:31.703 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":88,"stamp":"2023-12-11T17:11:30.380854+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":52,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220788,"kb_used_data":4604,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754753932,"statfs":{"total":773094113280,"available":772868026368,"internally_reserved":0,"allocated":4714496,"data_stored":2671572,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12750,"internal_metadata":221236786},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":41,"apply_latency_ms":41,"commit_latency_ns":41000000,"apply_latency_ns":41000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.735074"},"pg_stats":[{"pgid":"6.3f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.896852+0000","last_change":"2023-12-11T17:11:26.722699+0000","last_active":"2023-12-11T17:11:27.896852+0000","last_peered":"2023-12-11T17:11:27.896852+0000","last_clean":"2023-12-11T17:11:27.896852+0000","last_became_active":"2023-12-11T17:11:26.722157+0000","last_became_peered":"2023-12-11T17:11:26.722157+0000","last_unstale":"2023-12-11T17:11:27.896852+0000","last_undegraded":"2023-12-11T17:11:27.896852+0000","last_fullsized":"2023-12-11T17:11:27.896852+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:06:08.503480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.896848+0000","last_change":"2023-12-11T17:11:26.706126+0000","last_active":"2023-12-11T17:11:27.896848+0000","last_peered":"2023-12-11T17:11:27.896848+0000","last_clean":"2023-12-11T17:11:27.896848+0000","last_became_active":"2023-12-11T17:11:26.705842+0000","last_became_peered":"2023-12-11T17:11:26.705842+0000","last_unstale":"2023-12-11T17:11:27.896848+0000","last_undegraded":"2023-12-11T17:11:27.896848+0000","last_fullsized":"2023-12-11T17:11:27.896848+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:45:05.383435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.729533+0000","last_change":"2023-12-11T17:11:26.727043+0000","last_active":"2023-12-11T17:11:26.729533+0000","last_peered":"2023-12-11T17:11:26.729533+0000","last_clean":"2023-12-11T17:11:26.729533+0000","last_became_active":"2023-12-11T17:11:26.726757+0000","last_became_peered":"2023-12-11T17:11:26.726757+0000","last_unstale":"2023-12-11T17:11:26.729533+0000","last_undegraded":"2023-12-11T17:11:26.729533+0000","last_fullsized":"2023-12-11T17:11:26.729533+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:20:28.132731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.3c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.722884+0000","last_change":"2023-12-11T17:11:26.715845+0000","last_active":"2023-12-11T17:11:26.722884+0000","last_peered":"2023-12-11T17:11:26.722884+0000","last_clean":"2023-12-11T17:11:26.722884+0000","last_became_active":"2023-12-11T17:11:26.714906+0000","last_became_peered":"2023-12-11T17:11:26.714906+0000","last_unstale":"2023-12-11T17:11:26.722884+0000","last_undegraded":"2023-12-11T17:11:26.722884+0000","last_fullsized":"2023-12-11T17:11:26.722884+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:10:51.250661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3b","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.721023+0000","last_change":"2023-12-11T17:11:26.713131+0000","last_active":"2023-12-11T17:11:26.721023+0000","last_peered":"2023-12-11T17:11:26.721023+0000","last_clean":"2023-12-11T17:11:26.721023+0000","last_became_active":"2023-12-11T17:11:26.712619+0000","last_became_peered":"2023-12-11T17:11:26.712619+0000","last_unstale":"2023-12-11T17:11:26.721023+0000","last_undegraded":"2023-12-11T17:11:26.721023+0000","last_fullsized":"2023-12-11T17:11:26.721023+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:39:02.907182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.3a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.897085+0000","last_change":"2023-12-11T17:11:26.719084+0000","last_active":"2023-12-11T17:11:27.897085+0000","last_peered":"2023-12-11T17:11:27.897085+0000","last_clean":"2023-12-11T17:11:27.897085+0000","last_became_active":"2023-12-11T17:11:26.718771+0000","last_became_peered":"2023-12-11T17:11:26.718771+0000","last_unstale":"2023-12-11T17:11:27.897085+0000","last_undegraded":"2023-12-11T17:11:27.897085+0000","last_fullsized":"2023-12-11T17:11:27.897085+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:33:21.785462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.39","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.850641+0000","last_change":"2023-12-11T17:11:26.728711+0000","last_active":"2023-12-11T17:11:27.850641+0000","last_peered":"2023-12-11T17:11:27.850641+0000","last_clean":"2023-12-11T17:11:27.850641+0000","last_became_active":"2023-12-11T17:11:26.727998+0000","last_became_peered":"2023-12-11T17:11:26.727998+0000","last_unstale":"2023-12-11T17:11:27.850641+0000","last_undegraded":"2023-12-11T17:11:27.850641+0000","last_fullsized":"2023-12-11T17:11:27.850641+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:24:29.357095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.38","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.895086+0000","last_change":"2023-12-11T17:11:26.707787+0000","last_active":"2023-12-11T17:11:27.895086+0000","last_peered":"2023-12-11T17:11:27.895086+0000","last_clean":"2023-12-11T17:11:27.895086+0000","last_became_active":"2023-12-11T17:11:26.707488+0000","last_became_peered":"2023-12-11T17:11:26.707488+0000","last_unstale":"2023-12-11T17:11:27.895086+0000","last_undegraded":"2023-12-11T17:11:27.895086+0000","last_fullsized":"2023-12-11T17:11:27.895086+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:24:29.357095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.37","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.729456+0000","last_change":"2023-12-11T17:11:26.725811+0000","last_active":"2023-12-11T17:11:26.729456+0000","last_peered":"2023-12-11T17:11:26.729456+0000","last_clean":"2023-12-11T17:11:26.729456+0000","last_became_active":"2023-12-11T17:11:26.725557+0000","last_became_peered":"2023-12-11T17:11:26.725557+0000","last_unstale":"2023-12-11T17:11:26.729456+0000","last_undegraded":"2023-12-11T17:11:26.729456+0000","last_fullsized":"2023-12-11T17:11:26.729456+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:20:43.624803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.36","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.851919+0000","last_change":"2023-12-11T17:11:26.712468+0000","last_active":"2023-12-11T17:11:27.851919+0000","last_peered":"2023-12-11T17:11:27.851919+0000","last_clean":"2023-12-11T17:11:27.851919+0000","last_became_active":"2023-12-11T17:11:26.711680+0000","last_became_peered":"2023-12-11T17:11:26.711680+0000","last_unstale":"2023-12-11T17:11:27.851919+0000","last_undegraded":"2023-12-11T17:11:27.851919+0000","last_fullsized":"2023-12-11T17:11:27.851919+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:06:08.503480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.35","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.851628+0000","last_change":"2023-12-11T17:11:26.722879+0000","last_active":"2023-12-11T17:11:27.851628+0000","last_peered":"2023-12-11T17:11:27.851628+0000","last_clean":"2023-12-11T17:11:27.851628+0000","last_became_active":"2023-12-11T17:11:26.716927+0000","last_became_peered":"2023-12-11T17:11:26.716927+0000","last_unstale":"2023-12-11T17:11:27.851628+0000","last_undegraded":"2023-12-11T17:11:27.851628+0000","last_fullsized":"2023-12-11T17:11:27.851628+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:33:47.471050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.34","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.725176+0000","last_change":"2023-12-11T17:11:26.711132+0000","last_active":"2023-12-11T17:11:26.725176+0000","last_peered":"2023-12-11T17:11:26.725176+0000","last_clean":"2023-12-11T17:11:26.725176+0000","last_became_active":"2023-12-11T17:11:26.710802+0000","last_became_peered":"2023-12-11T17:11:26.710802+0000","last_unstale":"2023-12-11T17:11:26.725176+0000","last_undegraded":"2023-12-11T17:11:26.725176+0000","last_fullsized":"2023-12-11T17:11:26.725176+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:26:57.215725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.33","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.850915+0000","last_change":"2023-12-11T17:11:26.712632+0000","last_active":"2023-12-11T17:11:27.850915+0000","last_peered":"2023-12-11T17:11:27.850915+0000","last_clean":"2023-12-11T17:11:27.850915+0000","last_became_active":"2023-12-11T17:11:26.711581+0000","last_became_peered":"2023-12-11T17:11:26.711581+0000","last_unstale":"2023-12-11T17:11:27.850915+0000","last_undegraded":"2023-12-11T17:11:27.850915+0000","last_fullsized":"2023-12-11T17:11:27.850915+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:44:24.531680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.32","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.716887+0000","last_change":"2023-12-11T17:11:26.711347+0000","last_active":"2023-12-11T17:11:26.716887+0000","last_peered":"2023-12-11T17:11:26.716887+0000","last_clean":"2023-12-11T17:11:26.716887+0000","last_became_active":"2023-12-11T17:11:26.711064+0000","last_became_peered":"2023-12-11T17:11:26.711064+0000","last_unstale":"2023-12-11T17:11:26.716887+0000","last_undegraded":"2023-12-11T17:11:26.716887+0000","last_fullsized":"2023-12-11T17:11:26.716887+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:44:17.226174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.31","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.850776+0000","last_change":"2023-12-11T17:11:26.715238+0000","last_active":"2023-12-11T17:11:27.850776+0000","last_peered":"2023-12-11T17:11:27.850776+0000","last_clean":"2023-12-11T17:11:27.850776+0000","last_became_active":"2023-12-11T17:11:26.714894+0000","last_became_peered":"2023-12-11T17:11:26.714894+0000","last_unstale":"2023-12-11T17:11:27.850776+0000","last_undegraded":"2023-12-11T17:11:27.850776+0000","last_fullsized":"2023-12-11T17:11:27.850776+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:42:11.341500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.30","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.725634+0000","last_change":"2023-12-11T17:11:26.722552+0000","last_active":"2023-12-11T17:11:26.725634+0000","last_peered":"2023-12-11T17:11:26.725634+0000","last_clean":"2023-12-11T17:11:26.725634+0000","last_became_active":"2023-12-11T17:11:26.721182+0000","last_became_peered":"2023-12-11T17:11:26.721182+0000","last_unstale":"2023-12-11T17:11:26.725634+0000","last_undegraded":"2023-12-11T17:11:26.725634+0000","last_fullsized":"2023-12-11T17:11:26.725634+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:44:32.834609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.735288+0000","last_change":"2023-12-11T17:11:26.732559+0000","last_active":"2023-12-11T17:11:26.735288+0000","last_peered":"2023-12-11T17:11:26.735288+0000","last_clean":"2023-12-11T17:11:26.735288+0000","last_became_active":"2023-12-11T17:11:26.732260+0000","last_became_peered":"2023-12-11T17:11:26.732260+0000","last_unstale":"2023-12-11T17:11:26.735288+0000","last_undegraded":"2023-12-11T17:11:26.735288+0000","last_fullsized":"2023-12-11T17:11:26.735288+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:23:34.611727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.2e","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.716184+0000","last_change":"2023-12-11T17:11:26.720851+0000","last_active":"2023-12-11T17:11:27.716184+0000","last_peered":"2023-12-11T17:11:27.716184+0000","last_clean":"2023-12-11T17:11:27.716184+0000","last_became_active":"2023-12-11T17:11:26.717617+0000","last_became_peered":"2023-12-11T17:11:26.717617+0000","last_unstale":"2023-12-11T17:11:27.716184+0000","last_undegraded":"2023-12-11T17:11:27.716184+0000","last_fullsized":"2023-12-11T17:11:27.716184+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:30:32.031696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2d","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.723043+0000","last_change":"2023-12-11T17:11:26.715900+0000","last_active":"2023-12-11T17:11:26.723043+0000","last_peered":"2023-12-11T17:11:26.723043+0000","last_clean":"2023-12-11T17:11:26.723043+0000","last_became_active":"2023-12-11T17:11:26.715617+0000","last_became_peered":"2023-12-11T17:11:26.715617+0000","last_unstale":"2023-12-11T17:11:26.723043+0000","last_undegraded":"2023-12-11T17:11:26.723043+0000","last_fullsized":"2023-12-11T17:11:26.723043+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:47:11.799659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.2c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.715643+0000","last_change":"2023-12-11T17:11:26.718015+0000","last_active":"2023-12-11T17:11:27.715643+0000","last_peered":"2023-12-11T17:11:27.715643+0000","last_clean":"2023-12-11T17:11:27.715643+0000","last_became_active":"2023-12-11T17:11:26.717670+0000","last_became_peered":"2023-12-11T17:11:26.717670+0000","last_unstale":"2023-12-11T17:11:27.715643+0000","last_undegraded":"2023-12-11T17:11:27.715643+0000","last_fullsized":"2023-12-11T17:11:27.715643+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:20:43.624803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.852079+0000","last_change":"2023-12-11T17:11:26.714593+0000","last_active":"2023-12-11T17:11:27.852079+0000","last_peered":"2023-12-11T17:11:27.852079+0000","last_clean":"2023-12-11T17:11:27.852079+0000","last_became_active":"2023-12-11T17:11:26.714331+0000","last_became_peered":"2023-12-11T17:11:26.714331+0000","last_unstale":"2023-12-11T17:11:27.852079+0000","last_undegraded":"2023-12-11T17:11:27.852079+0000","last_fullsized":"2023-12-11T17:11:27.852079+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:35:11.833704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.2a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.729748+0000","last_change":"2023-12-11T17:11:26.725547+0000","last_active":"2023-12-11T17:11:26.729748+0000","last_peered":"2023-12-11T17:11:26.729748+0000","last_clean":"2023-12-11T17:11:26.729748+0000","last_became_active":"2023-12-11T17:11:26.725247+0000","last_became_peered":"2023-12-11T17:11:26.725247+0000","last_unstale":"2023-12-11T17:11:26.729748+0000","last_undegraded":"2023-12-11T17:11:26.729748+0000","last_fullsized":"2023-12-11T17:11:26.729748+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:26:02.339725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.29","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.724529+0000","last_change":"2023-12-11T17:11:26.713258+0000","last_active":"2023-12-11T17:11:26.724529+0000","last_peered":"2023-12-11T17:11:26.724529+0000","last_clean":"2023-12-11T17:11:26.724529+0000","last_became_active":"2023-12-11T17:11:26.712973+0000","last_became_peered":"2023-12-11T17:11:26.712973+0000","last_unstale":"2023-12-11T17:11:26.724529+0000","last_undegraded":"2023-12-11T17:11:26.724529+0000","last_fullsized":"2023-12-11T17:11:26.724529+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:44:17.226174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.28","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.719732+0000","last_change":"2023-12-11T17:11:26.713973+0000","last_active":"2023-12-11T17:11:26.719732+0000","last_peered":"2023-12-11T17:11:26.719732+0000","last_clean":"2023-12-11T17:11:26.719732+0000","last_became_active":"2023-12-11T17:11:26.711496+0000","last_became_peered":"2023-12-11T17:11:26.711496+0000","last_unstale":"2023-12-11T17:11:26.719732+0000","last_undegraded":"2023-12-11T17:11:26.719732+0000","last_fullsized":"2023-12-11T17:11:26.719732+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:28:06.534444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.27","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.716267+0000","last_change":"2023-12-11T17:11:26.714885+0000","last_active":"2023-12-11T17:11:27.716267+0000","last_peered":"2023-12-11T17:11:27.716267+0000","last_clean":"2023-12-11T17:11:27.716267+0000","last_became_active":"2023-12-11T17:11:26.713575+0000","last_became_peered":"2023-12-11T17:11:26.713575+0000","last_unstale":"2023-12-11T17:11:27.716267+0000","last_undegraded":"2023-12-11T17:11:27.716267+0000","last_fullsized":"2023-12-11T17:11:27.716267+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:23:34.611727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.26","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.897685+0000","last_change":"2023-12-11T17:11:26.728949+0000","last_active":"2023-12-11T17:11:27.897685+0000","last_peered":"2023-12-11T17:11:27.897685+0000","last_clean":"2023-12-11T17:11:27.897685+0000","last_became_active":"2023-12-11T17:11:26.728288+0000","last_became_peered":"2023-12-11T17:11:26.728288+0000","last_unstale":"2023-12-11T17:11:27.897685+0000","last_undegraded":"2023-12-11T17:11:27.897685+0000","last_fullsized":"2023-12-11T17:11:27.897685+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:14:56.584307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.25","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.715787+0000","last_change":"2023-12-11T17:11:26.695102+0000","last_active":"2023-12-11T17:11:27.715787+0000","last_peered":"2023-12-11T17:11:27.715787+0000","last_clean":"2023-12-11T17:11:27.715787+0000","last_became_active":"2023-12-11T17:11:26.693989+0000","last_became_peered":"2023-12-11T17:11:26.693989+0000","last_unstale":"2023-12-11T17:11:27.715787+0000","last_undegraded":"2023-12-11T17:11:27.715787+0000","last_fullsized":"2023-12-11T17:11:27.715787+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:43:13.982753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.24","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.851359+0000","last_change":"2023-12-11T17:11:26.714247+0000","last_active":"2023-12-11T17:11:27.851359+0000","last_peered":"2023-12-11T17:11:27.851359+0000","last_clean":"2023-12-11T17:11:27.851359+0000","last_became_active":"2023-12-11T17:11:26.713922+0000","last_became_peered":"2023-12-11T17:11:26.713922+0000","last_unstale":"2023-12-11T17:11:27.851359+0000","last_undegraded":"2023-12-11T17:11:27.851359+0000","last_fullsized":"2023-12-11T17:11:27.851359+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T17:30:17.644157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.23","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.716182+0000","last_change":"2023-12-11T17:11:26.713086+0000","last_active":"2023-12-11T17:11:27.716182+0000","last_peered":"2023-12-11T17:11:27.716182+0000","last_clean":"2023-12-11T17:11:27.716182+0000","last_became_active":"2023-12-11T17:11:26.712792+0000","last_became_peered":"2023-12-11T17:11:26.712792+0000","last_unstale":"2023-12-11T17:11:27.716182+0000","last_undegraded":"2023-12-11T17:11:27.716182+0000","last_fullsized":"2023-12-11T17:11:27.716182+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:19:15.838711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.22","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.714660+0000","last_change":"2023-12-11T17:11:26.691641+0000","last_active":"2023-12-11T17:11:27.714660+0000","last_peered":"2023-12-11T17:11:27.714660+0000","last_clean":"2023-12-11T17:11:27.714660+0000","last_became_active":"2023-12-11T17:11:26.690912+0000","last_became_peered":"2023-12-11T17:11:26.690912+0000","last_unstale":"2023-12-11T17:11:27.714660+0000","last_undegraded":"2023-12-11T17:11:27.714660+0000","last_fullsized":"2023-12-11T17:11:27.714660+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T17:15:22.647845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.21","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.727139+0000","last_change":"2023-12-11T17:11:26.723280+0000","last_active":"2023-12-11T17:11:26.727139+0000","last_peered":"2023-12-11T17:11:26.727139+0000","last_clean":"2023-12-11T17:11:26.727139+0000","last_became_active":"2023-12-11T17:11:26.722932+0000","last_became_peered":"2023-12-11T17:11:26.722932+0000","last_unstale":"2023-12-11T17:11:26.727139+0000","last_undegraded":"2023-12-11T17:11:26.727139+0000","last_fullsized":"2023-12-11T17:11:26.727139+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:09:27.333941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.20","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.895587+0000","last_change":"2023-12-11T17:11:26.712943+0000","last_active":"2023-12-11T17:11:27.895587+0000","last_peered":"2023-12-11T17:11:27.895587+0000","last_clean":"2023-12-11T17:11:27.895587+0000","last_became_active":"2023-12-11T17:11:26.712645+0000","last_became_peered":"2023-12-11T17:11:26.712645+0000","last_unstale":"2023-12-11T17:11:27.895587+0000","last_undegraded":"2023-12-11T17:11:27.895587+0000","last_fullsized":"2023-12-11T17:11:27.895587+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:24:40.668465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.732190+0000","last_change":"2023-12-11T17:11:26.729701+0000","last_active":"2023-12-11T17:11:26.732190+0000","last_peered":"2023-12-11T17:11:26.732190+0000","last_clean":"2023-12-11T17:11:26.732190+0000","last_became_active":"2023-12-11T17:11:26.729441+0000","last_became_peered":"2023-12-11T17:11:26.729441+0000","last_unstale":"2023-12-11T17:11:26.732190+0000","last_undegraded":"2023-12-11T17:11:26.732190+0000","last_fullsized":"2023-12-11T17:11:26.732190+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:47:40.305060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1f","version":"38'4","reported_seq":16,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.716146+0000","last_change":"2023-12-11T17:11:25.682109+0000","last_active":"2023-12-11T17:11:27.716146+0000","last_peered":"2023-12-11T17:11:27.716146+0000","last_clean":"2023-12-11T17:11:27.716146+0000","last_became_active":"2023-12-11T17:11:25.681636+0000","last_became_peered":"2023-12-11T17:11:25.681636+0000","last_unstale":"2023-12-11T17:11:27.716146+0000","last_undegraded":"2023-12-11T17:11:27.716146+0000","last_fullsized":"2023-12-11T17:11:27.716146+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:09:26.321412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.897789+0000","last_change":"2023-12-11T17:11:26.729263+0000","last_active":"2023-12-11T17:11:27.897789+0000","last_peered":"2023-12-11T17:11:27.897789+0000","last_clean":"2023-12-11T17:11:27.897789+0000","last_became_active":"2023-12-11T17:11:26.728998+0000","last_became_peered":"2023-12-11T17:11:26.728998+0000","last_unstale":"2023-12-11T17:11:27.897789+0000","last_undegraded":"2023-12-11T17:11:27.897789+0000","last_fullsized":"2023-12-11T17:11:27.897789+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:24:54.112967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1e","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.732147+0000","last_change":"2023-12-11T17:11:25.681530+0000","last_active":"2023-12-11T17:11:26.732147+0000","last_peered":"2023-12-11T17:11:26.732147+0000","last_clean":"2023-12-11T17:11:26.732147+0000","last_became_active":"2023-12-11T17:11:25.680265+0000","last_became_peered":"2023-12-11T17:11:25.680265+0000","last_unstale":"2023-12-11T17:11:26.732147+0000","last_undegraded":"2023-12-11T17:11:26.732147+0000","last_fullsized":"2023-12-11T17:11:26.732147+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:43:12.970223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.717099+0000","last_change":"2023-12-11T17:11:26.713254+0000","last_active":"2023-12-11T17:11:26.717099+0000","last_peered":"2023-12-11T17:11:26.717099+0000","last_clean":"2023-12-11T17:11:26.717099+0000","last_became_active":"2023-12-11T17:11:26.712972+0000","last_became_peered":"2023-12-11T17:11:26.712972+0000","last_unstale":"2023-12-11T17:11:26.717099+0000","last_undegraded":"2023-12-11T17:11:26.717099+0000","last_fullsized":"2023-12-11T17:11:26.717099+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:20:28.132731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1d","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.897997+0000","last_change":"2023-12-11T17:11:25.684696+0000","last_active":"2023-12-11T17:11:27.897997+0000","last_peered":"2023-12-11T17:11:27.897997+0000","last_clean":"2023-12-11T17:11:27.897997+0000","last_became_active":"2023-12-11T17:11:25.684387+0000","last_became_peered":"2023-12-11T17:11:25.684387+0000","last_unstale":"2023-12-11T17:11:27.897997+0000","last_undegraded":"2023-12-11T17:11:27.897997+0000","last_fullsized":"2023-12-11T17:11:27.897997+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:43:12.970223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.896837+0000","last_change":"2023-12-11T17:11:26.698454+0000","last_active":"2023-12-11T17:11:27.896837+0000","last_peered":"2023-12-11T17:11:27.896837+0000","last_clean":"2023-12-11T17:11:27.896837+0000","last_became_active":"2023-12-11T17:11:26.695184+0000","last_became_peered":"2023-12-11T17:11:26.695184+0000","last_unstale":"2023-12-11T17:11:27.896837+0000","last_undegraded":"2023-12-11T17:11:27.896837+0000","last_fullsized":"2023-12-11T17:11:27.896837+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:55:43.681557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1c","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.731682+0000","last_change":"2023-12-11T17:11:25.686771+0000","last_active":"2023-12-11T17:11:26.731682+0000","last_peered":"2023-12-11T17:11:26.731682+0000","last_clean":"2023-12-11T17:11:26.731682+0000","last_became_active":"2023-12-11T17:11:25.686323+0000","last_became_peered":"2023-12-11T17:11:25.686323+0000","last_unstale":"2023-12-11T17:11:26.731682+0000","last_undegraded":"2023-12-11T17:11:26.731682+0000","last_fullsized":"2023-12-11T17:11:26.731682+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:43:12.970223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.725561+0000","last_change":"2023-12-11T17:11:26.716070+0000","last_active":"2023-12-11T17:11:26.725561+0000","last_peered":"2023-12-11T17:11:26.725561+0000","last_clean":"2023-12-11T17:11:26.725561+0000","last_became_active":"2023-12-11T17:11:26.715769+0000","last_became_peered":"2023-12-11T17:11:26.715769+0000","last_unstale":"2023-12-11T17:11:26.725561+0000","last_undegraded":"2023-12-11T17:11:26.725561+0000","last_fullsized":"2023-12-11T17:11:26.725561+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:09:27.333941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1b","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.851493+0000","last_change":"2023-12-11T17:11:25.682920+0000","last_active":"2023-12-11T17:11:27.851493+0000","last_peered":"2023-12-11T17:11:27.851493+0000","last_clean":"2023-12-11T17:11:27.851493+0000","last_became_active":"2023-12-11T17:11:25.682613+0000","last_became_peered":"2023-12-11T17:11:25.682613+0000","last_unstale":"2023-12-11T17:11:27.851493+0000","last_undegraded":"2023-12-11T17:11:27.851493+0000","last_fullsized":"2023-12-11T17:11:27.851493+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:24:53.100438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.851118+0000","last_change":"2023-12-11T17:11:26.727390+0000","last_active":"2023-12-11T17:11:27.851118+0000","last_peered":"2023-12-11T17:11:27.851118+0000","last_clean":"2023-12-11T17:11:27.851118+0000","last_became_active":"2023-12-11T17:11:26.727113+0000","last_became_peered":"2023-12-11T17:11:26.727113+0000","last_unstale":"2023-12-11T17:11:27.851118+0000","last_undegraded":"2023-12-11T17:11:27.851118+0000","last_fullsized":"2023-12-11T17:11:27.851118+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:30.919622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.731164+0000","last_change":"2023-12-11T17:11:25.681312+0000","last_active":"2023-12-11T17:11:26.731164+0000","last_peered":"2023-12-11T17:11:26.731164+0000","last_clean":"2023-12-11T17:11:26.731164+0000","last_became_active":"2023-12-11T17:11:25.681055+0000","last_became_peered":"2023-12-11T17:11:25.681055+0000","last_unstale":"2023-12-11T17:11:26.731164+0000","last_undegraded":"2023-12-11T17:11:26.731164+0000","last_fullsized":"2023-12-11T17:11:26.731164+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:43:12.970223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.727337+0000","last_change":"2023-12-11T17:11:26.720221+0000","last_active":"2023-12-11T17:11:26.727337+0000","last_peered":"2023-12-11T17:11:26.727337+0000","last_clean":"2023-12-11T17:11:26.727337+0000","last_became_active":"2023-12-11T17:11:26.719974+0000","last_became_peered":"2023-12-11T17:11:26.719974+0000","last_unstale":"2023-12-11T17:11:26.727337+0000","last_undegraded":"2023-12-11T17:11:26.727337+0000","last_fullsized":"2023-12-11T17:11:26.727337+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:26:57.215725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.897296+0000","last_change":"2023-12-11T17:11:25.690595+0000","last_active":"2023-12-11T17:11:27.897296+0000","last_peered":"2023-12-11T17:11:27.897296+0000","last_clean":"2023-12-11T17:11:27.897296+0000","last_became_active":"2023-12-11T17:11:25.690367+0000","last_became_peered":"2023-12-11T17:11:25.690367+0000","last_unstale":"2023-12-11T17:11:27.897296+0000","last_undegraded":"2023-12-11T17:11:27.897296+0000","last_fullsized":"2023-12-11T17:11:27.897296+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:20:42.612274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.896110+0000","last_change":"2023-12-11T17:11:26.710087+0000","last_active":"2023-12-11T17:11:27.896110+0000","last_peered":"2023-12-11T17:11:27.896110+0000","last_clean":"2023-12-11T17:11:27.896110+0000","last_became_active":"2023-12-11T17:11:26.709783+0000","last_became_peered":"2023-12-11T17:11:26.709783+0000","last_unstale":"2023-12-11T17:11:27.896110+0000","last_undegraded":"2023-12-11T17:11:27.896110+0000","last_fullsized":"2023-12-11T17:11:27.896110+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:41:35.312401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.714526+0000","last_change":"2023-12-11T17:11:25.688266+0000","last_active":"2023-12-11T17:11:26.714526+0000","last_peered":"2023-12-11T17:11:26.714526+0000","last_clean":"2023-12-11T17:11:26.714526+0000","last_became_active":"2023-12-11T17:11:25.687981+0000","last_became_peered":"2023-12-11T17:11:25.687981+0000","last_unstale":"2023-12-11T17:11:26.714526+0000","last_undegraded":"2023-12-11T17:11:26.714526+0000","last_fullsized":"2023-12-11T17:11:26.714526+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:19:14.826181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.723014+0000","last_change":"2023-12-11T17:11:26.715248+0000","last_active":"2023-12-11T17:11:26.723014+0000","last_peered":"2023-12-11T17:11:26.723014+0000","last_clean":"2023-12-11T17:11:26.723014+0000","last_became_active":"2023-12-11T17:11:26.714526+0000","last_became_peered":"2023-12-11T17:11:26.714526+0000","last_unstale":"2023-12-11T17:11:26.723014+0000","last_undegraded":"2023-12-11T17:11:26.723014+0000","last_fullsized":"2023-12-11T17:11:26.723014+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:43:16.878860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.897075+0000","last_change":"2023-12-11T17:11:25.676791+0000","last_active":"2023-12-11T17:11:27.897075+0000","last_peered":"2023-12-11T17:11:27.897075+0000","last_clean":"2023-12-11T17:11:27.897075+0000","last_became_active":"2023-12-11T17:11:25.676487+0000","last_became_peered":"2023-12-11T17:11:25.676487+0000","last_unstale":"2023-12-11T17:11:27.897075+0000","last_undegraded":"2023-12-11T17:11:27.897075+0000","last_fullsized":"2023-12-11T17:11:27.897075+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:46:18.699778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.727598+0000","last_change":"2023-12-11T17:11:26.723208+0000","last_active":"2023-12-11T17:11:26.727598+0000","last_peered":"2023-12-11T17:11:26.727598+0000","last_clean":"2023-12-11T17:11:26.727598+0000","last_became_active":"2023-12-11T17:11:26.720648+0000","last_became_peered":"2023-12-11T17:11:26.720648+0000","last_unstale":"2023-12-11T17:11:26.727598+0000","last_undegraded":"2023-12-11T17:11:26.727598+0000","last_fullsized":"2023-12-11T17:11:26.727598+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:30:32.031696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.851922+0000","last_change":"2023-12-11T17:11:25.689076+0000","last_active":"2023-12-11T17:11:27.851922+0000","last_peered":"2023-12-11T17:11:27.851922+0000","last_clean":"2023-12-11T17:11:27.851922+0000","last_became_active":"2023-12-11T17:11:25.687416+0000","last_became_peered":"2023-12-11T17:11:25.687416+0000","last_unstale":"2023-12-11T17:11:27.851922+0000","last_undegraded":"2023-12-11T17:11:27.851922+0000","last_fullsized":"2023-12-11T17:11:27.851922+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:46:18.699778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.726247+0000","last_change":"2023-12-11T17:11:26.714328+0000","last_active":"2023-12-11T17:11:26.726247+0000","last_peered":"2023-12-11T17:11:26.726247+0000","last_clean":"2023-12-11T17:11:26.726247+0000","last_became_active":"2023-12-11T17:11:26.714057+0000","last_became_peered":"2023-12-11T17:11:26.714057+0000","last_unstale":"2023-12-11T17:11:26.726247+0000","last_undegraded":"2023-12-11T17:11:26.726247+0000","last_fullsized":"2023-12-11T17:11:26.726247+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:44:17.226174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.15","version":"38'3","reported_seq":15,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.851913+0000","last_change":"2023-12-11T17:11:25.689841+0000","last_active":"2023-12-11T17:11:27.851913+0000","last_peered":"2023-12-11T17:11:27.851913+0000","last_clean":"2023-12-11T17:11:27.851913+0000","last_became_active":"2023-12-11T17:11:25.689562+0000","last_became_peered":"2023-12-11T17:11:25.689562+0000","last_unstale":"2023-12-11T17:11:27.851913+0000","last_undegraded":"2023-12-11T17:11:27.851913+0000","last_fullsized":"2023-12-11T17:11:27.851913+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:12:37.999620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.730842+0000","last_change":"2023-12-11T17:11:26.724038+0000","last_active":"2023-12-11T17:11:26.730842+0000","last_peered":"2023-12-11T17:11:26.730842+0000","last_clean":"2023-12-11T17:11:26.730842+0000","last_became_active":"2023-12-11T17:11:26.723730+0000","last_became_peered":"2023-12-11T17:11:26.723730+0000","last_unstale":"2023-12-11T17:11:26.730842+0000","last_undegraded":"2023-12-11T17:11:26.730842+0000","last_fullsized":"2023-12-11T17:11:26.730842+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:09:27.333941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.14","version":"38'6","reported_seq":18,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.896391+0000","last_change":"2023-12-11T17:11:25.682816+0000","last_active":"2023-12-11T17:11:27.896391+0000","last_peered":"2023-12-11T17:11:27.896391+0000","last_clean":"2023-12-11T17:11:27.896391+0000","last_became_active":"2023-12-11T17:11:25.682559+0000","last_became_peered":"2023-12-11T17:11:25.682559+0000","last_unstale":"2023-12-11T17:11:27.896391+0000","last_undegraded":"2023-12-11T17:11:27.896391+0000","last_fullsized":"2023-12-11T17:11:27.896391+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:14:55.571777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.726739+0000","last_change":"2023-12-11T17:11:26.717222+0000","last_active":"2023-12-11T17:11:26.726739+0000","last_peered":"2023-12-11T17:11:26.726739+0000","last_clean":"2023-12-11T17:11:26.726739+0000","last_became_active":"2023-12-11T17:11:26.716868+0000","last_became_peered":"2023-12-11T17:11:26.716868+0000","last_unstale":"2023-12-11T17:11:26.726739+0000","last_undegraded":"2023-12-11T17:11:26.726739+0000","last_fullsized":"2023-12-11T17:11:26.726739+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:44:32.834609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.13","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.896489+0000","last_change":"2023-12-11T17:11:25.685811+0000","last_active":"2023-12-11T17:11:27.896489+0000","last_peered":"2023-12-11T17:11:27.896489+0000","last_clean":"2023-12-11T17:11:27.896489+0000","last_became_active":"2023-12-11T17:11:25.685412+0000","last_became_peered":"2023-12-11T17:11:25.685412+0000","last_unstale":"2023-12-11T17:11:27.896489+0000","last_undegraded":"2023-12-11T17:11:27.896489+0000","last_fullsized":"2023-12-11T17:11:27.896489+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:24:53.100438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.895771+0000","last_change":"2023-12-11T17:11:26.713206+0000","last_active":"2023-12-11T17:11:27.895771+0000","last_peered":"2023-12-11T17:11:27.895771+0000","last_clean":"2023-12-11T17:11:27.895771+0000","last_became_active":"2023-12-11T17:11:26.712899+0000","last_became_peered":"2023-12-11T17:11:26.712899+0000","last_unstale":"2023-12-11T17:11:27.895771+0000","last_undegraded":"2023-12-11T17:11:27.895771+0000","last_fullsized":"2023-12-11T17:11:27.895771+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:42:11.341500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.897344+0000","last_change":"2023-12-11T17:11:25.684512+0000","last_active":"2023-12-11T17:11:27.897344+0000","last_peered":"2023-12-11T17:11:27.897344+0000","last_clean":"2023-12-11T17:11:27.897344+0000","last_became_active":"2023-12-11T17:11:25.683900+0000","last_became_peered":"2023-12-11T17:11:25.683900+0000","last_unstale":"2023-12-11T17:11:27.897344+0000","last_undegraded":"2023-12-11T17:11:27.897344+0000","last_fullsized":"2023-12-11T17:11:27.897344+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:19:14.826181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.728040+0000","last_change":"2023-12-11T17:11:26.724419+0000","last_active":"2023-12-11T17:11:26.728040+0000","last_peered":"2023-12-11T17:11:26.728040+0000","last_clean":"2023-12-11T17:11:26.728040+0000","last_became_active":"2023-12-11T17:11:26.723917+0000","last_became_peered":"2023-12-11T17:11:26.723917+0000","last_unstale":"2023-12-11T17:11:26.728040+0000","last_undegraded":"2023-12-11T17:11:26.728040+0000","last_fullsized":"2023-12-11T17:11:26.728040+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:20:28.132731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.713337+0000","last_change":"2023-12-11T17:11:25.680602+0000","last_active":"2023-12-11T17:11:27.713337+0000","last_peered":"2023-12-11T17:11:27.713337+0000","last_clean":"2023-12-11T17:11:27.713337+0000","last_became_active":"2023-12-11T17:11:25.680288+0000","last_became_peered":"2023-12-11T17:11:25.680288+0000","last_unstale":"2023-12-11T17:11:27.713337+0000","last_undegraded":"2023-12-11T17:11:27.713337+0000","last_fullsized":"2023-12-11T17:11:27.713337+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T20:12:48.992756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.896245+0000","last_change":"2023-12-11T17:11:26.709840+0000","last_active":"2023-12-11T17:11:27.896245+0000","last_peered":"2023-12-11T17:11:27.896245+0000","last_clean":"2023-12-11T17:11:27.896245+0000","last_became_active":"2023-12-11T17:11:26.709386+0000","last_became_peered":"2023-12-11T17:11:26.709386+0000","last_unstale":"2023-12-11T17:11:27.896245+0000","last_undegraded":"2023-12-11T17:11:27.896245+0000","last_fullsized":"2023-12-11T17:11:27.896245+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:30:30.919622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.10","version":"38'8","reported_seq":19,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.731509+0000","last_change":"2023-12-11T17:11:25.681586+0000","last_active":"2023-12-11T17:11:26.731509+0000","last_peered":"2023-12-11T17:11:26.731509+0000","last_clean":"2023-12-11T17:11:26.731509+0000","last_became_active":"2023-12-11T17:11:25.680658+0000","last_became_peered":"2023-12-11T17:11:25.680658+0000","last_unstale":"2023-12-11T17:11:26.731509+0000","last_undegraded":"2023-12-11T17:11:26.731509+0000","last_fullsized":"2023-12-11T17:11:26.731509+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:20:42.612274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.896199+0000","last_change":"2023-12-11T17:11:26.695102+0000","last_active":"2023-12-11T17:11:27.896199+0000","last_peered":"2023-12-11T17:11:27.896199+0000","last_clean":"2023-12-11T17:11:27.896199+0000","last_became_active":"2023-12-11T17:11:26.694487+0000","last_became_peered":"2023-12-11T17:11:26.694487+0000","last_unstale":"2023-12-11T17:11:27.896199+0000","last_undegraded":"2023-12-11T17:11:27.896199+0000","last_fullsized":"2023-12-11T17:11:27.896199+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:44:24.531680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"38'1","reported_seq":13,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.851671+0000","last_change":"2023-12-11T17:11:25.687522+0000","last_active":"2023-12-11T17:11:27.851671+0000","last_peered":"2023-12-11T17:11:27.851671+0000","last_clean":"2023-12-11T17:11:27.851671+0000","last_became_active":"2023-12-11T17:11:25.687083+0000","last_became_peered":"2023-12-11T17:11:25.687083+0000","last_unstale":"2023-12-11T17:11:27.851671+0000","last_undegraded":"2023-12-11T17:11:27.851671+0000","last_fullsized":"2023-12-11T17:11:27.851671+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:35:25.704016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.851810+0000","last_change":"2023-12-11T17:11:26.727488+0000","last_active":"2023-12-11T17:11:27.851810+0000","last_peered":"2023-12-11T17:11:27.851810+0000","last_clean":"2023-12-11T17:11:27.851810+0000","last_became_active":"2023-12-11T17:11:26.727182+0000","last_became_peered":"2023-12-11T17:11:26.727182+0000","last_unstale":"2023-12-11T17:11:27.851810+0000","last_undegraded":"2023-12-11T17:11:27.851810+0000","last_fullsized":"2023-12-11T17:11:27.851810+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:45:05.383435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.e","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.734230+0000","last_change":"2023-12-11T17:11:25.689884+0000","last_active":"2023-12-11T17:11:26.734230+0000","last_peered":"2023-12-11T17:11:26.734230+0000","last_clean":"2023-12-11T17:11:26.734230+0000","last_became_active":"2023-12-11T17:11:25.689616+0000","last_became_peered":"2023-12-11T17:11:25.689616+0000","last_unstale":"2023-12-11T17:11:26.734230+0000","last_undegraded":"2023-12-11T17:11:26.734230+0000","last_fullsized":"2023-12-11T17:11:26.734230+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:30:31.019166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.720567+0000","last_change":"2023-12-11T17:11:26.717782+0000","last_active":"2023-12-11T17:11:26.720567+0000","last_peered":"2023-12-11T17:11:26.720567+0000","last_clean":"2023-12-11T17:11:26.720567+0000","last_became_active":"2023-12-11T17:11:26.717464+0000","last_became_peered":"2023-12-11T17:11:26.717464+0000","last_unstale":"2023-12-11T17:11:26.720567+0000","last_undegraded":"2023-12-11T17:11:26.720567+0000","last_fullsized":"2023-12-11T17:11:26.720567+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T17:15:22.647845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"38'1","reported_seq":12,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.725389+0000","last_change":"2023-12-11T17:11:25.677121+0000","last_active":"2023-12-11T17:11:26.725389+0000","last_peered":"2023-12-11T17:11:26.725389+0000","last_clean":"2023-12-11T17:11:26.725389+0000","last_became_active":"2023-12-11T17:11:25.676809+0000","last_became_peered":"2023-12-11T17:11:25.676809+0000","last_unstale":"2023-12-11T17:11:26.725389+0000","last_undegraded":"2023-12-11T17:11:26.725389+0000","last_fullsized":"2023-12-11T17:11:26.725389+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:05:50.230664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.708221+0000","last_change":"2023-12-11T17:11:26.702504+0000","last_active":"2023-12-11T17:11:26.708221+0000","last_peered":"2023-12-11T17:11:26.708221+0000","last_clean":"2023-12-11T17:11:26.708221+0000","last_became_active":"2023-12-11T17:11:26.702193+0000","last_became_peered":"2023-12-11T17:11:26.702193+0000","last_unstale":"2023-12-11T17:11:26.708221+0000","last_undegraded":"2023-12-11T17:11:26.708221+0000","last_fullsized":"2023-12-11T17:11:26.708221+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:10:24.933247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.897135+0000","last_change":"2023-12-11T17:11:25.682408+0000","last_active":"2023-12-11T17:11:27.897135+0000","last_peered":"2023-12-11T17:11:27.897135+0000","last_clean":"2023-12-11T17:11:27.897135+0000","last_became_active":"2023-12-11T17:11:25.682135+0000","last_became_peered":"2023-12-11T17:11:25.682135+0000","last_unstale":"2023-12-11T17:11:27.897135+0000","last_undegraded":"2023-12-11T17:11:27.897135+0000","last_fullsized":"2023-12-11T17:11:27.897135+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T17:15:21.635315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.728084+0000","last_change":"2023-12-11T17:11:26.725460+0000","last_active":"2023-12-11T17:11:26.728084+0000","last_peered":"2023-12-11T17:11:26.728084+0000","last_clean":"2023-12-11T17:11:26.728084+0000","last_became_active":"2023-12-11T17:11:26.724612+0000","last_became_peered":"2023-12-11T17:11:26.724612+0000","last_unstale":"2023-12-11T17:11:26.728084+0000","last_undegraded":"2023-12-11T17:11:26.728084+0000","last_fullsized":"2023-12-11T17:11:26.728084+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:19:15.838711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"38'2","reported_seq":13,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.730698+0000","last_change":"2023-12-11T17:11:25.675366+0000","last_active":"2023-12-11T17:11:26.730698+0000","last_peered":"2023-12-11T17:11:26.730698+0000","last_clean":"2023-12-11T17:11:26.730698+0000","last_became_active":"2023-12-11T17:11:25.673658+0000","last_became_peered":"2023-12-11T17:11:25.673658+0000","last_unstale":"2023-12-11T17:11:26.730698+0000","last_undegraded":"2023-12-11T17:11:26.730698+0000","last_fullsized":"2023-12-11T17:11:26.730698+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:23:12.681818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.712268+0000","last_change":"2023-12-11T17:11:26.708315+0000","last_active":"2023-12-11T17:11:26.712268+0000","last_peered":"2023-12-11T17:11:26.712268+0000","last_clean":"2023-12-11T17:11:26.712268+0000","last_became_active":"2023-12-11T17:11:26.708033+0000","last_became_peered":"2023-12-11T17:11:26.708033+0000","last_unstale":"2023-12-11T17:11:26.712268+0000","last_undegraded":"2023-12-11T17:11:26.712268+0000","last_fullsized":"2023-12-11T17:11:26.712268+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T17:15:22.647845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.679142+0000","last_change":"2023-12-11T17:11:25.684451+0000","last_active":"2023-12-11T17:11:26.679142+0000","last_peered":"2023-12-11T17:11:26.679142+0000","last_clean":"2023-12-11T17:11:26.679142+0000","last_became_active":"2023-12-11T17:11:25.682930+0000","last_became_peered":"2023-12-11T17:11:25.682930+0000","last_unstale":"2023-12-11T17:11:26.679142+0000","last_undegraded":"2023-12-11T17:11:26.679142+0000","last_fullsized":"2023-12-11T17:11:26.679142+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T01:22:50.769156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.850907+0000","last_change":"2023-12-11T17:11:26.712126+0000","last_active":"2023-12-11T17:11:27.850907+0000","last_peered":"2023-12-11T17:11:27.850907+0000","last_clean":"2023-12-11T17:11:27.850907+0000","last_became_active":"2023-12-11T17:11:26.711523+0000","last_became_peered":"2023-12-11T17:11:26.711523+0000","last_unstale":"2023-12-11T17:11:27.850907+0000","last_undegraded":"2023-12-11T17:11:27.850907+0000","last_fullsized":"2023-12-11T17:11:27.850907+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:41:35.312401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.701336+0000","last_change":"2023-12-11T17:11:25.679783+0000","last_active":"2023-12-11T17:11:26.701336+0000","last_peered":"2023-12-11T17:11:26.701336+0000","last_clean":"2023-12-11T17:11:26.701336+0000","last_became_active":"2023-12-11T17:11:25.679449+0000","last_became_peered":"2023-12-11T17:11:25.679449+0000","last_unstale":"2023-12-11T17:11:26.701336+0000","last_undegraded":"2023-12-11T17:11:26.701336+0000","last_fullsized":"2023-12-11T17:11:26.701336+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T17:15:21.635315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.896382+0000","last_change":"2023-12-11T17:11:26.709987+0000","last_active":"2023-12-11T17:11:27.896382+0000","last_peered":"2023-12-11T17:11:27.896382+0000","last_clean":"2023-12-11T17:11:27.896382+0000","last_became_active":"2023-12-11T17:11:26.709532+0000","last_became_peered":"2023-12-11T17:11:26.709532+0000","last_unstale":"2023-12-11T17:11:27.896382+0000","last_undegraded":"2023-12-11T17:11:27.896382+0000","last_fullsized":"2023-12-11T17:11:27.896382+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T17:30:17.644157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.679834+0000","last_change":"2023-12-11T17:11:25.672420+0000","last_active":"2023-12-11T17:11:26.679834+0000","last_peered":"2023-12-11T17:11:26.679834+0000","last_clean":"2023-12-11T17:11:26.679834+0000","last_became_active":"2023-12-11T17:11:25.672095+0000","last_became_peered":"2023-12-11T17:11:25.672095+0000","last_unstale":"2023-12-11T17:11:26.679834+0000","last_undegraded":"2023-12-11T17:11:26.679834+0000","last_fullsized":"2023-12-11T17:11:26.679834+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T21:47:08.927941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.897298+0000","last_change":"2023-12-11T17:11:26.716913+0000","last_active":"2023-12-11T17:11:27.897298+0000","last_peered":"2023-12-11T17:11:27.897298+0000","last_clean":"2023-12-11T17:11:27.897298+0000","last_became_active":"2023-12-11T17:11:26.716638+0000","last_became_peered":"2023-12-11T17:11:26.716638+0000","last_unstale":"2023-12-11T17:11:27.897298+0000","last_undegraded":"2023-12-11T17:11:27.897298+0000","last_fullsized":"2023-12-11T17:11:27.897298+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:35:26.716545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"38'2","reported_seq":14,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.851878+0000","last_change":"2023-12-11T17:11:25.687364+0000","last_active":"2023-12-11T17:11:27.851878+0000","last_peered":"2023-12-11T17:11:27.851878+0000","last_clean":"2023-12-11T17:11:27.851878+0000","last_became_active":"2023-12-11T17:11:25.686669+0000","last_became_peered":"2023-12-11T17:11:25.686669+0000","last_unstale":"2023-12-11T17:11:27.851878+0000","last_undegraded":"2023-12-11T17:11:27.851878+0000","last_fullsized":"2023-12-11T17:11:27.851878+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:14:55.571777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.727970+0000","last_change":"2023-12-11T17:11:26.723887+0000","last_active":"2023-12-11T17:11:26.727970+0000","last_peered":"2023-12-11T17:11:26.727970+0000","last_clean":"2023-12-11T17:11:26.727970+0000","last_became_active":"2023-12-11T17:11:26.723589+0000","last_became_peered":"2023-12-11T17:11:26.723589+0000","last_unstale":"2023-12-11T17:11:26.727970+0000","last_undegraded":"2023-12-11T17:11:26.727970+0000","last_fullsized":"2023-12-11T17:11:26.727970+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:35:26.716545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.681351+0000","last_change":"2023-12-11T17:11:25.689254+0000","last_active":"2023-12-11T17:11:26.681351+0000","last_peered":"2023-12-11T17:11:26.681351+0000","last_clean":"2023-12-11T17:11:26.681351+0000","last_became_active":"2023-12-11T17:11:25.689058+0000","last_became_peered":"2023-12-11T17:11:25.689058+0000","last_unstale":"2023-12-11T17:11:26.681351+0000","last_undegraded":"2023-12-11T17:11:26.681351+0000","last_fullsized":"2023-12-11T17:11:26.681351+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:00:06.681773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.896848+0000","last_change":"2023-12-11T17:11:26.713896+0000","last_active":"2023-12-11T17:11:27.896848+0000","last_peered":"2023-12-11T17:11:27.896848+0000","last_clean":"2023-12-11T17:11:27.896848+0000","last_became_active":"2023-12-11T17:11:26.713591+0000","last_became_peered":"2023-12-11T17:11:26.713591+0000","last_unstale":"2023-12-11T17:11:27.896848+0000","last_undegraded":"2023-12-11T17:11:27.896848+0000","last_fullsized":"2023-12-11T17:11:27.896848+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:33:47.471050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.703038+0000","last_change":"2023-12-11T17:11:25.681014+0000","last_active":"2023-12-11T17:11:26.703038+0000","last_peered":"2023-12-11T17:11:26.703038+0000","last_clean":"2023-12-11T17:11:26.703038+0000","last_became_active":"2023-12-11T17:11:25.680711+0000","last_became_peered":"2023-12-11T17:11:25.680711+0000","last_unstale":"2023-12-11T17:11:26.703038+0000","last_undegraded":"2023-12-11T17:11:26.703038+0000","last_fullsized":"2023-12-11T17:11:26.703038+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T18:30:31.019166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.727343+0000","last_change":"2023-12-11T17:11:26.720619+0000","last_active":"2023-12-11T17:11:26.727343+0000","last_peered":"2023-12-11T17:11:26.727343+0000","last_clean":"2023-12-11T17:11:26.727343+0000","last_became_active":"2023-12-11T17:11:26.720264+0000","last_became_peered":"2023-12-11T17:11:26.720264+0000","last_unstale":"2023-12-11T17:11:26.727343+0000","last_undegraded":"2023-12-11T17:11:26.727343+0000","last_fullsized":"2023-12-11T17:11:26.727343+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:26:02.339725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.702850+0000","last_change":"2023-12-11T17:11:25.681604+0000","last_active":"2023-12-11T17:11:26.702850+0000","last_peered":"2023-12-11T17:11:26.702850+0000","last_clean":"2023-12-11T17:11:26.702850+0000","last_became_active":"2023-12-11T17:11:25.680648+0000","last_became_peered":"2023-12-11T17:11:25.680648+0000","last_unstale":"2023-12-11T17:11:26.702850+0000","last_undegraded":"2023-12-11T17:11:26.702850+0000","last_fullsized":"2023-12-11T17:11:26.702850+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:19:14.826181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.895820+0000","last_change":"2023-12-11T17:11:26.705750+0000","last_active":"2023-12-11T17:11:27.895820+0000","last_peered":"2023-12-11T17:11:27.895820+0000","last_clean":"2023-12-11T17:11:27.895820+0000","last_became_active":"2023-12-11T17:11:26.705414+0000","last_became_peered":"2023-12-11T17:11:26.705414+0000","last_unstale":"2023-12-11T17:11:27.895820+0000","last_undegraded":"2023-12-11T17:11:27.895820+0000","last_fullsized":"2023-12-11T17:11:27.895820+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:47:40.305060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.715969+0000","last_change":"2023-12-11T17:11:25.682555+0000","last_active":"2023-12-11T17:11:27.715969+0000","last_peered":"2023-12-11T17:11:27.715969+0000","last_clean":"2023-12-11T17:11:27.715969+0000","last_became_active":"2023-12-11T17:11:25.682195+0000","last_became_peered":"2023-12-11T17:11:25.682195+0000","last_unstale":"2023-12-11T17:11:27.715969+0000","last_undegraded":"2023-12-11T17:11:27.715969+0000","last_fullsized":"2023-12-11T17:11:27.715969+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T22:20:27.120201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.727259+0000","last_change":"2023-12-11T17:11:26.720169+0000","last_active":"2023-12-11T17:11:26.727259+0000","last_peered":"2023-12-11T17:11:26.727259+0000","last_clean":"2023-12-11T17:11:26.727259+0000","last_became_active":"2023-12-11T17:11:26.719593+0000","last_became_peered":"2023-12-11T17:11:26.719593+0000","last_unstale":"2023-12-11T17:11:26.727259+0000","last_undegraded":"2023-12-11T17:11:26.727259+0000","last_fullsized":"2023-12-11T17:11:26.727259+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:44:32.834609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.713616+0000","last_change":"2023-12-11T17:11:25.684634+0000","last_active":"2023-12-11T17:11:26.713616+0000","last_peered":"2023-12-11T17:11:26.713616+0000","last_clean":"2023-12-11T17:11:26.713616+0000","last_became_active":"2023-12-11T17:11:25.683902+0000","last_became_peered":"2023-12-11T17:11:25.683902+0000","last_unstale":"2023-12-11T17:11:26.713616+0000","last_undegraded":"2023-12-11T17:11:26.713616+0000","last_fullsized":"2023-12-11T17:11:26.713616+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T03:20:42.612274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":9,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.725785+0000","last_change":"2023-12-11T17:11:26.720468+0000","last_active":"2023-12-11T17:11:26.725785+0000","last_peered":"2023-12-11T17:11:26.725785+0000","last_clean":"2023-12-11T17:11:26.725785+0000","last_became_active":"2023-12-11T17:11:26.720147+0000","last_became_peered":"2023-12-11T17:11:26.720147+0000","last_unstale":"2023-12-11T17:11:26.725785+0000","last_undegraded":"2023-12-11T17:11:26.725785+0000","last_fullsized":"2023-12-11T17:11:26.725785+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T23:24:40.668465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":12,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.895529+0000","last_change":"2023-12-11T17:11:25.680109+0000","last_active":"2023-12-11T17:11:27.895529+0000","last_peered":"2023-12-11T17:11:27.895529+0000","last_clean":"2023-12-11T17:11:27.895529+0000","last_became_active":"2023-12-11T17:11:25.679825+0000","last_became_peered":"2023-12-11T17:11:25.679825+0000","last_unstale":"2023-12-11T17:11:27.895529+0000","last_undegraded":"2023-12-11T17:11:27.895529+0000","last_fullsized":"2023-12-11T17:11:27.895529+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T02:35:25.704016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":11,"reported_epoch":39,"state":"active+clean","last_fresh":"2023-12-11T17:11:27.851471+0000","last_change":"2023-12-11T17:11:26.715881+0000","last_active":"2023-12-11T17:11:27.851471+0000","last_peered":"2023-12-11T17:11:27.851471+0000","last_clean":"2023-12-11T17:11:27.851471+0000","last_became_active":"2023-12-11T17:11:26.715618+0000","last_became_peered":"2023-12-11T17:11:26.715618+0000","last_unstale":"2023-12-11T17:11:27.851471+0000","last_undegraded":"2023-12-11T17:11:27.851471+0000","last_fullsized":"2023-12-11T17:11:27.851471+0000","mapping_epoch":37,"log_start":"0'0","ondisk_log_start":"0'0","created":37,"last_epoch_clean":38,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:25.642632+0000","last_clean_scrub_stamp":"2023-12-11T17:11:25.642632+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T04:55:43.681557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":11,"reported_epoch":38,"state":"active+clean","last_fresh":"2023-12-11T17:11:26.708369+0000","last_change":"2023-12-11T17:11:25.681625+0000","last_active":"2023-12-11T17:11:26.708369+0000","last_peered":"2023-12-11T17:11:26.708369+0000","last_clean":"2023-12-11T17:11:26.708369+0000","last_became_active":"2023-12-11T17:11:25.681136+0000","last_became_peered":"2023-12-11T17:11:25.681136+0000","last_unstale":"2023-12-11T17:11:26.708369+0000","last_undegraded":"2023-12-11T17:11:26.708369+0000","last_fullsized":"2023-12-11T17:11:26.708369+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":36,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:11:24.630102+0000","last_clean_scrub_stamp":"2023-12-11T17:11:24.630102+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-13T00:33:20.772932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"18'117","reported_seq":178,"reported_epoch":37,"state":"active+clean","last_fresh":"2023-12-11T17:11:25.670329+0000","last_change":"2023-12-11T17:09:40.320298+0000","last_active":"2023-12-11T17:11:25.670329+0000","last_peered":"2023-12-11T17:11:25.670329+0000","last_clean":"2023-12-11T17:11:25.670329+0000","last_became_active":"2023-12-11T17:09:40.318118+0000","last_became_peered":"2023-12-11T17:09:40.318118+0000","last_unstale":"2023-12-11T17:11:25.670329+0000","last_undegraded":"2023-12-11T17:11:25.670329+0000","last_fullsized":"2023-12-11T17:11:25.670329+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-11T17:09:38.641841+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-11T17:09:38.641841+0000","last_clean_scrub_stamp":"2023-12-11T17:09:38.641841+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-12T19:36:05.856847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":6,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542168,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343824,"statfs":{"total":96636764160,"available":96608075776,"internally_reserved":0,"allocated":1015808,"data_stored":768602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"min":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":2.2719999999999998,"5min":2.2719999999999998,"15min":2.2719999999999998},"last":0.88},{"interface":"front","average":{"1min":1.157,"5min":1.157,"15min":1.157},"min":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":1.9119999999999999,"5min":1.9119999999999999,"15min":1.9119999999999999},"last":0.92100000000000004}]},{"osd":1,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.8,"5min":1.8,"15min":1.8},"last":0.75800000000000001},{"interface":"front","average":{"1min":1.252,"5min":1.252,"15min":1.252},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.0169999999999999,"5min":2.0169999999999999,"15min":2.0169999999999999},"last":1.321}]},{"osd":2,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.3260000000000001,"15min":1.3260000000000001},"min":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.71999999999999997},"max":{"1min":2.4780000000000002,"5min":2.4780000000000002,"15min":2.4780000000000002},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.3420000000000001,"5min":1.3420000000000001,"15min":1.3420000000000001},"min":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":2.3809999999999998,"5min":2.3809999999999998,"15min":2.3809999999999998},"last":0.98499999999999999}]},{"osd":3,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.3480000000000001,"5min":1.3480000000000001,"15min":1.3480000000000001},"min":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"max":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"last":1.1910000000000001},{"interface":"front","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.488,"5min":2.488,"15min":2.488},"last":1.0680000000000001}]},{"osd":4,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":2.3570000000000002,"5min":2.3570000000000002,"15min":2.3570000000000002},"last":1.4710000000000001},{"interface":"front","average":{"1min":1.556,"5min":1.556,"15min":1.556},"min":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"max":{"1min":2.5840000000000001,"5min":2.5840000000000001,"15min":2.5840000000000001},"last":1.2549999999999999}]},{"osd":5,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.524,"5min":1.524,"15min":1.524},"min":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":2.1749999999999998,"5min":2.1749999999999998,"15min":2.1749999999999998},"last":1.4510000000000001},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":1.206,"5min":1.206,"15min":1.206},"max":{"1min":3.3410000000000002,"5min":3.3410000000000002,"15min":3.3410000000000002},"last":1.5740000000000001}]},{"osd":6,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.6719999999999999,"5min":1.6719999999999999,"15min":1.6719999999999999},"min":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"max":{"1min":2.2690000000000001,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":1.5069999999999999},{"interface":"front","average":{"1min":1.7629999999999999,"5min":1.7629999999999999,"15min":1.7629999999999999},"min":{"1min":1.222,"5min":1.222,"15min":1.222},"max":{"1min":3.2250000000000001,"5min":3.2250000000000001,"15min":3.2250000000000001},"last":1.6859999999999999}]}]},{"osd":6,"up_from":14,"seq":60129542169,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":192531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":0.873},{"interface":"front","average":{"1min":1.032,"5min":1.032,"15min":1.032},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.389}]},{"osd":1,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.331,"5min":1.331,"15min":1.331},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.869,"5min":1.869,"15min":1.869},"last":1.4490000000000001},{"interface":"front","average":{"1min":1.397,"5min":1.397,"15min":1.397},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"last":1.7929999999999999}]},{"osd":2,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"min":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":1.835,"5min":1.835,"15min":1.835},"last":1.2330000000000001},{"interface":"front","average":{"1min":1.321,"5min":1.321,"15min":1.321},"min":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":1.992,"5min":1.992,"15min":1.992},"last":1.5509999999999999}]},{"osd":3,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.2829999999999999,"5min":1.2829999999999999,"15min":1.2829999999999999},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.883,"5min":1.883,"15min":1.883},"last":1.5980000000000001},{"interface":"front","average":{"1min":1.4119999999999999,"5min":1.4119999999999999,"15min":1.4119999999999999},"min":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"max":{"1min":2.4860000000000002,"5min":2.4860000000000002,"15min":2.4860000000000002},"last":1.0129999999999999}]},{"osd":4,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.23,"5min":1.23,"15min":1.23},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":1.542,"5min":1.542,"15min":1.542},"last":1.3149999999999999},{"interface":"front","average":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"min":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":1.518}]},{"osd":5,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.415,"5min":1.415,"15min":1.415},"min":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"max":{"1min":1.847,"5min":1.847,"15min":1.847},"last":1.49},{"interface":"front","average":{"1min":1.6859999999999999,"5min":1.6859999999999999,"15min":1.6859999999999999},"min":{"1min":1.288,"5min":1.288,"15min":1.288},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":1.6519999999999999}]},{"osd":7,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":1.5089999999999999,"15min":1.5089999999999999},"min":{"1min":1.173,"5min":1.173,"15min":1.173},"max":{"1min":2.3119999999999998,"5min":2.3119999999999998,"15min":2.3119999999999998},"last":1.869},{"interface":"front","average":{"1min":1.5580000000000001,"5min":1.5580000000000001,"15min":1.5580000000000001},"min":{"1min":1.139,"5min":1.139,"15min":1.139},"max":{"1min":2.871,"5min":2.871,"15min":2.871},"last":1.7629999999999999}]}]},{"osd":5,"up_from":14,"seq":60129542169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":442368,"data_stored":185441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 17:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.1220000000000001,"5min":1.1220000000000001,"15min":1.1220000000000001},"min":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.83599999999999997},"max":{"1min":1.3029999999999999,"5min":1.3029999999999999,"15min":1.3029999999999999},"last":0.97799999999999998},{"interface":"front","average":{"1min":1.119,"5min":1.119,"15min":1.119},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":1.6890000000000001},"last":1.139}]},{"osd":1,"last update":"Mon Dec 11 17:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.532,"5min":1.532,"15min":1.532},"last":1.393},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":1.413}]},{"osd":2,"last update":"Mon Dec 11 17:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"min":{"1min":0.71399999999999997,"5min":0.71399999999999997,"15min":0.71399999999999997},"max":{"1min":2.3919999999999999,"5min":2.3919999999999999,"15min":2.3919999999999999},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.3859999999999999,"15min":1.3859999999999999},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":1.9379999999999999,"5min":1.9379999999999999,"15min":1.9379999999999999},"last":1.2709999999999999}]},{"osd":3,"last update":"Mon Dec 11 17:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.4430000000000001,"5min":1.4430000000000001,"15min":1.4430000000000001},"min":{"1min":1.0449999999999999,"5min":1.0449999999999999,"15min":1.0449999999999999},"max":{"1min":2.0390000000000001,"5min":2.0390000000000001,"15min":2.0390000000000001},"last":1.034},{"interface":"front","average":{"1min":1.5700000000000001,"5min":1.5700000000000001,"15min":1.5700000000000001},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":3.133,"5min":3.133,"15min":3.133},"last":0.85499999999999998}]},{"osd":4,"last update":"Mon Dec 11 17:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.3939999999999999,"5min":1.3939999999999999,"15min":1.3939999999999999},"min":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"max":{"1min":2.113,"5min":2.113,"15min":2.113},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.512,"5min":1.512,"15min":1.512},"min":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.353}]},{"osd":6,"last update":"Mon Dec 11 17:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.6060000000000001,"5min":1.6060000000000001,"15min":1.6060000000000001},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":3.6429999999999998,"5min":3.6429999999999998,"15min":3.6429999999999998},"last":1.4630000000000001},{"interface":"front","average":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":2.9630000000000001,"5min":2.9630000000000001,"15min":2.9630000000000001},"last":1.218}]},{"osd":7,"last update":"Mon Dec 11 17:10:37 2023","interfaces":[{"interface":"back","average":{"1min":1.6279999999999999,"5min":1.6279999999999999,"15min":1.6279999999999999},"min":{"1min":0.99399999999999999,"5min":0.99399999999999999,"15min":0.99399999999999999},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":1.4990000000000001},{"interface":"front","average":{"1min":1.696,"5min":1.696,"15min":1.696},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":3.274,"5min":3.274,"15min":3.274},"last":1.526}]}]},{"osd":4,"up_from":14,"seq":60129542169,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27436,"kb_used_data":412,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344404,"statfs":{"total":96636764160,"available":96608669696,"internally_reserved":0,"allocated":421888,"data_stored":178234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.145,"5min":1.145,"15min":1.145},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":2.27,"5min":2.27,"15min":2.27},"last":1.4199999999999999},{"interface":"front","average":{"1min":1.196,"5min":1.196,"15min":1.196},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":1.6519999999999999},"last":1.6850000000000001}]},{"osd":1,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":1.155,"15min":1.155},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":1.742,"5min":1.742,"15min":1.742},"last":1.117},{"interface":"front","average":{"1min":1.0489999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":1.625,"5min":1.625,"15min":1.625},"last":1.621}]},{"osd":2,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"min":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"max":{"1min":1.976,"5min":1.976,"15min":1.976},"last":1.7150000000000001},{"interface":"front","average":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":1.673,"5min":1.673,"15min":1.673},"last":1.4850000000000001}]},{"osd":3,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"min":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":1.5820000000000001},"last":1.5629999999999999},{"interface":"front","average":{"1min":1.3899999999999999,"5min":1.3899999999999999,"15min":1.3899999999999999},"min":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"max":{"1min":2.0979999999999999,"5min":2.0979999999999999,"15min":2.0979999999999999},"last":1.655}]},{"osd":5,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.427,"5min":1.427,"15min":1.427},"min":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"max":{"1min":1.9550000000000001,"5min":1.9550000000000001,"15min":1.9550000000000001},"last":1.768},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.747,"5min":0.747,"15min":0.747},"max":{"1min":2.0899999999999999,"5min":2.0899999999999999,"15min":2.0899999999999999},"last":1.0700000000000001}]},{"osd":6,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":1.4159999999999999},"min":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"max":{"1min":2.2469999999999999,"5min":2.2469999999999999,"15min":2.2469999999999999},"last":0.93200000000000005},{"interface":"front","average":{"1min":1.5629999999999999,"5min":1.5629999999999999,"15min":1.5629999999999999},"min":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"max":{"1min":2.0350000000000001,"5min":2.0350000000000001,"15min":2.0350000000000001},"last":1.5860000000000001}]},{"osd":7,"last update":"Mon Dec 11 17:10:38 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.2370000000000001,"5min":2.2370000000000001,"15min":2.2370000000000001},"last":1.353},{"interface":"front","average":{"1min":1.5229999999999999,"5min":1.5229999999999999,"15min":1.5229999999999999},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.1859999999999999,"5min":2.1859999999999999,"15min":2.1859999999999999},"last":1.528}]}]},{"osd":3,"up_from":14,"seq":60129542170,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27476,"kb_used_data":452,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344364,"statfs":{"total":96636764160,"available":96608628736,"internally_reserved":0,"allocated":462848,"data_stored":193595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1592,"internal_metadata":27654600},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":2.6339999999999999,"5min":2.6339999999999999,"15min":2.6339999999999999},"last":0.871},{"interface":"front","average":{"1min":1.1699999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":2.7709999999999999,"5min":2.7709999999999999,"15min":2.7709999999999999},"last":1.3300000000000001}]},{"osd":1,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.107,"5min":1.107,"15min":1.107},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":3.1120000000000001,"5min":3.1120000000000001,"15min":3.1120000000000001},"last":0.82799999999999996},{"interface":"front","average":{"1min":1.296,"5min":1.296,"15min":1.296},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":2.6749999999999998,"5min":2.6749999999999998,"15min":2.6749999999999998},"last":0.76400000000000001}]},{"osd":2,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"min":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"max":{"1min":2.0419999999999998,"5min":2.0419999999999998,"15min":2.0419999999999998},"last":1.5780000000000001},{"interface":"front","average":{"1min":1.506,"5min":1.506,"15min":1.506},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":2.7109999999999999,"5min":2.7109999999999999,"15min":2.7109999999999999},"last":1.595}]},{"osd":4,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.425,"5min":1.425,"15min":1.425},"min":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"max":{"1min":2.8090000000000002,"5min":2.8090000000000002,"15min":2.8090000000000002},"last":1.4950000000000001},{"interface":"front","average":{"1min":1.516,"5min":1.516,"15min":1.516},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":2.5390000000000001,"5min":2.5390000000000001,"15min":2.5390000000000001},"last":1.512}]},{"osd":5,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.7270000000000001,"5min":1.7270000000000001,"15min":1.7270000000000001},"min":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"max":{"1min":3.4889999999999999,"5min":3.4889999999999999,"15min":3.4889999999999999},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":1.5600000000000001}]},{"osd":6,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.5920000000000001,"5min":1.5920000000000001,"15min":1.5920000000000001},"min":{"1min":0.91900000000000004,"5min":0.91900000000000004,"15min":0.91900000000000004},"max":{"1min":2.5859999999999999,"5min":2.5859999999999999,"15min":2.5859999999999999},"last":1.3779999999999999},{"interface":"front","average":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":1.7889999999999999},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":3.5289999999999999,"5min":3.5289999999999999,"15min":3.5289999999999999},"last":1.4419999999999999}]},{"osd":7,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.7450000000000001,"5min":1.7450000000000001,"15min":1.7450000000000001},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.8759999999999999,"5min":2.8759999999999999,"15min":2.8759999999999999},"last":1.1739999999999999},{"interface":"front","average":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":1.6000000000000001},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":2.6379999999999999,"5min":2.6379999999999999,"15min":2.6379999999999999},"last":1.1240000000000001}]}]},{"osd":2,"up_from":14,"seq":60129542168,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27452,"kb_used_data":428,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344388,"statfs":{"total":96636764160,"available":96608653312,"internally_reserved":0,"allocated":438272,"data_stored":185399,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"min":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"max":{"1min":1.6120000000000001,"5min":1.6120000000000001,"15min":1.6120000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":1.008,"5min":1.008,"15min":1.008},"min":{"1min":0.42499999999999999,"5min":0.42499999999999999,"15min":0.42499999999999999},"max":{"1min":2.2410000000000001,"5min":2.2410000000000001,"15min":2.2410000000000001},"last":0.90300000000000002}]},{"osd":1,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"min":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.226},{"interface":"front","average":{"1min":1.109,"5min":1.109,"15min":1.109},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.968,"5min":1.968,"15min":1.968},"last":1.1619999999999999}]},{"osd":3,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.036,"5min":1.036,"15min":1.036},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.476,"5min":1.476,"15min":1.476},"last":1.3029999999999999},{"interface":"front","average":{"1min":1.224,"5min":1.224,"15min":1.224},"min":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"max":{"1min":1.7689999999999999,"5min":1.7689999999999999,"15min":1.7689999999999999},"last":0.97299999999999998}]},{"osd":4,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.4390000000000001,"5min":1.4390000000000001,"15min":1.4390000000000001},"min":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"max":{"1min":1.905,"5min":1.905,"15min":1.905},"last":1.353},{"interface":"front","average":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":1.454}]},{"osd":5,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.2430000000000001,"5min":1.2430000000000001,"15min":1.2430000000000001},"min":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"max":{"1min":1.867,"5min":1.867,"15min":1.867},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"min":{"1min":1.0800000000000001,"5min":1.0800000000000001,"15min":1.0800000000000001},"max":{"1min":2.2589999999999999,"5min":2.2589999999999999,"15min":2.2589999999999999},"last":1.542}]},{"osd":6,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.419,"5min":1.419,"15min":1.419},"min":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"max":{"1min":2.278,"5min":2.278,"15min":2.278},"last":1.581},{"interface":"front","average":{"1min":1.365,"5min":1.365,"15min":1.365},"min":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"max":{"1min":2.0099999999999998,"5min":2.0099999999999998,"15min":2.0099999999999998},"last":1.4079999999999999}]},{"osd":7,"last update":"Mon Dec 11 17:10:39 2023","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"max":{"1min":2.339,"5min":2.339,"15min":2.339},"last":1.6839999999999999},{"interface":"front","average":{"1min":1.4710000000000001,"5min":1.4710000000000001,"15min":1.4710000000000001},"min":{"1min":1.1020000000000001,"5min":1.1020000000000001,"15min":1.1020000000000001},"max":{"1min":1.9019999999999999,"5min":1.9019999999999999,"15min":1.9019999999999999},"last":1.5}]}]},{"osd":1,"up_from":14,"seq":60129542169,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27464,"kb_used_data":440,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344376,"statfs":{"total":96636764160,"available":96608641024,"internally_reserved":0,"allocated":450560,"data_stored":192039,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Dec 11 17:10:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1279999999999999,"5min":1.1279999999999999,"15min":1.1279999999999999},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":4.9790000000000001,"5min":4.9790000000000001,"15min":4.9790000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.0129999999999999,"15min":1.0129999999999999},"min":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"max":{"1min":1.9910000000000001,"5min":1.9910000000000001,"15min":1.9910000000000001},"last":0.79400000000000004}]},{"osd":2,"last update":"Mon Dec 11 17:10:40 2023","interfaces":[{"interface":"back","average":{"1min":1.1419999999999999,"5min":1.1419999999999999,"15min":1.1419999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.6499999999999999,"5min":1.6499999999999999,"15min":1.6499999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":1.083,"5min":1.083,"15min":1.083},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.873,"5min":1.873,"15min":1.873},"last":0.62}]},{"osd":3,"last update":"Mon Dec 11 17:10:40 2023","interfaces":[{"interface":"back","average":{"1min":1.222,"5min":1.222,"15min":1.222},"min":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"last":0.497},{"interface":"front","average":{"1min":1.28,"5min":1.28,"15min":1.28},"min":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"max":{"1min":2.669,"5min":2.669,"15min":2.669},"last":0.84499999999999997}]},{"osd":4,"last update":"Mon Dec 11 17:10:40 2023","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.96299999999999997},{"interface":"front","average":{"1min":1.589,"5min":1.589,"15min":1.589},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":4.8630000000000004,"5min":4.8630000000000004,"15min":4.8630000000000004},"last":0.75800000000000001}]},{"osd":5,"last update":"Mon Dec 11 17:10:40 2023","interfaces":[{"interface":"back","average":{"1min":1.6679999999999999,"5min":1.6679999999999999,"15min":1.6679999999999999},"min":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"max":{"1min":4.9450000000000003,"5min":4.9450000000000003,"15min":4.9450000000000003},"last":0.82699999999999996},{"interface":"front","average":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":1.4379999999999999},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":2.3610000000000002,"5min":2.3610000000000002,"15min":2.3610000000000002},"last":1.391}]},{"osd":6,"last update":"Mon Dec 11 17:10:40 2023","interfaces":[{"interface":"back","average":{"1min":1.482,"5min":1.482,"15min":1.482},"min":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"max":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"last":1.304},{"interface":"front","average":{"1min":1.7509999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":4.9089999999999998,"5min":4.9089999999999998,"15min":4.9089999999999998},"last":0.92200000000000004}]},{"osd":7,"last update":"Mon Dec 11 17:10:40 2023","interfaces":[{"interface":"back","average":{"1min":1.5940000000000001,"5min":1.5940000000000001,"15min":1.5940000000000001},"min":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"max":{"1min":2.294,"5min":2.294,"15min":2.294},"last":1.115},{"interface":"front","average":{"1min":1.5880000000000001,"5min":1.5880000000000001,"15min":1.5880000000000001},"min":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":0.97599999999999998},"max":{"1min":2.7519999999999998,"5min":2.7519999999999998,"15min":2.7519999999999998},"last":1.3640000000000001}]}]},{"osd":0,"up_from":14,"seq":60129542169,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28028,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343812,"statfs":{"total":96636764160,"available":96608063488,"internally_reserved":0,"allocated":1032192,"data_stored":775731,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Dec 11 17:10:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":3.8879999999999999,"5min":3.8879999999999999,"15min":3.8879999999999999},"last":0.75},{"interface":"front","average":{"1min":1.125,"5min":1.125,"15min":1.125},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":3.4089999999999998,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":0.51300000000000001}]},{"osd":2,"last update":"Mon Dec 11 17:10:41 2023","interfaces":[{"interface":"back","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.899,"5min":1.899,"15min":1.899},"last":0.88700000000000001},{"interface":"front","average":{"1min":1.323,"5min":1.323,"15min":1.323},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":3.7879999999999998,"5min":3.7879999999999998,"15min":3.7879999999999998},"last":0.59999999999999998}]},{"osd":3,"last update":"Mon Dec 11 17:10:41 2023","interfaces":[{"interface":"back","average":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"min":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"max":{"1min":1.397,"5min":1.397,"15min":1.397},"last":0.80800000000000005},{"interface":"front","average":{"1min":1.2509999999999999,"5min":1.2509999999999999,"15min":1.2509999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":2.1890000000000001,"5min":2.1890000000000001,"15min":2.1890000000000001},"last":1.0269999999999999}]},{"osd":4,"last update":"Mon Dec 11 17:10:41 2023","interfaces":[{"interface":"back","average":{"1min":1.52,"5min":1.52,"15min":1.52},"min":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"max":{"1min":3.6699999999999999,"5min":3.6699999999999999,"15min":3.6699999999999999},"last":1.052},{"interface":"front","average":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":2.9159999999999999,"5min":2.9159999999999999,"15min":2.9159999999999999},"last":1.252}]},{"osd":5,"last update":"Mon Dec 11 17:10:41 2023","interfaces":[{"interface":"back","average":{"1min":1.466,"5min":1.466,"15min":1.466},"min":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"max":{"1min":3.5409999999999999,"5min":3.5409999999999999,"15min":3.5409999999999999},"last":1.163},{"interface":"front","average":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"min":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"max":{"1min":3.8410000000000002,"5min":3.8410000000000002,"15min":3.8410000000000002},"last":1.216}]},{"osd":6,"last update":"Mon Dec 11 17:10:41 2023","interfaces":[{"interface":"back","average":{"1min":1.663,"5min":1.663,"15min":1.663},"min":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"max":{"1min":3.927,"5min":3.927,"15min":3.927},"last":1.288},{"interface":"front","average":{"1min":1.6779999999999999,"5min":1.6779999999999999,"15min":1.6779999999999999},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":3.7170000000000001,"5min":3.7170000000000001,"15min":3.7170000000000001},"last":1.1240000000000001}]},{"osd":7,"last update":"Mon Dec 11 17:10:41 2023","interfaces":[{"interface":"back","average":{"1min":1.6819999999999999,"5min":1.6819999999999999,"15min":1.6819999999999999},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":3.7519999999999998,"5min":3.7519999999999998,"15min":3.7519999999999998},"last":0.98299999999999998},{"interface":"front","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"max":{"1min":3.0219999999999998,"5min":3.0219999999999998,"15min":3.0219999999999998},"last":1.077}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-12-11T17:11:31.708 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-11T17:11:31.708 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-11T17:11:31.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.985+0000 7f13a97bc640 1 Processor -- start 2023-12-11T17:11:31.986 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.985+0000 7f13a97bc640 1 -- start start 2023-12-11T17:11:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.987+0000 7f13a97bc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f13a415d5f0 0x7f13a40d1550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.987+0000 7f13a97bc640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f13a40d1a90 0x7f13a41672d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.987+0000 7f13a97bc640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13a40cdb80 con 0x7f13a415d210 2023-12-11T17:11:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.987+0000 7f13a97bc640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a40d1f20 con 0x7f13a415d5f0 2023-12-11T17:11:31.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.987+0000 7f13a97bc640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13a40b48e0 con 0x7f13a40d1a90 2023-12-11T17:11:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.987+0000 7f13a37fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f13a415d5f0 0x7f13a40d1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.987+0000 7f13a37fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f13a415d5f0 0x7f13a40d1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57556/0 (socket says 172.21.15.37:57556) 2023-12-11T17:11:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.987+0000 7f13a37fe640 1 -- 172.21.15.37:0/3510071741 learned_addr learned my addr 172.21.15.37:0/3510071741 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.988+0000 7f13a8fbb640 1 --2- 172.21.15.37:0/3510071741 >> v2:172.21.15.151:3300/0 conn(0x7f13a40d1a90 0x7f13a41672d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.988+0000 7f13a37fe640 1 -- 172.21.15.37:0/3510071741 >> v2:172.21.15.151:3300/0 conn(0x7f13a40d1a90 msgr2=0x7f13a41672d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.988+0000 7f13a37fe640 1 --2- 172.21.15.37:0/3510071741 >> v2:172.21.15.151:3300/0 conn(0x7f13a40d1a90 0x7f13a41672d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.988+0000 7f13a37fe640 1 -- 172.21.15.37:0/3510071741 >> v1:172.21.15.151:6789/0 conn(0x7f13a415d210 legacy=0x7f13a40d3680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:31.989 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.988+0000 7f13a37fe640 1 -- 172.21.15.37:0/3510071741 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13a40cddb0 con 0x7f13a415d5f0 2023-12-11T17:11:31.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.990+0000 7f13a37fe640 1 --2- 172.21.15.37:0/3510071741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a415d5f0 0x7f13a40d1550 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f13980098a0 tx=0x7f139802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea9ec51f90c7dc67 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:31.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.990+0000 7f13a2ffd640 1 -- 172.21.15.37:0/3510071741 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398030840 con 0x7f13a415d5f0 2023-12-11T17:11:31.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.990+0000 7f13a2ffd640 1 -- 172.21.15.37:0/3510071741 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13980309a0 con 0x7f13a415d5f0 2023-12-11T17:11:31.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.990+0000 7f13a2ffd640 1 -- 172.21.15.37:0/3510071741 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1398030d30 con 0x7f13a415d5f0 2023-12-11T17:11:31.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.991+0000 7f13a97bc640 1 -- 172.21.15.37:0/3510071741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a415d5f0 msgr2=0x7f13a40d1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:31.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.991+0000 7f13a97bc640 1 --2- 172.21.15.37:0/3510071741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a415d5f0 0x7f13a40d1550 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f13980098a0 tx=0x7f139802b980 comp rx=0 tx=0).stop 2023-12-11T17:11:31.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.991+0000 7f13a97bc640 1 -- 172.21.15.37:0/3510071741 shutdown_connections 2023-12-11T17:11:31.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.991+0000 7f13a97bc640 1 --2- 172.21.15.37:0/3510071741 >> v2:172.21.15.151:3300/0 conn(0x7f13a40d1a90 0x7f13a41672d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:31.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.991+0000 7f13a97bc640 1 --2- 172.21.15.37:0/3510071741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a415d5f0 0x7f13a40d1550 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:31.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.991+0000 7f13a97bc640 1 -- 172.21.15.37:0/3510071741 >> 172.21.15.37:0/3510071741 conn(0x7f13a409c250 msgr2=0x7f13a40d2f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:31.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.991+0000 7f13a97bc640 1 -- 172.21.15.37:0/3510071741 shutdown_connections 2023-12-11T17:11:31.992 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.991+0000 7f13a97bc640 1 -- 172.21.15.37:0/3510071741 wait complete. 2023-12-11T17:11:31.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.993+0000 7f13a97bc640 1 Processor -- start 2023-12-11T17:11:31.994 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.993+0000 7f13a97bc640 1 -- start start 2023-12-11T17:11:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.994+0000 7f13a97bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a40d1a90 0x7f13a406c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.994+0000 7f13a97bc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13a415d210 0x7f13a40cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.994+0000 7f13a97bc640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13a415d5f0 0x7f13a40b6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:31.995 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.994+0000 7f13a97bc640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a406b520 con 0x7f13a40d1a90 2023-12-11T17:11:31.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.994+0000 7f13a97bc640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13a406b800 con 0x7f13a415d210 2023-12-11T17:11:31.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.994+0000 7f13a97bc640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13a406bae0 con 0x7f13a415d5f0 2023-12-11T17:11:31.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.994+0000 7f13a3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a40d1a90 0x7f13a406c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:31.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.994+0000 7f13a3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a40d1a90 0x7f13a406c5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57564/0 (socket says 172.21.15.37:57564) 2023-12-11T17:11:31.996 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.994+0000 7f13a3fff640 1 -- 172.21.15.37:0/2593111667 learned_addr learned my addr 172.21.15.37:0/2593111667 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:31.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.995+0000 7f13a3fff640 1 -- 172.21.15.37:0/2593111667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13a415d5f0 msgr2=0x7f13a40b6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:31.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.995+0000 7f13a3fff640 1 --2- 172.21.15.37:0/2593111667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13a415d5f0 0x7f13a40b6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:31.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.995+0000 7f13a3fff640 1 -- 172.21.15.37:0/2593111667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13a415d210 msgr2=0x7f13a40cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:31.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.995+0000 7f13a3fff640 1 --2- 172.21.15.37:0/2593111667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13a415d210 0x7f13a40cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:31.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.995+0000 7f13a3fff640 1 -- 172.21.15.37:0/2593111667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13980094d0 con 0x7f13a40d1a90 2023-12-11T17:11:31.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.995+0000 7f13a3fff640 1 --2- 172.21.15.37:0/2593111667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a40d1a90 0x7f13a406c5c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f139400c450 tx=0x7f139400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:31.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.995+0000 7f13a0ff9640 1 -- 172.21.15.37:0/2593111667 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13940052d0 con 0x7f13a40d1a90 2023-12-11T17:11:31.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.996+0000 7f13a0ff9640 1 -- 172.21.15.37:0/2593111667 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1394005430 con 0x7f13a40d1a90 2023-12-11T17:11:31.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.996+0000 7f13a0ff9640 1 -- 172.21.15.37:0/2593111667 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1394003830 con 0x7f13a40d1a90 2023-12-11T17:11:31.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.996+0000 7f13a97bc640 1 -- 172.21.15.37:0/2593111667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13a406bdc0 con 0x7f13a40d1a90 2023-12-11T17:11:31.997 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.996+0000 7f13a97bc640 1 -- 172.21.15.37:0/2593111667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13a406b1b0 con 0x7f13a40d1a90 2023-12-11T17:11:31.998 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.997+0000 7f13a97bc640 1 -- 172.21.15.37:0/2593111667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13a406c2e0 con 0x7f13a40d1a90 2023-12-11T17:11:31.999 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.998+0000 7f13a0ff9640 1 -- 172.21.15.37:0/2593111667 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1394003990 con 0x7f13a40d1a90 2023-12-11T17:11:32.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:31.999+0000 7f13a0ff9640 1 --2- 172.21.15.37:0/2593111667 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f139006ae40 0x7f139006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:32.000 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.000+0000 7f13a0ff9640 1 -- 172.21.15.37:0/2593111667 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 6029+0+0 (secure 0 0 0) 0x7f1394088e70 con 0x7f13a40d1a90 2023-12-11T17:11:32.001 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.000+0000 7f13a37fe640 1 --2- 172.21.15.37:0/2593111667 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f139006ae40 0x7f139006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:32.002 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.001+0000 7f13a37fe640 1 --2- 172.21.15.37:0/2593111667 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f139006ae40 0x7f139006d300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1398036000 tx=0x7f139803b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:32.005 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.004+0000 7f13a0ff9640 1 -- 172.21.15.37:0/2593111667 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1394053cb0 con 0x7f13a40d1a90 2023-12-11T17:11:32.269 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.268+0000 7f13a97bc640 1 -- 172.21.15.37:0/2593111667 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f13a4074450 con 0x7f13a40d1a90 2023-12-11T17:11:32.273 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.272+0000 7f13a0ff9640 1 -- 172.21.15.37:0/2593111667 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+147 (secure 0 0 0) 0x7f1394017020 con 0x7f13a40d1a90 2023-12-11T17:11:32.273 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2023-12-11T17:11:32.274 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAcQndliHmLGxAA+EpFpS2I98RG7SN1gAiRLQ== 2023-12-11T17:11:32.274 INFO:teuthology.orchestra.run.smithi037.stdout: caps mds = "allow" 2023-12-11T17:11:32.274 INFO:teuthology.orchestra.run.smithi037.stdout: caps mon = "allow r" 2023-12-11T17:11:32.274 INFO:teuthology.orchestra.run.smithi037.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2023-12-11T17:11:32.274 INFO:teuthology.orchestra.run.smithi037.stderr:updated caps for client.0 2023-12-11T17:11:32.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.275+0000 7f13a97bc640 1 -- 172.21.15.37:0/2593111667 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f139006ae40 msgr2=0x7f139006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:32.276 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.275+0000 7f13a97bc640 1 --2- 172.21.15.37:0/2593111667 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f139006ae40 0x7f139006d300 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f1398036000 tx=0x7f139803b040 comp rx=0 tx=0).stop 2023-12-11T17:11:32.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.275+0000 7f13a97bc640 1 -- 172.21.15.37:0/2593111667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a40d1a90 msgr2=0x7f13a406c5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:32.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.275+0000 7f13a97bc640 1 --2- 172.21.15.37:0/2593111667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a40d1a90 0x7f13a406c5c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f139400c450 tx=0x7f139400c910 comp rx=0 tx=0).stop 2023-12-11T17:11:32.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.275+0000 7f13a97bc640 1 -- 172.21.15.37:0/2593111667 shutdown_connections 2023-12-11T17:11:32.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.275+0000 7f13a97bc640 1 --2- 172.21.15.37:0/2593111667 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f139006ae40 0x7f139006d300 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:32.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.275+0000 7f13a97bc640 1 --2- 172.21.15.37:0/2593111667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f13a415d210 0x7f13a40cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:32.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.275+0000 7f13a97bc640 1 --2- 172.21.15.37:0/2593111667 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f13a415d5f0 0x7f13a40b6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:32.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.275+0000 7f13a97bc640 1 --2- 172.21.15.37:0/2593111667 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f13a40d1a90 0x7f13a406c5c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:32.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.275+0000 7f13a97bc640 1 -- 172.21.15.37:0/2593111667 >> 172.21.15.37:0/2593111667 conn(0x7f13a409c250 msgr2=0x7f13a415fab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:32.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.275+0000 7f13a97bc640 1 -- 172.21.15.37:0/2593111667 shutdown_connections 2023-12-11T17:11:32.277 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.276+0000 7f13a97bc640 1 -- 172.21.15.37:0/2593111667 wait complete. 2023-12-11T17:11:32.297 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-11T17:11:32.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.519+0000 7f28eb59e640 1 Processor -- start 2023-12-11T17:11:32.520 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.519+0000 7f28eb59e640 1 -- start start 2023-12-11T17:11:32.527 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.521+0000 7f28eb59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28ec0b35c0 0x7f28ec06a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.521+0000 7f28eb59e640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f28ec146870 0x7f28ec06a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.521+0000 7f28eb59e640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28ec146150 con 0x7f28ec146320 2023-12-11T17:11:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.521+0000 7f28eb59e640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28ec0b5060 con 0x7f28ec146870 2023-12-11T17:11:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.521+0000 7f28eb59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0cfa50 con 0x7f28ec0b35c0 2023-12-11T17:11:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.522+0000 7f28e3fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f28ec146320 0x7f28ec160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35006/0 (socket says 172.21.15.37:35006) 2023-12-11T17:11:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.522+0000 7f28e3fff640 1 -- 172.21.15.37:0/4042473693 learned_addr learned my addr 172.21.15.37:0/4042473693 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:32.528 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.522+0000 7f28e9d9b640 1 -- 172.21.15.37:0/4042473693 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3789926956 0 0) 0x7f28ec146150 con 0x7f28ec146320 2023-12-11T17:11:32.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.522+0000 7f28ead9d640 1 --2- 172.21.15.37:0/4042473693 >> v2:172.21.15.151:3300/0 conn(0x7f28ec146870 0x7f28ec06a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:32.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.522+0000 7f28e9d9b640 1 -- 172.21.15.37:0/4042473693 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f28d8003520 con 0x7f28ec146320 2023-12-11T17:11:32.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.522+0000 7f28ea59c640 1 --2- 172.21.15.37:0/4042473693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28ec0b35c0 0x7f28ec06a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:32.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.522+0000 7f28e9d9b640 1 -- 172.21.15.37:0/4042473693 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 495499166 0 0) 0x7f28d8003520 con 0x7f28ec146320 2023-12-11T17:11:32.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.522+0000 7f28e9d9b640 1 -- 172.21.15.37:0/4042473693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28ec0b35c0 msgr2=0x7f28ec06a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:32.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.522+0000 7f28e9d9b640 1 --2- 172.21.15.37:0/4042473693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28ec0b35c0 0x7f28ec06a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:32.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.522+0000 7f28e9d9b640 1 -- 172.21.15.37:0/4042473693 >> v2:172.21.15.151:3300/0 conn(0x7f28ec146870 msgr2=0x7f28ec06a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:32.529 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.522+0000 7f28e9d9b640 1 --2- 172.21.15.37:0/4042473693 >> v2:172.21.15.151:3300/0 conn(0x7f28ec146870 0x7f28ec06a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.522+0000 7f28e9d9b640 1 -- 172.21.15.37:0/4042473693 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec0cfd30 con 0x7f28ec146320 2023-12-11T17:11:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.523+0000 7f28e9d9b640 1 -- 172.21.15.37:0/4042473693 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f28d4001670 con 0x7f28ec146320 2023-12-11T17:11:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.523+0000 7f28ead9d640 1 --2- 172.21.15.37:0/4042473693 >> v2:172.21.15.151:3300/0 conn(0x7f28ec146870 0x7f28ec06a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-11T17:11:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.523+0000 7f28e9d9b640 1 -- 172.21.15.37:0/4042473693 >> v1:172.21.15.37:6789/0 conn(0x7f28ec146320 legacy=0x7f28ec160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.523+0000 7f28e9d9b640 1 --2- 172.21.15.37:0/4042473693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28d8003970 0x7f28d8003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.523+0000 7f28e9d9b640 1 --2- 172.21.15.37:0/4042473693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28d80047c0 0x7f28d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.523+0000 7f28e9d9b640 1 --2- 172.21.15.37:0/4042473693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28d8005180 0x7f28d800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:32.530 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.523+0000 7f28e9d9b640 1 -- 172.21.15.37:0/4042473693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0b5060 con 0x7f28d80047c0 2023-12-11T17:11:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.523+0000 7f28e9d9b640 1 -- 172.21.15.37:0/4042473693 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec0cfa50 con 0x7f28d8005180 2023-12-11T17:11:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.523+0000 7f28e9d9b640 1 -- 172.21.15.37:0/4042473693 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d800bef0 con 0x7f28d8003970 2023-12-11T17:11:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.523+0000 7f28e3fff640 1 --2- 172.21.15.37:0/4042473693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28d80047c0 0x7f28d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.523+0000 7f28ea59c640 1 --2- 172.21.15.37:0/4042473693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28d8003970 0x7f28d8003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.523+0000 7f28e3fff640 1 -- 172.21.15.37:0/4042473693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28d8003970 msgr2=0x7f28d8003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.523+0000 7f28e3fff640 1 --2- 172.21.15.37:0/4042473693 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28d8003970 0x7f28d8003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.523+0000 7f28ead9d640 1 --2- 172.21.15.37:0/4042473693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28d8005180 0x7f28d800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:32.531 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.523+0000 7f28e3fff640 1 -- 172.21.15.37:0/4042473693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28d8005180 msgr2=0x7f28d800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.523+0000 7f28e3fff640 1 --2- 172.21.15.37:0/4042473693 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28d8005180 0x7f28d800b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.523+0000 7f28e3fff640 1 -- 172.21.15.37:0/4042473693 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d8003520 con 0x7f28d80047c0 2023-12-11T17:11:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.525+0000 7f28e3fff640 1 --2- 172.21.15.37:0/4042473693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28d80047c0 0x7f28d8004c40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f28d400c160 tx=0x7f28d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ff64716a3936f37 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.525+0000 7f28e9d9b640 1 -- 172.21.15.37:0/4042473693 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d4005ad0 con 0x7f28d80047c0 2023-12-11T17:11:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.525+0000 7f28e9d9b640 1 -- 172.21.15.37:0/4042473693 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d4005c30 con 0x7f28d80047c0 2023-12-11T17:11:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.525+0000 7f28e9d9b640 1 -- 172.21.15.37:0/4042473693 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d402c810 con 0x7f28d80047c0 2023-12-11T17:11:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.525+0000 7f28eb59e640 1 -- 172.21.15.37:0/4042473693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28d80047c0 msgr2=0x7f28d8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:32.532 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.525+0000 7f28eb59e640 1 --2- 172.21.15.37:0/4042473693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28d80047c0 0x7f28d8004c40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f28d400c160 tx=0x7f28d80057f0 comp rx=0 tx=0).stop 2023-12-11T17:11:32.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.525+0000 7f28ead9d640 1 -- 172.21.15.37:0/4042473693 reap_dead start 2023-12-11T17:11:32.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.526+0000 7f28eb59e640 1 -- 172.21.15.37:0/4042473693 shutdown_connections 2023-12-11T17:11:32.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.526+0000 7f28eb59e640 1 -- 172.21.15.37:0/4042473693 >> 172.21.15.37:0/4042473693 conn(0x7f28ec0b1840 msgr2=0x7f28ec0b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:32.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.526+0000 7f28eb59e640 1 -- 172.21.15.37:0/4042473693 shutdown_connections 2023-12-11T17:11:32.533 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.526+0000 7f28eb59e640 1 -- 172.21.15.37:0/4042473693 wait complete. 2023-12-11T17:11:32.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.527+0000 7f28eb59e640 1 Processor -- start 2023-12-11T17:11:32.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.528+0000 7f28eb59e640 1 -- start start 2023-12-11T17:11:32.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.528+0000 7f28eb59e640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28d80047c0 0x7f28ec1f2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:32.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.528+0000 7f28eb59e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28ec1f2540 0x7f28ec140b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:32.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.528+0000 7f28eb59e640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28ec1410a0 0x7f28ec13e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:32.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.528+0000 7f28eb59e640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec1f3690 con 0x7f28ec1410a0 2023-12-11T17:11:32.536 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.528+0000 7f28eb59e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec1f2a80 con 0x7f28ec1f2540 2023-12-11T17:11:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.528+0000 7f28eb59e640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28ec1f2d60 con 0x7f28d80047c0 2023-12-11T17:11:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.529+0000 7f28ead9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28ec1410a0 0x7f28ec13e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.529+0000 7f28ead9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28ec1410a0 0x7f28ec13e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57586/0 (socket says 172.21.15.37:57586) 2023-12-11T17:11:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.529+0000 7f28ead9d640 1 -- 172.21.15.37:0/4144924781 learned_addr learned my addr 172.21.15.37:0/4144924781 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.529+0000 7f28e3fff640 1 --2- 172.21.15.37:0/4144924781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28ec1f2540 0x7f28ec140b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.529+0000 7f28ea59c640 1 --2- 172.21.15.37:0/4144924781 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28d80047c0 0x7f28ec1f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.529+0000 7f28ead9d640 1 -- 172.21.15.37:0/4144924781 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28d80047c0 msgr2=0x7f28ec1f2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.529+0000 7f28ead9d640 1 --2- 172.21.15.37:0/4144924781 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28d80047c0 0x7f28ec1f2000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.529+0000 7f28ead9d640 1 -- 172.21.15.37:0/4144924781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28ec1f2540 msgr2=0x7f28ec140b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.529+0000 7f28ead9d640 1 --2- 172.21.15.37:0/4144924781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28ec1f2540 0x7f28ec140b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.529+0000 7f28ead9d640 1 -- 172.21.15.37:0/4144924781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28ec1f3040 con 0x7f28ec1410a0 2023-12-11T17:11:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.529+0000 7f28ead9d640 1 --2- 172.21.15.37:0/4144924781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28ec1410a0 0x7f28ec13e9e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f28ec0725e0 tx=0x7f28e4004840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.530+0000 7f28e2ffd640 1 -- 172.21.15.37:0/4144924781 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e4007cb0 con 0x7f28ec1410a0 2023-12-11T17:11:32.537 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.530+0000 7f28e2ffd640 1 -- 172.21.15.37:0/4144924781 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28e4007e50 con 0x7f28ec1410a0 2023-12-11T17:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.530+0000 7f28e2ffd640 1 -- 172.21.15.37:0/4144924781 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28e4014640 con 0x7f28ec1410a0 2023-12-11T17:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.530+0000 7f28eb59e640 1 -- 172.21.15.37:0/4144924781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28ec1f3320 con 0x7f28ec1410a0 2023-12-11T17:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.530+0000 7f28eb59e640 1 -- 172.21.15.37:0/4144924781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28ec13f100 con 0x7f28ec1410a0 2023-12-11T17:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.531+0000 7f28eb59e640 1 -- 172.21.15.37:0/4144924781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28ec13f350 con 0x7f28ec1410a0 2023-12-11T17:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.532+0000 7f28e2ffd640 1 -- 172.21.15.37:0/4144924781 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f28e40147a0 con 0x7f28ec1410a0 2023-12-11T17:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.533+0000 7f28e2ffd640 1 --2- 172.21.15.37:0/4144924781 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f28cc06ae70 0x7f28cc06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.533+0000 7f28e2ffd640 1 -- 172.21.15.37:0/4144924781 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f28e40893f0 con 0x7f28ec1410a0 2023-12-11T17:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.533+0000 7f28ea59c640 1 --2- 172.21.15.37:0/4144924781 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f28cc06ae70 0x7f28cc06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.534+0000 7f28ea59c640 1 --2- 172.21.15.37:0/4144924781 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f28cc06ae70 0x7f28cc06d330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f28ec141600 tx=0x7f28dc008040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:32.538 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.537+0000 7f28e2ffd640 1 -- 172.21.15.37:0/4144924781 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f28e4057e70 con 0x7f28ec1410a0 2023-12-11T17:11:32.766 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.765+0000 7f28eb59e640 1 -- 172.21.15.37:0/4144924781 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28ec0673f0 con 0x7f28ec1410a0 2023-12-11T17:11:32.767 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.766+0000 7f28e2ffd640 1 -- 172.21.15.37:0/4144924781 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) v1 ==== 94+0+4916 (secure 0 0 0) 0x7f28e4057a00 con 0x7f28ec1410a0 2023-12-11T17:11:32.767 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:11:32.767 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":17,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4697,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/2560634941","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":2560634941},{"type":"v1","addr":"172.21.15.151:6837","nonce":2560634941}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4703,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.37:6835/1658416108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6834","nonce":1658416108},{"type":"v1","addr":"172.21.15.37:6835","nonce":1658416108}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":12},{"gid":4963,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/634584168","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":634584168},{"type":"v1","addr":"172.21.15.151:6835","nonce":634584168}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-11T17:11:26.130781+0000","modified":"2023-12-11T17:11:29.213218+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}},"max_mds":1,"in":[0],"up":{"mds_0":5322},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5322":{"gid":5322,"name":"a","rank":0,"incarnation":13,"state":"up:active","state_seq":4,"addr":"172.21.15.37:6833/4124618590","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6832","nonce":4124618590},{"type":"v1","addr":"172.21.15.37:6833","nonce":4124618590}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments"}}}},"data_pools":[6],"metadata_pool":5,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-11T17:11:32.767 INFO:teuthology.orchestra.run.smithi037.stderr:dumped fsmap epoch 17 2023-12-11T17:11:32.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.768+0000 7f28eb59e640 1 -- 172.21.15.37:0/4144924781 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f28cc06ae70 msgr2=0x7f28cc06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:32.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.768+0000 7f28eb59e640 1 --2- 172.21.15.37:0/4144924781 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f28cc06ae70 0x7f28cc06d330 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f28ec141600 tx=0x7f28dc008040 comp rx=0 tx=0).stop 2023-12-11T17:11:32.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.768+0000 7f28eb59e640 1 -- 172.21.15.37:0/4144924781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28ec1410a0 msgr2=0x7f28ec13e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:32.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.768+0000 7f28eb59e640 1 --2- 172.21.15.37:0/4144924781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28ec1410a0 0x7f28ec13e9e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f28ec0725e0 tx=0x7f28e4004840 comp rx=0 tx=0).stop 2023-12-11T17:11:32.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.769+0000 7f28eb59e640 1 -- 172.21.15.37:0/4144924781 shutdown_connections 2023-12-11T17:11:32.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.769+0000 7f28eb59e640 1 --2- 172.21.15.37:0/4144924781 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f28cc06ae70 0x7f28cc06d330 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:32.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.769+0000 7f28eb59e640 1 --2- 172.21.15.37:0/4144924781 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f28ec1f2540 0x7f28ec140b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:32.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.769+0000 7f28eb59e640 1 --2- 172.21.15.37:0/4144924781 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f28ec1410a0 0x7f28ec13e9e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:32.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.769+0000 7f28eb59e640 1 --2- 172.21.15.37:0/4144924781 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f28d80047c0 0x7f28ec1f2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:32.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.769+0000 7f28eb59e640 1 -- 172.21.15.37:0/4144924781 >> 172.21.15.37:0/4144924781 conn(0x7f28ec0b1840 msgr2=0x7f28ec143aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:32.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.769+0000 7f28eb59e640 1 -- 172.21.15.37:0/4144924781 shutdown_connections 2023-12-11T17:11:32.770 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:32.769+0000 7f28eb59e640 1 -- 172.21.15.37:0/4144924781 wait complete. 2023-12-11T17:11:33.192 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-11T17:11:26.130781+0000', 'modified': '2023-12-11T17:11:29.213218+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5322}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5322': {'gid': 5322, 'name': 'a', 'rank': 0, 'incarnation': 13, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.37:6833/4124618590', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.37:6832', 'nonce': 4124618590}, {'type': 'v1', 'addr': '172.21.15.37:6833', 'nonce': 4124618590}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments'}}}}, 'data_pools': [6], 'metadata_pool': 5, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-11T17:11:33.193 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-11T17:11:33.193 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-11T17:11:33.430 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.429+0000 7f66d36e7640 1 Processor -- start 2023-12-11T17:11:33.431 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.430+0000 7f66d36e7640 1 -- start start 2023-12-11T17:11:33.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.431+0000 7f66d36e7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f66cc1467c0 0x7f66cc0cc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.431+0000 7f66d36e7640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66cc06d510 con 0x7f66cc146ba0 2023-12-11T17:11:33.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.431+0000 7f66d36e7640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66cc06d7f0 con 0x7f66cc06cef0 2023-12-11T17:11:33.432 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.431+0000 7f66d36e7640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66cc0ac860 con 0x7f66cc1467c0 2023-12-11T17:11:33.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.431+0000 7f66d1483640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f66cc1467c0 0x7f66cc0cc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:33.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.432+0000 7f66d1483640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f66cc1467c0 0x7f66cc0cc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57602/0 (socket says 172.21.15.37:57602) 2023-12-11T17:11:33.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.432+0000 7f66d0c82640 1 --1- 172.21.15.37:0/1211471351 >> v1:172.21.15.37:6789/0 conn(0x7f66cc146ba0 0x7f66cc06c7e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35012/0 (socket says 172.21.15.37:35012) 2023-12-11T17:11:33.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.432+0000 7f66d1483640 1 -- 172.21.15.37:0/1211471351 learned_addr learned my addr 172.21.15.37:0/1211471351 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:33.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.432+0000 7f66d1483640 1 -- 172.21.15.37:0/1211471351 >> v1:172.21.15.151:6789/0 conn(0x7f66cc06cef0 legacy=0x7f66cc0accb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:33.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.432+0000 7f66d1483640 1 -- 172.21.15.37:0/1211471351 >> v1:172.21.15.37:6789/0 conn(0x7f66cc146ba0 legacy=0x7f66cc06c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:33.433 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.432+0000 7f66d1483640 1 -- 172.21.15.37:0/1211471351 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66cc06dad0 con 0x7f66cc1467c0 2023-12-11T17:11:33.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.433+0000 7f66d1483640 1 --2- 172.21.15.37:0/1211471351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66cc1467c0 0x7f66cc0cc8f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009870 tx=0x7f66c802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78431a3899d2416f server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:33.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.433+0000 7f66c3fff640 1 -- 172.21.15.37:0/1211471351 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c8030860 con 0x7f66cc1467c0 2023-12-11T17:11:33.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.434+0000 7f66c3fff640 1 -- 172.21.15.37:0/1211471351 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c80309c0 con 0x7f66cc1467c0 2023-12-11T17:11:33.434 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.434+0000 7f66c3fff640 1 -- 172.21.15.37:0/1211471351 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c8030d50 con 0x7f66cc1467c0 2023-12-11T17:11:33.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.434+0000 7f66d36e7640 1 -- 172.21.15.37:0/1211471351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66cc1467c0 msgr2=0x7f66cc0cc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:33.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.434+0000 7f66d36e7640 1 --2- 172.21.15.37:0/1211471351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66cc1467c0 0x7f66cc0cc8f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009870 tx=0x7f66c802b9a0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.434+0000 7f66d36e7640 1 -- 172.21.15.37:0/1211471351 shutdown_connections 2023-12-11T17:11:33.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.434+0000 7f66d36e7640 1 --2- 172.21.15.37:0/1211471351 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66cc1467c0 0x7f66cc0cc8f0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.434+0000 7f66d36e7640 1 -- 172.21.15.37:0/1211471351 >> 172.21.15.37:0/1211471351 conn(0x7f66cc0b0a90 msgr2=0x7f66cc0b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:33.435 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.434+0000 7f66d36e7640 1 -- 172.21.15.37:0/1211471351 shutdown_connections 2023-12-11T17:11:33.436 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.434+0000 7f66d36e7640 1 -- 172.21.15.37:0/1211471351 wait complete. 2023-12-11T17:11:33.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.436+0000 7f66d36e7640 1 Processor -- start 2023-12-11T17:11:33.437 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.436+0000 7f66d36e7640 1 -- start start 2023-12-11T17:11:33.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.437+0000 7f66d36e7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66cc06cef0 0x7f66cc144810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.437+0000 7f66d36e7640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66cc1467c0 0x7f66cc0b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.437+0000 7f66d36e7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66cc146ba0 0x7f66cc15d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.437+0000 7f66d36e7640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc1f36e0 con 0x7f66cc146ba0 2023-12-11T17:11:33.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.437+0000 7f66d36e7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc15bc70 con 0x7f66cc06cef0 2023-12-11T17:11:33.438 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.437+0000 7f66d36e7640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66cc15bea0 con 0x7f66cc1467c0 2023-12-11T17:11:33.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.438+0000 7f66d1c84640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66cc146ba0 0x7f66cc15d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:33.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.438+0000 7f66d1c84640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66cc146ba0 0x7f66cc15d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57604/0 (socket says 172.21.15.37:57604) 2023-12-11T17:11:33.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.438+0000 7f66d1c84640 1 -- 172.21.15.37:0/4276062022 learned_addr learned my addr 172.21.15.37:0/4276062022 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:33.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.438+0000 7f66d1483640 1 --2- 172.21.15.37:0/4276062022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66cc06cef0 0x7f66cc144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:33.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.438+0000 7f66d0c82640 1 --2- 172.21.15.37:0/4276062022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66cc1467c0 0x7f66cc0b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:33.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.438+0000 7f66d1c84640 1 -- 172.21.15.37:0/4276062022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66cc1467c0 msgr2=0x7f66cc0b4210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:33.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.438+0000 7f66d1c84640 1 --2- 172.21.15.37:0/4276062022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66cc1467c0 0x7f66cc0b4210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.438+0000 7f66d1c84640 1 -- 172.21.15.37:0/4276062022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66cc06cef0 msgr2=0x7f66cc144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:33.440 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.438+0000 7f66d1c84640 1 --2- 172.21.15.37:0/4276062022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66cc06cef0 0x7f66cc144810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.438+0000 7f66d1c84640 1 -- 172.21.15.37:0/4276062022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66c80094d0 con 0x7f66cc146ba0 2023-12-11T17:11:33.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.439+0000 7f66d1c84640 1 --2- 172.21.15.37:0/4276062022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66cc146ba0 0x7f66cc15d830 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f66c400c780 tx=0x7f66c400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:33.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.439+0000 7f66c1ffb640 1 -- 172.21.15.37:0/4276062022 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c4003d80 con 0x7f66cc146ba0 2023-12-11T17:11:33.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.439+0000 7f66c1ffb640 1 -- 172.21.15.37:0/4276062022 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c400ce90 con 0x7f66cc146ba0 2023-12-11T17:11:33.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.439+0000 7f66d36e7640 1 -- 172.21.15.37:0/4276062022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66cc15c140 con 0x7f66cc146ba0 2023-12-11T17:11:33.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.439+0000 7f66c1ffb640 1 -- 172.21.15.37:0/4276062022 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c40052b0 con 0x7f66cc146ba0 2023-12-11T17:11:33.441 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.439+0000 7f66d36e7640 1 -- 172.21.15.37:0/4276062022 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66cc15c700 con 0x7f66cc146ba0 2023-12-11T17:11:33.442 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.442+0000 7f66c1ffb640 1 -- 172.21.15.37:0/4276062022 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f66c4005410 con 0x7f66cc146ba0 2023-12-11T17:11:33.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.442+0000 7f66c1ffb640 1 --2- 172.21.15.37:0/4276062022 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f66b006ae40 0x7f66b006d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.443 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.443+0000 7f66c1ffb640 1 -- 172.21.15.37:0/4276062022 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f66c4088c30 con 0x7f66cc146ba0 2023-12-11T17:11:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.443+0000 7f66d627f740 1 Processor -- start 2023-12-11T17:11:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.443+0000 7f66d1483640 1 --2- 172.21.15.37:0/4276062022 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f66b006ae40 0x7f66b006d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:33.444 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.443+0000 7f66d627f740 1 -- start start 2023-12-11T17:11:33.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.444+0000 7f66d627f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c399010 0x56456c3993f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.444+0000 7f66d627f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56456c3692c0 0x56456c396280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.444+0000 7f66d627f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56456c36cb90 0x56456c3967c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.444+0000 7f66d627f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456c2dbf40 con 0x56456c399010 2023-12-11T17:11:33.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.444+0000 7f66d627f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456c2d9630 con 0x56456c36cb90 2023-12-11T17:11:33.446 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.444+0000 7f66d627f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56456c2d4f20 con 0x56456c3692c0 2023-12-11T17:11:33.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.445+0000 7f66d1483640 1 --2- 172.21.15.37:0/4276062022 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f66b006ae40 0x7f66b006d300 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f66c8036000 tx=0x7f66c8008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:33.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.445+0000 7f66d1483640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c399010 0x56456c3993f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:33.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.445+0000 7f66d1483640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c399010 0x56456c3993f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57618/0 (socket says 172.21.15.37:57618) 2023-12-11T17:11:33.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.445+0000 7f66d1483640 1 -- 172.21.15.37:0/4016276860 learned_addr learned my addr 172.21.15.37:0/4016276860 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:33.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.445+0000 7f66d0c82640 1 --2- 172.21.15.37:0/4016276860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56456c3692c0 0x56456c396280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:33.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.445+0000 7f66d1483640 1 -- 172.21.15.37:0/4016276860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56456c3692c0 msgr2=0x56456c396280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:33.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.445+0000 7f66d1483640 1 --2- 172.21.15.37:0/4016276860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56456c3692c0 0x56456c396280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.445+0000 7f66d1c84640 1 --2- 172.21.15.37:0/4016276860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56456c36cb90 0x56456c3967c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:33.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.445+0000 7f66d1483640 1 -- 172.21.15.37:0/4016276860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56456c36cb90 msgr2=0x56456c3967c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:33.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.445+0000 7f66d1483640 1 --2- 172.21.15.37:0/4016276860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56456c36cb90 0x56456c3967c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.445+0000 7f66d1483640 1 -- 172.21.15.37:0/4016276860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56456c297910 con 0x56456c399010 2023-12-11T17:11:33.447 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.445+0000 7f66d1483640 1 --2- 172.21.15.37:0/4016276860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c399010 0x56456c3993f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f66c80090b0 tx=0x7f66c8030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99b85f43c83a1c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.446+0000 7f66b6ffd640 1 -- 172.21.15.37:0/4016276860 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c8049070 con 0x56456c399010 2023-12-11T17:11:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.446+0000 7f66b6ffd640 1 -- 172.21.15.37:0/4016276860 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c80399a0 con 0x56456c399010 2023-12-11T17:11:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.446+0000 7f66b6ffd640 1 -- 172.21.15.37:0/4016276860 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c8039d50 con 0x56456c399010 2023-12-11T17:11:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.446+0000 7f66d627f740 1 -- 172.21.15.37:0/4016276860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c399010 msgr2=0x56456c3993f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.446+0000 7f66d627f740 1 --2- 172.21.15.37:0/4016276860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c399010 0x56456c3993f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f66c80090b0 tx=0x7f66c8030000 comp rx=0 tx=0).stop 2023-12-11T17:11:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.446+0000 7f66d627f740 1 -- 172.21.15.37:0/4016276860 shutdown_connections 2023-12-11T17:11:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.447+0000 7f66d627f740 1 --2- 172.21.15.37:0/4016276860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56456c36cb90 0x56456c3967c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.447+0000 7f66d627f740 1 --2- 172.21.15.37:0/4016276860 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56456c3692c0 0x56456c396280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.447+0000 7f66d627f740 1 --2- 172.21.15.37:0/4016276860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c399010 0x56456c3993f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.447+0000 7f66d627f740 1 -- 172.21.15.37:0/4016276860 >> 172.21.15.37:0/4016276860 conn(0x56456c36b530 msgr2=0x56456c3b3e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.447+0000 7f66d627f740 1 -- 172.21.15.37:0/4016276860 shutdown_connections 2023-12-11T17:11:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.447+0000 7f66d627f740 1 -- 172.21.15.37:0/4016276860 wait complete. 2023-12-11T17:11:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.447+0000 7f66d627f740 1 -- start start 2023-12-11T17:11:33.449 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.448+0000 7f66d627f740 1 Processor -- start 2023-12-11T17:11:33.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.449+0000 7f66d627f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c36cb90 0x56456c38a000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.449+0000 7f66d627f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56456c399010 0x56456c39bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.449+0000 7f66d627f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56456c3a0bb0 0x56456c3a1030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.449+0000 7f66d627f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456c2712f0 con 0x56456c36cb90 2023-12-11T17:11:33.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.449+0000 7f66d627f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456c28ec70 con 0x56456c3a0bb0 2023-12-11T17:11:33.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.449+0000 7f66d627f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56456c037f20 con 0x56456c399010 2023-12-11T17:11:33.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.449+0000 7f66d627f740 10 client.0 _ll_register_callbacks cb 0x56456c2933b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T17:11:33.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.449+0000 7f66d1483640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c36cb90 0x56456c38a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:33.452 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.449+0000 7f66d1483640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c36cb90 0x56456c38a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57622/0 (socket says 172.21.15.37:57622) 2023-12-11T17:11:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.449+0000 7f66d1483640 1 -- 172.21.15.37:0/1578553397 learned_addr learned my addr 172.21.15.37:0/1578553397 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.449+0000 7f66d1483640 1 -- 172.21.15.37:0/1578553397 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56456c399010 msgr2=0x56456c39bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.449+0000 7f66d1483640 1 --2- 172.21.15.37:0/1578553397 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56456c399010 0x56456c39bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.449+0000 7f66d1483640 1 -- 172.21.15.37:0/1578553397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56456c3a0bb0 msgr2=0x56456c3a1030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.449+0000 7f66d1483640 1 --2- 172.21.15.37:0/1578553397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56456c3a0bb0 0x56456c3a1030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.450+0000 7f66d1483640 1 -- 172.21.15.37:0/1578553397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66cc06dad0 con 0x56456c36cb90 2023-12-11T17:11:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.450+0000 7f66d1483640 1 --2- 172.21.15.37:0/1578553397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c36cb90 0x56456c38a000 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009990 tx=0x7f66c8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704fc5ca4947877c server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.450+0000 7f66abfff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-12-11T17:11:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.450+0000 7f66abfff640 1 -- 172.21.15.37:0/1578553397 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c8049040 con 0x56456c36cb90 2023-12-11T17:11:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.450+0000 7f66abfff640 1 -- 172.21.15.37:0/1578553397 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f66c803e040 con 0x56456c36cb90 2023-12-11T17:11:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.450+0000 7f66d627f740 1 -- 172.21.15.37:0/1578553397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x56456c2cddb0 con 0x56456c36cb90 2023-12-11T17:11:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.450+0000 7f66abfff640 1 -- 172.21.15.37:0/1578553397 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66c8044990 con 0x56456c36cb90 2023-12-11T17:11:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.450+0000 7f66d627f740 10 client.5499 fetch_fsmap learned FSMap version 17 2023-12-11T17:11:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.450+0000 7f66d627f740 1 -- 172.21.15.37:0/1578553397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56456c2d35a0 con 0x56456c36cb90 2023-12-11T17:11:33.453 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.451+0000 7f66abfff640 1 -- 172.21.15.37:0/1578553397 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x56456c2cddb0 con 0x56456c36cb90 2023-12-11T17:11:33.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.451+0000 7f66abfff640 1 -- 172.21.15.37:0/1578553397 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f66c8044af0 con 0x56456c36cb90 2023-12-11T17:11:33.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.451+0000 7f66d627f740 10 client.5499 fetch_fsmap finished waiting for FSMap version 17 2023-12-11T17:11:33.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.451+0000 7f66d627f740 10 client.5499 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-11T17:11:33.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.451+0000 7f66d627f740 20 client.5499 populate_metadata read hostname 'smithi037' 2023-12-11T17:11:33.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.451+0000 7f66d627f740 1 --2- 172.21.15.37:0/1578553397 >> [v2:172.21.15.37:6832/4124618590,v1:172.21.15.37:6833/4124618590] conn(0x56456c3c7e10 0x56456c3d17b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.451+0000 7f66d627f740 4 client.5499 mds_command: new command op to 5322 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2023-12-11T17:11:33.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.451+0000 7f66d627f740 1 -- 172.21.15.37:0/1578553397 --> [v2:172.21.15.37:6832/4124618590,v1:172.21.15.37:6833/4124618590] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x56456c2cdad0 con 0x56456c3c7e10 2023-12-11T17:11:33.454 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.451+0000 7f66d0c82640 1 --2- 172.21.15.37:0/1578553397 >> [v2:172.21.15.37:6832/4124618590,v1:172.21.15.37:6833/4124618590] conn(0x56456c3c7e10 0x56456c3d17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:33.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.452+0000 7f66d0c82640 1 --2- 172.21.15.37:0/1578553397 >> [v2:172.21.15.37:6832/4124618590,v1:172.21.15.37:6833/4124618590] conn(0x56456c3c7e10 0x56456c3d17b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e93c652dd33f4907 server_cookie=ff48540ecdefd154 in_seq=0 out_seq=0 2023-12-11T17:11:33.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.452+0000 7f66abfff640 10 client.5499 ms_handle_connect on v2:172.21.15.37:6832/4124618590 2023-12-11T17:11:33.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.453+0000 7f66abfff640 1 -- 172.21.15.37:0/1578553397 <== mds.0 v2:172.21.15.37:6832/4124618590 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+19073 (crc 0 0 0) 0x56456c2cdad0 con 0x56456c3c7e10 2023-12-11T17:11:33.455 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.453+0000 7f66abfff640 10 client.5499 handle_command_reply: tid=0 2023-12-11T17:11:33.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.453+0000 7f66d627f740 1 client.5499 shutdown 2023-12-11T17:11:33.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.453+0000 7f66d627f740 1 -- 172.21.15.37:0/1578553397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c36cb90 msgr2=0x56456c38a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:33.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.453+0000 7f66d627f740 1 --2- 172.21.15.37:0/1578553397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c36cb90 0x56456c38a000 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f66c8009990 tx=0x7f66c8004730 comp rx=0 tx=0).stop 2023-12-11T17:11:33.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.453+0000 7f66d627f740 1 -- 172.21.15.37:0/1578553397 shutdown_connections 2023-12-11T17:11:33.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.453+0000 7f66d627f740 1 --2- 172.21.15.37:0/1578553397 >> [v2:172.21.15.37:6832/4124618590,v1:172.21.15.37:6833/4124618590] conn(0x56456c3c7e10 0x56456c3d17b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.453+0000 7f66d627f740 1 --2- 172.21.15.37:0/1578553397 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56456c3a0bb0 0x56456c3a1030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.453+0000 7f66d627f740 1 --2- 172.21.15.37:0/1578553397 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56456c399010 0x56456c39bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.453+0000 7f66d627f740 1 --2- 172.21.15.37:0/1578553397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c36cb90 0x56456c38a000 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.453+0000 7f66abfff640 0 client.5499 ms_handle_reset on v2:172.21.15.37:6832/4124618590 2023-12-11T17:11:33.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.453+0000 7f66d627f740 1 -- 172.21.15.37:0/1578553397 >> 172.21.15.37:0/1578553397 conn(0x56456c3692c0 msgr2=0x56456c36d410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:33.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.453+0000 7f66d627f740 1 -- 172.21.15.37:0/1578553397 shutdown_connections 2023-12-11T17:11:33.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.453+0000 7f66d627f740 1 -- 172.21.15.37:0/1578553397 wait complete. 2023-12-11T17:11:33.456 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.453+0000 7f66d627f740 20 client.5499 trim_cache size 0 max 16384 2023-12-11T17:11:33.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.471+0000 7f66d627f740 1 Processor -- start 2023-12-11T17:11:33.472 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.471+0000 7f66d627f740 1 -- start start 2023-12-11T17:11:33.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.472+0000 7f66d627f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56456c36cb90 0x56456c395eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.472+0000 7f66d627f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56456c399010 0x56456c3c5f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.472+0000 7f66d627f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c3a0bb0 0x56456c3c6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.472+0000 7f66d627f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456c3d6630 con 0x56456c3a0bb0 2023-12-11T17:11:33.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.472+0000 7f66d627f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456c39c330 con 0x56456c36cb90 2023-12-11T17:11:33.473 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.472+0000 7f66d627f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56456c3c3cf0 con 0x56456c399010 2023-12-11T17:11:33.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.472+0000 7f66d1c84640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c3a0bb0 0x56456c3c6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:33.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.472+0000 7f66d1c84640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c3a0bb0 0x56456c3c6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57636/0 (socket says 172.21.15.37:57636) 2023-12-11T17:11:33.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.472+0000 7f66d1c84640 1 -- 172.21.15.37:0/1783679859 learned_addr learned my addr 172.21.15.37:0/1783679859 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:33.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.472+0000 7f66d0c82640 1 --2- 172.21.15.37:0/1783679859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56456c399010 0x56456c3c5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:33.474 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.473+0000 7f66d1483640 1 --2- 172.21.15.37:0/1783679859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56456c36cb90 0x56456c395eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.473+0000 7f66d1c84640 1 -- 172.21.15.37:0/1783679859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56456c399010 msgr2=0x56456c3c5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.473+0000 7f66d1c84640 1 --2- 172.21.15.37:0/1783679859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56456c399010 0x56456c3c5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.473+0000 7f66d1c84640 1 -- 172.21.15.37:0/1783679859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56456c36cb90 msgr2=0x56456c395eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.473+0000 7f66d1c84640 1 --2- 172.21.15.37:0/1783679859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56456c36cb90 0x56456c395eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.473+0000 7f66d1c84640 1 -- 172.21.15.37:0/1783679859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x56456c270b80 con 0x56456c3a0bb0 2023-12-11T17:11:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.473+0000 7f66d1c84640 1 --2- 172.21.15.37:0/1783679859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c3a0bb0 0x56456c3c6490 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f66c405f570 tx=0x7f66c40572e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9dde18a4490e3f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.473+0000 7f66b77fe640 1 -- 172.21.15.37:0/1783679859 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c4055bf0 con 0x56456c3a0bb0 2023-12-11T17:11:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.473+0000 7f66b77fe640 1 -- 172.21.15.37:0/1783679859 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c40056c0 con 0x56456c3a0bb0 2023-12-11T17:11:33.475 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.473+0000 7f66b77fe640 1 -- 172.21.15.37:0/1783679859 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66c4005830 con 0x56456c3a0bb0 2023-12-11T17:11:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.474+0000 7f66d627f740 1 -- 172.21.15.37:0/1783679859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c3a0bb0 msgr2=0x56456c3c6490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.474+0000 7f66d627f740 1 --2- 172.21.15.37:0/1783679859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c3a0bb0 0x56456c3c6490 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f66c405f570 tx=0x7f66c40572e0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.474+0000 7f66d627f740 1 -- 172.21.15.37:0/1783679859 shutdown_connections 2023-12-11T17:11:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.474+0000 7f66d627f740 1 --2- 172.21.15.37:0/1783679859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c3a0bb0 0x56456c3c6490 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.474+0000 7f66d627f740 1 --2- 172.21.15.37:0/1783679859 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56456c399010 0x56456c3c5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.474+0000 7f66d627f740 1 --2- 172.21.15.37:0/1783679859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56456c36cb90 0x56456c395eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.476 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.474+0000 7f66d627f740 1 -- 172.21.15.37:0/1783679859 >> 172.21.15.37:0/1783679859 conn(0x56456c3692c0 msgr2=0x56456c364ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:33.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.474+0000 7f66d627f740 1 -- 172.21.15.37:0/1783679859 shutdown_connections 2023-12-11T17:11:33.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.474+0000 7f66d627f740 1 -- 172.21.15.37:0/1783679859 wait complete. 2023-12-11T17:11:33.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.475+0000 7f66d627f740 1 -- start start 2023-12-11T17:11:33.477 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.475+0000 7f66d627f740 1 Processor -- start 2023-12-11T17:11:33.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.476+0000 7f66d627f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56456c36cb90 0x56456c3cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.476+0000 7f66d627f740 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c399010 0x56456c415010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.476+0000 7f66d627f740 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56456c3a0bb0 0x56456c421a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.476+0000 7f66d627f740 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456c421fc0 con 0x56456c399010 2023-12-11T17:11:33.479 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.476+0000 7f66d627f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x56456c4223f0 con 0x56456c36cb90 2023-12-11T17:11:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.476+0000 7f66d627f740 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x56456c3d5b20 con 0x56456c3a0bb0 2023-12-11T17:11:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.476+0000 7f66d627f740 10 client.0 _ll_register_callbacks cb 0x7f66c8052070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-11T17:11:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.476+0000 7f66d0c82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c399010 0x56456c415010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.477+0000 7f66d0c82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c399010 0x56456c415010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57640/0 (socket says 172.21.15.37:57640) 2023-12-11T17:11:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.477+0000 7f66d0c82640 1 -- 172.21.15.37:0/4239158335 learned_addr learned my addr 172.21.15.37:0/4239158335 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.477+0000 7f66d1483640 1 --2- 172.21.15.37:0/4239158335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56456c36cb90 0x56456c3cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.477+0000 7f66d1c84640 1 --2- 172.21.15.37:0/4239158335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56456c3a0bb0 0x56456c421a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.477+0000 7f66d0c82640 1 -- 172.21.15.37:0/4239158335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56456c3a0bb0 msgr2=0x56456c421a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.477+0000 7f66d0c82640 1 --2- 172.21.15.37:0/4239158335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56456c3a0bb0 0x56456c421a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.477+0000 7f66d0c82640 1 -- 172.21.15.37:0/4239158335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56456c36cb90 msgr2=0x56456c3cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.477+0000 7f66d0c82640 1 --2- 172.21.15.37:0/4239158335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56456c36cb90 0x56456c3cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.477+0000 7f66d0c82640 1 -- 172.21.15.37:0/4239158335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66cc15c700 con 0x56456c399010 2023-12-11T17:11:33.480 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.477+0000 7f66d0c82640 1 --2- 172.21.15.37:0/4239158335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c399010 0x56456c415010 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f66bc000c00 tx=0x7f66bc0169d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba03176d59e7efa server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:33.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.477+0000 7f66abfff640 10 client.0 ms_handle_connect on v2:172.21.15.37:3300/0 2023-12-11T17:11:33.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.478+0000 7f66abfff640 1 -- 172.21.15.37:0/4239158335 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66bc01f5f0 con 0x56456c399010 2023-12-11T17:11:33.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.478+0000 7f66abfff640 1 -- 172.21.15.37:0/4239158335 <== mon.0 v2:172.21.15.37:3300/0 2 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f66bc01f750 con 0x56456c399010 2023-12-11T17:11:33.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.478+0000 7f66d627f740 1 -- 172.21.15.37:0/4239158335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f66c80399a0 con 0x56456c399010 2023-12-11T17:11:33.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.478+0000 7f66abfff640 1 -- 172.21.15.37:0/4239158335 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) v2 ==== 24+0+0 (secure 0 0 0) 0x7f66bc01f930 con 0x56456c399010 2023-12-11T17:11:33.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.478+0000 7f66d627f740 10 client.5505 fetch_fsmap learned FSMap version 17 2023-12-11T17:11:33.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.478+0000 7f66d627f740 1 -- 172.21.15.37:0/4239158335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=2+}) v3 -- 0x56456c296170 con 0x56456c399010 2023-12-11T17:11:33.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.478+0000 7f66abfff640 1 -- 172.21.15.37:0/4239158335 <== mon.0 v2:172.21.15.37:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66c80399a0 con 0x56456c399010 2023-12-11T17:11:33.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.478+0000 7f66abfff640 1 -- 172.21.15.37:0/4239158335 <== mon.0 v2:172.21.15.37:3300/0 5 ==== fsmap(e 17) v1 ==== 3294+0+0 (secure 0 0 0) 0x7f66bc017d20 con 0x56456c399010 2023-12-11T17:11:33.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.478+0000 7f66d627f740 10 client.5505 fetch_fsmap finished waiting for FSMap version 17 2023-12-11T17:11:33.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.478+0000 7f66d627f740 10 client.5505 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-11T17:11:33.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.478+0000 7f66d627f740 20 client.5505 populate_metadata read hostname 'smithi037' 2023-12-11T17:11:33.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.478+0000 7f66d627f740 1 --2- 172.21.15.37:0/4239158335 >> [v2:172.21.15.37:6832/4124618590,v1:172.21.15.37:6833/4124618590] conn(0x56456c39b950 0x56456c39bd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.481 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.478+0000 7f66d627f740 4 client.5505 mds_command: new command op to 5322 tid=0 multi_id=0 [{"prefix": "status"}] 2023-12-11T17:11:33.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.478+0000 7f66d627f740 1 -- 172.21.15.37:0/4239158335 --> [v2:172.21.15.37:6832/4124618590,v1:172.21.15.37:6833/4124618590] -- command(tid 0: {"prefix": "status"}) v1 -- 0x56456bfd56c0 con 0x56456c39b950 2023-12-11T17:11:33.482 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.479+0000 7f66d1483640 1 --2- 172.21.15.37:0/4239158335 >> [v2:172.21.15.37:6832/4124618590,v1:172.21.15.37:6833/4124618590] conn(0x56456c39b950 0x56456c39bd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:33.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.479+0000 7f66d1483640 1 --2- 172.21.15.37:0/4239158335 >> [v2:172.21.15.37:6832/4124618590,v1:172.21.15.37:6833/4124618590] conn(0x56456c39b950 0x56456c39bd30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26ec64d4b7ee8e26 server_cookie=c8591c8d0361c5c1 in_seq=0 out_seq=0 2023-12-11T17:11:33.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.479+0000 7f66abfff640 10 client.5505 ms_handle_connect on v2:172.21.15.37:6832/4124618590 2023-12-11T17:11:33.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.479+0000 7f66abfff640 1 -- 172.21.15.37:0/4239158335 <== mds.0 v2:172.21.15.37:6832/4124618590 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x56456bfd56c0 con 0x56456c39b950 2023-12-11T17:11:33.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.479+0000 7f66abfff640 10 client.5505 handle_command_reply: tid=0 2023-12-11T17:11:33.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.479+0000 7f66d627f740 1 client.5505 shutdown 2023-12-11T17:11:33.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.480+0000 7f66d627f740 1 -- 172.21.15.37:0/4239158335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c399010 msgr2=0x56456c415010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:33.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.480+0000 7f66d627f740 1 --2- 172.21.15.37:0/4239158335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c399010 0x56456c415010 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f66bc000c00 tx=0x7f66bc0169d0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.480+0000 7f66d627f740 1 -- 172.21.15.37:0/4239158335 shutdown_connections 2023-12-11T17:11:33.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.480+0000 7f66d627f740 1 --2- 172.21.15.37:0/4239158335 >> [v2:172.21.15.37:6832/4124618590,v1:172.21.15.37:6833/4124618590] conn(0x56456c39b950 0x56456c39bd30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.483 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.480+0000 7f66d627f740 1 --2- 172.21.15.37:0/4239158335 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x56456c3a0bb0 0x56456c421a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.480+0000 7f66d627f740 1 --2- 172.21.15.37:0/4239158335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56456c399010 0x56456c415010 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.480+0000 7f66d627f740 1 --2- 172.21.15.37:0/4239158335 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56456c36cb90 0x56456c3cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.480+0000 7f66abfff640 0 client.5505 ms_handle_reset on v2:172.21.15.37:6832/4124618590 2023-12-11T17:11:33.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.480+0000 7f66d627f740 1 -- 172.21.15.37:0/4239158335 >> 172.21.15.37:0/4239158335 conn(0x56456c3692c0 msgr2=0x56456c36ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:33.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.480+0000 7f66d627f740 1 -- 172.21.15.37:0/4239158335 shutdown_connections 2023-12-11T17:11:33.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.480+0000 7f66d627f740 1 -- 172.21.15.37:0/4239158335 wait complete. 2023-12-11T17:11:33.484 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.480+0000 7f66d627f740 20 client.5505 trim_cache size 0 max 16384 2023-12-11T17:11:33.484 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2023-12-11T17:11:33.484 INFO:teuthology.orchestra.run.smithi037.stdout: "cluster_fsid": "349792a4-57b1-4c92-9cc0-0c9ba4325d41", 2023-12-11T17:11:33.484 INFO:teuthology.orchestra.run.smithi037.stdout: "whoami": 0, 2023-12-11T17:11:33.484 INFO:teuthology.orchestra.run.smithi037.stdout: "id": 5322, 2023-12-11T17:11:33.485 INFO:teuthology.orchestra.run.smithi037.stdout: "want_state": "up:active", 2023-12-11T17:11:33.485 INFO:teuthology.orchestra.run.smithi037.stdout: "state": "up:active", 2023-12-11T17:11:33.485 INFO:teuthology.orchestra.run.smithi037.stdout: "fs_name": "cephfs", 2023-12-11T17:11:33.485 INFO:teuthology.orchestra.run.smithi037.stdout: "rank_uptime": 6.7819421999999996, 2023-12-11T17:11:33.485 INFO:teuthology.orchestra.run.smithi037.stdout: "mdsmap_epoch": 17, 2023-12-11T17:11:33.485 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch": 41, 2023-12-11T17:11:33.485 INFO:teuthology.orchestra.run.smithi037.stdout: "osdmap_epoch_barrier": 39, 2023-12-11T17:11:33.485 INFO:teuthology.orchestra.run.smithi037.stdout: "uptime": 15.639215262 2023-12-11T17:11:33.485 INFO:teuthology.orchestra.run.smithi037.stdout:} 2023-12-11T17:11:33.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.481+0000 7f66d36e7640 1 -- 172.21.15.37:0/4276062022 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f66b006ae40 msgr2=0x7f66b006d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:33.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.481+0000 7f66d36e7640 1 --2- 172.21.15.37:0/4276062022 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f66b006ae40 0x7f66b006d300 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f66c8036000 tx=0x7f66c8008030 comp rx=0 tx=0).stop 2023-12-11T17:11:33.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.481+0000 7f66d36e7640 1 -- 172.21.15.37:0/4276062022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66cc146ba0 msgr2=0x7f66cc15d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:33.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.481+0000 7f66d36e7640 1 --2- 172.21.15.37:0/4276062022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66cc146ba0 0x7f66cc15d830 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f66c400c780 tx=0x7f66c400cc40 comp rx=0 tx=0).stop 2023-12-11T17:11:33.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.481+0000 7f66d36e7640 1 -- 172.21.15.37:0/4276062022 shutdown_connections 2023-12-11T17:11:33.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.481+0000 7f66d36e7640 1 --2- 172.21.15.37:0/4276062022 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f66b006ae40 0x7f66b006d300 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.481+0000 7f66d36e7640 1 --2- 172.21.15.37:0/4276062022 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f66cc146ba0 0x7f66cc15d830 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.481+0000 7f66d36e7640 1 --2- 172.21.15.37:0/4276062022 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f66cc1467c0 0x7f66cc0b4210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.481+0000 7f66d36e7640 1 --2- 172.21.15.37:0/4276062022 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66cc06cef0 0x7f66cc144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.486 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.481+0000 7f66d36e7640 1 -- 172.21.15.37:0/4276062022 >> 172.21.15.37:0/4276062022 conn(0x7f66cc0b0a90 msgr2=0x7f66cc15f3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:33.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.481+0000 7f66d36e7640 1 -- 172.21.15.37:0/4276062022 shutdown_connections 2023-12-11T17:11:33.487 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.481+0000 7f66d36e7640 1 -- 172.21.15.37:0/4276062022 wait complete. 2023-12-11T17:11:33.499 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-11T17:11:33.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.725+0000 7fe03e354640 1 Processor -- start 2023-12-11T17:11:33.726 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.725+0000 7fe03e354640 1 -- start start 2023-12-11T17:11:33.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.727+0000 7fe03e354640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0380ae200 0x7fe038070b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.727+0000 7fe03e354640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe0380abd20 0x7fe038071090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.727+0000 7fe03e354640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe038071f90 con 0x7fe03815e5d0 2023-12-11T17:11:33.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.727+0000 7fe03e354640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe038072270 con 0x7fe0380abd20 2023-12-11T17:11:33.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.727+0000 7fe03e354640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe038070070 con 0x7fe0380ae200 2023-12-11T17:11:33.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.727+0000 7fe03d352640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe03815e5d0 0x7fe03806bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35018/0 (socket says 172.21.15.37:35018) 2023-12-11T17:11:33.728 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.727+0000 7fe03d352640 1 -- 172.21.15.37:0/1812561559 learned_addr learned my addr 172.21.15.37:0/1812561559 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:11:33.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.727+0000 7fe03db53640 1 --2- 172.21.15.37:0/1812561559 >> v2:172.21.15.37:3300/0 conn(0x7fe0380abd20 0x7fe038071090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:33.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.728+0000 7fe03cb51640 1 --2- 172.21.15.37:0/1812561559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0380ae200 0x7fe038070b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:33.729 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.728+0000 7fe02ffff640 1 -- 172.21.15.37:0/1812561559 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 717702556 0 0) 0x7fe038071f90 con 0x7fe03815e5d0 2023-12-11T17:11:33.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.728+0000 7fe02ffff640 1 -- 172.21.15.37:0/1812561559 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe024003520 con 0x7fe03815e5d0 2023-12-11T17:11:33.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.728+0000 7fe03db53640 1 -- 172.21.15.37:0/1812561559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0380ae200 msgr2=0x7fe038070b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:11:33.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.728+0000 7fe03db53640 1 --2- 172.21.15.37:0/1812561559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0380ae200 0x7fe038070b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.728+0000 7fe03db53640 1 -- 172.21.15.37:0/1812561559 >> v1:172.21.15.37:6789/0 conn(0x7fe03815e5d0 legacy=0x7fe03806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:33.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.728+0000 7fe03db53640 1 -- 172.21.15.37:0/1812561559 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe038070350 con 0x7fe0380abd20 2023-12-11T17:11:33.730 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.730+0000 7fe03db53640 1 --2- 172.21.15.37:0/1812561559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0380abd20 0x7fe038071090 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe030009d90 tx=0x7fe03002bd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f458729de43bc872 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:33.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.730+0000 7fe02ffff640 1 -- 172.21.15.37:0/1812561559 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03002cb30 con 0x7fe0380abd20 2023-12-11T17:11:33.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.730+0000 7fe02ffff640 1 -- 172.21.15.37:0/1812561559 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03002cc90 con 0x7fe0380abd20 2023-12-11T17:11:33.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.730+0000 7fe02ffff640 1 -- 172.21.15.37:0/1812561559 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe030034440 con 0x7fe0380abd20 2023-12-11T17:11:33.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.731+0000 7fe03e354640 1 -- 172.21.15.37:0/1812561559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0380abd20 msgr2=0x7fe038071090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:33.731 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.731+0000 7fe03e354640 1 --2- 172.21.15.37:0/1812561559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0380abd20 0x7fe038071090 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fe030009d90 tx=0x7fe03002bd80 comp rx=0 tx=0).stop 2023-12-11T17:11:33.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.731+0000 7fe03e354640 1 -- 172.21.15.37:0/1812561559 shutdown_connections 2023-12-11T17:11:33.732 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.731+0000 7fe03e354640 1 --2- 172.21.15.37:0/1812561559 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0380abd20 0x7fe038071090 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.731+0000 7fe03e354640 1 --2- 172.21.15.37:0/1812561559 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0380ae200 0x7fe038070b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.731+0000 7fe03e354640 1 -- 172.21.15.37:0/1812561559 >> 172.21.15.37:0/1812561559 conn(0x7fe0380b0860 msgr2=0x7fe0380b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:33.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.731+0000 7fe03e354640 1 -- 172.21.15.37:0/1812561559 shutdown_connections 2023-12-11T17:11:33.733 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.731+0000 7fe03e354640 1 -- 172.21.15.37:0/1812561559 wait complete. 2023-12-11T17:11:33.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.733+0000 7fe03e354640 1 Processor -- start 2023-12-11T17:11:33.734 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.733+0000 7fe03e354640 1 -- start start 2023-12-11T17:11:33.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.734+0000 7fe03e354640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0380abd20 0x7fe03815cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.734+0000 7fe03e354640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0380ae200 0x7fe0380aed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.734+0000 7fe03e354640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03815e5d0 0x7fe0380af2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.734+0000 7fe03e354640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0381f21c0 con 0x7fe03815e5d0 2023-12-11T17:11:33.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.734+0000 7fe03e354640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0381f24a0 con 0x7fe0380ae200 2023-12-11T17:11:33.735 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.734+0000 7fe03e354640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe038156c20 con 0x7fe0380abd20 2023-12-11T17:11:33.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.735+0000 7fe03db53640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03815e5d0 0x7fe0380af2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:33.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.735+0000 7fe03db53640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03815e5d0 0x7fe0380af2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57670/0 (socket says 172.21.15.37:57670) 2023-12-11T17:11:33.736 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.735+0000 7fe03db53640 1 -- 172.21.15.37:0/2081305171 learned_addr learned my addr 172.21.15.37:0/2081305171 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:11:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.735+0000 7fe03cb51640 1 --2- 172.21.15.37:0/2081305171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0380ae200 0x7fe0380aed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.735+0000 7fe03d352640 1 --2- 172.21.15.37:0/2081305171 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0380abd20 0x7fe03815cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.735+0000 7fe03db53640 1 -- 172.21.15.37:0/2081305171 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0380abd20 msgr2=0x7fe03815cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.735+0000 7fe03db53640 1 --2- 172.21.15.37:0/2081305171 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0380abd20 0x7fe03815cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.735+0000 7fe03db53640 1 -- 172.21.15.37:0/2081305171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0380ae200 msgr2=0x7fe0380aed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.735+0000 7fe03db53640 1 --2- 172.21.15.37:0/2081305171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0380ae200 0x7fe0380aed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.735+0000 7fe03db53640 1 -- 172.21.15.37:0/2081305171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe030009a70 con 0x7fe03815e5d0 2023-12-11T17:11:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.735+0000 7fe03cb51640 1 --2- 172.21.15.37:0/2081305171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0380ae200 0x7fe0380aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:11:33.737 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.736+0000 7fe03db53640 1 --2- 172.21.15.37:0/2081305171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03815e5d0 0x7fe0380af2d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe030009d90 tx=0x7fe030004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:33.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.736+0000 7fe02dffb640 1 -- 172.21.15.37:0/2081305171 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03003e410 con 0x7fe03815e5d0 2023-12-11T17:11:33.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.736+0000 7fe02dffb640 1 -- 172.21.15.37:0/2081305171 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03003e590 con 0x7fe03815e5d0 2023-12-11T17:11:33.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.736+0000 7fe03e354640 1 -- 172.21.15.37:0/2081305171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe03806c680 con 0x7fe03815e5d0 2023-12-11T17:11:33.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.736+0000 7fe02dffb640 1 -- 172.21.15.37:0/2081305171 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03003e940 con 0x7fe03815e5d0 2023-12-11T17:11:33.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.736+0000 7fe03e354640 1 -- 172.21.15.37:0/2081305171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0381550c0 con 0x7fe03815e5d0 2023-12-11T17:11:33.738 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.738+0000 7fe03e354640 1 -- 172.21.15.37:0/2081305171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0381f25e0 con 0x7fe03815e5d0 2023-12-11T17:11:33.739 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.739+0000 7fe02dffb640 1 -- 172.21.15.37:0/2081305171 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fe03003b050 con 0x7fe03815e5d0 2023-12-11T17:11:33.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.739+0000 7fe02dffb640 1 --2- 172.21.15.37:0/2081305171 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe01c06ae40 0x7fe01c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:11:33.740 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.740+0000 7fe02dffb640 1 -- 172.21.15.37:0/2081305171 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fe0300abf00 con 0x7fe03815e5d0 2023-12-11T17:11:33.741 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.740+0000 7fe03d352640 1 --2- 172.21.15.37:0/2081305171 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe01c06ae40 0x7fe01c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:11:33.743 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.741+0000 7fe03d352640 1 --2- 172.21.15.37:0/2081305171 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe01c06ae40 0x7fe01c06d300 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe0340011e0 tx=0x7fe034009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:11:33.746 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.745+0000 7fe02dffb640 1 -- 172.21.15.37:0/2081305171 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fe0381f25e0 con 0x7fe03815e5d0 2023-12-11T17:11:33.981 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.980+0000 7fe03e354640 1 -- 172.21.15.37:0/2081305171 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe0381f25e0 con 0x7fe03815e5d0 2023-12-11T17:11:33.982 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.981+0000 7fe02dffb640 1 -- 172.21.15.37:0/2081305171 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe0381f25e0 con 0x7fe03815e5d0 2023-12-11T17:11:33.982 INFO:teuthology.orchestra.run.smithi037.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-11T17:11:33.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.983+0000 7fe03e354640 1 -- 172.21.15.37:0/2081305171 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe01c06ae40 msgr2=0x7fe01c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:33.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.983+0000 7fe03e354640 1 --2- 172.21.15.37:0/2081305171 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe01c06ae40 0x7fe01c06d300 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe0340011e0 tx=0x7fe034009040 comp rx=0 tx=0).stop 2023-12-11T17:11:33.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.983+0000 7fe03e354640 1 -- 172.21.15.37:0/2081305171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03815e5d0 msgr2=0x7fe0380af2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:11:33.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.983+0000 7fe03e354640 1 --2- 172.21.15.37:0/2081305171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03815e5d0 0x7fe0380af2d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe030009d90 tx=0x7fe030004a40 comp rx=0 tx=0).stop 2023-12-11T17:11:33.984 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.983+0000 7fe03e354640 1 -- 172.21.15.37:0/2081305171 shutdown_connections 2023-12-11T17:11:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.983+0000 7fe03e354640 1 --2- 172.21.15.37:0/2081305171 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fe01c06ae40 0x7fe01c06d300 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.983+0000 7fe03e354640 1 --2- 172.21.15.37:0/2081305171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe0380ae200 0x7fe0380aed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.983+0000 7fe03e354640 1 --2- 172.21.15.37:0/2081305171 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03815e5d0 0x7fe0380af2d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.983+0000 7fe03e354640 1 --2- 172.21.15.37:0/2081305171 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fe0380abd20 0x7fe03815cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:11:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.983+0000 7fe03e354640 1 -- 172.21.15.37:0/2081305171 >> 172.21.15.37:0/2081305171 conn(0x7fe0380b0860 msgr2=0x7fe03806bdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:11:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.983+0000 7fe03e354640 1 -- 172.21.15.37:0/2081305171 shutdown_connections 2023-12-11T17:11:33.985 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:11:33.984+0000 7fe03e354640 1 -- 172.21.15.37:0/2081305171 wait complete. 2023-12-11T17:11:34.003 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-12-11T17:11:34.003 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-11T17:11:34.003 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi037.front.sepia.ceph.com 2023-12-11T17:11:34.003 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-11T17:11:34.003 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-11T17:11:34.003 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-12-11T17:11:34.003 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-12-11T17:11:34.003 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-11T17:11:34.004 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-11T17:11:34.004 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:11:34.004 DEBUG:teuthology.orchestra.run.smithi037:> ip addr 2023-12-11T17:11:34.057 INFO:teuthology.orchestra.run.smithi037.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-11T17:11:34.057 INFO:teuthology.orchestra.run.smithi037.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-11T17:11:34.058 INFO:teuthology.orchestra.run.smithi037.stdout: inet 127.0.0.1/8 scope host lo 2023-12-11T17:11:34.058 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:11:34.058 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 ::1/128 scope host 2023-12-11T17:11:34.058 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:11:34.058 INFO:teuthology.orchestra.run.smithi037.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-11T17:11:34.058 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:18 brd ff:ff:ff:ff:ff:ff 2023-12-11T17:11:34.058 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f0 2023-12-11T17:11:34.058 INFO:teuthology.orchestra.run.smithi037.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-11T17:11:34.058 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:6b:fd:19 brd ff:ff:ff:ff:ff:ff 2023-12-11T17:11:34.058 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp7s0f1 2023-12-11T17:11:34.058 INFO:teuthology.orchestra.run.smithi037.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-11T17:11:34.058 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:94 brd ff:ff:ff:ff:ff:ff 2023-12-11T17:11:34.058 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f0 2023-12-11T17:11:34.059 INFO:teuthology.orchestra.run.smithi037.stdout: inet 172.21.15.37/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-12-11T17:11:34.059 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft 42281sec preferred_lft 42281sec 2023-12-11T17:11:34.059 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::ec4:7aff:fe88:7794/64 scope link noprefixroute 2023-12-11T17:11:34.059 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:11:34.059 INFO:teuthology.orchestra.run.smithi037.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-11T17:11:34.059 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 0c:c4:7a:88:77:95 brd ff:ff:ff:ff:ff:ff 2023-12-11T17:11:34.059 INFO:teuthology.orchestra.run.smithi037.stdout: altname enp1s0f1 2023-12-11T17:11:34.059 INFO:teuthology.orchestra.run.smithi037.stdout:8: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-11T17:11:34.059 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 7e:b3:ed:4d:89:cf brd ff:ff:ff:ff:ff:ff 2023-12-11T17:11:34.060 INFO:teuthology.orchestra.run.smithi037.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-11T17:11:34.060 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:11:34.060 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::40bb:10ff:feaf:ff3f/64 scope link 2023-12-11T17:11:34.060 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:11:34.060 INFO:teuthology.orchestra.run.smithi037.stdout:9: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-11T17:11:34.060 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether 7e:b3:ed:4d:89:cf brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-11T17:11:34.060 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::7cb3:edff:fe4d:89cf/64 scope link 2023-12-11T17:11:34.060 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:11:34.060 INFO:teuthology.orchestra.run.smithi037.stdout:10: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-11T17:11:34.060 INFO:teuthology.orchestra.run.smithi037.stdout: link/ether b2:61:0e:c2:7b:1c brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-11T17:11:34.060 INFO:teuthology.orchestra.run.smithi037.stdout: inet6 fe80::b061:eff:fec2:7b1c/64 scope link 2023-12-11T17:11:34.060 INFO:teuthology.orchestra.run.smithi037.stdout: valid_lft forever preferred_lft forever 2023-12-11T17:11:34.062 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:11:34.062 DEBUG:teuthology.orchestra.run.smithi037:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-11T17:11:34.162 INFO:teuthology.orchestra.run.smithi037.stdout:1 2023-12-11T17:11:34.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:11:34.166 DEBUG:teuthology.orchestra.run.smithi037:> route 2023-12-11T17:11:34.228 INFO:teuthology.orchestra.run.smithi037.stdout:Kernel IP routing table 2023-12-11T17:11:34.228 INFO:teuthology.orchestra.run.smithi037.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-11T17:11:34.228 INFO:teuthology.orchestra.run.smithi037.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-12-11T17:11:34.228 INFO:teuthology.orchestra.run.smithi037.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-12-11T17:11:34.228 INFO:teuthology.orchestra.run.smithi037.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-11T17:11:34.229 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:11:34.229 DEBUG:teuthology.orchestra.run.smithi037:> (cd / && exec bash -c ' 2023-12-11T17:11:34.229 DEBUG:teuthology.orchestra.run.smithi037:> set -e 2023-12-11T17:11:34.229 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-12-11T17:11:34.229 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-12-11T17:11:34.229 DEBUG:teuthology.orchestra.run.smithi037:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-12-11T17:11:34.229 DEBUG:teuthology.orchestra.run.smithi037:> ') 2023-12-11T17:11:34.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:11:34.434 DEBUG:teuthology.orchestra.run.smithi037:> ip netns list 2023-12-11T17:11:34.488 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-11T17:11:34.488 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-11T17:11:34.489 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-11T17:11:34.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:11:34.490 DEBUG:teuthology.orchestra.run.smithi037:> sudo ip link set brx.0 up 2023-12-11T17:11:34.593 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-11T17:11:34.593 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-11T17:11:34.654 INFO:teuthology.orchestra.run.smithi037.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-11T17:11:34.654 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-11T17:11:34.655 DEBUG:teuthology.orchestra.run.smithi037:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-11T17:11:34.711 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-12-11T17:11:34.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:11:34.711 DEBUG:teuthology.orchestra.run.smithi037:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-11T17:11:34.850 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-11T17:11:34.851 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-11T17:11:34.851 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-12-11T17:11:34.874 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-11T17:11:34.875 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-11T17:11:34.875 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-12-11T17:11:34.875 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-11T17:11:34.875 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-11T17:11:34.902 INFO:teuthology.orchestra.run.smithi037.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-12-11T17:11:34.903 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-12-11T17:11:34.903 INFO:teuthology.orchestra.run.smithi037.stdout:invalid new device string format 2023-12-11T17:11:34.903 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:3300,172.21.15.151:3300,172.21.15.151:3301" 2023-12-11T17:11:34.903 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: switching to using v1 address with old syntax 2023-12-11T17:11:34.903 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: resolved to: "172.21.15.37:6789,172.21.15.151:6789,172.21.15.151:6790" 2023-12-11T17:11:34.903 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.37:6789,172.21.15.151:6789,172.21.15.151:6790:/ 2023-12-11T17:11:34.903 INFO:teuthology.orchestra.run.smithi037.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=349792a4-57b1-4c92-9cc0-0c9ba4325d41" will pass to kernel 2023-12-11T17:11:34.906 INFO:teuthology.orchestra.run.smithi037.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2023-12-11T17:11:34.906 INFO:teuthology.orchestra.run.smithi037.stdout: You just mounted a file system that supports labels which does not 2023-12-11T17:11:34.906 INFO:teuthology.orchestra.run.smithi037.stdout: contain labels, onto an SELinux box. It is likely that confined 2023-12-11T17:11:34.906 INFO:teuthology.orchestra.run.smithi037.stdout: applications will generate AVC messages and not be allowed access to 2023-12-11T17:11:34.906 INFO:teuthology.orchestra.run.smithi037.stdout: this file system. For more details see restorecon(8) and mount(8). 2023-12-11T17:11:34.910 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-12-11T17:11:34.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:11:34.910 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-11T17:11:35.002 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:11:35.002 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec bash -c 'getfattr --only-values -n ceph.client_id .') 2023-12-11T17:11:35.078 INFO:teuthology.orchestra.run.smithi037.stdout:client5053 2023-12-11T17:11:35.078 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:11:35.079 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-11T17:11:35.140 DEBUG:teuthology.orchestra.run.smithi037:> mktemp -d --suffix=xfstests-dev 2023-12-11T17:11:35.201 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.gLzcJVJdzjxfstests-dev 2023-12-11T17:11:35.201 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:11:35.201 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo chmod a+rx /tmp/tmp.gLzcJVJdzjxfstests-dev) 2023-12-11T17:11:35.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:11:35.310 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec git clone https://git.ceph.com/xfstests-dev.git --depth 1 /tmp/tmp.gLzcJVJdzjxfstests-dev) 2023-12-11T17:11:35.375 INFO:teuthology.orchestra.run.smithi037.stderr:Cloning into '/tmp/tmp.gLzcJVJdzjxfstests-dev'... 2023-12-11T17:11:36.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:11:36.451 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir test) 2023-12-11T17:11:36.524 DEBUG:teuthology.orchestra.run.smithi037:> mktemp -d --suffix=test 2023-12-11T17:11:36.583 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.IOXZHTg9krtest 2023-12-11T17:11:36.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:11:36.583 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest/mnt.0 && exec mkdir scratch) 2023-12-11T17:11:36.649 DEBUG:teuthology.orchestra.run.smithi037:> mktemp -d --suffix=scratch 2023-12-11T17:11:36.704 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:11:36.704 INFO:tasks.cephfs.xfstests_dev:distro and version detected is "centos" and "9". 2023-12-11T17:11:36.705 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum install -y acl attr automake bc dbench dump e2fsprogs fio gawk gcc gdbm-devel git indent kernel-devel libacl-devel libaio-devel libcap-devel libtool libuuid-devel lvm2 make psmisc python3 quota sed sqlite udftools xfsprogs 2023-12-11T17:11:37.593 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:04:31 ago on Mon 11 Dec 2023 05:07:06 PM UTC. 2023-12-11T17:11:37.700 INFO:teuthology.orchestra.run.smithi037.stdout:Package acl-2.3.1-4.el9.x86_64 is already installed. 2023-12-11T17:11:37.701 INFO:teuthology.orchestra.run.smithi037.stdout:Package attr-2.5.1-3.el9.x86_64 is already installed. 2023-12-11T17:11:37.702 INFO:teuthology.orchestra.run.smithi037.stdout:Package automake-1.16.2-8.el9.noarch is already installed. 2023-12-11T17:11:37.703 INFO:teuthology.orchestra.run.smithi037.stdout:Package bc-1.07.1-14.el9.x86_64 is already installed. 2023-12-11T17:11:37.704 INFO:teuthology.orchestra.run.smithi037.stdout:Package dbench-4.0-25.el9.x86_64 is already installed. 2023-12-11T17:11:37.706 INFO:teuthology.orchestra.run.smithi037.stdout:Package e2fsprogs-1.46.5-3.el9.x86_64 is already installed. 2023-12-11T17:11:37.708 INFO:teuthology.orchestra.run.smithi037.stdout:Package gawk-5.1.0-6.el9.x86_64 is already installed. 2023-12-11T17:11:37.709 INFO:teuthology.orchestra.run.smithi037.stdout:Package gcc-11.4.1-2.1.el9.x86_64 is already installed. 2023-12-11T17:11:37.711 INFO:teuthology.orchestra.run.smithi037.stdout:Package git-2.39.3-1.el9.x86_64 is already installed. 2023-12-11T17:11:37.714 INFO:teuthology.orchestra.run.smithi037.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2023-12-11T17:11:37.715 INFO:teuthology.orchestra.run.smithi037.stdout:Package libaio-devel-0.3.111-13.el9.x86_64 is already installed. 2023-12-11T17:11:37.717 INFO:teuthology.orchestra.run.smithi037.stdout:Package libtool-2.4.6-45.el9.x86_64 is already installed. 2023-12-11T17:11:37.718 INFO:teuthology.orchestra.run.smithi037.stdout:Package libuuid-devel-2.37.4-15.el9.x86_64 is already installed. 2023-12-11T17:11:37.720 INFO:teuthology.orchestra.run.smithi037.stdout:Package lvm2-9:2.03.21-3.el9.x86_64 is already installed. 2023-12-11T17:11:37.720 INFO:teuthology.orchestra.run.smithi037.stdout:Package make-1:4.3-7.el9.x86_64 is already installed. 2023-12-11T17:11:37.722 INFO:teuthology.orchestra.run.smithi037.stdout:Package psmisc-23.4-3.el9.x86_64 is already installed. 2023-12-11T17:11:37.723 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-3.9.17-2.el9.x86_64 is already installed. 2023-12-11T17:11:37.724 INFO:teuthology.orchestra.run.smithi037.stdout:Package quota-1:4.06-6.el9.x86_64 is already installed. 2023-12-11T17:11:37.725 INFO:teuthology.orchestra.run.smithi037.stdout:Package sed-4.8-9.el9.x86_64 is already installed. 2023-12-11T17:11:37.728 INFO:teuthology.orchestra.run.smithi037.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-11T17:11:37.793 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2023-12-11T17:11:37.796 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-12-11T17:11:37.796 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2023-12-11T17:11:37.796 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-12-11T17:11:37.796 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2023-12-11T17:11:37.796 INFO:teuthology.orchestra.run.smithi037.stdout: dump x86_64 1:0.4-0.51.b47.el9 epel 88 k 2023-12-11T17:11:37.796 INFO:teuthology.orchestra.run.smithi037.stdout: fio x86_64 3.35-1.el9 CentOS-AppStream 6.2 M 2023-12-11T17:11:37.796 INFO:teuthology.orchestra.run.smithi037.stdout: gdbm-devel x86_64 1:1.19-4.el9 crb 59 k 2023-12-11T17:11:37.796 INFO:teuthology.orchestra.run.smithi037.stdout: indent x86_64 2.2.13-4.el9 epel 179 k 2023-12-11T17:11:37.796 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-devel x86_64 5.14.0-390.el9 appstream 21 M 2023-12-11T17:11:37.796 INFO:teuthology.orchestra.run.smithi037.stdout: libcap-devel x86_64 2.48-9.el9 CentOS-AppStream 33 k 2023-12-11T17:11:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: sqlite x86_64 3.34.1-6.el9 CentOS-AppStream 747 k 2023-12-11T17:11:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: udftools x86_64 2.2-5.el9 CentOS-AppStream 144 k 2023-12-11T17:11:37.797 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2023-12-11T17:11:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: cpp x86_64 11.4.1-2.3.el9 CentOS-AppStream 11 M 2023-12-11T17:11:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: e2fsprogs x86_64 1.46.5-4.el9 CentOS-BaseOS 1.0 M 2023-12-11T17:11:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: e2fsprogs-libs x86_64 1.46.5-4.el9 CentOS-BaseOS 221 k 2023-12-11T17:11:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: gcc x86_64 11.4.1-2.3.el9 CentOS-AppStream 32 M 2023-12-11T17:11:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: gcc-c++ x86_64 11.4.1-2.3.el9 CentOS-AppStream 13 M 2023-12-11T17:11:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: gcc-plugin-annobin x86_64 11.4.1-2.3.el9 CentOS-AppStream 47 k 2023-12-11T17:11:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: libcom_err x86_64 1.46.5-4.el9 CentOS-BaseOS 25 k 2023-12-11T17:11:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: libgcc x86_64 11.4.1-2.3.el9 CentOS-BaseOS 92 k 2023-12-11T17:11:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: libgomp x86_64 11.4.1-2.3.el9 CentOS-BaseOS 268 k 2023-12-11T17:11:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: libss x86_64 1.46.5-4.el9 CentOS-BaseOS 31 k 2023-12-11T17:11:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: libstdc++ x86_64 11.4.1-2.3.el9 CentOS-BaseOS 735 k 2023-12-11T17:11:37.797 INFO:teuthology.orchestra.run.smithi037.stdout: libstdc++-devel x86_64 11.4.1-2.3.el9 CentOS-AppStream 2.2 M 2023-12-11T17:11:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: python-unversioned-command noarch 3.9.18-1.el9 CentOS-AppStream 8.8 k 2023-12-11T17:11:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: python3 x86_64 3.9.18-1.el9 CentOS-BaseOS 26 k 2023-12-11T17:11:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel x86_64 3.9.18-1.el9 CentOS-AppStream 204 k 2023-12-11T17:11:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: python3-libs x86_64 3.9.18-1.el9 CentOS-BaseOS 7.3 M 2023-12-11T17:11:37.798 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2023-12-11T17:11:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: gdbm x86_64 1:1.19-4.el9 crb 132 k 2023-12-11T17:11:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: libnbd x86_64 1.18.1-3.el9 appstream 166 k 2023-12-11T17:11:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: rmt x86_64 2:1.6-6.el9 CentOS-BaseOS 45 k 2023-12-11T17:11:37.798 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2023-12-11T17:11:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: fio-engine-http x86_64 3.35-1.el9 CentOS-AppStream 17 k 2023-12-11T17:11:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: fio-engine-libaio x86_64 3.35-1.el9 CentOS-AppStream 14 k 2023-12-11T17:11:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: fio-engine-nbd x86_64 3.35-1.el9 CentOS-AppStream 13 k 2023-12-11T17:11:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: fio-engine-rados x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-12-11T17:11:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: fio-engine-rbd x86_64 3.35-1.el9 CentOS-AppStream 15 k 2023-12-11T17:11:37.798 INFO:teuthology.orchestra.run.smithi037.stdout: fio-engine-rdma x86_64 3.35-1.el9 CentOS-AppStream 20 k 2023-12-11T17:11:37.799 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:11:37.799 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2023-12-11T17:11:37.799 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2023-12-11T17:11:37.799 INFO:teuthology.orchestra.run.smithi037.stdout:Install 17 Packages 2023-12-11T17:11:37.799 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 16 Packages 2023-12-11T17:11:37.799 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:11:37.799 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 97 M 2023-12-11T17:11:37.799 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2023-12-11T17:11:38.462 INFO:teuthology.orchestra.run.smithi037.stdout:(1/33): fio-engine-http-3.35-1.el9.x86_64.rpm 68 kB/s | 17 kB 00:00 2023-12-11T17:11:38.485 INFO:teuthology.orchestra.run.smithi037.stdout:(2/33): fio-engine-libaio-3.35-1.el9.x86_64.rpm 53 kB/s | 14 kB 00:00 2023-12-11T17:11:38.519 INFO:teuthology.orchestra.run.smithi037.stdout:(3/33): fio-engine-nbd-3.35-1.el9.x86_64.rpm 249 kB/s | 13 kB 00:00 2023-12-11T17:11:38.552 INFO:teuthology.orchestra.run.smithi037.stdout:(4/33): fio-engine-rados-3.35-1.el9.x86_64.rpm 223 kB/s | 15 kB 00:00 2023-12-11T17:11:38.586 INFO:teuthology.orchestra.run.smithi037.stdout:(5/33): fio-engine-rbd-3.35-1.el9.x86_64.rpm 249 kB/s | 15 kB 00:00 2023-12-11T17:11:38.711 INFO:teuthology.orchestra.run.smithi037.stdout:(6/33): fio-3.35-1.el9.x86_64.rpm 12 MB/s | 6.2 MB 00:00 2023-12-11T17:11:38.736 INFO:teuthology.orchestra.run.smithi037.stdout:(7/33): fio-engine-rdma-3.35-1.el9.x86_64.rpm 116 kB/s | 20 kB 00:00 2023-12-11T17:11:38.761 INFO:teuthology.orchestra.run.smithi037.stdout:(8/33): libcap-devel-2.48-9.el9.x86_64.rpm 194 kB/s | 33 kB 00:00 2023-12-11T17:11:38.804 INFO:teuthology.orchestra.run.smithi037.stdout:(9/33): rmt-1.6-6.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2023-12-11T17:11:38.837 INFO:teuthology.orchestra.run.smithi037.stdout:(10/33): udftools-2.2-5.el9.x86_64.rpm 1.9 MB/s | 144 kB 00:00 2023-12-11T17:11:38.879 INFO:teuthology.orchestra.run.smithi037.stdout:(11/33): sqlite-3.34.1-6.el9.x86_64.rpm 6.3 MB/s | 747 kB 00:00 2023-12-11T17:11:39.380 INFO:teuthology.orchestra.run.smithi037.stdout:(12/33): libnbd-1.18.1-3.el9.x86_64.rpm 308 kB/s | 166 kB 00:00 2023-12-11T17:11:39.480 INFO:teuthology.orchestra.run.smithi037.stdout:(13/33): gdbm-1.19-4.el9.x86_64.rpm 220 kB/s | 132 kB 00:00 2023-12-11T17:11:39.538 INFO:teuthology.orchestra.run.smithi037.stdout:(14/33): gdbm-devel-1.19-4.el9.x86_64.rpm 372 kB/s | 59 kB 00:00 2023-12-11T17:11:39.897 INFO:teuthology.orchestra.run.smithi037.stdout:(15/33): dump-0.4-0.51.b47.el9.x86_64.rpm 211 kB/s | 88 kB 00:00 2023-12-11T17:11:39.939 INFO:teuthology.orchestra.run.smithi037.stdout:(16/33): indent-2.2.13-4.el9.x86_64.rpm 546 kB/s | 179 kB 00:00 2023-12-11T17:11:40.173 INFO:teuthology.orchestra.run.smithi037.stdout:(17/33): cpp-11.4.1-2.3.el9.x86_64.rpm 39 MB/s | 11 MB 00:00 2023-12-11T17:11:40.384 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:11:40.394 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:11:40.582 INFO:teuthology.orchestra.run.smithi037.stdout:(18/33): gcc-c++-11.4.1-2.3.el9.x86_64.rpm 32 MB/s | 13 MB 00:00 2023-12-11T17:11:40.932 INFO:teuthology.orchestra.run.smithi037.stdout:(19/33): gcc-11.4.1-2.3.el9.x86_64.rpm 33 MB/s | 32 MB 00:00 2023-12-11T17:11:40.957 INFO:teuthology.orchestra.run.smithi037.stdout:(20/33): gcc-plugin-annobin-11.4.1-2.3.el9.x86_ 128 kB/s | 47 kB 00:00 2023-12-11T17:11:40.991 INFO:teuthology.orchestra.run.smithi037.stdout:(21/33): python-unversioned-command-3.9.18-1.el 274 kB/s | 8.8 kB 00:00 2023-12-11T17:11:41.074 INFO:teuthology.orchestra.run.smithi037.stdout:(22/33): libstdc++-devel-11.4.1-2.3.el9.x86_64. 19 MB/s | 2.2 MB 00:00 2023-12-11T17:11:41.099 INFO:teuthology.orchestra.run.smithi037.stdout:(23/33): python3-devel-3.9.18-1.el9.x86_64.rpm 2.1 MB/s | 204 kB 00:00 2023-12-11T17:11:41.183 INFO:teuthology.orchestra.run.smithi037.stdout:(24/33): e2fsprogs-1.46.5-4.el9.x86_64.rpm 12 MB/s | 1.0 MB 00:00 2023-12-11T17:11:41.208 INFO:teuthology.orchestra.run.smithi037.stdout:(25/33): e2fsprogs-libs-1.46.5-4.el9.x86_64.rpm 2.0 MB/s | 221 kB 00:00 2023-12-11T17:11:41.250 INFO:teuthology.orchestra.run.smithi037.stdout:(26/33): libcom_err-1.46.5-4.el9.x86_64.rpm 622 kB/s | 25 kB 00:00 2023-12-11T17:11:41.276 INFO:teuthology.orchestra.run.smithi037.stdout:(27/33): libgcc-11.4.1-2.3.el9.x86_64.rpm 1.4 MB/s | 92 kB 00:00 2023-12-11T17:11:41.309 INFO:teuthology.orchestra.run.smithi037.stdout:(28/33): libgomp-11.4.1-2.3.el9.x86_64.rpm 4.6 MB/s | 268 kB 00:00 2023-12-11T17:11:41.335 INFO:teuthology.orchestra.run.smithi037.stdout:(29/33): libss-1.46.5-4.el9.x86_64.rpm 555 kB/s | 31 kB 00:00 2023-12-11T17:11:41.377 INFO:teuthology.orchestra.run.smithi037.stdout:(30/33): libstdc++-11.4.1-2.3.el9.x86_64.rpm 11 MB/s | 735 kB 00:00 2023-12-11T17:11:41.410 INFO:teuthology.orchestra.run.smithi037.stdout:(31/33): python3-3.9.18-1.el9.x86_64.rpm 378 kB/s | 26 kB 00:00 2023-12-11T17:11:41.586 INFO:teuthology.orchestra.run.smithi037.stdout:(32/33): python3-libs-3.9.18-1.el9.x86_64.rpm 35 MB/s | 7.3 MB 00:00 2023-12-11T17:11:59.610 INFO:teuthology.orchestra.run.smithi037.stdout:(33/33): kernel-devel-5.14.0-390.el9.x86_64.rpm 1.0 MB/s | 21 MB 00:20 2023-12-11T17:11:59.621 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2023-12-11T17:11:59.622 INFO:teuthology.orchestra.run.smithi037.stdout:Total 4.4 MB/s | 97 MB 00:21 2023-12-11T17:12:00.056 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2023-12-11T17:12:00.445 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2023-12-11T17:12:00.445 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2023-12-11T17:12:01.799 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2023-12-11T17:12:01.800 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2023-12-11T17:12:04.308 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2023-12-11T17:12:04.389 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libcom_err-1.46.5-4.el9.x86_64 1/49 2023-12-11T17:12:04.428 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libgcc-11.4.1-2.3.el9.x86_64 2/49 2023-12-11T17:12:04.571 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libgcc-11.4.1-2.3.el9.x86_64 2/49 2023-12-11T17:12:04.642 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libstdc++-11.4.1-2.3.el9.x86_64 3/49 2023-12-11T17:12:05.395 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : e2fsprogs-libs-1.46.5-4.el9.x86_64 4/49 2023-12-11T17:12:05.639 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libstdc++-devel-11.4.1-2.3.el9.x86_64 5/49 2023-12-11T17:12:07.246 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libss-1.46.5-4.el9.x86_64 6/49 2023-12-11T17:12:07.426 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : python3-libs-3.9.18-1.el9.x86_64 7/49 2023-12-11T17:12:07.461 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : python3-3.9.18-1.el9.x86_64 8/49 2023-12-11T17:12:07.519 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : python-unversioned-command-3.9.18-1.el9.noarch 9/49 2023-12-11T17:12:07.888 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : libgomp-11.4.1-2.3.el9.x86_64 10/49 2023-12-11T17:12:09.135 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : cpp-11.4.1-2.3.el9.x86_64 11/49 2023-12-11T17:12:09.359 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : gcc-11.4.1-2.3.el9.x86_64 12/49 2023-12-11T17:12:09.463 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: gcc-11.4.1-2.3.el9.x86_64 12/49 2023-12-11T17:12:09.510 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gdbm-1:1.19-4.el9.x86_64 13/49 2023-12-11T17:12:09.547 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libnbd-1.18.1-3.el9.x86_64 14/49 2023-12-11T17:12:09.580 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fio-engine-http-3.35-1.el9.x86_64 15/49 2023-12-11T17:12:09.614 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fio-engine-libaio-3.35-1.el9.x86_64 16/49 2023-12-11T17:12:09.657 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fio-engine-nbd-3.35-1.el9.x86_64 17/49 2023-12-11T17:12:09.690 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fio-engine-rados-3.35-1.el9.x86_64 18/49 2023-12-11T17:12:09.724 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fio-engine-rbd-3.35-1.el9.x86_64 19/49 2023-12-11T17:12:09.994 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fio-engine-rdma-3.35-1.el9.x86_64 20/49 2023-12-11T17:12:10.141 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fio-3.35-1.el9.x86_64 21/49 2023-12-11T17:12:10.314 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rmt-2:1.6-6.el9.x86_64 22/49 2023-12-11T17:12:10.358 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : dump-1:0.4-0.51.b47.el9.x86_64 23/49 2023-12-11T17:12:10.599 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:12:10.609 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:12:22.190 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gdbm-devel-1:1.19-4.el9.x86_64 24/49 2023-12-11T17:12:22.429 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-devel-5.14.0-390.el9.x86_64 25/49 2023-12-11T17:12:40.746 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:12:40.756 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:13:10.902 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:13:10.909 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:13:17.023 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-devel-5.14.0-390.el9.x86_64 25/49 2023-12-11T17:13:17.102 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : gcc-c++-11.4.1-2.3.el9.x86_64 26/49 2023-12-11T17:13:17.133 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 27/49 2023-12-11T17:13:17.325 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 27/49 2023-12-11T17:13:17.476 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : python3-devel-3.9.18-1.el9.x86_64 28/49 2023-12-11T17:13:17.618 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : e2fsprogs-1.46.5-4.el9.x86_64 29/49 2023-12-11T17:13:17.677 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : indent-2.2.13-4.el9.x86_64 30/49 2023-12-11T17:13:17.726 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : udftools-2.2-5.el9.x86_64 31/49 2023-12-11T17:13:17.799 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : sqlite-3.34.1-6.el9.x86_64 32/49 2023-12-11T17:13:17.833 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcap-devel-2.48-9.el9.x86_64 33/49 2023-12-11T17:13:17.881 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : e2fsprogs-1.46.5-3.el9.x86_64 34/49 2023-12-11T17:13:17.920 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : gcc-c++-11.4.1-2.1.el9.x86_64 35/49 2023-12-11T17:13:17.963 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : python3-devel-3.9.17-2.el9.x86_64 36/49 2023-12-11T17:13:17.996 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : python3-3.9.17-2.el9.x86_64 37/49 2023-12-11T17:13:18.030 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : python-unversioned-command-3.9.17-2.el9.noarch 38/49 2023-12-11T17:13:18.032 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 39/49 2023-12-11T17:13:18.146 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 39/49 2023-12-11T17:13:18.207 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : gcc-11.4.1-2.1.el9.x86_64 40/49 2023-12-11T17:13:18.265 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : e2fsprogs-libs-1.46.5-3.el9.x86_64 41/49 2023-12-11T17:13:18.342 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libss-1.46.5-3.el9.x86_64 42/49 2023-12-11T17:13:18.391 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libstdc++-devel-11.4.1-2.1.el9.x86_64 43/49 2023-12-11T17:13:18.424 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libstdc++-11.4.1-2.1.el9.x86_64 44/49 2023-12-11T17:13:18.424 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libgcc-11.4.1-2.1.el9.x86_64 45/49 2023-12-11T17:13:18.544 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libgcc-11.4.1-2.1.el9.x86_64 45/49 2023-12-11T17:13:18.578 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libcom_err-1.46.5-3.el9.x86_64 46/49 2023-12-11T17:13:18.617 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : cpp-11.4.1-2.1.el9.x86_64 47/49 2023-12-11T17:13:18.767 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : libgomp-11.4.1-2.1.el9.x86_64 48/49 2023-12-11T17:13:18.894 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : python3-libs-3.9.17-2.el9.x86_64 49/49 2023-12-11T17:13:20.540 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: python3-libs-3.9.17-2.el9.x86_64 49/49 2023-12-11T17:13:20.540 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fio-3.35-1.el9.x86_64 1/49 2023-12-11T17:13:20.540 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fio-engine-http-3.35-1.el9.x86_64 2/49 2023-12-11T17:13:20.540 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fio-engine-libaio-3.35-1.el9.x86_64 3/49 2023-12-11T17:13:20.540 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fio-engine-nbd-3.35-1.el9.x86_64 4/49 2023-12-11T17:13:20.540 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fio-engine-rados-3.35-1.el9.x86_64 5/49 2023-12-11T17:13:20.540 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fio-engine-rbd-3.35-1.el9.x86_64 6/49 2023-12-11T17:13:20.541 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fio-engine-rdma-3.35-1.el9.x86_64 7/49 2023-12-11T17:13:20.541 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcap-devel-2.48-9.el9.x86_64 8/49 2023-12-11T17:13:20.541 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : sqlite-3.34.1-6.el9.x86_64 9/49 2023-12-11T17:13:20.541 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : udftools-2.2-5.el9.x86_64 10/49 2023-12-11T17:13:20.541 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rmt-2:1.6-6.el9.x86_64 11/49 2023-12-11T17:13:20.541 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-devel-5.14.0-390.el9.x86_64 12/49 2023-12-11T17:13:20.541 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libnbd-1.18.1-3.el9.x86_64 13/49 2023-12-11T17:13:20.541 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gdbm-1:1.19-4.el9.x86_64 14/49 2023-12-11T17:13:20.541 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gdbm-devel-1:1.19-4.el9.x86_64 15/49 2023-12-11T17:13:20.541 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : dump-1:0.4-0.51.b47.el9.x86_64 16/49 2023-12-11T17:13:20.541 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : indent-2.2.13-4.el9.x86_64 17/49 2023-12-11T17:13:20.541 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cpp-11.4.1-2.3.el9.x86_64 18/49 2023-12-11T17:13:20.541 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cpp-11.4.1-2.1.el9.x86_64 19/49 2023-12-11T17:13:20.541 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gcc-11.4.1-2.3.el9.x86_64 20/49 2023-12-11T17:13:20.542 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gcc-11.4.1-2.1.el9.x86_64 21/49 2023-12-11T17:13:20.542 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gcc-c++-11.4.1-2.3.el9.x86_64 22/49 2023-12-11T17:13:20.542 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gcc-c++-11.4.1-2.1.el9.x86_64 23/49 2023-12-11T17:13:20.542 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 24/49 2023-12-11T17:13:20.542 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gcc-plugin-annobin-11.4.1-2.1.el9.x86_64 25/49 2023-12-11T17:13:20.542 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libstdc++-devel-11.4.1-2.3.el9.x86_64 26/49 2023-12-11T17:13:20.542 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libstdc++-devel-11.4.1-2.1.el9.x86_64 27/49 2023-12-11T17:13:20.542 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python-unversioned-command-3.9.18-1.el9.noarch 28/49 2023-12-11T17:13:20.544 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python-unversioned-command-3.9.17-2.el9.noarch 29/49 2023-12-11T17:13:20.544 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-devel-3.9.18-1.el9.x86_64 30/49 2023-12-11T17:13:20.544 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 31/49 2023-12-11T17:13:20.544 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : e2fsprogs-1.46.5-4.el9.x86_64 32/49 2023-12-11T17:13:20.544 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : e2fsprogs-1.46.5-3.el9.x86_64 33/49 2023-12-11T17:13:20.544 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : e2fsprogs-libs-1.46.5-4.el9.x86_64 34/49 2023-12-11T17:13:20.545 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : e2fsprogs-libs-1.46.5-3.el9.x86_64 35/49 2023-12-11T17:13:20.545 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcom_err-1.46.5-4.el9.x86_64 36/49 2023-12-11T17:13:20.545 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcom_err-1.46.5-3.el9.x86_64 37/49 2023-12-11T17:13:20.545 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgcc-11.4.1-2.3.el9.x86_64 38/49 2023-12-11T17:13:20.545 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgcc-11.4.1-2.1.el9.x86_64 39/49 2023-12-11T17:13:20.545 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgomp-11.4.1-2.3.el9.x86_64 40/49 2023-12-11T17:13:20.545 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgomp-11.4.1-2.1.el9.x86_64 41/49 2023-12-11T17:13:20.545 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libss-1.46.5-4.el9.x86_64 42/49 2023-12-11T17:13:20.545 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libss-1.46.5-3.el9.x86_64 43/49 2023-12-11T17:13:20.545 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libstdc++-11.4.1-2.3.el9.x86_64 44/49 2023-12-11T17:13:20.545 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libstdc++-11.4.1-2.1.el9.x86_64 45/49 2023-12-11T17:13:20.545 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-3.9.18-1.el9.x86_64 46/49 2023-12-11T17:13:20.545 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-3.9.17-2.el9.x86_64 47/49 2023-12-11T17:13:20.545 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-libs-3.9.18-1.el9.x86_64 48/49 2023-12-11T17:13:21.399 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-libs-3.9.17-2.el9.x86_64 49/49 2023-12-11T17:13:21.399 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:13:21.399 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2023-12-11T17:13:21.399 INFO:teuthology.orchestra.run.smithi037.stdout: cpp-11.4.1-2.3.el9.x86_64 2023-12-11T17:13:21.399 INFO:teuthology.orchestra.run.smithi037.stdout: e2fsprogs-1.46.5-4.el9.x86_64 2023-12-11T17:13:21.399 INFO:teuthology.orchestra.run.smithi037.stdout: e2fsprogs-libs-1.46.5-4.el9.x86_64 2023-12-11T17:13:21.399 INFO:teuthology.orchestra.run.smithi037.stdout: gcc-11.4.1-2.3.el9.x86_64 2023-12-11T17:13:21.399 INFO:teuthology.orchestra.run.smithi037.stdout: gcc-c++-11.4.1-2.3.el9.x86_64 2023-12-11T17:13:21.399 INFO:teuthology.orchestra.run.smithi037.stdout: gcc-plugin-annobin-11.4.1-2.3.el9.x86_64 2023-12-11T17:13:21.399 INFO:teuthology.orchestra.run.smithi037.stdout: libcom_err-1.46.5-4.el9.x86_64 2023-12-11T17:13:21.399 INFO:teuthology.orchestra.run.smithi037.stdout: libgcc-11.4.1-2.3.el9.x86_64 2023-12-11T17:13:21.399 INFO:teuthology.orchestra.run.smithi037.stdout: libgomp-11.4.1-2.3.el9.x86_64 2023-12-11T17:13:21.400 INFO:teuthology.orchestra.run.smithi037.stdout: libss-1.46.5-4.el9.x86_64 2023-12-11T17:13:21.400 INFO:teuthology.orchestra.run.smithi037.stdout: libstdc++-11.4.1-2.3.el9.x86_64 2023-12-11T17:13:21.400 INFO:teuthology.orchestra.run.smithi037.stdout: libstdc++-devel-11.4.1-2.3.el9.x86_64 2023-12-11T17:13:21.400 INFO:teuthology.orchestra.run.smithi037.stdout: python-unversioned-command-3.9.18-1.el9.noarch 2023-12-11T17:13:21.400 INFO:teuthology.orchestra.run.smithi037.stdout: python3-3.9.18-1.el9.x86_64 2023-12-11T17:13:21.400 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel-3.9.18-1.el9.x86_64 2023-12-11T17:13:21.400 INFO:teuthology.orchestra.run.smithi037.stdout: python3-libs-3.9.18-1.el9.x86_64 2023-12-11T17:13:21.400 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2023-12-11T17:13:21.400 INFO:teuthology.orchestra.run.smithi037.stdout: dump-1:0.4-0.51.b47.el9.x86_64 fio-3.35-1.el9.x86_64 2023-12-11T17:13:21.400 INFO:teuthology.orchestra.run.smithi037.stdout: fio-engine-http-3.35-1.el9.x86_64 fio-engine-libaio-3.35-1.el9.x86_64 2023-12-11T17:13:21.400 INFO:teuthology.orchestra.run.smithi037.stdout: fio-engine-nbd-3.35-1.el9.x86_64 fio-engine-rados-3.35-1.el9.x86_64 2023-12-11T17:13:21.401 INFO:teuthology.orchestra.run.smithi037.stdout: fio-engine-rbd-3.35-1.el9.x86_64 fio-engine-rdma-3.35-1.el9.x86_64 2023-12-11T17:13:21.401 INFO:teuthology.orchestra.run.smithi037.stdout: gdbm-1:1.19-4.el9.x86_64 gdbm-devel-1:1.19-4.el9.x86_64 2023-12-11T17:13:21.401 INFO:teuthology.orchestra.run.smithi037.stdout: indent-2.2.13-4.el9.x86_64 kernel-devel-5.14.0-390.el9.x86_64 2023-12-11T17:13:21.401 INFO:teuthology.orchestra.run.smithi037.stdout: libcap-devel-2.48-9.el9.x86_64 libnbd-1.18.1-3.el9.x86_64 2023-12-11T17:13:21.401 INFO:teuthology.orchestra.run.smithi037.stdout: rmt-2:1.6-6.el9.x86_64 sqlite-3.34.1-6.el9.x86_64 2023-12-11T17:13:21.401 INFO:teuthology.orchestra.run.smithi037.stdout: udftools-2.2-5.el9.x86_64 2023-12-11T17:13:21.401 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:13:21.401 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2023-12-11T17:13:21.941 DEBUG:teuthology.orchestra.run.smithi037:> sudo useradd -m fsgqa 2023-12-11T17:13:22.018 INFO:teuthology.orchestra.run.smithi037.stderr:useradd: user 'fsgqa' already exists 2023-12-11T17:13:22.022 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-12-11T17:13:22.022 DEBUG:teuthology.orchestra.run.smithi037:> sudo groupadd fsgqa 2023-12-11T17:13:22.097 INFO:teuthology.orchestra.run.smithi037.stderr:groupadd: group 'fsgqa' already exists 2023-12-11T17:13:22.099 DEBUG:teuthology.orchestra.run:got remote process result: 9 2023-12-11T17:13:22.100 DEBUG:teuthology.orchestra.run.smithi037:> sudo useradd fsgqa2 2023-12-11T17:13:22.803 DEBUG:teuthology.orchestra.run.smithi037:> sudo useradd 123456-fsgqa 2023-12-11T17:13:23.492 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json mon dump 2023-12-11T17:13:23.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.682+0000 7f936ac20640 1 Processor -- start 2023-12-11T17:13:23.682 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.682+0000 7f936ac20640 1 -- start start 2023-12-11T17:13:23.685 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.684+0000 7f936ac20640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9364159fd0 0x7f93640ae1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:13:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.684+0000 7f936ac20640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f9364070750 0x7f9364070ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:13:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.684+0000 7f936ac20640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93640715f0 con 0x7f93640711e0 2023-12-11T17:13:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.684+0000 7f936ac20640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93640705f0 con 0x7f9364159fd0 2023-12-11T17:13:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.684+0000 7f936ac20640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9364070070 con 0x7f9364070750 2023-12-11T17:13:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.684+0000 7f9369c1e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9364159fd0 0x7f93640ae1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:13:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.684+0000 7f936a41f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f93640711e0 0x7f93640ac700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:43694/0 (socket says 172.21.15.37:43694) 2023-12-11T17:13:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.684+0000 7f936a41f640 1 -- 172.21.15.37:0/927489338 learned_addr learned my addr 172.21.15.37:0/927489338 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-11T17:13:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.685+0000 7f936941d640 1 --2- 172.21.15.37:0/927489338 >> v2:172.21.15.151:3300/0 conn(0x7f9364070750 0x7f9364070ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:13:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.685+0000 7f9369c1e640 1 -- 172.21.15.37:0/927489338 >> v2:172.21.15.151:3300/0 conn(0x7f9364070750 msgr2=0x7f9364070ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:13:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.685+0000 7f9369c1e640 1 --2- 172.21.15.37:0/927489338 >> v2:172.21.15.151:3300/0 conn(0x7f9364070750 0x7f9364070ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:13:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.685+0000 7f9369c1e640 1 -- 172.21.15.37:0/927489338 >> v1:172.21.15.37:6789/0 conn(0x7f93640711e0 legacy=0x7f93640ac700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:13:23.686 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.685+0000 7f9369c1e640 1 -- 172.21.15.37:0/927489338 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9364070310 con 0x7f9364159fd0 2023-12-11T17:13:23.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.685+0000 7f9368c1c640 1 -- 172.21.15.37:0/927489338 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 592986216 0 0) 0x7f93640715f0 con 0x7f93640711e0 2023-12-11T17:13:23.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.686+0000 7f9369c1e640 1 --2- 172.21.15.37:0/927489338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9364159fd0 0x7f93640ae1d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9364070000 tx=0x7f936002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c18019687c12988 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:13:23.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.686+0000 7f9368c1c640 1 -- 172.21.15.37:0/927489338 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360030610 con 0x7f9364159fd0 2023-12-11T17:13:23.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.687+0000 7f9368c1c640 1 -- 172.21.15.37:0/927489338 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9360030770 con 0x7f9364159fd0 2023-12-11T17:13:23.687 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.687+0000 7f9368c1c640 1 -- 172.21.15.37:0/927489338 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9360030b00 con 0x7f9364159fd0 2023-12-11T17:13:23.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.687+0000 7f936ac20640 1 -- 172.21.15.37:0/927489338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9364159fd0 msgr2=0x7f93640ae1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:13:23.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.687+0000 7f936ac20640 1 --2- 172.21.15.37:0/927489338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9364159fd0 0x7f93640ae1d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f9364070000 tx=0x7f936002b960 comp rx=0 tx=0).stop 2023-12-11T17:13:23.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.687+0000 7f936ac20640 1 -- 172.21.15.37:0/927489338 shutdown_connections 2023-12-11T17:13:23.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.687+0000 7f936ac20640 1 --2- 172.21.15.37:0/927489338 >> v2:172.21.15.151:3300/0 conn(0x7f9364070750 0x7f9364070ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:13:23.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.687+0000 7f936ac20640 1 --2- 172.21.15.37:0/927489338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9364159fd0 0x7f93640ae1d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:13:23.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.687+0000 7f936ac20640 1 -- 172.21.15.37:0/927489338 >> 172.21.15.37:0/927489338 conn(0x7f93640b0860 msgr2=0x7f93640b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:13:23.688 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.687+0000 7f936ac20640 1 -- 172.21.15.37:0/927489338 shutdown_connections 2023-12-11T17:13:23.689 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.687+0000 7f936ac20640 1 -- 172.21.15.37:0/927489338 wait complete. 2023-12-11T17:13:23.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.690+0000 7f936ac20640 1 Processor -- start 2023-12-11T17:13:23.690 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.690+0000 7f936ac20640 1 -- start start 2023-12-11T17:13:23.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.691+0000 7f936ac20640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9364070750 0x7f936409b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:13:23.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.691+0000 7f936ac20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93640711e0 0x7f93641551a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:13:23.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.691+0000 7f936ac20640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9364159fd0 0x7f93641556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:13:23.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.691+0000 7f936ac20640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f936409bd00 con 0x7f93640711e0 2023-12-11T17:13:23.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.691+0000 7f936ac20640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9364153880 con 0x7f9364159fd0 2023-12-11T17:13:23.692 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.691+0000 7f936ac20640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9364153b60 con 0x7f9364070750 2023-12-11T17:13:23.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.691+0000 7f936941d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93640711e0 0x7f93641551a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:13:23.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.691+0000 7f936941d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93640711e0 0x7f93641551a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37516/0 (socket says 172.21.15.37:37516) 2023-12-11T17:13:23.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.691+0000 7f936941d640 1 -- 172.21.15.37:0/2445765355 learned_addr learned my addr 172.21.15.37:0/2445765355 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:13:23.694 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.691+0000 7f9369c1e640 1 --2- 172.21.15.37:0/2445765355 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9364070750 0x7f936409b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:13:23.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.692+0000 7f936a41f640 1 --2- 172.21.15.37:0/2445765355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9364159fd0 0x7f93641556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:13:23.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.692+0000 7f936941d640 1 -- 172.21.15.37:0/2445765355 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9364070750 msgr2=0x7f936409b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:13:23.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.692+0000 7f936941d640 1 --2- 172.21.15.37:0/2445765355 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9364070750 0x7f936409b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:13:23.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.692+0000 7f936941d640 1 -- 172.21.15.37:0/2445765355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9364159fd0 msgr2=0x7f93641556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:13:23.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.692+0000 7f936941d640 1 --2- 172.21.15.37:0/2445765355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9364159fd0 0x7f93641556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:13:23.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.692+0000 7f936941d640 1 -- 172.21.15.37:0/2445765355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9360009400 con 0x7f93640711e0 2023-12-11T17:13:23.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.692+0000 7f936941d640 1 --2- 172.21.15.37:0/2445765355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93640711e0 0x7f93641551a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f935400d5f0 tx=0x7f935400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:13:23.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.692+0000 7f935a7fc640 1 -- 172.21.15.37:0/2445765355 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93540125f0 con 0x7f93640711e0 2023-12-11T17:13:23.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.692+0000 7f935a7fc640 1 -- 172.21.15.37:0/2445765355 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9354012750 con 0x7f93640711e0 2023-12-11T17:13:23.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.692+0000 7f935a7fc640 1 -- 172.21.15.37:0/2445765355 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9354012b00 con 0x7f93640711e0 2023-12-11T17:13:23.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.692+0000 7f936ac20640 1 -- 172.21.15.37:0/2445765355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9364153e40 con 0x7f93640711e0 2023-12-11T17:13:23.695 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.693+0000 7f936ac20640 1 -- 172.21.15.37:0/2445765355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9364154400 con 0x7f93640711e0 2023-12-11T17:13:23.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.694+0000 7f936ac20640 1 -- 172.21.15.37:0/2445765355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9364074450 con 0x7f93640711e0 2023-12-11T17:13:23.696 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.695+0000 7f935a7fc640 1 -- 172.21.15.37:0/2445765355 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f9354012c60 con 0x7f93640711e0 2023-12-11T17:13:23.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.697+0000 7f935a7fc640 1 --2- 172.21.15.37:0/2445765355 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f934806ae40 0x7f934806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:13:23.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.697+0000 7f935a7fc640 1 -- 172.21.15.37:0/2445765355 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f9354089c60 con 0x7f93640711e0 2023-12-11T17:13:23.697 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.698+0000 7f9369c1e640 1 --2- 172.21.15.37:0/2445765355 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f934806ae40 0x7f934806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:13:23.699 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.699+0000 7f9369c1e640 1 --2- 172.21.15.37:0/2445765355 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f934806ae40 0x7f934806d300 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9360036000 tx=0x7f9360008030 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:13:23.702 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.702+0000 7f935a7fc640 1 -- 172.21.15.37:0/2445765355 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f9354054bb0 con 0x7f93640711e0 2023-12-11T17:13:23.987 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.987+0000 7f936ac20640 1 -- 172.21.15.37:0/2445765355 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f936409cdc0 con 0x7f93640711e0 2023-12-11T17:13:23.988 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.988+0000 7f935a7fc640 1 -- 172.21.15.37:0/2445765355 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+1276 (secure 0 0 0) 0x7f93540581d0 con 0x7f93640711e0 2023-12-11T17:13:23.988 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:13:23.988 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":1,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","modified":"2023-12-11T17:08:41.671402Z","created":"2023-12-11T17:08:41.671402Z","min_mon_release":18,"min_mon_release_name":"reef","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:3300","nonce":0},{"type":"v1","addr":"172.21.15.37:6789","nonce":0}]},"addr":"172.21.15.37:6789/0","public_addr":"172.21.15.37:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:3300","nonce":0},{"type":"v1","addr":"172.21.15.151:6789","nonce":0}]},"addr":"172.21.15.151:6789/0","public_addr":"172.21.15.151:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:3301","nonce":0},{"type":"v1","addr":"172.21.15.151:6790","nonce":0}]},"addr":"172.21.15.151:6790/0","public_addr":"172.21.15.151:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2023-12-11T17:13:23.988 INFO:teuthology.orchestra.run.smithi037.stderr:dumped monmap epoch 1 2023-12-11T17:13:23.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.990+0000 7f936ac20640 1 -- 172.21.15.37:0/2445765355 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f934806ae40 msgr2=0x7f934806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:13:23.990 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.990+0000 7f936ac20640 1 --2- 172.21.15.37:0/2445765355 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f934806ae40 0x7f934806d300 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f9360036000 tx=0x7f9360008030 comp rx=0 tx=0).stop 2023-12-11T17:13:23.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.990+0000 7f936ac20640 1 -- 172.21.15.37:0/2445765355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93640711e0 msgr2=0x7f93641551a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:13:23.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.990+0000 7f936ac20640 1 --2- 172.21.15.37:0/2445765355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93640711e0 0x7f93641551a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f935400d5f0 tx=0x7f935400dab0 comp rx=0 tx=0).stop 2023-12-11T17:13:23.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.990+0000 7f936ac20640 1 -- 172.21.15.37:0/2445765355 shutdown_connections 2023-12-11T17:13:23.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.990+0000 7f936ac20640 1 --2- 172.21.15.37:0/2445765355 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f934806ae40 0x7f934806d300 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:13:23.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.990+0000 7f936ac20640 1 --2- 172.21.15.37:0/2445765355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9364159fd0 0x7f93641556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:13:23.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.990+0000 7f936ac20640 1 --2- 172.21.15.37:0/2445765355 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f93640711e0 0x7f93641551a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:13:23.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.990+0000 7f936ac20640 1 --2- 172.21.15.37:0/2445765355 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f9364070750 0x7f936409b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:13:23.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.990+0000 7f936ac20640 1 -- 172.21.15.37:0/2445765355 >> 172.21.15.37:0/2445765355 conn(0x7f93640b0860 msgr2=0x7f93640b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:13:23.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.990+0000 7f936ac20640 1 -- 172.21.15.37:0/2445765355 shutdown_connections 2023-12-11T17:13:23.991 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:23.990+0000 7f936ac20640 1 -- 172.21.15.37:0/2445765355 wait complete. 2023-12-11T17:13:24.009 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get-or-create client.admin 2023-12-11T17:13:24.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.191+0000 7fbf65384640 1 Processor -- start 2023-12-11T17:13:24.191 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.191+0000 7fbf65384640 1 -- start start 2023-12-11T17:13:24.192 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.192+0000 7fbf65384640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf60143990 0x7fbf600cdec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:13:24.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.192+0000 7fbf65384640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbf60071be0 0x7fbf601441c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:13:24.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.192+0000 7fbf65384640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf6006d520 con 0x7fbf6006a460 2023-12-11T17:13:24.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.192+0000 7fbf65384640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf60143d70 con 0x7fbf60071be0 2023-12-11T17:13:24.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.192+0000 7fbf65384640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf600723c0 con 0x7fbf60143990 2023-12-11T17:13:24.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.193+0000 7fbf57fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbf60071be0 0x7fbf601441c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:13:24.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.193+0000 7fbf57fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fbf60071be0 0x7fbf601441c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37532/0 (socket says 172.21.15.37:37532) 2023-12-11T17:13:24.193 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.193+0000 7fbf57fff640 1 -- 172.21.15.37:0/4079064361 learned_addr learned my addr 172.21.15.37:0/4079064361 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:13:24.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.193+0000 7fbf57fff640 1 -- 172.21.15.37:0/4079064361 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf60143990 msgr2=0x7fbf600cdec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:13:24.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.193+0000 7fbf5effd640 1 --2- 172.21.15.37:0/4079064361 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf60143990 0x7fbf600cdec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:13:24.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.193+0000 7fbf57fff640 1 --2- 172.21.15.37:0/4079064361 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf60143990 0x7fbf600cdec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:13:24.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.193+0000 7fbf57fff640 1 -- 172.21.15.37:0/4079064361 >> v1:172.21.15.151:6789/0 conn(0x7fbf6006a460 legacy=0x7fbf6006e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-11T17:13:24.194 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.193+0000 7fbf57fff640 1 -- 172.21.15.37:0/4079064361 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf6006d770 con 0x7fbf60071be0 2023-12-11T17:13:24.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.194+0000 7fbf57fff640 1 --2- 172.21.15.37:0/4079064361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf60071be0 0x7fbf601441c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbf48009870 tx=0x7fbf4802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25c70e3647d067a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:13:24.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.195+0000 7fbf5e7fc640 1 -- 172.21.15.37:0/4079064361 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf48031640 con 0x7fbf60071be0 2023-12-11T17:13:24.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.195+0000 7fbf5e7fc640 1 -- 172.21.15.37:0/4079064361 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf480317a0 con 0x7fbf60071be0 2023-12-11T17:13:24.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.195+0000 7fbf5e7fc640 1 -- 172.21.15.37:0/4079064361 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf48031b30 con 0x7fbf60071be0 2023-12-11T17:13:24.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.195+0000 7fbf65384640 1 -- 172.21.15.37:0/4079064361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf60071be0 msgr2=0x7fbf601441c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:13:24.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.195+0000 7fbf65384640 1 --2- 172.21.15.37:0/4079064361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf60071be0 0x7fbf601441c0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fbf48009870 tx=0x7fbf4802b8f0 comp rx=0 tx=0).stop 2023-12-11T17:13:24.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.195+0000 7fbf65384640 1 -- 172.21.15.37:0/4079064361 shutdown_connections 2023-12-11T17:13:24.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.195+0000 7fbf65384640 1 --2- 172.21.15.37:0/4079064361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf60071be0 0x7fbf601441c0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:13:24.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.195+0000 7fbf65384640 1 --2- 172.21.15.37:0/4079064361 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf60143990 0x7fbf600cdec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:13:24.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.195+0000 7fbf65384640 1 -- 172.21.15.37:0/4079064361 >> 172.21.15.37:0/4079064361 conn(0x7fbf600cfe30 msgr2=0x7fbf600d0240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:13:24.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.195+0000 7fbf65384640 1 -- 172.21.15.37:0/4079064361 shutdown_connections 2023-12-11T17:13:24.196 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.195+0000 7fbf65384640 1 -- 172.21.15.37:0/4079064361 wait complete. 2023-12-11T17:13:24.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.197+0000 7fbf65384640 1 Processor -- start 2023-12-11T17:13:24.197 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.197+0000 7fbf65384640 1 -- start start 2023-12-11T17:13:24.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.198+0000 7fbf65384640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf6006a460 0x7fbf6015cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:13:24.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.198+0000 7fbf65384640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf60071be0 0x7fbf60160020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:13:24.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.198+0000 7fbf65384640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf60143990 0x7fbf60160560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:13:24.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.198+0000 7fbf65384640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf600b3da0 con 0x7fbf6006a460 2023-12-11T17:13:24.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.198+0000 7fbf65384640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf601f3d40 con 0x7fbf60071be0 2023-12-11T17:13:24.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.198+0000 7fbf65384640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf601f3440 con 0x7fbf60143990 2023-12-11T17:13:24.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.198+0000 7fbf5effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf6006a460 0x7fbf6015cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:13:24.199 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.198+0000 7fbf5effd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf6006a460 0x7fbf6015cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:37536/0 (socket says 172.21.15.37:37536) 2023-12-11T17:13:24.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.198+0000 7fbf5effd640 1 -- 172.21.15.37:0/3656820530 learned_addr learned my addr 172.21.15.37:0/3656820530 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-11T17:13:24.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.199+0000 7fbf5f7fe640 1 --2- 172.21.15.37:0/3656820530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf60143990 0x7fbf60160560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:13:24.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.199+0000 7fbf5effd640 1 -- 172.21.15.37:0/3656820530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf60143990 msgr2=0x7fbf60160560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:13:24.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.199+0000 7fbf5effd640 1 --2- 172.21.15.37:0/3656820530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf60143990 0x7fbf60160560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:13:24.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.199+0000 7fbf5effd640 1 -- 172.21.15.37:0/3656820530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf60071be0 msgr2=0x7fbf60160020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:13:24.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.199+0000 7fbf57fff640 1 --2- 172.21.15.37:0/3656820530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf60071be0 0x7fbf60160020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:13:24.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.199+0000 7fbf5effd640 1 --2- 172.21.15.37:0/3656820530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf60071be0 0x7fbf60160020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:13:24.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.199+0000 7fbf5effd640 1 -- 172.21.15.37:0/3656820530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf480094d0 con 0x7fbf6006a460 2023-12-11T17:13:24.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.199+0000 7fbf5f7fe640 1 --2- 172.21.15.37:0/3656820530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf60143990 0x7fbf60160560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-11T17:13:24.200 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.199+0000 7fbf5effd640 1 --2- 172.21.15.37:0/3656820530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf6006a460 0x7fbf6015cfa0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000c820 tx=0x7fbf5000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:13:24.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.199+0000 7fbf577fe640 1 -- 172.21.15.37:0/3656820530 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf50004020 con 0x7fbf6006a460 2023-12-11T17:13:24.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.200+0000 7fbf577fe640 1 -- 172.21.15.37:0/3656820530 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf50004180 con 0x7fbf6006a460 2023-12-11T17:13:24.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.200+0000 7fbf577fe640 1 -- 172.21.15.37:0/3656820530 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf500077d0 con 0x7fbf6006a460 2023-12-11T17:13:24.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.200+0000 7fbf65384640 1 -- 172.21.15.37:0/3656820530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf6015d4e0 con 0x7fbf6006a460 2023-12-11T17:13:24.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.200+0000 7fbf65384640 1 -- 172.21.15.37:0/3656820530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf601f3680 con 0x7fbf6006a460 2023-12-11T17:13:24.201 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.201+0000 7fbf65384640 1 -- 172.21.15.37:0/3656820530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf600745d0 con 0x7fbf6006a460 2023-12-11T17:13:24.202 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.202+0000 7fbf577fe640 1 -- 172.21.15.37:0/3656820530 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fbf50007930 con 0x7fbf6006a460 2023-12-11T17:13:24.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.203+0000 7fbf577fe640 1 --2- 172.21.15.37:0/3656820530 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbf4006ae70 0x7fbf4006d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-11T17:13:24.203 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.203+0000 7fbf577fe640 1 -- 172.21.15.37:0/3656820530 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fbf50089310 con 0x7fbf6006a460 2023-12-11T17:13:24.204 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.204+0000 7fbf57fff640 1 --2- 172.21.15.37:0/3656820530 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbf4006ae70 0x7fbf4006d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-11T17:13:24.205 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.205+0000 7fbf57fff640 1 --2- 172.21.15.37:0/3656820530 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbf4006ae70 0x7fbf4006d330 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbf48036000 tx=0x7fbf4803c040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-11T17:13:24.207 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.207+0000 7fbf577fe640 1 -- 172.21.15.37:0/3656820530 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fbf500542f0 con 0x7fbf6006a460 2023-12-11T17:13:24.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.467+0000 7fbf65384640 1 -- 172.21.15.37:0/3656820530 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.admin"} v 0) v1 -- 0x7fbf60071930 con 0x7fbf6006a460 2023-12-11T17:13:24.467 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.467+0000 7fbf577fe640 1 -- 172.21.15.37:0/3656820530 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.admin"}]=0 v15) v1 ==== 92+0+63 (secure 0 0 0) 0x7fbf50057910 con 0x7fbf6006a460 2023-12-11T17:13:24.467 INFO:teuthology.orchestra.run.smithi037.stdout:[client.admin] 2023-12-11T17:13:24.467 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== 2023-12-11T17:13:24.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.470+0000 7fbf65384640 1 -- 172.21.15.37:0/3656820530 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbf4006ae70 msgr2=0x7fbf4006d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:13:24.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.470+0000 7fbf65384640 1 --2- 172.21.15.37:0/3656820530 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbf4006ae70 0x7fbf4006d330 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fbf48036000 tx=0x7fbf4803c040 comp rx=0 tx=0).stop 2023-12-11T17:13:24.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.470+0000 7fbf65384640 1 -- 172.21.15.37:0/3656820530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf6006a460 msgr2=0x7fbf6015cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-11T17:13:24.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.470+0000 7fbf65384640 1 --2- 172.21.15.37:0/3656820530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf6006a460 0x7fbf6015cfa0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fbf5000c820 tx=0x7fbf5000cce0 comp rx=0 tx=0).stop 2023-12-11T17:13:24.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.470+0000 7fbf65384640 1 -- 172.21.15.37:0/3656820530 shutdown_connections 2023-12-11T17:13:24.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.470+0000 7fbf65384640 1 --2- 172.21.15.37:0/3656820530 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fbf4006ae70 0x7fbf4006d330 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:13:24.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.470+0000 7fbf65384640 1 --2- 172.21.15.37:0/3656820530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbf60071be0 0x7fbf60160020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:13:24.470 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.470+0000 7fbf65384640 1 --2- 172.21.15.37:0/3656820530 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fbf60143990 0x7fbf60160560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:13:24.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.470+0000 7fbf65384640 1 --2- 172.21.15.37:0/3656820530 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fbf6006a460 0x7fbf6015cfa0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-11T17:13:24.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.470+0000 7fbf65384640 1 -- 172.21.15.37:0/3656820530 >> 172.21.15.37:0/3656820530 conn(0x7fbf600cfe30 msgr2=0x7fbf601467e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-11T17:13:24.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.470+0000 7fbf65384640 1 -- 172.21.15.37:0/3656820530 shutdown_connections 2023-12-11T17:13:24.471 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-11T17:13:24.470+0000 7fbf65384640 1 -- 172.21.15.37:0/3656820530 wait complete. 2023-12-11T17:13:24.489 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:13:24.489 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/tmp/tmp.gLzcJVJdzjxfstests-dev/local.config 2023-12-11T17:13:24.559 INFO:tasks.cephfs.xfstests_dev:local.config's contents - export FSTYP=ceph export TEST_DEV=172.21.15.37:6789:/test export TEST_DIR=/tmp/tmp.IOXZHTg9krtest export SCRATCH_DEV=172.21.15.37:6789:/scratch export SCRATCH_MNT=/tmp/tmp.4GCEnGEZ83scratch export CEPHFS_MOUNT_OPTIONS="-o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw==" 2023-12-11T17:13:24.559 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-11T17:13:24.559 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/tmp/tmp.gLzcJVJdzjxfstests-dev/ceph.exclude 2023-12-11T17:13:24.702 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo make) 2023-12-11T17:13:24.845 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize -cfi 2023-12-11T17:13:25.447 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: putting auxiliary files in '.'. 2023-12-11T17:13:25.447 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file './config.guess' 2023-12-11T17:13:25.457 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file './config.sub' 2023-12-11T17:13:25.468 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file './install-sh' 2023-12-11T17:13:25.480 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file './ltmain.sh' 2023-12-11T17:13:25.552 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: putting macros in AC_CONFIG_MACRO_DIRS, 'm4'. 2023-12-11T17:13:25.553 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file 'm4/libtool.m4' 2023-12-11T17:13:25.569 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file 'm4/ltoptions.m4' 2023-12-11T17:13:25.586 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file 'm4/ltsugar.m4' 2023-12-11T17:13:25.604 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file 'm4/ltversion.m4' 2023-12-11T17:13:25.622 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: copying file 'm4/lt~obsolete.m4' 2023-12-11T17:13:25.647 INFO:teuthology.orchestra.run.smithi037.stdout:libtoolize: Consider adding '-I m4' to ACLOCAL_AMFLAGS in Makefile.am. 2023-12-11T17:13:25.652 INFO:teuthology.orchestra.run.smithi037.stdout:cp include/install-sh . 2023-12-11T17:13:25.655 INFO:teuthology.orchestra.run.smithi037.stdout:aclocal -I m4 2023-12-11T17:13:27.407 INFO:teuthology.orchestra.run.smithi037.stdout:autoheader 2023-12-11T17:13:27.850 INFO:teuthology.orchestra.run.smithi037.stdout:autoconf 2023-12-11T17:13:28.128 INFO:teuthology.orchestra.run.smithi037.stdout:./configure \ 2023-12-11T17:13:28.128 INFO:teuthology.orchestra.run.smithi037.stdout: --libexecdir=/usr/lib \ 2023-12-11T17:13:28.128 INFO:teuthology.orchestra.run.smithi037.stdout: --exec_prefix=/var/lib 2023-12-11T17:13:28.742 INFO:teuthology.orchestra.run.smithi037.stdout:checking build system type... x86_64-pc-linux-gnu 2023-12-11T17:13:28.743 INFO:teuthology.orchestra.run.smithi037.stdout:checking host system type... x86_64-pc-linux-gnu 2023-12-11T17:13:28.748 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to print strings... printf 2023-12-11T17:13:28.748 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gcc... gcc 2023-12-11T17:13:28.914 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether the C compiler works... yes 2023-12-11T17:13:28.914 INFO:teuthology.orchestra.run.smithi037.stdout:checking for C compiler default output file name... a.out 2023-12-11T17:13:28.990 INFO:teuthology.orchestra.run.smithi037.stdout:checking for suffix of executables... 2023-12-11T17:13:29.095 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether we are cross compiling... no 2023-12-11T17:13:29.152 INFO:teuthology.orchestra.run.smithi037.stdout:checking for suffix of object files... o 2023-12-11T17:13:29.202 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether we are using the GNU C compiler... yes 2023-12-11T17:13:29.250 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether gcc accepts -g... yes 2023-12-11T17:13:29.321 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gcc option to accept ISO C89... none needed 2023-12-11T17:13:29.332 INFO:teuthology.orchestra.run.smithi037.stdout:checking for a sed that does not truncate output... /bin/sed 2023-12-11T17:13:29.340 INFO:teuthology.orchestra.run.smithi037.stdout:checking for grep that handles long lines and -e... /bin/grep 2023-12-11T17:13:29.346 INFO:teuthology.orchestra.run.smithi037.stdout:checking for egrep... /bin/grep -E 2023-12-11T17:13:29.351 INFO:teuthology.orchestra.run.smithi037.stdout:checking for fgrep... /bin/grep -F 2023-12-11T17:13:29.364 INFO:teuthology.orchestra.run.smithi037.stdout:checking for ld used by gcc... /bin/ld 2023-12-11T17:13:29.370 INFO:teuthology.orchestra.run.smithi037.stdout:checking if the linker (/bin/ld) is GNU ld... yes 2023-12-11T17:13:29.385 INFO:teuthology.orchestra.run.smithi037.stdout:checking for BSD- or MS-compatible name lister (nm)... /bin/nm -B 2023-12-11T17:13:30.384 INFO:teuthology.orchestra.run.smithi037.stdout:checking the name lister (/bin/nm -B) interface... BSD nm 2023-12-11T17:13:30.384 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether ln -s works... yes 2023-12-11T17:13:30.408 INFO:teuthology.orchestra.run.smithi037.stdout:checking the maximum length of command line arguments... 1572864 2023-12-11T17:13:30.419 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to convert x86_64-pc-linux-gnu file names to x86_64-pc-linux-gnu format... func_convert_file_noop 2023-12-11T17:13:30.419 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to convert x86_64-pc-linux-gnu file names to toolchain format... func_convert_file_noop 2023-12-11T17:13:30.419 INFO:teuthology.orchestra.run.smithi037.stdout:checking for /bin/ld option to reload object files... -r 2023-12-11T17:13:30.420 INFO:teuthology.orchestra.run.smithi037.stdout:checking for objdump... objdump 2023-12-11T17:13:30.421 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to recognize dependent libraries... pass_all 2023-12-11T17:13:30.422 INFO:teuthology.orchestra.run.smithi037.stdout:checking for dlltool... no 2023-12-11T17:13:30.423 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to associate runtime and link libraries... printf %s\n 2023-12-11T17:13:30.424 INFO:teuthology.orchestra.run.smithi037.stdout:checking for ar... ar 2023-12-11T17:13:30.544 INFO:teuthology.orchestra.run.smithi037.stdout:checking for archiver @FILE support... @ 2023-12-11T17:13:30.545 INFO:teuthology.orchestra.run.smithi037.stdout:checking for strip... strip 2023-12-11T17:13:30.546 INFO:teuthology.orchestra.run.smithi037.stdout:checking for ranlib... ranlib 2023-12-11T17:13:30.547 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gawk... gawk 2023-12-11T17:13:30.738 INFO:teuthology.orchestra.run.smithi037.stdout:checking command to parse /bin/nm -B output from gcc object... ok 2023-12-11T17:13:30.743 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sysroot... no 2023-12-11T17:13:30.755 INFO:teuthology.orchestra.run.smithi037.stdout:checking for a working dd... /bin/dd 2023-12-11T17:13:30.766 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to truncate binary pipes... /bin/dd bs=4096 count=1 2023-12-11T17:13:30.809 INFO:teuthology.orchestra.run.smithi037.stdout:checking for mt... no 2023-12-11T17:13:30.821 INFO:teuthology.orchestra.run.smithi037.stdout:checking if : is a manifest tool... no 2023-12-11T17:13:30.941 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to run the C preprocessor... gcc -E 2023-12-11T17:13:31.313 INFO:teuthology.orchestra.run.smithi037.stdout:checking for ANSI C header files... yes 2023-12-11T17:13:31.377 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/types.h... yes 2023-12-11T17:13:31.469 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/stat.h... yes 2023-12-11T17:13:31.546 INFO:teuthology.orchestra.run.smithi037.stdout:checking for stdlib.h... yes 2023-12-11T17:13:31.624 INFO:teuthology.orchestra.run.smithi037.stdout:checking for string.h... yes 2023-12-11T17:13:31.706 INFO:teuthology.orchestra.run.smithi037.stdout:checking for memory.h... yes 2023-12-11T17:13:31.784 INFO:teuthology.orchestra.run.smithi037.stdout:checking for strings.h... yes 2023-12-11T17:13:31.874 INFO:teuthology.orchestra.run.smithi037.stdout:checking for inttypes.h... yes 2023-12-11T17:13:31.953 INFO:teuthology.orchestra.run.smithi037.stdout:checking for stdint.h... yes 2023-12-11T17:13:32.045 INFO:teuthology.orchestra.run.smithi037.stdout:checking for unistd.h... yes 2023-12-11T17:13:32.124 INFO:teuthology.orchestra.run.smithi037.stdout:checking for dlfcn.h... yes 2023-12-11T17:13:32.137 INFO:teuthology.orchestra.run.smithi037.stdout:checking for objdir... .libs 2023-12-11T17:13:32.328 INFO:teuthology.orchestra.run.smithi037.stdout:checking if gcc supports -fno-rtti -fno-exceptions... no 2023-12-11T17:13:32.328 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gcc option to produce PIC... -fPIC -DPIC 2023-12-11T17:13:32.386 INFO:teuthology.orchestra.run.smithi037.stdout:checking if gcc PIC flag -fPIC -DPIC works... yes 2023-12-11T17:13:32.441 INFO:teuthology.orchestra.run.smithi037.stdout:checking if gcc static flag -static works... no 2023-12-11T17:13:32.529 INFO:teuthology.orchestra.run.smithi037.stdout:checking if gcc supports -c -o file.o... yes 2023-12-11T17:13:32.529 INFO:teuthology.orchestra.run.smithi037.stdout:checking if gcc supports -c -o file.o... (cached) yes 2023-12-11T17:13:32.558 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether the gcc linker (/bin/ld -m elf_x86_64) supports shared libraries... yes 2023-12-11T17:13:32.633 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether -lc should be explicitly linked in... no 2023-12-11T17:13:32.792 INFO:teuthology.orchestra.run.smithi037.stdout:checking dynamic linker characteristics... GNU/Linux ld.so 2023-12-11T17:13:32.792 INFO:teuthology.orchestra.run.smithi037.stdout:checking how to hardcode library paths into programs... immediate 2023-12-11T17:13:32.797 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether stripping libraries is possible... yes 2023-12-11T17:13:32.797 INFO:teuthology.orchestra.run.smithi037.stdout:checking if libtool supports shared libraries... yes 2023-12-11T17:13:32.797 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether to build shared libraries... yes 2023-12-11T17:13:32.797 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether to build static libraries... yes 2023-12-11T17:13:32.821 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gcc... (cached) gcc 2023-12-11T17:13:32.883 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether we are using the GNU C compiler... (cached) yes 2023-12-11T17:13:32.884 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether gcc accepts -g... (cached) yes 2023-12-11T17:13:32.886 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gcc option to accept ISO C89... (cached) none needed 2023-12-11T17:13:32.887 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gmake... /usr/bin/gmake 2023-12-11T17:13:32.887 INFO:teuthology.orchestra.run.smithi037.stderr:./configure: line 12083: test: $(SHELL): binary operator expected 2023-12-11T17:13:32.888 INFO:teuthology.orchestra.run.smithi037.stdout:checking for tar... /bin/tar 2023-12-11T17:13:32.888 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gzip... /bin/gzip 2023-12-11T17:13:32.917 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether gcc -MM is supported... yes 2023-12-11T17:13:32.918 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sort... /bin/sort 2023-12-11T17:13:32.919 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether ln -s works... yes 2023-12-11T17:13:32.920 INFO:teuthology.orchestra.run.smithi037.stdout:checking for rpm... /bin/rpm 2023-12-11T17:13:32.932 INFO:teuthology.orchestra.run.smithi037.stdout:checking for rpmbuild... no 2023-12-11T17:13:33.099 INFO:teuthology.orchestra.run.smithi037.stdout:checking assert.h usability... yes 2023-12-11T17:13:33.129 INFO:teuthology.orchestra.run.smithi037.stdout:checking assert.h presence... yes 2023-12-11T17:13:33.129 INFO:teuthology.orchestra.run.smithi037.stdout:checking for assert.h... yes 2023-12-11T17:13:33.216 INFO:teuthology.orchestra.run.smithi037.stdout:checking bstring.h usability... no 2023-12-11T17:13:33.261 INFO:teuthology.orchestra.run.smithi037.stdout:checking bstring.h presence... no 2023-12-11T17:13:33.261 INFO:teuthology.orchestra.run.smithi037.stdout:checking for bstring.h... no 2023-12-11T17:13:33.338 INFO:teuthology.orchestra.run.smithi037.stdout:checking libgen.h usability... yes 2023-12-11T17:13:33.367 INFO:teuthology.orchestra.run.smithi037.stdout:checking libgen.h presence... yes 2023-12-11T17:13:33.367 INFO:teuthology.orchestra.run.smithi037.stdout:checking for libgen.h... yes 2023-12-11T17:13:33.458 INFO:teuthology.orchestra.run.smithi037.stdout:checking dirent.h usability... yes 2023-12-11T17:13:33.488 INFO:teuthology.orchestra.run.smithi037.stdout:checking dirent.h presence... yes 2023-12-11T17:13:33.488 INFO:teuthology.orchestra.run.smithi037.stdout:checking for dirent.h... yes 2023-12-11T17:13:33.675 INFO:teuthology.orchestra.run.smithi037.stdout:checking errno.h usability... yes 2023-12-11T17:13:33.708 INFO:teuthology.orchestra.run.smithi037.stdout:checking errno.h presence... yes 2023-12-11T17:13:33.708 INFO:teuthology.orchestra.run.smithi037.stdout:checking for errno.h... yes 2023-12-11T17:13:33.802 INFO:teuthology.orchestra.run.smithi037.stdout:checking malloc.h usability... yes 2023-12-11T17:13:33.837 INFO:teuthology.orchestra.run.smithi037.stdout:checking malloc.h presence... yes 2023-12-11T17:13:33.837 INFO:teuthology.orchestra.run.smithi037.stdout:checking for malloc.h... yes 2023-12-11T17:13:33.920 INFO:teuthology.orchestra.run.smithi037.stdout:checking uuid.h usability... no 2023-12-11T17:13:33.964 INFO:teuthology.orchestra.run.smithi037.stdout:checking uuid.h presence... no 2023-12-11T17:13:33.964 INFO:teuthology.orchestra.run.smithi037.stdout:checking for uuid.h... no 2023-12-11T17:13:34.050 INFO:teuthology.orchestra.run.smithi037.stdout:checking uuid/uuid.h usability... yes 2023-12-11T17:13:34.082 INFO:teuthology.orchestra.run.smithi037.stdout:checking uuid/uuid.h presence... yes 2023-12-11T17:13:34.082 INFO:teuthology.orchestra.run.smithi037.stdout:checking for uuid/uuid.h... yes 2023-12-11T17:13:34.169 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/uuid.h usability... no 2023-12-11T17:13:34.213 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/uuid.h presence... no 2023-12-11T17:13:34.213 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/uuid.h... no 2023-12-11T17:13:34.430 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/file.h usability... yes 2023-12-11T17:13:34.465 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/file.h presence... yes 2023-12-11T17:13:34.465 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/file.h... yes 2023-12-11T17:13:34.555 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/fcntl.h usability... yes 2023-12-11T17:13:34.583 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/fcntl.h presence... yes 2023-12-11T17:13:34.583 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/fcntl.h... yes 2023-12-11T17:13:34.673 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/syssgi.h usability... no 2023-12-11T17:13:34.717 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/syssgi.h presence... no 2023-12-11T17:13:34.717 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/syssgi.h... no 2023-12-11T17:13:34.815 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/param.h usability... yes 2023-12-11T17:13:34.850 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/param.h presence... yes 2023-12-11T17:13:34.850 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/param.h... yes 2023-12-11T17:13:34.871 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/stat.h... (cached) yes 2023-12-11T17:13:34.970 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/statvfs.h usability... yes 2023-12-11T17:13:35.000 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/statvfs.h presence... yes 2023-12-11T17:13:35.000 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/statvfs.h... yes 2023-12-11T17:13:35.082 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/time.h usability... yes 2023-12-11T17:13:35.110 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/time.h presence... yes 2023-12-11T17:13:35.110 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/time.h... yes 2023-12-11T17:13:35.199 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/ioctl.h usability... yes 2023-12-11T17:13:35.229 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/ioctl.h presence... yes 2023-12-11T17:13:35.229 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/ioctl.h... yes 2023-12-11T17:13:35.330 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/wait.h usability... yes 2023-12-11T17:13:35.364 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/wait.h presence... yes 2023-12-11T17:13:35.364 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/wait.h... yes 2023-12-11T17:13:35.384 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/types.h... (cached) yes 2023-12-11T17:13:35.401 INFO:teuthology.orchestra.run.smithi037.stdout:checking for strings.h... (cached) yes 2023-12-11T17:13:35.483 INFO:teuthology.orchestra.run.smithi037.stdout:checking err.h usability... yes 2023-12-11T17:13:35.512 INFO:teuthology.orchestra.run.smithi037.stdout:checking err.h presence... yes 2023-12-11T17:13:35.512 INFO:teuthology.orchestra.run.smithi037.stdout:checking for err.h... yes 2023-12-11T17:13:35.597 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/falloc.h usability... yes 2023-12-11T17:13:35.626 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/falloc.h presence... yes 2023-12-11T17:13:35.627 INFO:teuthology.orchestra.run.smithi037.stdout:checking for linux/falloc.h... yes 2023-12-11T17:13:35.714 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/fs/xfs_fsops.h usability... no 2023-12-11T17:13:35.759 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/fs/xfs_fsops.h presence... no 2023-12-11T17:13:35.760 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/fs/xfs_fsops.h... no 2023-12-11T17:13:35.839 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/fs/xfs_itable.h usability... no 2023-12-11T17:13:35.880 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/fs/xfs_itable.h presence... no 2023-12-11T17:13:35.881 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/fs/xfs_itable.h... no 2023-12-11T17:13:35.961 INFO:teuthology.orchestra.run.smithi037.stdout:checking xfs/platform_defs.h usability... no 2023-12-11T17:13:36.008 INFO:teuthology.orchestra.run.smithi037.stdout:checking xfs/platform_defs.h presence... no 2023-12-11T17:13:36.009 INFO:teuthology.orchestra.run.smithi037.stdout:checking for xfs/platform_defs.h... no 2023-12-11T17:13:36.088 INFO:teuthology.orchestra.run.smithi037.stdout:checking btrfs/ioctl.h usability... no 2023-12-11T17:13:36.135 INFO:teuthology.orchestra.run.smithi037.stdout:checking btrfs/ioctl.h presence... no 2023-12-11T17:13:36.135 INFO:teuthology.orchestra.run.smithi037.stdout:checking for btrfs/ioctl.h... no 2023-12-11T17:13:36.214 INFO:teuthology.orchestra.run.smithi037.stdout:checking cifs/ioctl.h usability... no 2023-12-11T17:13:36.257 INFO:teuthology.orchestra.run.smithi037.stdout:checking cifs/ioctl.h presence... no 2023-12-11T17:13:36.257 INFO:teuthology.orchestra.run.smithi037.stdout:checking for cifs/ioctl.h... no 2023-12-11T17:13:36.337 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/mman.h usability... yes 2023-12-11T17:13:36.370 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/mman.h presence... yes 2023-12-11T17:13:36.371 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/mman.h... yes 2023-12-11T17:13:36.429 INFO:teuthology.orchestra.run.smithi037.stdout:checking for xfs/xfs_log_format.h... no 2023-12-11T17:13:36.532 INFO:teuthology.orchestra.run.smithi037.stdout:checking for uuid_compare... no 2023-12-11T17:13:36.619 INFO:teuthology.orchestra.run.smithi037.stdout:checking for uuid_compare in -luuid... yes 2023-12-11T17:13:36.744 INFO:teuthology.orchestra.run.smithi037.stdout:checking for xfs/xfs.h... yes 2023-12-11T17:13:36.800 INFO:teuthology.orchestra.run.smithi037.stdout:checking for xfs/libxfs.h... no 2023-12-11T17:13:36.865 INFO:teuthology.orchestra.run.smithi037.stdout:checking whether xlog_assign_lsn is declared... no 2023-12-11T17:13:36.944 INFO:teuthology.orchestra.run.smithi037.stdout:checking for xfs/xqm.h... yes 2023-12-11T17:13:37.053 INFO:teuthology.orchestra.run.smithi037.stdout:checking xfsctl from xfs/xfs.h... ok 2023-12-11T17:13:37.119 INFO:teuthology.orchestra.run.smithi037.stdout:checking xfs/handle.h usability... yes 2023-12-11T17:13:37.146 INFO:teuthology.orchestra.run.smithi037.stdout:checking xfs/handle.h presence... yes 2023-12-11T17:13:37.146 INFO:teuthology.orchestra.run.smithi037.stdout:checking for xfs/handle.h... yes 2023-12-11T17:13:37.248 INFO:teuthology.orchestra.run.smithi037.stdout:checking for attr_list_by_handle in -lhandle... yes 2023-12-11T17:13:37.315 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/acl.h usability... yes 2023-12-11T17:13:37.349 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/acl.h presence... yes 2023-12-11T17:13:37.350 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/acl.h... yes 2023-12-11T17:13:37.418 INFO:teuthology.orchestra.run.smithi037.stdout:checking acl/libacl.h usability... yes 2023-12-11T17:13:37.452 INFO:teuthology.orchestra.run.smithi037.stdout:checking acl/libacl.h presence... yes 2023-12-11T17:13:37.452 INFO:teuthology.orchestra.run.smithi037.stdout:checking for acl/libacl.h... yes 2023-12-11T17:13:37.542 INFO:teuthology.orchestra.run.smithi037.stdout:checking for acl_init in -lacl... yes 2023-12-11T17:13:37.613 INFO:teuthology.orchestra.run.smithi037.stdout:checking gdbm-ndbm.h usability... no 2023-12-11T17:13:37.659 INFO:teuthology.orchestra.run.smithi037.stdout:checking gdbm-ndbm.h presence... no 2023-12-11T17:13:37.659 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gdbm-ndbm.h... no 2023-12-11T17:13:37.727 INFO:teuthology.orchestra.run.smithi037.stdout:checking gdbm/ndbm.h usability... yes 2023-12-11T17:13:37.761 INFO:teuthology.orchestra.run.smithi037.stdout:checking gdbm/ndbm.h presence... yes 2023-12-11T17:13:37.761 INFO:teuthology.orchestra.run.smithi037.stdout:checking for gdbm/ndbm.h... yes 2023-12-11T17:13:37.863 INFO:teuthology.orchestra.run.smithi037.stdout:checking for dbm_open in -lgdbm... no 2023-12-11T17:13:37.968 INFO:teuthology.orchestra.run.smithi037.stdout:checking for dbm_fetch in -lgdbm... no 2023-12-11T17:13:38.068 INFO:teuthology.orchestra.run.smithi037.stdout:checking for dbm_store in -lgdbm... no 2023-12-11T17:13:38.166 INFO:teuthology.orchestra.run.smithi037.stdout:checking for dbm_close in -lgdbm... no 2023-12-11T17:13:38.266 INFO:teuthology.orchestra.run.smithi037.stdout:checking for dbm_open in -lgdbm_compat... yes 2023-12-11T17:13:38.353 INFO:teuthology.orchestra.run.smithi037.stdout:checking for dbm_fetch in -lgdbm_compat... yes 2023-12-11T17:13:38.438 INFO:teuthology.orchestra.run.smithi037.stdout:checking for dbm_store in -lgdbm_compat... yes 2023-12-11T17:13:38.526 INFO:teuthology.orchestra.run.smithi037.stdout:checking for dbm_close in -lgdbm_compat... yes 2023-12-11T17:13:38.593 INFO:teuthology.orchestra.run.smithi037.stdout:checking libaio.h usability... yes 2023-12-11T17:13:38.624 INFO:teuthology.orchestra.run.smithi037.stdout:checking libaio.h presence... yes 2023-12-11T17:13:38.624 INFO:teuthology.orchestra.run.smithi037.stdout:checking for libaio.h... yes 2023-12-11T17:13:38.698 INFO:teuthology.orchestra.run.smithi037.stdout:checking liburing.h usability... no 2023-12-11T17:13:38.745 INFO:teuthology.orchestra.run.smithi037.stdout:checking liburing.h presence... no 2023-12-11T17:13:38.745 INFO:teuthology.orchestra.run.smithi037.stdout:checking for liburing.h... no 2023-12-11T17:13:38.818 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/capability.h usability... yes 2023-12-11T17:13:38.849 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/capability.h presence... yes 2023-12-11T17:13:38.849 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/capability.h... yes 2023-12-11T17:13:38.913 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/fiemap.h usability... yes 2023-12-11T17:13:38.939 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/fiemap.h presence... yes 2023-12-11T17:13:38.939 INFO:teuthology.orchestra.run.smithi037.stdout:checking for linux/fiemap.h... yes 2023-12-11T17:13:39.035 INFO:teuthology.orchestra.run.smithi037.stdout:checking for fallocate... yes 2023-12-11T17:13:39.128 INFO:teuthology.orchestra.run.smithi037.stdout:checking for open_by_handle_at... yes 2023-12-11T17:13:39.207 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/prctl.h usability... yes 2023-12-11T17:13:39.233 INFO:teuthology.orchestra.run.smithi037.stdout:checking sys/prctl.h presence... yes 2023-12-11T17:13:39.233 INFO:teuthology.orchestra.run.smithi037.stdout:checking for sys/prctl.h... yes 2023-12-11T17:13:39.294 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/fs.h usability... yes 2023-12-11T17:13:39.320 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/fs.h presence... yes 2023-12-11T17:13:39.320 INFO:teuthology.orchestra.run.smithi037.stdout:checking for linux/fs.h... yes 2023-12-11T17:13:39.389 INFO:teuthology.orchestra.run.smithi037.stdout:checking btrfsutil.h usability... no 2023-12-11T17:13:39.433 INFO:teuthology.orchestra.run.smithi037.stdout:checking btrfsutil.h presence... no 2023-12-11T17:13:39.433 INFO:teuthology.orchestra.run.smithi037.stdout:checking for btrfsutil.h... no 2023-12-11T17:13:39.531 INFO:teuthology.orchestra.run.smithi037.stdout:checking for copy_file_range... yes 2023-12-11T17:13:39.626 INFO:teuthology.orchestra.run.smithi037.stdout:checking for SEEK_DATA... yes 2023-12-11T17:13:39.738 INFO:teuthology.orchestra.run.smithi037.stdout:checking for BMV_OF_SHARED... yes 2023-12-11T17:13:39.837 INFO:teuthology.orchestra.run.smithi037.stdout:checking for nftw... yes 2023-12-11T17:13:39.940 INFO:teuthology.orchestra.run.smithi037.stdout:checking for RLIMIT_NOFILE... yes 2023-12-11T17:13:40.026 INFO:teuthology.orchestra.run.smithi037.stdout:checking for XFS_IOC_EXCHANGE_RANGE... no 2023-12-11T17:13:40.114 INFO:teuthology.orchestra.run.smithi037.stdout:checking for FICLONE... yes 2023-12-11T17:13:40.203 INFO:teuthology.orchestra.run.smithi037.stdout:checking for renameat2... yes 2023-12-11T17:13:40.296 INFO:teuthology.orchestra.run.smithi037.stdout:checking for reallocarray... yes 2023-12-11T17:13:40.400 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct mount_attr... yes 2023-12-11T17:13:40.511 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_qgroup_limit... yes 2023-12-11T17:13:40.622 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_qgroup_inherit... yes 2023-12-11T17:13:40.741 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_ioctl_vol_args... yes 2023-12-11T17:13:40.854 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_ioctl_vol_args_v2... yes 2023-12-11T17:13:40.967 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_ioctl_ino_lookup_args... yes 2023-12-11T17:13:41.041 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:13:41.048 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:13:41.076 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_ioctl_ino_lookup_user_args... yes 2023-12-11T17:13:41.179 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_ioctl_get_subvol_rootref_args... yes 2023-12-11T17:13:41.256 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/btrfs.h usability... yes 2023-12-11T17:13:41.283 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/btrfs.h presence... yes 2023-12-11T17:13:41.283 INFO:teuthology.orchestra.run.smithi037.stdout:checking for linux/btrfs.h... yes 2023-12-11T17:13:41.381 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/btrfs_tree.h usability... yes 2023-12-11T17:13:41.414 INFO:teuthology.orchestra.run.smithi037.stdout:checking linux/btrfs_tree.h presence... yes 2023-12-11T17:13:41.415 INFO:teuthology.orchestra.run.smithi037.stdout:checking for linux/btrfs_tree.h... yes 2023-12-11T17:13:41.484 INFO:teuthology.orchestra.run.smithi037.stdout:checking for struct btrfs_ioctl_vol_args_v2.subvolid... yes 2023-12-11T17:13:41.524 INFO:teuthology.orchestra.run.smithi037.stdout:configure: creating ./config.status 2023-12-11T17:13:42.894 INFO:teuthology.orchestra.run.smithi037.stdout:config.status: creating include/builddefs 2023-12-11T17:13:42.941 INFO:teuthology.orchestra.run.smithi037.stdout:config.status: creating include/config.h 2023-12-11T17:13:42.975 INFO:teuthology.orchestra.run.smithi037.stdout:config.status: executing libtool commands 2023-12-11T17:13:43.089 INFO:teuthology.orchestra.run.smithi037.stdout:Building include 2023-12-11T17:13:43.101 INFO:teuthology.orchestra.run.smithi037.stdout:Building lib 2023-12-11T17:13:43.112 INFO:teuthology.orchestra.run.smithi037.stdout: [LTDEP] 2023-12-11T17:13:43.444 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] dataascii.lo 2023-12-11T17:13:43.741 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] databin.lo 2023-12-11T17:13:44.070 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] datapid.lo 2023-12-11T17:13:44.348 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] file_lock.lo 2023-12-11T17:13:44.693 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] forker.lo 2023-12-11T17:13:44.997 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] pattern.lo 2023-12-11T17:13:45.287 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] open_flags.lo 2023-12-11T17:13:45.604 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] random_range.lo 2023-12-11T17:13:46.022 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] string_to_tokens.lo 2023-12-11T17:13:46.282 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] str_to_bytes.lo 2023-12-11T17:13:46.597 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] tlibio.lo 2023-12-11T17:13:47.039 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] write_log.lo 2023-12-11T17:13:47.474 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] random.lo 2023-12-11T17:13:47.744 INFO:teuthology.orchestra.run.smithi037.stdout: [LD] 2023-12-11T17:13:47.972 INFO:teuthology.orchestra.run.smithi037.stdout:Building ltp 2023-12-11T17:13:47.983 INFO:teuthology.orchestra.run.smithi037.stdout: [DEP] 2023-12-11T17:13:48.280 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] doio 2023-12-11T17:13:49.262 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fsstress 2023-12-11T17:13:51.008 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fsx 2023-12-11T17:13:52.016 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] growfiles 2023-12-11T17:13:52.797 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] iogen 2023-12-11T17:13:53.391 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-stress 2023-12-11T17:13:54.071 INFO:teuthology.orchestra.run.smithi037.stdout:Building src 2023-12-11T17:13:54.087 INFO:teuthology.orchestra.run.smithi037.stdout: [DEP] 2023-12-11T17:13:58.164 INFO:teuthology.orchestra.run.smithi037.stdout: [DEP] 2023-12-11T17:13:58.243 INFO:teuthology.orchestra.run.smithi037.stdout: [DEP] 2023-12-11T17:13:58.266 INFO:teuthology.orchestra.run.smithi037.stdout: [DEP] 2023-12-11T17:13:58.781 INFO:teuthology.orchestra.run.smithi037.stdout: [DEP] 2023-12-11T17:13:58.841 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] dirstress 2023-12-11T17:13:59.336 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fill 2023-12-11T17:13:59.739 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fill2 2023-12-11T17:14:00.172 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] getpagesize 2023-12-11T17:14:00.513 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] holes 2023-12-11T17:14:00.935 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] lstat64 2023-12-11T17:14:01.361 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] nametest 2023-12-11T17:14:01.833 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] permname 2023-12-11T17:14:02.262 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] randholes 2023-12-11T17:14:02.791 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] runas 2023-12-11T17:14:03.202 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] truncfile 2023-12-11T17:14:03.609 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] usemem 2023-12-11T17:14:03.967 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] mmapcat 2023-12-11T17:14:04.339 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] append_reader 2023-12-11T17:14:04.688 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] append_writer 2023-12-11T17:14:05.039 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] dirperf 2023-12-11T17:14:05.489 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] metaperf 2023-12-11T17:14:05.992 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] devzero 2023-12-11T17:14:06.381 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] feature 2023-12-11T17:14:06.804 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] alloc 2023-12-11T17:14:07.216 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fault 2023-12-11T17:14:07.594 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fstest 2023-12-11T17:14:08.088 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_access_root 2023-12-11T17:14:08.451 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] godown 2023-12-11T17:14:08.872 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] resvtest 2023-12-11T17:14:09.279 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] writemod 2023-12-11T17:14:09.664 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] writev_on_pagefault 2023-12-11T17:14:10.038 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] makeextents 2023-12-11T17:14:10.448 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] itrash 2023-12-11T17:14:10.814 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] rename 2023-12-11T17:14:11.171 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] multi_open_unlink 2023-12-11T17:14:11.181 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:14:11.187 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:14:11.490 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] unwritten_sync 2023-12-11T17:14:11.886 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] genhashnames 2023-12-11T17:14:12.288 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_holes 2023-12-11T17:14:12.624 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_writev 2023-12-11T17:14:12.995 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_truncate_cmtime 2023-12-11T17:14:13.377 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] dirhash_collide 2023-12-11T17:14:13.765 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_rename_overwrite 2023-12-11T17:14:14.107 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] holetest 2023-12-11T17:14:14.560 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_truncate_self 2023-12-11T17:14:14.916 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] af_unix 2023-12-11T17:14:15.269 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_stale_pmd 2023-12-11T17:14:15.668 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_cow_race 2023-12-11T17:14:16.047 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_fallocate 2023-12-11T17:14:16.392 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fsync-err 2023-12-11T17:14:16.794 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_write_ro 2023-12-11T17:14:17.151 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_ext4_dax_journal_corruption 2023-12-11T17:14:17.531 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_ext4_dax_inline_corruption 2023-12-11T17:14:17.872 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_ofd_locks 2023-12-11T17:14:18.297 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_collision 2023-12-11T17:14:18.694 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] mmap-write-concurrent 2023-12-11T17:14:19.081 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_get_file_time 2023-12-11T17:14:19.464 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_create_short_dirs 2023-12-11T17:14:19.846 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_create_long_dirs 2023-12-11T17:14:20.226 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_enospc 2023-12-11T17:14:20.639 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_writev_overlap 2023-12-11T17:14:21.046 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] checkpoint_journal 2023-12-11T17:14:21.411 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] mmap-rw-fault 2023-12-11T17:14:21.790 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] allocstale 2023-12-11T17:14:22.175 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_cow_memory_failure 2023-12-11T17:14:22.560 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fake-dump-rootino 2023-12-11T17:14:22.925 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] dio-buf-fault 2023-12-11T17:14:23.301 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] rewinddir-test 2023-12-11T17:14:23.711 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] xfsctl 2023-12-11T17:14:24.149 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] bstat 2023-12-11T17:14:24.554 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mtab 2023-12-11T17:14:24.944 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] getdevicesize 2023-12-11T17:14:25.331 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] preallo_rw_pattern_reader 2023-12-11T17:14:25.714 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] preallo_rw_pattern_writer 2023-12-11T17:14:26.099 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] ftrunc 2023-12-11T17:14:26.464 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] trunc 2023-12-11T17:14:26.825 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fs_perms 2023-12-11T17:14:27.209 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] testx 2023-12-11T17:14:27.534 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] looptest 2023-12-11T17:14:27.945 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] locktest 2023-12-11T17:14:28.488 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] unwritten_mmap 2023-12-11T17:14:28.868 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] bulkstat_unlink_test 2023-12-11T17:14:29.273 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] deduperace 2023-12-11T17:14:29.686 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] bulkstat_unlink_test_modified 2023-12-11T17:14:30.095 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_dir_offset 2023-12-11T17:14:30.453 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_futimens 2023-12-11T17:14:30.799 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_immutable 2023-12-11T17:14:31.696 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] stale_handle 2023-12-11T17:14:32.070 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] pwrite_mmap_blocked 2023-12-11T17:14:32.463 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_dir_offset2 2023-12-11T17:14:32.878 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] seek_sanity_test 2023-12-11T17:14:33.556 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] seek_copy_test 2023-12-11T17:14:33.977 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_readdir_1 2023-12-11T17:14:34.340 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_readdir_2 2023-12-11T17:14:34.710 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fsync-tester 2023-12-11T17:14:35.200 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] nsexec 2023-12-11T17:14:35.578 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] cloner 2023-12-11T17:14:35.937 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] renameat2 2023-12-11T17:14:36.344 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_getcwd 2023-12-11T17:14:36.726 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] e4compact 2023-12-11T17:14:37.150 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] test-nextquota 2023-12-11T17:14:37.541 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] punch-alternating 2023-12-11T17:14:37.961 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] attr-list-by-handle-cursor-test 2023-12-11T17:14:38.349 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] listxattr 2023-12-11T17:14:38.711 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] dio-interleaved 2023-12-11T17:14:39.043 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_dir_type 2023-12-11T17:14:39.436 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] dio-invalidate-cache 2023-12-11T17:14:39.884 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] stat_test 2023-12-11T17:14:40.429 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_encrypted_d_revalidate 2023-12-11T17:14:40.828 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] attr_replace_test 2023-12-11T17:14:41.226 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] swapon 2023-12-11T17:14:41.337 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:14:41.344 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:14:41.590 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] mkswap 2023-12-11T17:14:41.984 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_attr_corruption 2023-12-11T17:14:42.356 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_open_tmpfiles 2023-12-11T17:14:42.769 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fscrypt-crypt-util 2023-12-11T17:14:43.696 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] bulkstat_null_ocount 2023-12-11T17:14:44.072 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] splice-test 2023-12-11T17:14:44.470 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] chprojid_fail 2023-12-11T17:14:44.842 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] detached_mounts_propagation 2023-12-11T17:14:45.253 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] ext4_resize 2023-12-11T17:14:45.665 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_readdir_3 2023-12-11T17:14:46.105 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] splice2pipe 2023-12-11T17:14:46.494 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] uuid_ioctl 2023-12-11T17:14:46.855 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fiemap-tester 2023-12-11T17:14:47.349 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_stripealign 2023-12-11T17:14:47.751 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] open_by_handle 2023-12-11T17:14:48.229 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] dbtest 2023-12-11T17:14:48.683 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_mmap_dio 2023-12-11T17:14:49.040 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] xfsfind 2023-12-11T17:14:49.458 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] t_reflink_read_race 2023-12-11T17:14:49.838 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] fssum 2023-12-11T17:14:50.540 INFO:teuthology.orchestra.run.smithi037.stdout:Building log-writes 2023-12-11T17:14:50.554 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] replay-log 2023-12-11T17:14:51.100 INFO:teuthology.orchestra.run.smithi037.stdout:Building perf 2023-12-11T17:14:51.111 INFO:teuthology.orchestra.run.smithi037.stdout:Building aio-dio-regress 2023-12-11T17:14:51.125 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aiocp 2023-12-11T17:14:51.573 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-append-write-fallocate-race 2023-12-11T17:14:51.945 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-append-write-read-race 2023-12-11T17:14:52.373 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-cow-race 2023-12-11T17:14:52.706 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-cycle-write 2023-12-11T17:14:53.132 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-eof-race 2023-12-11T17:14:53.536 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-extend-stat 2023-12-11T17:14:53.895 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-fcntl-race 2023-12-11T17:14:54.263 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-hole-filling-race 2023-12-11T17:14:54.616 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-invalidate-failure 2023-12-11T17:14:54.984 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-invalidate-readahead 2023-12-11T17:14:55.360 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aiodio_sparse2 2023-12-11T17:14:55.796 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-subblock-eof-read 2023-12-11T17:14:56.141 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-dio-write-verify 2023-12-11T17:14:56.546 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-free-ring-with-bogus-nr-pages 2023-12-11T17:14:56.855 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-io-setup-with-nonwritable-context-pointer 2023-12-11T17:14:57.196 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] aio-last-ref-held-by-io 2023-12-11T17:14:57.584 INFO:teuthology.orchestra.run.smithi037.stdout:Building vfs 2023-12-11T17:14:57.599 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] vfstest 2023-12-11T17:15:01.715 INFO:teuthology.orchestra.run.smithi037.stdout: [CC] mount-idmapped 2023-12-11T17:15:02.365 INFO:teuthology.orchestra.run.smithi037.stdout:Building m4 2023-12-11T17:15:02.376 INFO:teuthology.orchestra.run.smithi037.stdout:Building common 2023-12-11T17:15:02.387 INFO:teuthology.orchestra.run.smithi037.stdout:Building tests 2023-12-11T17:15:02.402 INFO:teuthology.orchestra.run.smithi037.stdout:Building btrfs 2023-12-11T17:15:02.422 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/btrfs/group.list 2023-12-11T17:15:02.665 INFO:teuthology.orchestra.run.smithi037.stdout:Building ceph 2023-12-11T17:15:02.681 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/ceph/group.list 2023-12-11T17:15:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:Building cifs 2023-12-11T17:15:02.758 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/cifs/group.list 2023-12-11T17:15:02.806 INFO:teuthology.orchestra.run.smithi037.stdout:Building ext4 2023-12-11T17:15:02.822 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/ext4/group.list 2023-12-11T17:15:02.972 INFO:teuthology.orchestra.run.smithi037.stdout:Building f2fs 2023-12-11T17:15:02.988 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/f2fs/group.list 2023-12-11T17:15:03.054 INFO:teuthology.orchestra.run.smithi037.stdout:Building generic 2023-12-11T17:15:03.073 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/generic/group.list 2023-12-11T17:15:03.466 INFO:teuthology.orchestra.run.smithi037.stdout:Building nfs 2023-12-11T17:15:03.482 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/nfs/group.list 2023-12-11T17:15:03.540 INFO:teuthology.orchestra.run.smithi037.stdout:Building ocfs2 2023-12-11T17:15:03.555 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/ocfs2/group.list 2023-12-11T17:15:03.609 INFO:teuthology.orchestra.run.smithi037.stdout:Building overlay 2023-12-11T17:15:03.624 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/overlay/group.list 2023-12-11T17:15:03.790 INFO:teuthology.orchestra.run.smithi037.stdout:Building perf 2023-12-11T17:15:03.806 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/perf/group.list 2023-12-11T17:15:03.852 INFO:teuthology.orchestra.run.smithi037.stdout:Building selftest 2023-12-11T17:15:03.865 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/selftest/group.list 2023-12-11T17:15:03.914 INFO:teuthology.orchestra.run.smithi037.stdout:Building shared 2023-12-11T17:15:03.930 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/shared/group.list 2023-12-11T17:15:03.999 INFO:teuthology.orchestra.run.smithi037.stdout:Building tmpfs 2023-12-11T17:15:04.015 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/tmpfs/group.list 2023-12-11T17:15:04.072 INFO:teuthology.orchestra.run.smithi037.stdout:Building udf 2023-12-11T17:15:04.088 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/udf/group.list 2023-12-11T17:15:04.132 INFO:teuthology.orchestra.run.smithi037.stdout:Building xfs 2023-12-11T17:15:04.148 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/xfs/group.list 2023-12-11T17:15:04.538 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo make install) 2023-12-11T17:15:04.676 INFO:teuthology.orchestra.run.smithi037.stdout:Building include 2023-12-11T17:15:04.687 INFO:teuthology.orchestra.run.smithi037.stdout:Building lib 2023-12-11T17:15:04.699 INFO:teuthology.orchestra.run.smithi037.stdout:Building ltp 2023-12-11T17:15:04.712 INFO:teuthology.orchestra.run.smithi037.stdout:Building src 2023-12-11T17:15:04.808 INFO:teuthology.orchestra.run.smithi037.stdout:Building log-writes 2023-12-11T17:15:04.820 INFO:teuthology.orchestra.run.smithi037.stdout:Building perf 2023-12-11T17:15:04.831 INFO:teuthology.orchestra.run.smithi037.stdout:Building aio-dio-regress 2023-12-11T17:15:04.844 INFO:teuthology.orchestra.run.smithi037.stdout:Building vfs 2023-12-11T17:15:04.858 INFO:teuthology.orchestra.run.smithi037.stdout:Building m4 2023-12-11T17:15:04.870 INFO:teuthology.orchestra.run.smithi037.stdout:Building common 2023-12-11T17:15:04.882 INFO:teuthology.orchestra.run.smithi037.stdout:Building tests 2023-12-11T17:15:04.898 INFO:teuthology.orchestra.run.smithi037.stdout:Building btrfs 2023-12-11T17:15:04.916 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/btrfs/group.list 2023-12-11T17:15:05.153 INFO:teuthology.orchestra.run.smithi037.stdout:Building ceph 2023-12-11T17:15:05.167 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/ceph/group.list 2023-12-11T17:15:05.223 INFO:teuthology.orchestra.run.smithi037.stdout:Building cifs 2023-12-11T17:15:05.237 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/cifs/group.list 2023-12-11T17:15:05.285 INFO:teuthology.orchestra.run.smithi037.stdout:Building ext4 2023-12-11T17:15:05.301 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/ext4/group.list 2023-12-11T17:15:05.473 INFO:teuthology.orchestra.run.smithi037.stdout:Building f2fs 2023-12-11T17:15:05.489 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/f2fs/group.list 2023-12-11T17:15:05.560 INFO:teuthology.orchestra.run.smithi037.stdout:Building generic 2023-12-11T17:15:05.580 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/generic/group.list 2023-12-11T17:15:05.993 INFO:teuthology.orchestra.run.smithi037.stdout:Building nfs 2023-12-11T17:15:06.007 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/nfs/group.list 2023-12-11T17:15:06.068 INFO:teuthology.orchestra.run.smithi037.stdout:Building ocfs2 2023-12-11T17:15:06.083 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/ocfs2/group.list 2023-12-11T17:15:06.139 INFO:teuthology.orchestra.run.smithi037.stdout:Building overlay 2023-12-11T17:15:06.155 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/overlay/group.list 2023-12-11T17:15:06.336 INFO:teuthology.orchestra.run.smithi037.stdout:Building perf 2023-12-11T17:15:06.352 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/perf/group.list 2023-12-11T17:15:06.400 INFO:teuthology.orchestra.run.smithi037.stdout:Building selftest 2023-12-11T17:15:06.415 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/selftest/group.list 2023-12-11T17:15:06.466 INFO:teuthology.orchestra.run.smithi037.stdout:Building shared 2023-12-11T17:15:06.482 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/shared/group.list 2023-12-11T17:15:06.551 INFO:teuthology.orchestra.run.smithi037.stdout:Building tmpfs 2023-12-11T17:15:06.566 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/tmpfs/group.list 2023-12-11T17:15:06.620 INFO:teuthology.orchestra.run.smithi037.stdout:Building udf 2023-12-11T17:15:06.636 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/udf/group.list 2023-12-11T17:15:06.683 INFO:teuthology.orchestra.run.smithi037.stdout:Building xfs 2023-12-11T17:15:06.699 INFO:teuthology.orchestra.run.smithi037.stdout: [GROUP] /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/xfs/group.list 2023-12-11T17:15:07.117 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C include install 2023-12-11T17:15:07.121 INFO:teuthology.orchestra.run.smithi037.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-11T17:15:07.122 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C lib install 2023-12-11T17:15:07.127 INFO:teuthology.orchestra.run.smithi037.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-11T17:15:07.128 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C ltp install 2023-12-11T17:15:07.133 INFO:teuthology.orchestra.run.smithi037.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/ltp 2023-12-11T17:15:07.169 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 doio fsstress fsx growfiles iogen aio-stress /var/lib/xfstests/ltp 2023-12-11T17:15:07.438 INFO:teuthology.orchestra.run.smithi037.stdout:../install-sh -o root -g root -m 755 rwtest.sh /var/lib/xfstests/ltp 2023-12-11T17:15:07.478 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C src install 2023-12-11T17:15:07.526 INFO:teuthology.orchestra.run.smithi037.stdout:Building log-writes 2023-12-11T17:15:07.538 INFO:teuthology.orchestra.run.smithi037.stdout:Building perf 2023-12-11T17:15:07.549 INFO:teuthology.orchestra.run.smithi037.stdout:Building aio-dio-regress 2023-12-11T17:15:07.562 INFO:teuthology.orchestra.run.smithi037.stdout:Building vfs 2023-12-11T17:15:07.571 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake -C log-writes install 2023-12-11T17:15:07.575 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/log-writes 2023-12-11T17:15:07.609 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 replay-log /var/lib/xfstests/src/log-writes 2023-12-11T17:15:07.645 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake -C perf install 2023-12-11T17:15:07.649 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/perf 2023-12-11T17:15:07.686 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 FioCompare.py fio-insert-and-compare.py FioResultDecoder.py generate-schema.py ResultData.py fio-results.sql /var/lib/xfstests/src/perf 2023-12-11T17:15:07.781 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake -C aio-dio-regress install 2023-12-11T17:15:07.786 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/aio-dio-regress 2023-12-11T17:15:07.823 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 aiocp aio-dio-append-write-fallocate-race aio-dio-append-write-read-race aio-dio-cow-race aio-dio-cycle-write aio-dio-eof-race aio-dio-extend-stat aio-dio-fcntl-race aio-dio-hole-filling-race aio-dio-invalidate-failure aio-dio-invalidate-readahead aiodio_sparse2 aio-dio-subblock-eof-read aio-dio-write-verify aio-free-ring-with-bogus-nr-pages aio-io-setup-with-nonwritable-context-pointer aio-last-ref-held-by-io /var/lib/xfstests/src/aio-dio-regress 2023-12-11T17:15:08.054 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake -C vfs install 2023-12-11T17:15:08.057 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src/vfs 2023-12-11T17:15:08.095 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 vfstest mount-idmapped /var/lib/xfstests/src/vfs 2023-12-11T17:15:08.145 INFO:teuthology.orchestra.run.smithi037.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/src 2023-12-11T17:15:08.182 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dirstress fill fill2 getpagesize holes lstat64 nametest permname randholes runas truncfile usemem mmapcat append_reader append_writer dirperf metaperf devzero feature alloc fault fstest t_access_root godown resvtest writemod writev_on_pagefault makeextents itrash rename multi_open_unlink unwritten_sync genhashnames t_holes t_mmap_writev t_truncate_cmtime dirhash_collide t_rename_overwrite holetest t_truncate_self af_unix t_mmap_stale_pmd t_mmap_cow_race t_mmap_fallocate fsync-err t_mmap_write_ro t_ext4_dax_journal_corruption t_ext4_dax_inline_corruption t_ofd_locks t_mmap_collision mmap-write-concurrent t_get_file_time t_create_short_dirs t_create_long_dirs t_enospc t_mmap_writev_overlap checkpoint_journal mmap-rw-fault allocstale t_mmap_cow_memory_failure fake-dump-rootino dio-buf-fault rewinddir-test xfsctl bstat t_mtab getdevicesize preallo_rw_pattern_reader preallo_rw_pattern_writer ftrunc trunc fs_perms testx looptest locktest unwritten_mmap bulkstat_unlink_test deduperace bulkstat_unlink_test_modified t_dir_offset t_futimens t_immutable stale_handle pwrite_mmap_blocked t_dir_offset2 seek_sanity_test seek_copy_test t_readdir_1 t_readdir_2 fsync-tester nsexec cloner renameat2 t_getcwd e4compact test-nextquota punch-alternating attr-list-by-handle-cursor-test listxattr dio-interleaved t_dir_type dio-invalidate-cache stat_test t_encrypted_d_revalidate attr_replace_test swapon mkswap t_attr_corruption t_open_tmpfiles fscrypt-crypt-util bulkstat_null_ocount splice-test chprojid_fail detached_mounts_propagation ext4_resize t_readdir_3 splice2pipe uuid_ioctl fiemap-tester t_stripealign open_by_handle dbtest t_mmap_dio xfsfind t_reflink_read_race fssum /var/lib/xfstests/src 2023-12-11T17:15:11.465 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:15:11.471 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:15:12.941 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 755 dmerror fill2attr fill2fs fill2fs_check scaleread.sh btrfs_crc32c_forged_name.py popdir.pl popattr.py soak_duration.awk /var/lib/xfstests/src 2023-12-11T17:15:13.312 INFO:teuthology.orchestra.run.smithi037.stdout:/bin/sh ../libtool --quiet --mode=install ../install-sh -o root -g root -m 644 dumpfile /var/lib/xfstests/src 2023-12-11T17:15:13.385 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C m4 install 2023-12-11T17:15:13.389 INFO:teuthology.orchestra.run.smithi037.stdout:gmake[1]: Nothing to be done for 'install'. 2023-12-11T17:15:13.390 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C common install 2023-12-11T17:15:13.394 INFO:teuthology.orchestra.run.smithi037.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/common 2023-12-11T17:15:13.430 INFO:teuthology.orchestra.run.smithi037.stdout:../install-sh -o root -g root -m 644 * /var/lib/xfstests/common 2023-12-11T17:15:13.942 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C tests install 2023-12-11T17:15:13.946 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/btrfs/ install 2023-12-11T17:15:13.953 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/btrfs 2023-12-11T17:15:13.988 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 /var/lib/xfstests/tests/btrfs 2023-12-11T17:15:17.914 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/btrfs 2023-12-11T17:15:17.951 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out /var/lib/xfstests/tests/btrfs 2023-12-11T17:15:21.365 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/ceph/ install 2023-12-11T17:15:21.368 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ceph 2023-12-11T17:15:21.403 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 /var/lib/xfstests/tests/ceph 2023-12-11T17:15:21.482 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ceph 2023-12-11T17:15:21.518 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out /var/lib/xfstests/tests/ceph 2023-12-11T17:15:21.597 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/cifs/ install 2023-12-11T17:15:21.601 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/cifs 2023-12-11T17:15:21.637 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/cifs 2023-12-11T17:15:21.673 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/cifs 2023-12-11T17:15:21.707 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/cifs 2023-12-11T17:15:21.744 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/ext4/ install 2023-12-11T17:15:21.749 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ext4 2023-12-11T17:15:21.784 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 271 301 302 303 304 305 306 307 308 /var/lib/xfstests/tests/ext4 2023-12-11T17:15:22.573 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ext4 2023-12-11T17:15:22.610 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out.default 001.out.nodelalloc 001.out.nozero 001.cfg 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 271.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out /var/lib/xfstests/tests/ext4 2023-12-11T17:15:23.438 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/f2fs/ install 2023-12-11T17:15:23.442 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/f2fs 2023-12-11T17:15:23.477 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 /var/lib/xfstests/tests/f2fs 2023-12-11T17:15:23.525 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/f2fs 2023-12-11T17:15:23.560 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out 002.out /var/lib/xfstests/tests/f2fs 2023-12-11T17:15:23.606 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/generic/ install 2023-12-11T17:15:23.617 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/generic 2023-12-11T17:15:23.652 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 605 606 607 608 609 610 611 612 613 614 615 616 617 618 619 620 621 622 623 624 625 626 627 628 629 630 631 632 633 634 635 636 637 638 639 640 641 642 643 644 645 646 647 648 649 650 651 652 653 654 655 656 657 658 659 660 661 662 663 664 665 666 667 668 669 670 671 672 673 674 675 676 677 678 679 680 681 682 683 684 685 686 687 688 689 690 691 692 693 694 695 696 697 698 699 700 701 702 703 704 705 706 707 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 /var/lib/xfstests/tests/generic 2023-12-11T17:15:32.810 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/generic 2023-12-11T17:15:32.850 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 035.out.default 035.out.nfs 050.out.default 050.out.nojournal 050.out.xfsquota 035.cfg 050.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 096.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 216.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 605.out 606.out 607.out 608.out 609.out 610.out 611.out 612.out 613.out 614.out 615.out 616.out 617.out 618.out 619.out 620.out 621.out 622.out 623.out 624.out 625.out 626.out 627.out 628.out 629.out 630.out 631.out 632.out 633.out 634.out 635.out 636.out 637.out 638.out 639.out 640.out 641.out 642.out 643.out 644.out 645.out 646.out 647.out 648.out 649.out 650.out 651.out 652.out 653.out 654.out 655.out 656.out 657.out 658.out 659.out 660.out 661.out 662.out 663.out 664.out 665.out 666.out 667.out 668.out 669.out 670.out 671.out 672.out 673.out 674.out 675.out 676.out 677.out 678.out 679.out 680.out 681.out 682.out 683.out 684.out 685.out 686.out 687.out 688.out 689.out 690.out 691.out 692.out 693.out 694.out 695.out 696.out 697.out 698.out 699.out 700.out 701.out 702.out 703.out 704.out 705.out 706.out 707.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out /var/lib/xfstests/tests/generic 2023-12-11T17:15:41.606 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:15:41.616 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:15:41.994 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/nfs/ install 2023-12-11T17:15:41.998 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/nfs 2023-12-11T17:15:42.034 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/nfs 2023-12-11T17:15:42.069 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/nfs 2023-12-11T17:15:42.104 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/nfs 2023-12-11T17:15:42.139 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/ocfs2/ install 2023-12-11T17:15:42.144 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/ocfs2 2023-12-11T17:15:42.180 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/ocfs2 2023-12-11T17:15:42.215 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/ocfs2 2023-12-11T17:15:42.250 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/ocfs2 2023-12-11T17:15:42.286 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/overlay/ install 2023-12-11T17:15:42.292 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/overlay 2023-12-11T17:15:42.328 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 /var/lib/xfstests/tests/overlay 2023-12-11T17:15:43.515 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/overlay 2023-12-11T17:15:43.549 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 033.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 071.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out /var/lib/xfstests/tests/overlay 2023-12-11T17:15:44.776 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/perf/ install 2023-12-11T17:15:44.780 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/perf 2023-12-11T17:15:44.815 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/perf 2023-12-11T17:15:44.852 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/perf 2023-12-11T17:15:44.887 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/perf 2023-12-11T17:15:44.924 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/selftest/ install 2023-12-11T17:15:44.928 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/selftest 2023-12-11T17:15:44.965 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 /var/lib/xfstests/tests/selftest 2023-12-11T17:15:45.056 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/selftest 2023-12-11T17:15:45.092 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out 002.out 003.out 004.out 005.out 006.out /var/lib/xfstests/tests/selftest 2023-12-11T17:15:45.183 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/shared/ install 2023-12-11T17:15:45.187 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/shared 2023-12-11T17:15:45.221 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 002 032 298 /var/lib/xfstests/tests/shared 2023-12-11T17:15:45.277 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/shared 2023-12-11T17:15:45.314 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 002.out 032.out 298.out /var/lib/xfstests/tests/shared 2023-12-11T17:15:45.373 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/tmpfs/ install 2023-12-11T17:15:45.377 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/tmpfs 2023-12-11T17:15:45.414 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 /var/lib/xfstests/tests/tmpfs 2023-12-11T17:15:45.450 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/tmpfs 2023-12-11T17:15:45.485 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 001.out /var/lib/xfstests/tests/tmpfs 2023-12-11T17:15:45.522 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/udf/ install 2023-12-11T17:15:45.526 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/udf 2023-12-11T17:15:45.564 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 102 /var/lib/xfstests/tests/udf 2023-12-11T17:15:45.599 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/udf 2023-12-11T17:15:45.633 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 102.out /var/lib/xfstests/tests/udf 2023-12-11T17:15:45.668 INFO:teuthology.orchestra.run.smithi037.stdout:/usr/bin/gmake --no-print-directory Q=@ -C /tmp/tmp.gLzcJVJdzjxfstests-dev/tests/xfs/ install 2023-12-11T17:15:45.679 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests/xfs 2023-12-11T17:15:45.713 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 755 001 002 003 004 005 006 007 008 009 010 011 012 013 014 015 016 017 018 019 020 021 022 023 024 025 026 027 028 029 030 031 032 033 034 035 036 037 038 039 040 041 042 043 044 045 046 047 048 049 050 051 052 053 054 055 056 057 058 059 060 061 062 063 064 065 066 067 068 069 070 071 072 073 074 075 076 077 078 079 080 081 082 083 084 085 086 087 088 089 090 091 092 093 094 095 096 097 098 099 100 101 102 103 104 105 106 107 108 109 110 111 112 113 114 115 116 117 118 119 120 121 122 123 124 125 126 127 128 129 130 131 132 133 134 135 136 137 138 139 140 141 142 143 144 145 146 147 148 149 150 151 152 153 154 155 156 157 158 159 160 161 162 163 164 165 166 167 168 169 170 171 172 173 174 175 176 177 178 179 180 181 182 183 184 185 186 187 188 189 190 191 192 193 194 195 196 197 198 199 200 201 202 203 204 205 206 207 208 209 210 211 212 213 214 215 216 217 218 219 220 221 222 223 224 225 226 227 228 229 230 231 232 233 234 235 236 237 238 239 240 241 242 243 244 245 246 247 248 249 250 251 252 253 254 255 256 257 258 259 260 261 262 263 264 265 266 267 268 269 270 271 272 273 274 275 276 277 278 279 280 281 282 283 284 285 286 287 288 289 290 291 292 293 294 295 296 297 298 299 300 301 302 303 304 305 306 307 308 309 310 311 312 313 314 315 316 317 318 319 320 321 322 323 324 325 326 327 328 329 330 331 332 333 334 335 336 337 338 339 340 341 342 343 344 345 346 347 348 349 350 351 352 353 354 355 356 357 358 359 360 361 362 363 364 365 366 367 368 369 370 371 372 373 374 375 376 377 378 379 380 381 382 383 384 385 386 387 388 389 390 391 392 393 394 395 396 397 398 399 400 401 402 403 404 405 406 407 408 409 410 411 412 413 414 415 416 417 418 419 420 421 422 423 424 425 426 427 428 429 430 431 432 433 434 435 436 437 438 439 440 441 442 443 444 445 446 447 448 449 450 451 452 453 454 455 456 457 458 459 460 461 462 463 464 465 466 467 468 469 470 471 472 473 474 475 476 477 478 479 480 481 482 483 484 485 486 487 488 489 490 491 492 493 494 495 496 497 498 499 500 501 502 503 504 505 506 507 508 509 510 511 512 513 514 515 516 517 518 519 520 521 522 523 524 525 526 527 528 529 530 531 532 533 534 535 536 537 538 539 540 541 542 543 544 545 546 547 548 549 550 551 552 553 554 555 556 557 558 559 560 561 562 563 564 565 566 567 568 569 570 571 572 573 574 575 576 577 578 579 580 581 582 583 584 585 586 587 588 589 590 591 592 593 594 595 596 597 598 599 600 601 602 603 604 708 709 710 711 712 713 714 715 716 717 718 719 720 721 722 723 724 725 726 727 728 729 730 731 732 733 734 735 736 737 738 739 740 741 742 743 744 745 746 747 748 749 750 751 752 753 754 755 756 757 758 759 760 761 762 763 764 765 766 767 768 769 770 771 772 773 774 775 776 777 778 779 780 781 782 783 784 785 786 787 788 789 790 791 792 793 794 795 796 797 798 799 800 /var/lib/xfstests/tests/xfs 2023-12-11T17:15:54.440 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 group.list /var/lib/xfstests/tests/xfs 2023-12-11T17:15:54.476 INFO:teuthology.orchestra.run.smithi037.stdout:../../install-sh -o root -g root -m 644 033.out.crc 033.out.default 071.out.32 071.out.64 096.out.external 096.out.internal 216.out.64mblog 216.out.classic 033.cfg 216.cfg 001.out 002.out 003.out 004.out 005.out 006.out 007.out 008.out 009.out 010.out 011.out 012.out 013.out 014.out 015.out 016.out 017.out 018.out 019.out 020.out 021.out 022.out 023.out 024.out 025.out 026.out 027.out 028.out 029.out 030.out 031.out 032.out 034.out 035.out 036.out 037.out 038.out 039.out 040.out 041.out 042.out 043.out 044.out 045.out 046.out 047.out 048.out 049.out 050.out 051.out 052.out 053.out 054.out 055.out 056.out 057.out 058.out 059.out 060.out 061.out 062.out 063.out 064.out 065.out 066.out 067.out 068.out 069.out 070.out 072.out 073.out 074.out 075.out 076.out 077.out 078.out 079.out 080.out 081.out 082.out 083.out 084.out 085.out 086.out 087.out 088.out 089.out 090.out 091.out 092.out 093.out 094.out 095.out 097.out 098.out 099.out 100.out 101.out 102.out 103.out 104.out 105.out 106.out 107.out 108.out 109.out 110.out 111.out 112.out 113.out 114.out 115.out 116.out 117.out 118.out 119.out 120.out 121.out 122.out 123.out 124.out 125.out 126.out 127.out 128.out 129.out 130.out 131.out 132.out 133.out 134.out 135.out 136.out 137.out 138.out 139.out 140.out 141.out 142.out 143.out 144.out 145.out 146.out 147.out 148.out 149.out 150.out 151.out 152.out 153.out 154.out 155.out 156.out 157.out 158.out 159.out 160.out 161.out 162.out 163.out 164.out 165.out 166.out 167.out 168.out 169.out 170.out 171.out 172.out 173.out 174.out 175.out 176.out 177.out 178.out 179.out 180.out 181.out 182.out 183.out 184.out 185.out 186.out 187.out 188.out 189.out 190.out 191.out 192.out 193.out 194.out 195.out 196.out 197.out 198.out 199.out 200.out 201.out 202.out 203.out 204.out 205.out 206.out 207.out 208.out 209.out 210.out 211.out 212.out 213.out 214.out 215.out 217.out 218.out 219.out 220.out 221.out 222.out 223.out 224.out 225.out 226.out 227.out 228.out 229.out 230.out 231.out 232.out 233.out 234.out 235.out 236.out 237.out 238.out 239.out 240.out 241.out 242.out 243.out 244.out 245.out 246.out 247.out 248.out 249.out 250.out 251.out 252.out 253.out 254.out 255.out 256.out 257.out 258.out 259.out 260.out 261.out 262.out 263.out 264.out 265.out 266.out 267.out 268.out 269.out 270.out 271.out 272.out 273.out 274.out 275.out 276.out 277.out 278.out 279.out 280.out 281.out 282.out 283.out 284.out 285.out 286.out 287.out 288.out 289.out 290.out 291.out 292.out 293.out 294.out 295.out 296.out 297.out 298.out 299.out 300.out 301.out 302.out 303.out 304.out 305.out 306.out 307.out 308.out 309.out 310.out 311.out 312.out 313.out 314.out 315.out 316.out 317.out 318.out 319.out 320.out 321.out 322.out 323.out 324.out 325.out 326.out 327.out 328.out 329.out 330.out 331.out 332.out 333.out 334.out 335.out 336.out 337.out 338.out 339.out 340.out 341.out 342.out 343.out 344.out 345.out 346.out 347.out 348.out 349.out 350.out 351.out 352.out 353.out 354.out 355.out 356.out 357.out 358.out 359.out 360.out 361.out 362.out 363.out 364.out 365.out 366.out 367.out 368.out 369.out 370.out 371.out 372.out 373.out 374.out 375.out 376.out 377.out 378.out 379.out 380.out 381.out 382.out 383.out 384.out 385.out 386.out 387.out 388.out 389.out 390.out 391.out 392.out 393.out 394.out 395.out 396.out 397.out 398.out 399.out 400.out 401.out 402.out 403.out 404.out 405.out 406.out 407.out 408.out 409.out 410.out 411.out 412.out 413.out 414.out 415.out 416.out 417.out 418.out 419.out 420.out 421.out 422.out 423.out 424.out 425.out 426.out 427.out 428.out 429.out 430.out 431.out 432.out 433.out 434.out 435.out 436.out 437.out 438.out 439.out 440.out 441.out 442.out 443.out 444.out 445.out 446.out 447.out 448.out 449.out 450.out 451.out 452.out 453.out 454.out 455.out 456.out 457.out 458.out 459.out 460.out 461.out 462.out 463.out 464.out 465.out 466.out 467.out 468.out 469.out 470.out 471.out 472.out 473.out 474.out 475.out 476.out 477.out 478.out 479.out 480.out 481.out 482.out 483.out 484.out 485.out 486.out 487.out 488.out 489.out 490.out 491.out 492.out 493.out 494.out 495.out 496.out 497.out 498.out 499.out 500.out 501.out 502.out 503.out 504.out 505.out 506.out 507.out 508.out 509.out 510.out 511.out 512.out 513.out 514.out 515.out 516.out 517.out 518.out 519.out 520.out 521.out 522.out 523.out 524.out 525.out 526.out 527.out 528.out 529.out 530.out 531.out 532.out 533.out 534.out 535.out 536.out 537.out 538.out 539.out 540.out 541.out 542.out 543.out 544.out 545.out 546.out 547.out 548.out 549.out 550.out 551.out 552.out 553.out 554.out 555.out 556.out 557.out 558.out 559.out 560.out 561.out 562.out 563.out 564.out 565.out 566.out 567.out 568.out 569.out 570.out 571.out 572.out 573.out 574.out 575.out 576.out 577.out 578.out 579.out 580.out 581.out 582.out 583.out 584.out 585.out 586.out 587.out 588.out 589.out 590.out 591.out 592.out 593.out 594.out 595.out 596.out 597.out 598.out 599.out 600.out 601.out 602.out 603.out 604.out 708.out 709.out 710.out 711.out 712.out 713.out 714.out 715.out 716.out 717.out 718.out 719.out 720.out 721.out 722.out 723.out 724.out 725.out 726.out 727.out 728.out 729.out 730.out 731.out 732.out 733.out 734.out 735.out 736.out 737.out 738.out 739.out 740.out 741.out 742.out 743.out 744.out 745.out 746.out 747.out 748.out 749.out 750.out 751.out 752.out 753.out 754.out 755.out 756.out 757.out 758.out 759.out 760.out 761.out 762.out 763.out 764.out 765.out 766.out 767.out 768.out 769.out 770.out 771.out 772.out 773.out 774.out 775.out 776.out 777.out 778.out 779.out 780.out 781.out 782.out 783.out 784.out 785.out 786.out 787.out 788.out 789.out 790.out 791.out 792.out 793.out 794.out 795.out 796.out 797.out 798.out 799.out 800.out /var/lib/xfstests/tests/xfs 2023-12-11T17:16:02.492 INFO:teuthology.orchestra.run.smithi037.stdout:../install-sh -o root -g root -m 755 -d /var/lib/xfstests/tests 2023-12-11T17:16:02.528 INFO:teuthology.orchestra.run.smithi037.stdout:./install-sh -o root -g root -m 755 -d /var/lib/xfstests 2023-12-11T17:16:02.564 INFO:teuthology.orchestra.run.smithi037.stdout:./install-sh -o root -g root -m 755 check /var/lib/xfstests 2023-12-11T17:16:02.602 INFO:teuthology.orchestra.run.smithi037.stdout:./install-sh -o root -g root -m 644 randomize.awk /var/lib/xfstests 2023-12-11T17:16:02.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-11T17:16:02.646 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec ls tests/generic) 2023-12-11T17:16:02.707 INFO:teuthology.orchestra.run.smithi037.stdout:001 2023-12-11T17:16:02.707 INFO:teuthology.orchestra.run.smithi037.stdout:001.out 2023-12-11T17:16:02.707 INFO:teuthology.orchestra.run.smithi037.stdout:002 2023-12-11T17:16:02.707 INFO:teuthology.orchestra.run.smithi037.stdout:002.out 2023-12-11T17:16:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:003 2023-12-11T17:16:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:003.out 2023-12-11T17:16:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:004 2023-12-11T17:16:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:004.out 2023-12-11T17:16:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:005 2023-12-11T17:16:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:005.out 2023-12-11T17:16:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:006 2023-12-11T17:16:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:006.out 2023-12-11T17:16:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:007 2023-12-11T17:16:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:007.out 2023-12-11T17:16:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:008 2023-12-11T17:16:02.708 INFO:teuthology.orchestra.run.smithi037.stdout:008.out 2023-12-11T17:16:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:009 2023-12-11T17:16:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:009.out 2023-12-11T17:16:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:010 2023-12-11T17:16:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:010.out 2023-12-11T17:16:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:011 2023-12-11T17:16:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:011.out 2023-12-11T17:16:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:012 2023-12-11T17:16:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:012.out 2023-12-11T17:16:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:013 2023-12-11T17:16:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:013.out 2023-12-11T17:16:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:014 2023-12-11T17:16:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:014.out 2023-12-11T17:16:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:015 2023-12-11T17:16:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:015.out 2023-12-11T17:16:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:016 2023-12-11T17:16:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:016.out 2023-12-11T17:16:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:017 2023-12-11T17:16:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:017.out 2023-12-11T17:16:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:018 2023-12-11T17:16:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:018.out 2023-12-11T17:16:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:019 2023-12-11T17:16:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:019.out 2023-12-11T17:16:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:020 2023-12-11T17:16:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:020.out 2023-12-11T17:16:02.710 INFO:teuthology.orchestra.run.smithi037.stdout:021 2023-12-11T17:16:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:021.out 2023-12-11T17:16:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:022 2023-12-11T17:16:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:022.out 2023-12-11T17:16:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:023 2023-12-11T17:16:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:023.out 2023-12-11T17:16:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:024 2023-12-11T17:16:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:024.out 2023-12-11T17:16:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:025 2023-12-11T17:16:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:025.out 2023-12-11T17:16:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:026 2023-12-11T17:16:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:026.out 2023-12-11T17:16:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:027 2023-12-11T17:16:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:027.out 2023-12-11T17:16:02.711 INFO:teuthology.orchestra.run.smithi037.stdout:028 2023-12-11T17:16:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:028.out 2023-12-11T17:16:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:029 2023-12-11T17:16:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:029.out 2023-12-11T17:16:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:030 2023-12-11T17:16:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:030.out 2023-12-11T17:16:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:031 2023-12-11T17:16:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:031.out 2023-12-11T17:16:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:032 2023-12-11T17:16:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:032.out 2023-12-11T17:16:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:033 2023-12-11T17:16:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:033.out 2023-12-11T17:16:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:034 2023-12-11T17:16:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:034.out 2023-12-11T17:16:02.712 INFO:teuthology.orchestra.run.smithi037.stdout:035 2023-12-11T17:16:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:035.cfg 2023-12-11T17:16:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:035.out.default 2023-12-11T17:16:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:035.out.nfs 2023-12-11T17:16:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:036 2023-12-11T17:16:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:036.out 2023-12-11T17:16:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:037 2023-12-11T17:16:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:037.out 2023-12-11T17:16:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:038 2023-12-11T17:16:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:038.out 2023-12-11T17:16:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:039 2023-12-11T17:16:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:039.out 2023-12-11T17:16:02.713 INFO:teuthology.orchestra.run.smithi037.stdout:040 2023-12-11T17:16:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:040.out 2023-12-11T17:16:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:041 2023-12-11T17:16:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:041.out 2023-12-11T17:16:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:042 2023-12-11T17:16:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:042.out 2023-12-11T17:16:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:043 2023-12-11T17:16:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:043.out 2023-12-11T17:16:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:044 2023-12-11T17:16:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:044.out 2023-12-11T17:16:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:045 2023-12-11T17:16:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:045.out 2023-12-11T17:16:02.714 INFO:teuthology.orchestra.run.smithi037.stdout:046 2023-12-11T17:16:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:046.out 2023-12-11T17:16:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:047 2023-12-11T17:16:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:047.out 2023-12-11T17:16:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:048 2023-12-11T17:16:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:048.out 2023-12-11T17:16:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:049 2023-12-11T17:16:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:049.out 2023-12-11T17:16:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:050 2023-12-11T17:16:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:050.cfg 2023-12-11T17:16:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:050.out.default 2023-12-11T17:16:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:050.out.nojournal 2023-12-11T17:16:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:050.out.xfsquota 2023-12-11T17:16:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:051 2023-12-11T17:16:02.715 INFO:teuthology.orchestra.run.smithi037.stdout:051.out 2023-12-11T17:16:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:052 2023-12-11T17:16:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:052.out 2023-12-11T17:16:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:053 2023-12-11T17:16:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:053.out 2023-12-11T17:16:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:054 2023-12-11T17:16:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:054.out 2023-12-11T17:16:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:055 2023-12-11T17:16:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:055.out 2023-12-11T17:16:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:056 2023-12-11T17:16:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:056.out 2023-12-11T17:16:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:057 2023-12-11T17:16:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:057.out 2023-12-11T17:16:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:058 2023-12-11T17:16:02.716 INFO:teuthology.orchestra.run.smithi037.stdout:058.out 2023-12-11T17:16:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:059 2023-12-11T17:16:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:059.out 2023-12-11T17:16:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:060 2023-12-11T17:16:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:060.out 2023-12-11T17:16:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:061 2023-12-11T17:16:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:061.out 2023-12-11T17:16:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:062 2023-12-11T17:16:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:062.out 2023-12-11T17:16:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:063 2023-12-11T17:16:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:063.out 2023-12-11T17:16:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:064 2023-12-11T17:16:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:064.out 2023-12-11T17:16:02.717 INFO:teuthology.orchestra.run.smithi037.stdout:065 2023-12-11T17:16:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:065.out 2023-12-11T17:16:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:066 2023-12-11T17:16:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:066.out 2023-12-11T17:16:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:067 2023-12-11T17:16:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:067.out 2023-12-11T17:16:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:068 2023-12-11T17:16:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:068.out 2023-12-11T17:16:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:069 2023-12-11T17:16:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:069.out 2023-12-11T17:16:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:070 2023-12-11T17:16:02.718 INFO:teuthology.orchestra.run.smithi037.stdout:070.out 2023-12-11T17:16:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:071 2023-12-11T17:16:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:071.out 2023-12-11T17:16:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:072 2023-12-11T17:16:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:072.out 2023-12-11T17:16:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:073 2023-12-11T17:16:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:073.out 2023-12-11T17:16:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:074 2023-12-11T17:16:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:074.out 2023-12-11T17:16:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:075 2023-12-11T17:16:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:075.out 2023-12-11T17:16:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:076 2023-12-11T17:16:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:076.out 2023-12-11T17:16:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:077 2023-12-11T17:16:02.719 INFO:teuthology.orchestra.run.smithi037.stdout:077.out 2023-12-11T17:16:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:078 2023-12-11T17:16:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:078.out 2023-12-11T17:16:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:079 2023-12-11T17:16:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:079.out 2023-12-11T17:16:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:080 2023-12-11T17:16:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:080.out 2023-12-11T17:16:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:081 2023-12-11T17:16:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:081.out 2023-12-11T17:16:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:082 2023-12-11T17:16:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:082.out 2023-12-11T17:16:02.720 INFO:teuthology.orchestra.run.smithi037.stdout:083 2023-12-11T17:16:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:083.out 2023-12-11T17:16:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:084 2023-12-11T17:16:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:084.out 2023-12-11T17:16:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:085 2023-12-11T17:16:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:085.out 2023-12-11T17:16:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:086 2023-12-11T17:16:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:086.out 2023-12-11T17:16:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:087 2023-12-11T17:16:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:087.out 2023-12-11T17:16:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:088 2023-12-11T17:16:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:088.out 2023-12-11T17:16:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:089 2023-12-11T17:16:02.721 INFO:teuthology.orchestra.run.smithi037.stdout:089.out 2023-12-11T17:16:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:090 2023-12-11T17:16:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:090.out 2023-12-11T17:16:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:091 2023-12-11T17:16:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:091.out 2023-12-11T17:16:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:092 2023-12-11T17:16:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:092.out 2023-12-11T17:16:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:093 2023-12-11T17:16:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:093.out 2023-12-11T17:16:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:094 2023-12-11T17:16:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:094.out 2023-12-11T17:16:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:095 2023-12-11T17:16:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:095.out 2023-12-11T17:16:02.722 INFO:teuthology.orchestra.run.smithi037.stdout:096 2023-12-11T17:16:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:096.out 2023-12-11T17:16:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:097 2023-12-11T17:16:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:097.out 2023-12-11T17:16:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:098 2023-12-11T17:16:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:098.out 2023-12-11T17:16:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:099 2023-12-11T17:16:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:099.out 2023-12-11T17:16:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:100 2023-12-11T17:16:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:100.out 2023-12-11T17:16:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:101 2023-12-11T17:16:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:101.out 2023-12-11T17:16:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:102 2023-12-11T17:16:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:102.out 2023-12-11T17:16:02.723 INFO:teuthology.orchestra.run.smithi037.stdout:103 2023-12-11T17:16:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:103.out 2023-12-11T17:16:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:104 2023-12-11T17:16:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:104.out 2023-12-11T17:16:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:105 2023-12-11T17:16:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:105.out 2023-12-11T17:16:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:106 2023-12-11T17:16:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:106.out 2023-12-11T17:16:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:107 2023-12-11T17:16:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:107.out 2023-12-11T17:16:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:108 2023-12-11T17:16:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:108.out 2023-12-11T17:16:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:109 2023-12-11T17:16:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:109.out 2023-12-11T17:16:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:110 2023-12-11T17:16:02.724 INFO:teuthology.orchestra.run.smithi037.stdout:110.out 2023-12-11T17:16:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:111 2023-12-11T17:16:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:111.out 2023-12-11T17:16:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:112 2023-12-11T17:16:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:112.out 2023-12-11T17:16:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:113 2023-12-11T17:16:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:113.out 2023-12-11T17:16:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:114 2023-12-11T17:16:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:114.out 2023-12-11T17:16:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:115 2023-12-11T17:16:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:115.out 2023-12-11T17:16:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:116 2023-12-11T17:16:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:116.out 2023-12-11T17:16:02.725 INFO:teuthology.orchestra.run.smithi037.stdout:117 2023-12-11T17:16:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:117.out 2023-12-11T17:16:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:118 2023-12-11T17:16:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:118.out 2023-12-11T17:16:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:119 2023-12-11T17:16:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:119.out 2023-12-11T17:16:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:120 2023-12-11T17:16:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:120.out 2023-12-11T17:16:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:121 2023-12-11T17:16:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:121.out 2023-12-11T17:16:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:122 2023-12-11T17:16:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:122.out 2023-12-11T17:16:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:123 2023-12-11T17:16:02.726 INFO:teuthology.orchestra.run.smithi037.stdout:123.out 2023-12-11T17:16:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:124 2023-12-11T17:16:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:124.out 2023-12-11T17:16:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:125 2023-12-11T17:16:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:125.out 2023-12-11T17:16:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:126 2023-12-11T17:16:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:126.out 2023-12-11T17:16:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:127 2023-12-11T17:16:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:127.out 2023-12-11T17:16:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:128 2023-12-11T17:16:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:128.out 2023-12-11T17:16:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:129 2023-12-11T17:16:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:129.out 2023-12-11T17:16:02.727 INFO:teuthology.orchestra.run.smithi037.stdout:130 2023-12-11T17:16:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:130.out 2023-12-11T17:16:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:131 2023-12-11T17:16:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:131.out 2023-12-11T17:16:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:132 2023-12-11T17:16:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:132.out 2023-12-11T17:16:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:133 2023-12-11T17:16:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:133.out 2023-12-11T17:16:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:134 2023-12-11T17:16:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:134.out 2023-12-11T17:16:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:135 2023-12-11T17:16:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:135.out 2023-12-11T17:16:02.728 INFO:teuthology.orchestra.run.smithi037.stdout:136 2023-12-11T17:16:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:136.out 2023-12-11T17:16:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:137 2023-12-11T17:16:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:137.out 2023-12-11T17:16:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:138 2023-12-11T17:16:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:138.out 2023-12-11T17:16:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:139 2023-12-11T17:16:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:139.out 2023-12-11T17:16:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:140 2023-12-11T17:16:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:140.out 2023-12-11T17:16:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:141 2023-12-11T17:16:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:141.out 2023-12-11T17:16:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:142 2023-12-11T17:16:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:142.out 2023-12-11T17:16:02.729 INFO:teuthology.orchestra.run.smithi037.stdout:143 2023-12-11T17:16:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:143.out 2023-12-11T17:16:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:144 2023-12-11T17:16:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:144.out 2023-12-11T17:16:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:145 2023-12-11T17:16:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:145.out 2023-12-11T17:16:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:146 2023-12-11T17:16:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:146.out 2023-12-11T17:16:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:147 2023-12-11T17:16:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:147.out 2023-12-11T17:16:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:148 2023-12-11T17:16:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:148.out 2023-12-11T17:16:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:149 2023-12-11T17:16:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:149.out 2023-12-11T17:16:02.730 INFO:teuthology.orchestra.run.smithi037.stdout:150 2023-12-11T17:16:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:150.out 2023-12-11T17:16:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:151 2023-12-11T17:16:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:151.out 2023-12-11T17:16:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:152 2023-12-11T17:16:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:152.out 2023-12-11T17:16:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:153 2023-12-11T17:16:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:153.out 2023-12-11T17:16:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:154 2023-12-11T17:16:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:154.out 2023-12-11T17:16:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:155 2023-12-11T17:16:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:155.out 2023-12-11T17:16:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:156 2023-12-11T17:16:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:156.out 2023-12-11T17:16:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:157 2023-12-11T17:16:02.731 INFO:teuthology.orchestra.run.smithi037.stdout:157.out 2023-12-11T17:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:158 2023-12-11T17:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:158.out 2023-12-11T17:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:159 2023-12-11T17:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:159.out 2023-12-11T17:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:160 2023-12-11T17:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:160.out 2023-12-11T17:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:161 2023-12-11T17:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:161.out 2023-12-11T17:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:162 2023-12-11T17:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:162.out 2023-12-11T17:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:163 2023-12-11T17:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:163.out 2023-12-11T17:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:164 2023-12-11T17:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:164.out 2023-12-11T17:16:02.732 INFO:teuthology.orchestra.run.smithi037.stdout:165 2023-12-11T17:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:165.out 2023-12-11T17:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:166 2023-12-11T17:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:166.out 2023-12-11T17:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:167 2023-12-11T17:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:167.out 2023-12-11T17:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:168 2023-12-11T17:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:168.out 2023-12-11T17:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:169 2023-12-11T17:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:169.out 2023-12-11T17:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:170 2023-12-11T17:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:170.out 2023-12-11T17:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:171 2023-12-11T17:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:171.out 2023-12-11T17:16:02.733 INFO:teuthology.orchestra.run.smithi037.stdout:172 2023-12-11T17:16:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:172.out 2023-12-11T17:16:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:173 2023-12-11T17:16:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:173.out 2023-12-11T17:16:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:174 2023-12-11T17:16:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:174.out 2023-12-11T17:16:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:175 2023-12-11T17:16:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:175.out 2023-12-11T17:16:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:176 2023-12-11T17:16:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:176.out 2023-12-11T17:16:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:177 2023-12-11T17:16:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:177.out 2023-12-11T17:16:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:178 2023-12-11T17:16:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:178.out 2023-12-11T17:16:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:179 2023-12-11T17:16:02.734 INFO:teuthology.orchestra.run.smithi037.stdout:179.out 2023-12-11T17:16:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:180 2023-12-11T17:16:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:180.out 2023-12-11T17:16:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:181 2023-12-11T17:16:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:181.out 2023-12-11T17:16:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:182 2023-12-11T17:16:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:182.out 2023-12-11T17:16:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:183 2023-12-11T17:16:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:183.out 2023-12-11T17:16:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:184 2023-12-11T17:16:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:184.out 2023-12-11T17:16:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:185 2023-12-11T17:16:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:185.out 2023-12-11T17:16:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:186 2023-12-11T17:16:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:186.out 2023-12-11T17:16:02.735 INFO:teuthology.orchestra.run.smithi037.stdout:187 2023-12-11T17:16:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:187.out 2023-12-11T17:16:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:188 2023-12-11T17:16:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:188.out 2023-12-11T17:16:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:189 2023-12-11T17:16:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:189.out 2023-12-11T17:16:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:190 2023-12-11T17:16:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:190.out 2023-12-11T17:16:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:191 2023-12-11T17:16:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:191.out 2023-12-11T17:16:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:192 2023-12-11T17:16:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:192.out 2023-12-11T17:16:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:193 2023-12-11T17:16:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:193.out 2023-12-11T17:16:02.736 INFO:teuthology.orchestra.run.smithi037.stdout:194 2023-12-11T17:16:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:194.out 2023-12-11T17:16:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:195 2023-12-11T17:16:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:195.out 2023-12-11T17:16:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:196 2023-12-11T17:16:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:196.out 2023-12-11T17:16:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:197 2023-12-11T17:16:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:197.out 2023-12-11T17:16:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:198 2023-12-11T17:16:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:198.out 2023-12-11T17:16:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:199 2023-12-11T17:16:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:199.out 2023-12-11T17:16:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:200 2023-12-11T17:16:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:200.out 2023-12-11T17:16:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:201 2023-12-11T17:16:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:201.out 2023-12-11T17:16:02.737 INFO:teuthology.orchestra.run.smithi037.stdout:202 2023-12-11T17:16:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:202.out 2023-12-11T17:16:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:203 2023-12-11T17:16:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:203.out 2023-12-11T17:16:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:204 2023-12-11T17:16:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:204.out 2023-12-11T17:16:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:205 2023-12-11T17:16:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:205.out 2023-12-11T17:16:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:206 2023-12-11T17:16:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:206.out 2023-12-11T17:16:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:207 2023-12-11T17:16:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:207.out 2023-12-11T17:16:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:208 2023-12-11T17:16:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:208.out 2023-12-11T17:16:02.738 INFO:teuthology.orchestra.run.smithi037.stdout:209 2023-12-11T17:16:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:209.out 2023-12-11T17:16:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:210 2023-12-11T17:16:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:210.out 2023-12-11T17:16:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:211 2023-12-11T17:16:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:211.out 2023-12-11T17:16:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:212 2023-12-11T17:16:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:212.out 2023-12-11T17:16:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:213 2023-12-11T17:16:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:213.out 2023-12-11T17:16:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:214 2023-12-11T17:16:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:214.out 2023-12-11T17:16:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:215 2023-12-11T17:16:02.739 INFO:teuthology.orchestra.run.smithi037.stdout:215.out 2023-12-11T17:16:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:216 2023-12-11T17:16:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:216.out 2023-12-11T17:16:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:217 2023-12-11T17:16:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:217.out 2023-12-11T17:16:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:218 2023-12-11T17:16:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:218.out 2023-12-11T17:16:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:219 2023-12-11T17:16:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:219.out 2023-12-11T17:16:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:220 2023-12-11T17:16:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:220.out 2023-12-11T17:16:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:221 2023-12-11T17:16:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:221.out 2023-12-11T17:16:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:222 2023-12-11T17:16:02.740 INFO:teuthology.orchestra.run.smithi037.stdout:222.out 2023-12-11T17:16:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:223 2023-12-11T17:16:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:223.out 2023-12-11T17:16:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:224 2023-12-11T17:16:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:224.out 2023-12-11T17:16:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:225 2023-12-11T17:16:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:225.out 2023-12-11T17:16:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:226 2023-12-11T17:16:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:226.out 2023-12-11T17:16:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:227 2023-12-11T17:16:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:227.out 2023-12-11T17:16:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:228 2023-12-11T17:16:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:228.out 2023-12-11T17:16:02.741 INFO:teuthology.orchestra.run.smithi037.stdout:229 2023-12-11T17:16:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:229.out 2023-12-11T17:16:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:230 2023-12-11T17:16:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:230.out 2023-12-11T17:16:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:231 2023-12-11T17:16:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:231.out 2023-12-11T17:16:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:232 2023-12-11T17:16:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:232.out 2023-12-11T17:16:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:233 2023-12-11T17:16:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:233.out 2023-12-11T17:16:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:234 2023-12-11T17:16:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:234.out 2023-12-11T17:16:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:235 2023-12-11T17:16:02.742 INFO:teuthology.orchestra.run.smithi037.stdout:235.out 2023-12-11T17:16:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:236 2023-12-11T17:16:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:236.out 2023-12-11T17:16:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:237 2023-12-11T17:16:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:237.out 2023-12-11T17:16:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:238 2023-12-11T17:16:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:238.out 2023-12-11T17:16:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:239 2023-12-11T17:16:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:239.out 2023-12-11T17:16:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:240 2023-12-11T17:16:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:240.out 2023-12-11T17:16:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:241 2023-12-11T17:16:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:241.out 2023-12-11T17:16:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:242 2023-12-11T17:16:02.743 INFO:teuthology.orchestra.run.smithi037.stdout:242.out 2023-12-11T17:16:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:243 2023-12-11T17:16:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:243.out 2023-12-11T17:16:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:244 2023-12-11T17:16:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:244.out 2023-12-11T17:16:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:245 2023-12-11T17:16:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:245.out 2023-12-11T17:16:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:246 2023-12-11T17:16:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:246.out 2023-12-11T17:16:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:247 2023-12-11T17:16:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:247.out 2023-12-11T17:16:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:248 2023-12-11T17:16:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:248.out 2023-12-11T17:16:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:249 2023-12-11T17:16:02.744 INFO:teuthology.orchestra.run.smithi037.stdout:249.out 2023-12-11T17:16:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:250 2023-12-11T17:16:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:250.out 2023-12-11T17:16:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:251 2023-12-11T17:16:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:251.out 2023-12-11T17:16:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:252 2023-12-11T17:16:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:252.out 2023-12-11T17:16:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:253 2023-12-11T17:16:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:253.out 2023-12-11T17:16:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:254 2023-12-11T17:16:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:254.out 2023-12-11T17:16:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:255 2023-12-11T17:16:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:255.out 2023-12-11T17:16:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:256 2023-12-11T17:16:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:256.out 2023-12-11T17:16:02.745 INFO:teuthology.orchestra.run.smithi037.stdout:257 2023-12-11T17:16:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:257.out 2023-12-11T17:16:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:258 2023-12-11T17:16:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:258.out 2023-12-11T17:16:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:259 2023-12-11T17:16:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:259.out 2023-12-11T17:16:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:260 2023-12-11T17:16:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:260.out 2023-12-11T17:16:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:261 2023-12-11T17:16:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:261.out 2023-12-11T17:16:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:262 2023-12-11T17:16:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:262.out 2023-12-11T17:16:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:263 2023-12-11T17:16:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:263.out 2023-12-11T17:16:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:264 2023-12-11T17:16:02.746 INFO:teuthology.orchestra.run.smithi037.stdout:264.out 2023-12-11T17:16:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:265 2023-12-11T17:16:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:265.out 2023-12-11T17:16:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:266 2023-12-11T17:16:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:266.out 2023-12-11T17:16:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:267 2023-12-11T17:16:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:267.out 2023-12-11T17:16:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:268 2023-12-11T17:16:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:268.out 2023-12-11T17:16:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:269 2023-12-11T17:16:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:269.out 2023-12-11T17:16:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:270 2023-12-11T17:16:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:270.out 2023-12-11T17:16:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:271 2023-12-11T17:16:02.747 INFO:teuthology.orchestra.run.smithi037.stdout:271.out 2023-12-11T17:16:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:272 2023-12-11T17:16:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:272.out 2023-12-11T17:16:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:273 2023-12-11T17:16:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:273.out 2023-12-11T17:16:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:274 2023-12-11T17:16:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:274.out 2023-12-11T17:16:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:275 2023-12-11T17:16:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:275.out 2023-12-11T17:16:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:276 2023-12-11T17:16:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:276.out 2023-12-11T17:16:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:277 2023-12-11T17:16:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:277.out 2023-12-11T17:16:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:278 2023-12-11T17:16:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:278.out 2023-12-11T17:16:02.748 INFO:teuthology.orchestra.run.smithi037.stdout:279 2023-12-11T17:16:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:279.out 2023-12-11T17:16:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:280 2023-12-11T17:16:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:280.out 2023-12-11T17:16:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:281 2023-12-11T17:16:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:281.out 2023-12-11T17:16:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:282 2023-12-11T17:16:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:282.out 2023-12-11T17:16:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:283 2023-12-11T17:16:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:283.out 2023-12-11T17:16:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:284 2023-12-11T17:16:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:284.out 2023-12-11T17:16:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:285 2023-12-11T17:16:02.749 INFO:teuthology.orchestra.run.smithi037.stdout:285.out 2023-12-11T17:16:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:286 2023-12-11T17:16:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:286.out 2023-12-11T17:16:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:287 2023-12-11T17:16:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:287.out 2023-12-11T17:16:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:288 2023-12-11T17:16:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:288.out 2023-12-11T17:16:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:289 2023-12-11T17:16:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:289.out 2023-12-11T17:16:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:290 2023-12-11T17:16:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:290.out 2023-12-11T17:16:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:291 2023-12-11T17:16:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:291.out 2023-12-11T17:16:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:292 2023-12-11T17:16:02.750 INFO:teuthology.orchestra.run.smithi037.stdout:292.out 2023-12-11T17:16:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:293 2023-12-11T17:16:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:293.out 2023-12-11T17:16:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:294 2023-12-11T17:16:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:294.out 2023-12-11T17:16:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:295 2023-12-11T17:16:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:295.out 2023-12-11T17:16:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:296 2023-12-11T17:16:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:296.out 2023-12-11T17:16:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:297 2023-12-11T17:16:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:297.out 2023-12-11T17:16:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:298 2023-12-11T17:16:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:298.out 2023-12-11T17:16:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:299 2023-12-11T17:16:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:299.out 2023-12-11T17:16:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:300 2023-12-11T17:16:02.751 INFO:teuthology.orchestra.run.smithi037.stdout:300.out 2023-12-11T17:16:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:301 2023-12-11T17:16:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:301.out 2023-12-11T17:16:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:302 2023-12-11T17:16:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:302.out 2023-12-11T17:16:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:303 2023-12-11T17:16:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:303.out 2023-12-11T17:16:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:304 2023-12-11T17:16:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:304.out 2023-12-11T17:16:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:305 2023-12-11T17:16:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:305.out 2023-12-11T17:16:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:306 2023-12-11T17:16:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:306.out 2023-12-11T17:16:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:307 2023-12-11T17:16:02.752 INFO:teuthology.orchestra.run.smithi037.stdout:307.out 2023-12-11T17:16:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:308 2023-12-11T17:16:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:308.out 2023-12-11T17:16:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:309 2023-12-11T17:16:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:309.out 2023-12-11T17:16:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:310 2023-12-11T17:16:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:310.out 2023-12-11T17:16:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:311 2023-12-11T17:16:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:311.out 2023-12-11T17:16:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:312 2023-12-11T17:16:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:312.out 2023-12-11T17:16:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:313 2023-12-11T17:16:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:313.out 2023-12-11T17:16:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:314 2023-12-11T17:16:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:314.out 2023-12-11T17:16:02.753 INFO:teuthology.orchestra.run.smithi037.stdout:315 2023-12-11T17:16:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:315.out 2023-12-11T17:16:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:316 2023-12-11T17:16:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:316.out 2023-12-11T17:16:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:317 2023-12-11T17:16:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:317.out 2023-12-11T17:16:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:318 2023-12-11T17:16:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:318.out 2023-12-11T17:16:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:319 2023-12-11T17:16:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:319.out 2023-12-11T17:16:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:320 2023-12-11T17:16:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:320.out 2023-12-11T17:16:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:321 2023-12-11T17:16:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:321.out 2023-12-11T17:16:02.754 INFO:teuthology.orchestra.run.smithi037.stdout:322 2023-12-11T17:16:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:322.out 2023-12-11T17:16:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:323 2023-12-11T17:16:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:323.out 2023-12-11T17:16:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:324 2023-12-11T17:16:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:324.out 2023-12-11T17:16:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:325 2023-12-11T17:16:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:325.out 2023-12-11T17:16:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:326 2023-12-11T17:16:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:326.out 2023-12-11T17:16:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:327 2023-12-11T17:16:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:327.out 2023-12-11T17:16:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:328 2023-12-11T17:16:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:328.out 2023-12-11T17:16:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:329 2023-12-11T17:16:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:329.out 2023-12-11T17:16:02.755 INFO:teuthology.orchestra.run.smithi037.stdout:330 2023-12-11T17:16:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:330.out 2023-12-11T17:16:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:331 2023-12-11T17:16:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:331.out 2023-12-11T17:16:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:332 2023-12-11T17:16:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:332.out 2023-12-11T17:16:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:333 2023-12-11T17:16:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:333.out 2023-12-11T17:16:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:334 2023-12-11T17:16:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:334.out 2023-12-11T17:16:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:335 2023-12-11T17:16:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:335.out 2023-12-11T17:16:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:336 2023-12-11T17:16:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:336.out 2023-12-11T17:16:02.756 INFO:teuthology.orchestra.run.smithi037.stdout:337 2023-12-11T17:16:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:337.out 2023-12-11T17:16:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:338 2023-12-11T17:16:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:338.out 2023-12-11T17:16:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:339 2023-12-11T17:16:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:339.out 2023-12-11T17:16:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:340 2023-12-11T17:16:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:340.out 2023-12-11T17:16:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:341 2023-12-11T17:16:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:341.out 2023-12-11T17:16:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:342 2023-12-11T17:16:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:342.out 2023-12-11T17:16:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:343 2023-12-11T17:16:02.757 INFO:teuthology.orchestra.run.smithi037.stdout:343.out 2023-12-11T17:16:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:344 2023-12-11T17:16:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:344.out 2023-12-11T17:16:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:345 2023-12-11T17:16:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:345.out 2023-12-11T17:16:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:346 2023-12-11T17:16:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:346.out 2023-12-11T17:16:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:347 2023-12-11T17:16:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:347.out 2023-12-11T17:16:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:348 2023-12-11T17:16:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:348.out 2023-12-11T17:16:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:349 2023-12-11T17:16:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:349.out 2023-12-11T17:16:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:350 2023-12-11T17:16:02.758 INFO:teuthology.orchestra.run.smithi037.stdout:350.out 2023-12-11T17:16:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:351 2023-12-11T17:16:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:351.out 2023-12-11T17:16:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:352 2023-12-11T17:16:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:352.out 2023-12-11T17:16:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:353 2023-12-11T17:16:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:353.out 2023-12-11T17:16:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:354 2023-12-11T17:16:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:354.out 2023-12-11T17:16:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:355 2023-12-11T17:16:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:355.out 2023-12-11T17:16:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:356 2023-12-11T17:16:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:356.out 2023-12-11T17:16:02.759 INFO:teuthology.orchestra.run.smithi037.stdout:357 2023-12-11T17:16:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:357.out 2023-12-11T17:16:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:358 2023-12-11T17:16:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:358.out 2023-12-11T17:16:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:359 2023-12-11T17:16:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:359.out 2023-12-11T17:16:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:360 2023-12-11T17:16:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:360.out 2023-12-11T17:16:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:361 2023-12-11T17:16:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:361.out 2023-12-11T17:16:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:362 2023-12-11T17:16:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:362.out 2023-12-11T17:16:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:363 2023-12-11T17:16:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:363.out 2023-12-11T17:16:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:364 2023-12-11T17:16:02.760 INFO:teuthology.orchestra.run.smithi037.stdout:364.out 2023-12-11T17:16:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:365 2023-12-11T17:16:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:365.out 2023-12-11T17:16:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:366 2023-12-11T17:16:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:366.out 2023-12-11T17:16:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:367 2023-12-11T17:16:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:367.out 2023-12-11T17:16:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:368 2023-12-11T17:16:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:368.out 2023-12-11T17:16:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:369 2023-12-11T17:16:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:369.out 2023-12-11T17:16:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:370 2023-12-11T17:16:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:370.out 2023-12-11T17:16:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:371 2023-12-11T17:16:02.761 INFO:teuthology.orchestra.run.smithi037.stdout:371.out 2023-12-11T17:16:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:372 2023-12-11T17:16:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:372.out 2023-12-11T17:16:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:373 2023-12-11T17:16:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:373.out 2023-12-11T17:16:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:374 2023-12-11T17:16:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:374.out 2023-12-11T17:16:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:375 2023-12-11T17:16:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:375.out 2023-12-11T17:16:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:376 2023-12-11T17:16:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:376.out 2023-12-11T17:16:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:377 2023-12-11T17:16:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:377.out 2023-12-11T17:16:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:378 2023-12-11T17:16:02.762 INFO:teuthology.orchestra.run.smithi037.stdout:378.out 2023-12-11T17:16:02.763 INFO:teuthology.orchestra.run.smithi037.stdout:379 2023-12-11T17:16:02.763 INFO:teuthology.orchestra.run.smithi037.stdout:379.out 2023-12-11T17:16:02.763 INFO:teuthology.orchestra.run.smithi037.stdout:380 2023-12-11T17:16:02.763 INFO:teuthology.orchestra.run.smithi037.stdout:380.out 2023-12-11T17:16:02.763 INFO:teuthology.orchestra.run.smithi037.stdout:381 2023-12-11T17:16:02.763 INFO:teuthology.orchestra.run.smithi037.stdout:381.out 2023-12-11T17:16:02.763 INFO:teuthology.orchestra.run.smithi037.stdout:382 2023-12-11T17:16:02.763 INFO:teuthology.orchestra.run.smithi037.stdout:382.out 2023-12-11T17:16:02.763 INFO:teuthology.orchestra.run.smithi037.stdout:383 2023-12-11T17:16:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:383.out 2023-12-11T17:16:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:384 2023-12-11T17:16:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:384.out 2023-12-11T17:16:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:385 2023-12-11T17:16:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:385.out 2023-12-11T17:16:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:386 2023-12-11T17:16:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:386.out 2023-12-11T17:16:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:387 2023-12-11T17:16:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:387.out 2023-12-11T17:16:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:388 2023-12-11T17:16:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:388.out 2023-12-11T17:16:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:389 2023-12-11T17:16:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:389.out 2023-12-11T17:16:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:390 2023-12-11T17:16:02.764 INFO:teuthology.orchestra.run.smithi037.stdout:390.out 2023-12-11T17:16:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:391 2023-12-11T17:16:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:391.out 2023-12-11T17:16:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:392 2023-12-11T17:16:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:392.out 2023-12-11T17:16:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:393 2023-12-11T17:16:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:393.out 2023-12-11T17:16:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:394 2023-12-11T17:16:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:394.out 2023-12-11T17:16:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:395 2023-12-11T17:16:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:395.out 2023-12-11T17:16:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:396 2023-12-11T17:16:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:396.out 2023-12-11T17:16:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:397 2023-12-11T17:16:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:397.out 2023-12-11T17:16:02.765 INFO:teuthology.orchestra.run.smithi037.stdout:398 2023-12-11T17:16:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:398.out 2023-12-11T17:16:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:399 2023-12-11T17:16:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:399.out 2023-12-11T17:16:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:400 2023-12-11T17:16:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:400.out 2023-12-11T17:16:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:401 2023-12-11T17:16:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:401.out 2023-12-11T17:16:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:402 2023-12-11T17:16:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:402.out 2023-12-11T17:16:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:403 2023-12-11T17:16:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:403.out 2023-12-11T17:16:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:404 2023-12-11T17:16:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:404.out 2023-12-11T17:16:02.766 INFO:teuthology.orchestra.run.smithi037.stdout:405 2023-12-11T17:16:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:405.out 2023-12-11T17:16:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:406 2023-12-11T17:16:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:406.out 2023-12-11T17:16:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:407 2023-12-11T17:16:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:407.out 2023-12-11T17:16:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:408 2023-12-11T17:16:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:408.out 2023-12-11T17:16:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:409 2023-12-11T17:16:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:409.out 2023-12-11T17:16:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:410 2023-12-11T17:16:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:410.out 2023-12-11T17:16:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:411 2023-12-11T17:16:02.767 INFO:teuthology.orchestra.run.smithi037.stdout:411.out 2023-12-11T17:16:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:412 2023-12-11T17:16:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:412.out 2023-12-11T17:16:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:413 2023-12-11T17:16:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:413.out 2023-12-11T17:16:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:414 2023-12-11T17:16:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:414.out 2023-12-11T17:16:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:415 2023-12-11T17:16:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:415.out 2023-12-11T17:16:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:416 2023-12-11T17:16:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:416.out 2023-12-11T17:16:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:417 2023-12-11T17:16:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:417.out 2023-12-11T17:16:02.768 INFO:teuthology.orchestra.run.smithi037.stdout:418 2023-12-11T17:16:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:418.out 2023-12-11T17:16:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:419 2023-12-11T17:16:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:419.out 2023-12-11T17:16:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:420 2023-12-11T17:16:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:420.out 2023-12-11T17:16:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:421 2023-12-11T17:16:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:421.out 2023-12-11T17:16:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:422 2023-12-11T17:16:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:422.out 2023-12-11T17:16:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:423 2023-12-11T17:16:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:423.out 2023-12-11T17:16:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:424 2023-12-11T17:16:02.769 INFO:teuthology.orchestra.run.smithi037.stdout:424.out 2023-12-11T17:16:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:425 2023-12-11T17:16:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:425.out 2023-12-11T17:16:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:426 2023-12-11T17:16:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:426.out 2023-12-11T17:16:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:427 2023-12-11T17:16:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:427.out 2023-12-11T17:16:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:428 2023-12-11T17:16:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:428.out 2023-12-11T17:16:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:429 2023-12-11T17:16:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:429.out 2023-12-11T17:16:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:430 2023-12-11T17:16:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:430.out 2023-12-11T17:16:02.770 INFO:teuthology.orchestra.run.smithi037.stdout:431 2023-12-11T17:16:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:431.out 2023-12-11T17:16:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:432 2023-12-11T17:16:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:432.out 2023-12-11T17:16:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:433 2023-12-11T17:16:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:433.out 2023-12-11T17:16:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:434 2023-12-11T17:16:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:434.out 2023-12-11T17:16:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:435 2023-12-11T17:16:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:435.out 2023-12-11T17:16:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:436 2023-12-11T17:16:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:436.out 2023-12-11T17:16:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:437 2023-12-11T17:16:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:437.out 2023-12-11T17:16:02.771 INFO:teuthology.orchestra.run.smithi037.stdout:438 2023-12-11T17:16:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:438.out 2023-12-11T17:16:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:439 2023-12-11T17:16:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:439.out 2023-12-11T17:16:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:440 2023-12-11T17:16:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:440.out 2023-12-11T17:16:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:441 2023-12-11T17:16:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:441.out 2023-12-11T17:16:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:442 2023-12-11T17:16:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:442.out 2023-12-11T17:16:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:443 2023-12-11T17:16:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:443.out 2023-12-11T17:16:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:444 2023-12-11T17:16:02.772 INFO:teuthology.orchestra.run.smithi037.stdout:444.out 2023-12-11T17:16:02.773 INFO:teuthology.orchestra.run.smithi037.stdout:445 2023-12-11T17:16:02.773 INFO:teuthology.orchestra.run.smithi037.stdout:445.out 2023-12-11T17:16:02.773 INFO:teuthology.orchestra.run.smithi037.stdout:446 2023-12-11T17:16:02.773 INFO:teuthology.orchestra.run.smithi037.stdout:446.out 2023-12-11T17:16:02.773 INFO:teuthology.orchestra.run.smithi037.stdout:447 2023-12-11T17:16:02.773 INFO:teuthology.orchestra.run.smithi037.stdout:447.out 2023-12-11T17:16:02.773 INFO:teuthology.orchestra.run.smithi037.stdout:448 2023-12-11T17:16:02.773 INFO:teuthology.orchestra.run.smithi037.stdout:448.out 2023-12-11T17:16:02.773 INFO:teuthology.orchestra.run.smithi037.stdout:449 2023-12-11T17:16:02.773 INFO:teuthology.orchestra.run.smithi037.stdout:449.out 2023-12-11T17:16:02.773 INFO:teuthology.orchestra.run.smithi037.stdout:450 2023-12-11T17:16:02.773 INFO:teuthology.orchestra.run.smithi037.stdout:450.out 2023-12-11T17:16:02.773 INFO:teuthology.orchestra.run.smithi037.stdout:451 2023-12-11T17:16:02.774 INFO:teuthology.orchestra.run.smithi037.stdout:451.out 2023-12-11T17:16:02.774 INFO:teuthology.orchestra.run.smithi037.stdout:452 2023-12-11T17:16:02.774 INFO:teuthology.orchestra.run.smithi037.stdout:452.out 2023-12-11T17:16:02.774 INFO:teuthology.orchestra.run.smithi037.stdout:453 2023-12-11T17:16:02.774 INFO:teuthology.orchestra.run.smithi037.stdout:453.out 2023-12-11T17:16:02.774 INFO:teuthology.orchestra.run.smithi037.stdout:454 2023-12-11T17:16:02.774 INFO:teuthology.orchestra.run.smithi037.stdout:454.out 2023-12-11T17:16:02.774 INFO:teuthology.orchestra.run.smithi037.stdout:455 2023-12-11T17:16:02.774 INFO:teuthology.orchestra.run.smithi037.stdout:455.out 2023-12-11T17:16:02.774 INFO:teuthology.orchestra.run.smithi037.stdout:456 2023-12-11T17:16:02.774 INFO:teuthology.orchestra.run.smithi037.stdout:456.out 2023-12-11T17:16:02.775 INFO:teuthology.orchestra.run.smithi037.stdout:457 2023-12-11T17:16:02.775 INFO:teuthology.orchestra.run.smithi037.stdout:457.out 2023-12-11T17:16:02.775 INFO:teuthology.orchestra.run.smithi037.stdout:458 2023-12-11T17:16:02.775 INFO:teuthology.orchestra.run.smithi037.stdout:458.out 2023-12-11T17:16:02.775 INFO:teuthology.orchestra.run.smithi037.stdout:459 2023-12-11T17:16:02.775 INFO:teuthology.orchestra.run.smithi037.stdout:459.out 2023-12-11T17:16:02.775 INFO:teuthology.orchestra.run.smithi037.stdout:460 2023-12-11T17:16:02.775 INFO:teuthology.orchestra.run.smithi037.stdout:460.out 2023-12-11T17:16:02.775 INFO:teuthology.orchestra.run.smithi037.stdout:461 2023-12-11T17:16:02.775 INFO:teuthology.orchestra.run.smithi037.stdout:461.out 2023-12-11T17:16:02.775 INFO:teuthology.orchestra.run.smithi037.stdout:462 2023-12-11T17:16:02.775 INFO:teuthology.orchestra.run.smithi037.stdout:462.out 2023-12-11T17:16:02.776 INFO:teuthology.orchestra.run.smithi037.stdout:463 2023-12-11T17:16:02.776 INFO:teuthology.orchestra.run.smithi037.stdout:463.out 2023-12-11T17:16:02.776 INFO:teuthology.orchestra.run.smithi037.stdout:464 2023-12-11T17:16:02.776 INFO:teuthology.orchestra.run.smithi037.stdout:464.out 2023-12-11T17:16:02.776 INFO:teuthology.orchestra.run.smithi037.stdout:465 2023-12-11T17:16:02.776 INFO:teuthology.orchestra.run.smithi037.stdout:465.out 2023-12-11T17:16:02.776 INFO:teuthology.orchestra.run.smithi037.stdout:466 2023-12-11T17:16:02.776 INFO:teuthology.orchestra.run.smithi037.stdout:466.out 2023-12-11T17:16:02.776 INFO:teuthology.orchestra.run.smithi037.stdout:467 2023-12-11T17:16:02.776 INFO:teuthology.orchestra.run.smithi037.stdout:467.out 2023-12-11T17:16:02.776 INFO:teuthology.orchestra.run.smithi037.stdout:468 2023-12-11T17:16:02.776 INFO:teuthology.orchestra.run.smithi037.stdout:468.out 2023-12-11T17:16:02.776 INFO:teuthology.orchestra.run.smithi037.stdout:469 2023-12-11T17:16:02.777 INFO:teuthology.orchestra.run.smithi037.stdout:469.out 2023-12-11T17:16:02.777 INFO:teuthology.orchestra.run.smithi037.stdout:470 2023-12-11T17:16:02.777 INFO:teuthology.orchestra.run.smithi037.stdout:470.out 2023-12-11T17:16:02.777 INFO:teuthology.orchestra.run.smithi037.stdout:471 2023-12-11T17:16:02.777 INFO:teuthology.orchestra.run.smithi037.stdout:471.out 2023-12-11T17:16:02.777 INFO:teuthology.orchestra.run.smithi037.stdout:472 2023-12-11T17:16:02.777 INFO:teuthology.orchestra.run.smithi037.stdout:472.out 2023-12-11T17:16:02.777 INFO:teuthology.orchestra.run.smithi037.stdout:473 2023-12-11T17:16:02.778 INFO:teuthology.orchestra.run.smithi037.stdout:473.out 2023-12-11T17:16:02.778 INFO:teuthology.orchestra.run.smithi037.stdout:474 2023-12-11T17:16:02.778 INFO:teuthology.orchestra.run.smithi037.stdout:474.out 2023-12-11T17:16:02.778 INFO:teuthology.orchestra.run.smithi037.stdout:475 2023-12-11T17:16:02.778 INFO:teuthology.orchestra.run.smithi037.stdout:475.out 2023-12-11T17:16:02.778 INFO:teuthology.orchestra.run.smithi037.stdout:476 2023-12-11T17:16:02.781 INFO:teuthology.orchestra.run.smithi037.stdout:476.out 2023-12-11T17:16:02.781 INFO:teuthology.orchestra.run.smithi037.stdout:477 2023-12-11T17:16:02.781 INFO:teuthology.orchestra.run.smithi037.stdout:477.out 2023-12-11T17:16:02.781 INFO:teuthology.orchestra.run.smithi037.stdout:478 2023-12-11T17:16:02.781 INFO:teuthology.orchestra.run.smithi037.stdout:478.out 2023-12-11T17:16:02.781 INFO:teuthology.orchestra.run.smithi037.stdout:479 2023-12-11T17:16:02.782 INFO:teuthology.orchestra.run.smithi037.stdout:479.out 2023-12-11T17:16:02.782 INFO:teuthology.orchestra.run.smithi037.stdout:480 2023-12-11T17:16:02.782 INFO:teuthology.orchestra.run.smithi037.stdout:480.out 2023-12-11T17:16:02.782 INFO:teuthology.orchestra.run.smithi037.stdout:481 2023-12-11T17:16:02.782 INFO:teuthology.orchestra.run.smithi037.stdout:481.out 2023-12-11T17:16:02.782 INFO:teuthology.orchestra.run.smithi037.stdout:482 2023-12-11T17:16:02.782 INFO:teuthology.orchestra.run.smithi037.stdout:482.out 2023-12-11T17:16:02.782 INFO:teuthology.orchestra.run.smithi037.stdout:483 2023-12-11T17:16:02.782 INFO:teuthology.orchestra.run.smithi037.stdout:483.out 2023-12-11T17:16:02.782 INFO:teuthology.orchestra.run.smithi037.stdout:484 2023-12-11T17:16:02.782 INFO:teuthology.orchestra.run.smithi037.stdout:484.out 2023-12-11T17:16:02.782 INFO:teuthology.orchestra.run.smithi037.stdout:485 2023-12-11T17:16:02.782 INFO:teuthology.orchestra.run.smithi037.stdout:485.out 2023-12-11T17:16:02.782 INFO:teuthology.orchestra.run.smithi037.stdout:486 2023-12-11T17:16:02.783 INFO:teuthology.orchestra.run.smithi037.stdout:486.out 2023-12-11T17:16:02.783 INFO:teuthology.orchestra.run.smithi037.stdout:487 2023-12-11T17:16:02.783 INFO:teuthology.orchestra.run.smithi037.stdout:487.out 2023-12-11T17:16:02.783 INFO:teuthology.orchestra.run.smithi037.stdout:488 2023-12-11T17:16:02.783 INFO:teuthology.orchestra.run.smithi037.stdout:488.out 2023-12-11T17:16:02.783 INFO:teuthology.orchestra.run.smithi037.stdout:489 2023-12-11T17:16:02.783 INFO:teuthology.orchestra.run.smithi037.stdout:489.out 2023-12-11T17:16:02.783 INFO:teuthology.orchestra.run.smithi037.stdout:490 2023-12-11T17:16:02.783 INFO:teuthology.orchestra.run.smithi037.stdout:490.out 2023-12-11T17:16:02.783 INFO:teuthology.orchestra.run.smithi037.stdout:491 2023-12-11T17:16:02.783 INFO:teuthology.orchestra.run.smithi037.stdout:491.out 2023-12-11T17:16:02.783 INFO:teuthology.orchestra.run.smithi037.stdout:492 2023-12-11T17:16:02.783 INFO:teuthology.orchestra.run.smithi037.stdout:492.out 2023-12-11T17:16:02.783 INFO:teuthology.orchestra.run.smithi037.stdout:493 2023-12-11T17:16:02.784 INFO:teuthology.orchestra.run.smithi037.stdout:493.out 2023-12-11T17:16:02.784 INFO:teuthology.orchestra.run.smithi037.stdout:494 2023-12-11T17:16:02.784 INFO:teuthology.orchestra.run.smithi037.stdout:494.out 2023-12-11T17:16:02.784 INFO:teuthology.orchestra.run.smithi037.stdout:495 2023-12-11T17:16:02.784 INFO:teuthology.orchestra.run.smithi037.stdout:495.out 2023-12-11T17:16:02.784 INFO:teuthology.orchestra.run.smithi037.stdout:496 2023-12-11T17:16:02.784 INFO:teuthology.orchestra.run.smithi037.stdout:496.out 2023-12-11T17:16:02.784 INFO:teuthology.orchestra.run.smithi037.stdout:497 2023-12-11T17:16:02.784 INFO:teuthology.orchestra.run.smithi037.stdout:497.out 2023-12-11T17:16:02.784 INFO:teuthology.orchestra.run.smithi037.stdout:498 2023-12-11T17:16:02.784 INFO:teuthology.orchestra.run.smithi037.stdout:498.out 2023-12-11T17:16:02.784 INFO:teuthology.orchestra.run.smithi037.stdout:499 2023-12-11T17:16:02.784 INFO:teuthology.orchestra.run.smithi037.stdout:499.out 2023-12-11T17:16:02.784 INFO:teuthology.orchestra.run.smithi037.stdout:500 2023-12-11T17:16:02.784 INFO:teuthology.orchestra.run.smithi037.stdout:500.out 2023-12-11T17:16:02.785 INFO:teuthology.orchestra.run.smithi037.stdout:501 2023-12-11T17:16:02.785 INFO:teuthology.orchestra.run.smithi037.stdout:501.out 2023-12-11T17:16:02.785 INFO:teuthology.orchestra.run.smithi037.stdout:502 2023-12-11T17:16:02.785 INFO:teuthology.orchestra.run.smithi037.stdout:502.out 2023-12-11T17:16:02.785 INFO:teuthology.orchestra.run.smithi037.stdout:503 2023-12-11T17:16:02.785 INFO:teuthology.orchestra.run.smithi037.stdout:503.out 2023-12-11T17:16:02.785 INFO:teuthology.orchestra.run.smithi037.stdout:504 2023-12-11T17:16:02.785 INFO:teuthology.orchestra.run.smithi037.stdout:504.out 2023-12-11T17:16:02.785 INFO:teuthology.orchestra.run.smithi037.stdout:505 2023-12-11T17:16:02.785 INFO:teuthology.orchestra.run.smithi037.stdout:505.out 2023-12-11T17:16:02.785 INFO:teuthology.orchestra.run.smithi037.stdout:506 2023-12-11T17:16:02.785 INFO:teuthology.orchestra.run.smithi037.stdout:506.out 2023-12-11T17:16:02.785 INFO:teuthology.orchestra.run.smithi037.stdout:507 2023-12-11T17:16:02.785 INFO:teuthology.orchestra.run.smithi037.stdout:507.out 2023-12-11T17:16:02.785 INFO:teuthology.orchestra.run.smithi037.stdout:508 2023-12-11T17:16:02.786 INFO:teuthology.orchestra.run.smithi037.stdout:508.out 2023-12-11T17:16:02.786 INFO:teuthology.orchestra.run.smithi037.stdout:509 2023-12-11T17:16:02.786 INFO:teuthology.orchestra.run.smithi037.stdout:509.out 2023-12-11T17:16:02.786 INFO:teuthology.orchestra.run.smithi037.stdout:510 2023-12-11T17:16:02.786 INFO:teuthology.orchestra.run.smithi037.stdout:510.out 2023-12-11T17:16:02.786 INFO:teuthology.orchestra.run.smithi037.stdout:511 2023-12-11T17:16:02.786 INFO:teuthology.orchestra.run.smithi037.stdout:511.out 2023-12-11T17:16:02.786 INFO:teuthology.orchestra.run.smithi037.stdout:512 2023-12-11T17:16:02.786 INFO:teuthology.orchestra.run.smithi037.stdout:512.out 2023-12-11T17:16:02.786 INFO:teuthology.orchestra.run.smithi037.stdout:513 2023-12-11T17:16:02.786 INFO:teuthology.orchestra.run.smithi037.stdout:513.out 2023-12-11T17:16:02.786 INFO:teuthology.orchestra.run.smithi037.stdout:514 2023-12-11T17:16:02.786 INFO:teuthology.orchestra.run.smithi037.stdout:514.out 2023-12-11T17:16:02.786 INFO:teuthology.orchestra.run.smithi037.stdout:515 2023-12-11T17:16:02.787 INFO:teuthology.orchestra.run.smithi037.stdout:515.out 2023-12-11T17:16:02.787 INFO:teuthology.orchestra.run.smithi037.stdout:516 2023-12-11T17:16:02.787 INFO:teuthology.orchestra.run.smithi037.stdout:516.out 2023-12-11T17:16:02.787 INFO:teuthology.orchestra.run.smithi037.stdout:517 2023-12-11T17:16:02.787 INFO:teuthology.orchestra.run.smithi037.stdout:517.out 2023-12-11T17:16:02.787 INFO:teuthology.orchestra.run.smithi037.stdout:518 2023-12-11T17:16:02.787 INFO:teuthology.orchestra.run.smithi037.stdout:518.out 2023-12-11T17:16:02.787 INFO:teuthology.orchestra.run.smithi037.stdout:519 2023-12-11T17:16:02.787 INFO:teuthology.orchestra.run.smithi037.stdout:519.out 2023-12-11T17:16:02.787 INFO:teuthology.orchestra.run.smithi037.stdout:520 2023-12-11T17:16:02.787 INFO:teuthology.orchestra.run.smithi037.stdout:520.out 2023-12-11T17:16:02.787 INFO:teuthology.orchestra.run.smithi037.stdout:521 2023-12-11T17:16:02.787 INFO:teuthology.orchestra.run.smithi037.stdout:521.out 2023-12-11T17:16:02.787 INFO:teuthology.orchestra.run.smithi037.stdout:522 2023-12-11T17:16:02.788 INFO:teuthology.orchestra.run.smithi037.stdout:522.out 2023-12-11T17:16:02.788 INFO:teuthology.orchestra.run.smithi037.stdout:523 2023-12-11T17:16:02.788 INFO:teuthology.orchestra.run.smithi037.stdout:523.out 2023-12-11T17:16:02.788 INFO:teuthology.orchestra.run.smithi037.stdout:524 2023-12-11T17:16:02.788 INFO:teuthology.orchestra.run.smithi037.stdout:524.out 2023-12-11T17:16:02.788 INFO:teuthology.orchestra.run.smithi037.stdout:525 2023-12-11T17:16:02.788 INFO:teuthology.orchestra.run.smithi037.stdout:525.out 2023-12-11T17:16:02.788 INFO:teuthology.orchestra.run.smithi037.stdout:526 2023-12-11T17:16:02.788 INFO:teuthology.orchestra.run.smithi037.stdout:526.out 2023-12-11T17:16:02.788 INFO:teuthology.orchestra.run.smithi037.stdout:527 2023-12-11T17:16:02.788 INFO:teuthology.orchestra.run.smithi037.stdout:527.out 2023-12-11T17:16:02.788 INFO:teuthology.orchestra.run.smithi037.stdout:528 2023-12-11T17:16:02.788 INFO:teuthology.orchestra.run.smithi037.stdout:528.out 2023-12-11T17:16:02.788 INFO:teuthology.orchestra.run.smithi037.stdout:529 2023-12-11T17:16:02.788 INFO:teuthology.orchestra.run.smithi037.stdout:529.out 2023-12-11T17:16:02.789 INFO:teuthology.orchestra.run.smithi037.stdout:530 2023-12-11T17:16:02.789 INFO:teuthology.orchestra.run.smithi037.stdout:530.out 2023-12-11T17:16:02.789 INFO:teuthology.orchestra.run.smithi037.stdout:531 2023-12-11T17:16:02.789 INFO:teuthology.orchestra.run.smithi037.stdout:531.out 2023-12-11T17:16:02.789 INFO:teuthology.orchestra.run.smithi037.stdout:532 2023-12-11T17:16:02.789 INFO:teuthology.orchestra.run.smithi037.stdout:532.out 2023-12-11T17:16:02.789 INFO:teuthology.orchestra.run.smithi037.stdout:533 2023-12-11T17:16:02.789 INFO:teuthology.orchestra.run.smithi037.stdout:533.out 2023-12-11T17:16:02.789 INFO:teuthology.orchestra.run.smithi037.stdout:534 2023-12-11T17:16:02.789 INFO:teuthology.orchestra.run.smithi037.stdout:534.out 2023-12-11T17:16:02.789 INFO:teuthology.orchestra.run.smithi037.stdout:535 2023-12-11T17:16:02.789 INFO:teuthology.orchestra.run.smithi037.stdout:535.out 2023-12-11T17:16:02.789 INFO:teuthology.orchestra.run.smithi037.stdout:536 2023-12-11T17:16:02.789 INFO:teuthology.orchestra.run.smithi037.stdout:536.out 2023-12-11T17:16:02.790 INFO:teuthology.orchestra.run.smithi037.stdout:537 2023-12-11T17:16:02.790 INFO:teuthology.orchestra.run.smithi037.stdout:537.out 2023-12-11T17:16:02.790 INFO:teuthology.orchestra.run.smithi037.stdout:538 2023-12-11T17:16:02.790 INFO:teuthology.orchestra.run.smithi037.stdout:538.out 2023-12-11T17:16:02.790 INFO:teuthology.orchestra.run.smithi037.stdout:539 2023-12-11T17:16:02.790 INFO:teuthology.orchestra.run.smithi037.stdout:539.out 2023-12-11T17:16:02.790 INFO:teuthology.orchestra.run.smithi037.stdout:540 2023-12-11T17:16:02.790 INFO:teuthology.orchestra.run.smithi037.stdout:540.out 2023-12-11T17:16:02.790 INFO:teuthology.orchestra.run.smithi037.stdout:541 2023-12-11T17:16:02.790 INFO:teuthology.orchestra.run.smithi037.stdout:541.out 2023-12-11T17:16:02.790 INFO:teuthology.orchestra.run.smithi037.stdout:542 2023-12-11T17:16:02.790 INFO:teuthology.orchestra.run.smithi037.stdout:542.out 2023-12-11T17:16:02.790 INFO:teuthology.orchestra.run.smithi037.stdout:543 2023-12-11T17:16:02.791 INFO:teuthology.orchestra.run.smithi037.stdout:543.out 2023-12-11T17:16:02.791 INFO:teuthology.orchestra.run.smithi037.stdout:544 2023-12-11T17:16:02.791 INFO:teuthology.orchestra.run.smithi037.stdout:544.out 2023-12-11T17:16:02.791 INFO:teuthology.orchestra.run.smithi037.stdout:545 2023-12-11T17:16:02.791 INFO:teuthology.orchestra.run.smithi037.stdout:545.out 2023-12-11T17:16:02.791 INFO:teuthology.orchestra.run.smithi037.stdout:546 2023-12-11T17:16:02.791 INFO:teuthology.orchestra.run.smithi037.stdout:546.out 2023-12-11T17:16:02.791 INFO:teuthology.orchestra.run.smithi037.stdout:547 2023-12-11T17:16:02.791 INFO:teuthology.orchestra.run.smithi037.stdout:547.out 2023-12-11T17:16:02.791 INFO:teuthology.orchestra.run.smithi037.stdout:548 2023-12-11T17:16:02.791 INFO:teuthology.orchestra.run.smithi037.stdout:548.out 2023-12-11T17:16:02.791 INFO:teuthology.orchestra.run.smithi037.stdout:549 2023-12-11T17:16:02.791 INFO:teuthology.orchestra.run.smithi037.stdout:549.out 2023-12-11T17:16:02.791 INFO:teuthology.orchestra.run.smithi037.stdout:550 2023-12-11T17:16:02.791 INFO:teuthology.orchestra.run.smithi037.stdout:550.out 2023-12-11T17:16:02.791 INFO:teuthology.orchestra.run.smithi037.stdout:551 2023-12-11T17:16:02.792 INFO:teuthology.orchestra.run.smithi037.stdout:551.out 2023-12-11T17:16:02.792 INFO:teuthology.orchestra.run.smithi037.stdout:552 2023-12-11T17:16:02.792 INFO:teuthology.orchestra.run.smithi037.stdout:552.out 2023-12-11T17:16:02.792 INFO:teuthology.orchestra.run.smithi037.stdout:553 2023-12-11T17:16:02.792 INFO:teuthology.orchestra.run.smithi037.stdout:553.out 2023-12-11T17:16:02.792 INFO:teuthology.orchestra.run.smithi037.stdout:554 2023-12-11T17:16:02.792 INFO:teuthology.orchestra.run.smithi037.stdout:554.out 2023-12-11T17:16:02.792 INFO:teuthology.orchestra.run.smithi037.stdout:555 2023-12-11T17:16:02.792 INFO:teuthology.orchestra.run.smithi037.stdout:555.out 2023-12-11T17:16:02.792 INFO:teuthology.orchestra.run.smithi037.stdout:556 2023-12-11T17:16:02.792 INFO:teuthology.orchestra.run.smithi037.stdout:556.out 2023-12-11T17:16:02.792 INFO:teuthology.orchestra.run.smithi037.stdout:557 2023-12-11T17:16:02.792 INFO:teuthology.orchestra.run.smithi037.stdout:557.out 2023-12-11T17:16:02.792 INFO:teuthology.orchestra.run.smithi037.stdout:558 2023-12-11T17:16:02.792 INFO:teuthology.orchestra.run.smithi037.stdout:558.out 2023-12-11T17:16:02.793 INFO:teuthology.orchestra.run.smithi037.stdout:559 2023-12-11T17:16:02.793 INFO:teuthology.orchestra.run.smithi037.stdout:559.out 2023-12-11T17:16:02.793 INFO:teuthology.orchestra.run.smithi037.stdout:560 2023-12-11T17:16:02.793 INFO:teuthology.orchestra.run.smithi037.stdout:560.out 2023-12-11T17:16:02.793 INFO:teuthology.orchestra.run.smithi037.stdout:561 2023-12-11T17:16:02.793 INFO:teuthology.orchestra.run.smithi037.stdout:561.out 2023-12-11T17:16:02.793 INFO:teuthology.orchestra.run.smithi037.stdout:562 2023-12-11T17:16:02.793 INFO:teuthology.orchestra.run.smithi037.stdout:562.out 2023-12-11T17:16:02.793 INFO:teuthology.orchestra.run.smithi037.stdout:563 2023-12-11T17:16:02.793 INFO:teuthology.orchestra.run.smithi037.stdout:563.out 2023-12-11T17:16:02.793 INFO:teuthology.orchestra.run.smithi037.stdout:564 2023-12-11T17:16:02.793 INFO:teuthology.orchestra.run.smithi037.stdout:564.out 2023-12-11T17:16:02.793 INFO:teuthology.orchestra.run.smithi037.stdout:565 2023-12-11T17:16:02.793 INFO:teuthology.orchestra.run.smithi037.stdout:565.out 2023-12-11T17:16:02.793 INFO:teuthology.orchestra.run.smithi037.stdout:566 2023-12-11T17:16:02.794 INFO:teuthology.orchestra.run.smithi037.stdout:566.out 2023-12-11T17:16:02.794 INFO:teuthology.orchestra.run.smithi037.stdout:567 2023-12-11T17:16:02.794 INFO:teuthology.orchestra.run.smithi037.stdout:567.out 2023-12-11T17:16:02.794 INFO:teuthology.orchestra.run.smithi037.stdout:568 2023-12-11T17:16:02.794 INFO:teuthology.orchestra.run.smithi037.stdout:568.out 2023-12-11T17:16:02.794 INFO:teuthology.orchestra.run.smithi037.stdout:569 2023-12-11T17:16:02.794 INFO:teuthology.orchestra.run.smithi037.stdout:569.out 2023-12-11T17:16:02.794 INFO:teuthology.orchestra.run.smithi037.stdout:570 2023-12-11T17:16:02.794 INFO:teuthology.orchestra.run.smithi037.stdout:570.out 2023-12-11T17:16:02.794 INFO:teuthology.orchestra.run.smithi037.stdout:571 2023-12-11T17:16:02.794 INFO:teuthology.orchestra.run.smithi037.stdout:571.out 2023-12-11T17:16:02.794 INFO:teuthology.orchestra.run.smithi037.stdout:572 2023-12-11T17:16:02.794 INFO:teuthology.orchestra.run.smithi037.stdout:572.out 2023-12-11T17:16:02.794 INFO:teuthology.orchestra.run.smithi037.stdout:573 2023-12-11T17:16:02.794 INFO:teuthology.orchestra.run.smithi037.stdout:573.out 2023-12-11T17:16:02.795 INFO:teuthology.orchestra.run.smithi037.stdout:574 2023-12-11T17:16:02.795 INFO:teuthology.orchestra.run.smithi037.stdout:574.out 2023-12-11T17:16:02.795 INFO:teuthology.orchestra.run.smithi037.stdout:575 2023-12-11T17:16:02.795 INFO:teuthology.orchestra.run.smithi037.stdout:575.out 2023-12-11T17:16:02.795 INFO:teuthology.orchestra.run.smithi037.stdout:576 2023-12-11T17:16:02.795 INFO:teuthology.orchestra.run.smithi037.stdout:576.out 2023-12-11T17:16:02.795 INFO:teuthology.orchestra.run.smithi037.stdout:577 2023-12-11T17:16:02.795 INFO:teuthology.orchestra.run.smithi037.stdout:577.out 2023-12-11T17:16:02.795 INFO:teuthology.orchestra.run.smithi037.stdout:578 2023-12-11T17:16:02.795 INFO:teuthology.orchestra.run.smithi037.stdout:578.out 2023-12-11T17:16:02.795 INFO:teuthology.orchestra.run.smithi037.stdout:579 2023-12-11T17:16:02.795 INFO:teuthology.orchestra.run.smithi037.stdout:579.out 2023-12-11T17:16:02.795 INFO:teuthology.orchestra.run.smithi037.stdout:580 2023-12-11T17:16:02.795 INFO:teuthology.orchestra.run.smithi037.stdout:580.out 2023-12-11T17:16:02.795 INFO:teuthology.orchestra.run.smithi037.stdout:581 2023-12-11T17:16:02.796 INFO:teuthology.orchestra.run.smithi037.stdout:581.out 2023-12-11T17:16:02.796 INFO:teuthology.orchestra.run.smithi037.stdout:582 2023-12-11T17:16:02.796 INFO:teuthology.orchestra.run.smithi037.stdout:582.out 2023-12-11T17:16:02.796 INFO:teuthology.orchestra.run.smithi037.stdout:583 2023-12-11T17:16:02.796 INFO:teuthology.orchestra.run.smithi037.stdout:583.out 2023-12-11T17:16:02.796 INFO:teuthology.orchestra.run.smithi037.stdout:584 2023-12-11T17:16:02.796 INFO:teuthology.orchestra.run.smithi037.stdout:584.out 2023-12-11T17:16:02.796 INFO:teuthology.orchestra.run.smithi037.stdout:585 2023-12-11T17:16:02.796 INFO:teuthology.orchestra.run.smithi037.stdout:585.out 2023-12-11T17:16:02.796 INFO:teuthology.orchestra.run.smithi037.stdout:586 2023-12-11T17:16:02.796 INFO:teuthology.orchestra.run.smithi037.stdout:586.out 2023-12-11T17:16:02.796 INFO:teuthology.orchestra.run.smithi037.stdout:587 2023-12-11T17:16:02.796 INFO:teuthology.orchestra.run.smithi037.stdout:587.out 2023-12-11T17:16:02.796 INFO:teuthology.orchestra.run.smithi037.stdout:588 2023-12-11T17:16:02.796 INFO:teuthology.orchestra.run.smithi037.stdout:588.out 2023-12-11T17:16:02.797 INFO:teuthology.orchestra.run.smithi037.stdout:589 2023-12-11T17:16:02.797 INFO:teuthology.orchestra.run.smithi037.stdout:589.out 2023-12-11T17:16:02.797 INFO:teuthology.orchestra.run.smithi037.stdout:590 2023-12-11T17:16:02.797 INFO:teuthology.orchestra.run.smithi037.stdout:590.out 2023-12-11T17:16:02.797 INFO:teuthology.orchestra.run.smithi037.stdout:591 2023-12-11T17:16:02.797 INFO:teuthology.orchestra.run.smithi037.stdout:591.out 2023-12-11T17:16:02.797 INFO:teuthology.orchestra.run.smithi037.stdout:592 2023-12-11T17:16:02.797 INFO:teuthology.orchestra.run.smithi037.stdout:592.out 2023-12-11T17:16:02.797 INFO:teuthology.orchestra.run.smithi037.stdout:593 2023-12-11T17:16:02.797 INFO:teuthology.orchestra.run.smithi037.stdout:593.out 2023-12-11T17:16:02.797 INFO:teuthology.orchestra.run.smithi037.stdout:594 2023-12-11T17:16:02.797 INFO:teuthology.orchestra.run.smithi037.stdout:594.out 2023-12-11T17:16:02.797 INFO:teuthology.orchestra.run.smithi037.stdout:595 2023-12-11T17:16:02.797 INFO:teuthology.orchestra.run.smithi037.stdout:595.out 2023-12-11T17:16:02.798 INFO:teuthology.orchestra.run.smithi037.stdout:596 2023-12-11T17:16:02.798 INFO:teuthology.orchestra.run.smithi037.stdout:596.out 2023-12-11T17:16:02.798 INFO:teuthology.orchestra.run.smithi037.stdout:597 2023-12-11T17:16:02.798 INFO:teuthology.orchestra.run.smithi037.stdout:597.out 2023-12-11T17:16:02.798 INFO:teuthology.orchestra.run.smithi037.stdout:598 2023-12-11T17:16:02.798 INFO:teuthology.orchestra.run.smithi037.stdout:598.out 2023-12-11T17:16:02.798 INFO:teuthology.orchestra.run.smithi037.stdout:599 2023-12-11T17:16:02.798 INFO:teuthology.orchestra.run.smithi037.stdout:599.out 2023-12-11T17:16:02.798 INFO:teuthology.orchestra.run.smithi037.stdout:600 2023-12-11T17:16:02.798 INFO:teuthology.orchestra.run.smithi037.stdout:600.out 2023-12-11T17:16:02.798 INFO:teuthology.orchestra.run.smithi037.stdout:601 2023-12-11T17:16:02.798 INFO:teuthology.orchestra.run.smithi037.stdout:601.out 2023-12-11T17:16:02.798 INFO:teuthology.orchestra.run.smithi037.stdout:602 2023-12-11T17:16:02.798 INFO:teuthology.orchestra.run.smithi037.stdout:602.out 2023-12-11T17:16:02.799 INFO:teuthology.orchestra.run.smithi037.stdout:603 2023-12-11T17:16:02.799 INFO:teuthology.orchestra.run.smithi037.stdout:603.out 2023-12-11T17:16:02.799 INFO:teuthology.orchestra.run.smithi037.stdout:604 2023-12-11T17:16:02.799 INFO:teuthology.orchestra.run.smithi037.stdout:604.out 2023-12-11T17:16:02.799 INFO:teuthology.orchestra.run.smithi037.stdout:605 2023-12-11T17:16:02.799 INFO:teuthology.orchestra.run.smithi037.stdout:605.out 2023-12-11T17:16:02.799 INFO:teuthology.orchestra.run.smithi037.stdout:606 2023-12-11T17:16:02.799 INFO:teuthology.orchestra.run.smithi037.stdout:606.out 2023-12-11T17:16:02.799 INFO:teuthology.orchestra.run.smithi037.stdout:607 2023-12-11T17:16:02.799 INFO:teuthology.orchestra.run.smithi037.stdout:607.out 2023-12-11T17:16:02.799 INFO:teuthology.orchestra.run.smithi037.stdout:608 2023-12-11T17:16:02.799 INFO:teuthology.orchestra.run.smithi037.stdout:608.out 2023-12-11T17:16:02.799 INFO:teuthology.orchestra.run.smithi037.stdout:609 2023-12-11T17:16:02.799 INFO:teuthology.orchestra.run.smithi037.stdout:609.out 2023-12-11T17:16:02.800 INFO:teuthology.orchestra.run.smithi037.stdout:610 2023-12-11T17:16:02.800 INFO:teuthology.orchestra.run.smithi037.stdout:610.out 2023-12-11T17:16:02.800 INFO:teuthology.orchestra.run.smithi037.stdout:611 2023-12-11T17:16:02.800 INFO:teuthology.orchestra.run.smithi037.stdout:611.out 2023-12-11T17:16:02.800 INFO:teuthology.orchestra.run.smithi037.stdout:612 2023-12-11T17:16:02.800 INFO:teuthology.orchestra.run.smithi037.stdout:612.out 2023-12-11T17:16:02.800 INFO:teuthology.orchestra.run.smithi037.stdout:613 2023-12-11T17:16:02.800 INFO:teuthology.orchestra.run.smithi037.stdout:613.out 2023-12-11T17:16:02.800 INFO:teuthology.orchestra.run.smithi037.stdout:614 2023-12-11T17:16:02.800 INFO:teuthology.orchestra.run.smithi037.stdout:614.out 2023-12-11T17:16:02.800 INFO:teuthology.orchestra.run.smithi037.stdout:615 2023-12-11T17:16:02.800 INFO:teuthology.orchestra.run.smithi037.stdout:615.out 2023-12-11T17:16:02.800 INFO:teuthology.orchestra.run.smithi037.stdout:616 2023-12-11T17:16:02.800 INFO:teuthology.orchestra.run.smithi037.stdout:616.out 2023-12-11T17:16:02.800 INFO:teuthology.orchestra.run.smithi037.stdout:617 2023-12-11T17:16:02.801 INFO:teuthology.orchestra.run.smithi037.stdout:617.out 2023-12-11T17:16:02.801 INFO:teuthology.orchestra.run.smithi037.stdout:618 2023-12-11T17:16:02.801 INFO:teuthology.orchestra.run.smithi037.stdout:618.out 2023-12-11T17:16:02.801 INFO:teuthology.orchestra.run.smithi037.stdout:619 2023-12-11T17:16:02.801 INFO:teuthology.orchestra.run.smithi037.stdout:619.out 2023-12-11T17:16:02.801 INFO:teuthology.orchestra.run.smithi037.stdout:620 2023-12-11T17:16:02.801 INFO:teuthology.orchestra.run.smithi037.stdout:620.out 2023-12-11T17:16:02.801 INFO:teuthology.orchestra.run.smithi037.stdout:621 2023-12-11T17:16:02.801 INFO:teuthology.orchestra.run.smithi037.stdout:621.out 2023-12-11T17:16:02.801 INFO:teuthology.orchestra.run.smithi037.stdout:622 2023-12-11T17:16:02.801 INFO:teuthology.orchestra.run.smithi037.stdout:622.out 2023-12-11T17:16:02.801 INFO:teuthology.orchestra.run.smithi037.stdout:623 2023-12-11T17:16:02.801 INFO:teuthology.orchestra.run.smithi037.stdout:623.out 2023-12-11T17:16:02.801 INFO:teuthology.orchestra.run.smithi037.stdout:624 2023-12-11T17:16:02.801 INFO:teuthology.orchestra.run.smithi037.stdout:624.out 2023-12-11T17:16:02.802 INFO:teuthology.orchestra.run.smithi037.stdout:625 2023-12-11T17:16:02.802 INFO:teuthology.orchestra.run.smithi037.stdout:625.out 2023-12-11T17:16:02.802 INFO:teuthology.orchestra.run.smithi037.stdout:626 2023-12-11T17:16:02.802 INFO:teuthology.orchestra.run.smithi037.stdout:626.out 2023-12-11T17:16:02.802 INFO:teuthology.orchestra.run.smithi037.stdout:627 2023-12-11T17:16:02.802 INFO:teuthology.orchestra.run.smithi037.stdout:627.out 2023-12-11T17:16:02.802 INFO:teuthology.orchestra.run.smithi037.stdout:628 2023-12-11T17:16:02.802 INFO:teuthology.orchestra.run.smithi037.stdout:628.out 2023-12-11T17:16:02.802 INFO:teuthology.orchestra.run.smithi037.stdout:629 2023-12-11T17:16:02.802 INFO:teuthology.orchestra.run.smithi037.stdout:629.out 2023-12-11T17:16:02.802 INFO:teuthology.orchestra.run.smithi037.stdout:630 2023-12-11T17:16:02.802 INFO:teuthology.orchestra.run.smithi037.stdout:630.out 2023-12-11T17:16:02.802 INFO:teuthology.orchestra.run.smithi037.stdout:631 2023-12-11T17:16:02.803 INFO:teuthology.orchestra.run.smithi037.stdout:631.out 2023-12-11T17:16:02.803 INFO:teuthology.orchestra.run.smithi037.stdout:632 2023-12-11T17:16:02.803 INFO:teuthology.orchestra.run.smithi037.stdout:632.out 2023-12-11T17:16:02.803 INFO:teuthology.orchestra.run.smithi037.stdout:633 2023-12-11T17:16:02.803 INFO:teuthology.orchestra.run.smithi037.stdout:633.out 2023-12-11T17:16:02.803 INFO:teuthology.orchestra.run.smithi037.stdout:634 2023-12-11T17:16:02.803 INFO:teuthology.orchestra.run.smithi037.stdout:634.out 2023-12-11T17:16:02.803 INFO:teuthology.orchestra.run.smithi037.stdout:635 2023-12-11T17:16:02.803 INFO:teuthology.orchestra.run.smithi037.stdout:635.out 2023-12-11T17:16:02.803 INFO:teuthology.orchestra.run.smithi037.stdout:636 2023-12-11T17:16:02.803 INFO:teuthology.orchestra.run.smithi037.stdout:636.out 2023-12-11T17:16:02.803 INFO:teuthology.orchestra.run.smithi037.stdout:637 2023-12-11T17:16:02.803 INFO:teuthology.orchestra.run.smithi037.stdout:637.out 2023-12-11T17:16:02.803 INFO:teuthology.orchestra.run.smithi037.stdout:638 2023-12-11T17:16:02.804 INFO:teuthology.orchestra.run.smithi037.stdout:638.out 2023-12-11T17:16:02.804 INFO:teuthology.orchestra.run.smithi037.stdout:639 2023-12-11T17:16:02.804 INFO:teuthology.orchestra.run.smithi037.stdout:639.out 2023-12-11T17:16:02.804 INFO:teuthology.orchestra.run.smithi037.stdout:640 2023-12-11T17:16:02.804 INFO:teuthology.orchestra.run.smithi037.stdout:640.out 2023-12-11T17:16:02.804 INFO:teuthology.orchestra.run.smithi037.stdout:641 2023-12-11T17:16:02.804 INFO:teuthology.orchestra.run.smithi037.stdout:641.out 2023-12-11T17:16:02.804 INFO:teuthology.orchestra.run.smithi037.stdout:642 2023-12-11T17:16:02.804 INFO:teuthology.orchestra.run.smithi037.stdout:642.out 2023-12-11T17:16:02.804 INFO:teuthology.orchestra.run.smithi037.stdout:643 2023-12-11T17:16:02.804 INFO:teuthology.orchestra.run.smithi037.stdout:643.out 2023-12-11T17:16:02.804 INFO:teuthology.orchestra.run.smithi037.stdout:644 2023-12-11T17:16:02.805 INFO:teuthology.orchestra.run.smithi037.stdout:644.out 2023-12-11T17:16:02.805 INFO:teuthology.orchestra.run.smithi037.stdout:645 2023-12-11T17:16:02.805 INFO:teuthology.orchestra.run.smithi037.stdout:645.out 2023-12-11T17:16:02.805 INFO:teuthology.orchestra.run.smithi037.stdout:646 2023-12-11T17:16:02.805 INFO:teuthology.orchestra.run.smithi037.stdout:646.out 2023-12-11T17:16:02.805 INFO:teuthology.orchestra.run.smithi037.stdout:647 2023-12-11T17:16:02.805 INFO:teuthology.orchestra.run.smithi037.stdout:647.out 2023-12-11T17:16:02.805 INFO:teuthology.orchestra.run.smithi037.stdout:648 2023-12-11T17:16:02.805 INFO:teuthology.orchestra.run.smithi037.stdout:648.out 2023-12-11T17:16:02.805 INFO:teuthology.orchestra.run.smithi037.stdout:649 2023-12-11T17:16:02.805 INFO:teuthology.orchestra.run.smithi037.stdout:649.out 2023-12-11T17:16:02.805 INFO:teuthology.orchestra.run.smithi037.stdout:650 2023-12-11T17:16:02.805 INFO:teuthology.orchestra.run.smithi037.stdout:650.out 2023-12-11T17:16:02.806 INFO:teuthology.orchestra.run.smithi037.stdout:651 2023-12-11T17:16:02.806 INFO:teuthology.orchestra.run.smithi037.stdout:651.out 2023-12-11T17:16:02.806 INFO:teuthology.orchestra.run.smithi037.stdout:652 2023-12-11T17:16:02.806 INFO:teuthology.orchestra.run.smithi037.stdout:652.out 2023-12-11T17:16:02.806 INFO:teuthology.orchestra.run.smithi037.stdout:653 2023-12-11T17:16:02.806 INFO:teuthology.orchestra.run.smithi037.stdout:653.out 2023-12-11T17:16:02.806 INFO:teuthology.orchestra.run.smithi037.stdout:654 2023-12-11T17:16:02.806 INFO:teuthology.orchestra.run.smithi037.stdout:654.out 2023-12-11T17:16:02.806 INFO:teuthology.orchestra.run.smithi037.stdout:655 2023-12-11T17:16:02.806 INFO:teuthology.orchestra.run.smithi037.stdout:655.out 2023-12-11T17:16:02.806 INFO:teuthology.orchestra.run.smithi037.stdout:656 2023-12-11T17:16:02.806 INFO:teuthology.orchestra.run.smithi037.stdout:656.out 2023-12-11T17:16:02.806 INFO:teuthology.orchestra.run.smithi037.stdout:657 2023-12-11T17:16:02.806 INFO:teuthology.orchestra.run.smithi037.stdout:657.out 2023-12-11T17:16:02.807 INFO:teuthology.orchestra.run.smithi037.stdout:658 2023-12-11T17:16:02.807 INFO:teuthology.orchestra.run.smithi037.stdout:658.out 2023-12-11T17:16:02.807 INFO:teuthology.orchestra.run.smithi037.stdout:659 2023-12-11T17:16:02.807 INFO:teuthology.orchestra.run.smithi037.stdout:659.out 2023-12-11T17:16:02.807 INFO:teuthology.orchestra.run.smithi037.stdout:660 2023-12-11T17:16:02.807 INFO:teuthology.orchestra.run.smithi037.stdout:660.out 2023-12-11T17:16:02.807 INFO:teuthology.orchestra.run.smithi037.stdout:661 2023-12-11T17:16:02.807 INFO:teuthology.orchestra.run.smithi037.stdout:661.out 2023-12-11T17:16:02.807 INFO:teuthology.orchestra.run.smithi037.stdout:662 2023-12-11T17:16:02.807 INFO:teuthology.orchestra.run.smithi037.stdout:662.out 2023-12-11T17:16:02.807 INFO:teuthology.orchestra.run.smithi037.stdout:663 2023-12-11T17:16:02.807 INFO:teuthology.orchestra.run.smithi037.stdout:663.out 2023-12-11T17:16:02.807 INFO:teuthology.orchestra.run.smithi037.stdout:664 2023-12-11T17:16:02.807 INFO:teuthology.orchestra.run.smithi037.stdout:664.out 2023-12-11T17:16:02.807 INFO:teuthology.orchestra.run.smithi037.stdout:665 2023-12-11T17:16:02.808 INFO:teuthology.orchestra.run.smithi037.stdout:665.out 2023-12-11T17:16:02.808 INFO:teuthology.orchestra.run.smithi037.stdout:666 2023-12-11T17:16:02.808 INFO:teuthology.orchestra.run.smithi037.stdout:666.out 2023-12-11T17:16:02.808 INFO:teuthology.orchestra.run.smithi037.stdout:667 2023-12-11T17:16:02.808 INFO:teuthology.orchestra.run.smithi037.stdout:667.out 2023-12-11T17:16:02.808 INFO:teuthology.orchestra.run.smithi037.stdout:668 2023-12-11T17:16:02.808 INFO:teuthology.orchestra.run.smithi037.stdout:668.out 2023-12-11T17:16:02.808 INFO:teuthology.orchestra.run.smithi037.stdout:669 2023-12-11T17:16:02.808 INFO:teuthology.orchestra.run.smithi037.stdout:669.out 2023-12-11T17:16:02.808 INFO:teuthology.orchestra.run.smithi037.stdout:670 2023-12-11T17:16:02.808 INFO:teuthology.orchestra.run.smithi037.stdout:670.out 2023-12-11T17:16:02.808 INFO:teuthology.orchestra.run.smithi037.stdout:671 2023-12-11T17:16:02.808 INFO:teuthology.orchestra.run.smithi037.stdout:671.out 2023-12-11T17:16:02.808 INFO:teuthology.orchestra.run.smithi037.stdout:672 2023-12-11T17:16:02.809 INFO:teuthology.orchestra.run.smithi037.stdout:672.out 2023-12-11T17:16:02.809 INFO:teuthology.orchestra.run.smithi037.stdout:673 2023-12-11T17:16:02.809 INFO:teuthology.orchestra.run.smithi037.stdout:673.out 2023-12-11T17:16:02.809 INFO:teuthology.orchestra.run.smithi037.stdout:674 2023-12-11T17:16:02.809 INFO:teuthology.orchestra.run.smithi037.stdout:674.out 2023-12-11T17:16:02.809 INFO:teuthology.orchestra.run.smithi037.stdout:675 2023-12-11T17:16:02.809 INFO:teuthology.orchestra.run.smithi037.stdout:675.out 2023-12-11T17:16:02.809 INFO:teuthology.orchestra.run.smithi037.stdout:676 2023-12-11T17:16:02.809 INFO:teuthology.orchestra.run.smithi037.stdout:676.out 2023-12-11T17:16:02.809 INFO:teuthology.orchestra.run.smithi037.stdout:677 2023-12-11T17:16:02.809 INFO:teuthology.orchestra.run.smithi037.stdout:677.out 2023-12-11T17:16:02.809 INFO:teuthology.orchestra.run.smithi037.stdout:678 2023-12-11T17:16:02.810 INFO:teuthology.orchestra.run.smithi037.stdout:678.out 2023-12-11T17:16:02.810 INFO:teuthology.orchestra.run.smithi037.stdout:679 2023-12-11T17:16:02.810 INFO:teuthology.orchestra.run.smithi037.stdout:679.out 2023-12-11T17:16:02.810 INFO:teuthology.orchestra.run.smithi037.stdout:680 2023-12-11T17:16:02.810 INFO:teuthology.orchestra.run.smithi037.stdout:680.out 2023-12-11T17:16:02.810 INFO:teuthology.orchestra.run.smithi037.stdout:681 2023-12-11T17:16:02.810 INFO:teuthology.orchestra.run.smithi037.stdout:681.out 2023-12-11T17:16:02.810 INFO:teuthology.orchestra.run.smithi037.stdout:682 2023-12-11T17:16:02.810 INFO:teuthology.orchestra.run.smithi037.stdout:682.out 2023-12-11T17:16:02.810 INFO:teuthology.orchestra.run.smithi037.stdout:683 2023-12-11T17:16:02.810 INFO:teuthology.orchestra.run.smithi037.stdout:683.out 2023-12-11T17:16:02.811 INFO:teuthology.orchestra.run.smithi037.stdout:684 2023-12-11T17:16:02.811 INFO:teuthology.orchestra.run.smithi037.stdout:684.out 2023-12-11T17:16:02.811 INFO:teuthology.orchestra.run.smithi037.stdout:685 2023-12-11T17:16:02.811 INFO:teuthology.orchestra.run.smithi037.stdout:685.out 2023-12-11T17:16:02.811 INFO:teuthology.orchestra.run.smithi037.stdout:686 2023-12-11T17:16:02.811 INFO:teuthology.orchestra.run.smithi037.stdout:686.out 2023-12-11T17:16:02.811 INFO:teuthology.orchestra.run.smithi037.stdout:687 2023-12-11T17:16:02.811 INFO:teuthology.orchestra.run.smithi037.stdout:687.out 2023-12-11T17:16:02.811 INFO:teuthology.orchestra.run.smithi037.stdout:688 2023-12-11T17:16:02.811 INFO:teuthology.orchestra.run.smithi037.stdout:688.out 2023-12-11T17:16:02.811 INFO:teuthology.orchestra.run.smithi037.stdout:689 2023-12-11T17:16:02.811 INFO:teuthology.orchestra.run.smithi037.stdout:689.out 2023-12-11T17:16:02.811 INFO:teuthology.orchestra.run.smithi037.stdout:690 2023-12-11T17:16:02.812 INFO:teuthology.orchestra.run.smithi037.stdout:690.out 2023-12-11T17:16:02.812 INFO:teuthology.orchestra.run.smithi037.stdout:691 2023-12-11T17:16:02.812 INFO:teuthology.orchestra.run.smithi037.stdout:691.out 2023-12-11T17:16:02.812 INFO:teuthology.orchestra.run.smithi037.stdout:692 2023-12-11T17:16:02.812 INFO:teuthology.orchestra.run.smithi037.stdout:692.out 2023-12-11T17:16:02.812 INFO:teuthology.orchestra.run.smithi037.stdout:693 2023-12-11T17:16:02.812 INFO:teuthology.orchestra.run.smithi037.stdout:693.out 2023-12-11T17:16:02.812 INFO:teuthology.orchestra.run.smithi037.stdout:694 2023-12-11T17:16:02.812 INFO:teuthology.orchestra.run.smithi037.stdout:694.out 2023-12-11T17:16:02.812 INFO:teuthology.orchestra.run.smithi037.stdout:695 2023-12-11T17:16:02.812 INFO:teuthology.orchestra.run.smithi037.stdout:695.out 2023-12-11T17:16:02.812 INFO:teuthology.orchestra.run.smithi037.stdout:696 2023-12-11T17:16:02.812 INFO:teuthology.orchestra.run.smithi037.stdout:696.out 2023-12-11T17:16:02.812 INFO:teuthology.orchestra.run.smithi037.stdout:697 2023-12-11T17:16:02.812 INFO:teuthology.orchestra.run.smithi037.stdout:697.out 2023-12-11T17:16:02.812 INFO:teuthology.orchestra.run.smithi037.stdout:698 2023-12-11T17:16:02.813 INFO:teuthology.orchestra.run.smithi037.stdout:698.out 2023-12-11T17:16:02.813 INFO:teuthology.orchestra.run.smithi037.stdout:699 2023-12-11T17:16:02.813 INFO:teuthology.orchestra.run.smithi037.stdout:699.out 2023-12-11T17:16:02.813 INFO:teuthology.orchestra.run.smithi037.stdout:700 2023-12-11T17:16:02.813 INFO:teuthology.orchestra.run.smithi037.stdout:700.out 2023-12-11T17:16:02.813 INFO:teuthology.orchestra.run.smithi037.stdout:701 2023-12-11T17:16:02.813 INFO:teuthology.orchestra.run.smithi037.stdout:701.out 2023-12-11T17:16:02.813 INFO:teuthology.orchestra.run.smithi037.stdout:702 2023-12-11T17:16:02.813 INFO:teuthology.orchestra.run.smithi037.stdout:702.out 2023-12-11T17:16:02.813 INFO:teuthology.orchestra.run.smithi037.stdout:703 2023-12-11T17:16:02.813 INFO:teuthology.orchestra.run.smithi037.stdout:703.out 2023-12-11T17:16:02.813 INFO:teuthology.orchestra.run.smithi037.stdout:704 2023-12-11T17:16:02.813 INFO:teuthology.orchestra.run.smithi037.stdout:704.out 2023-12-11T17:16:02.813 INFO:teuthology.orchestra.run.smithi037.stdout:705 2023-12-11T17:16:02.813 INFO:teuthology.orchestra.run.smithi037.stdout:705.out 2023-12-11T17:16:02.814 INFO:teuthology.orchestra.run.smithi037.stdout:706 2023-12-11T17:16:02.814 INFO:teuthology.orchestra.run.smithi037.stdout:706.out 2023-12-11T17:16:02.814 INFO:teuthology.orchestra.run.smithi037.stdout:707 2023-12-11T17:16:02.814 INFO:teuthology.orchestra.run.smithi037.stdout:707.out 2023-12-11T17:16:02.814 INFO:teuthology.orchestra.run.smithi037.stdout:708 2023-12-11T17:16:02.814 INFO:teuthology.orchestra.run.smithi037.stdout:708.out 2023-12-11T17:16:02.814 INFO:teuthology.orchestra.run.smithi037.stdout:709 2023-12-11T17:16:02.814 INFO:teuthology.orchestra.run.smithi037.stdout:709.out 2023-12-11T17:16:02.814 INFO:teuthology.orchestra.run.smithi037.stdout:710 2023-12-11T17:16:02.814 INFO:teuthology.orchestra.run.smithi037.stdout:710.out 2023-12-11T17:16:02.814 INFO:teuthology.orchestra.run.smithi037.stdout:711 2023-12-11T17:16:02.814 INFO:teuthology.orchestra.run.smithi037.stdout:711.out 2023-12-11T17:16:02.814 INFO:teuthology.orchestra.run.smithi037.stdout:712 2023-12-11T17:16:02.814 INFO:teuthology.orchestra.run.smithi037.stdout:712.out 2023-12-11T17:16:02.814 INFO:teuthology.orchestra.run.smithi037.stdout:713 2023-12-11T17:16:02.815 INFO:teuthology.orchestra.run.smithi037.stdout:713.out 2023-12-11T17:16:02.815 INFO:teuthology.orchestra.run.smithi037.stdout:714 2023-12-11T17:16:02.815 INFO:teuthology.orchestra.run.smithi037.stdout:714.out 2023-12-11T17:16:02.815 INFO:teuthology.orchestra.run.smithi037.stdout:715 2023-12-11T17:16:02.815 INFO:teuthology.orchestra.run.smithi037.stdout:715.out 2023-12-11T17:16:02.815 INFO:teuthology.orchestra.run.smithi037.stdout:716 2023-12-11T17:16:02.815 INFO:teuthology.orchestra.run.smithi037.stdout:716.out 2023-12-11T17:16:02.815 INFO:teuthology.orchestra.run.smithi037.stdout:717 2023-12-11T17:16:02.815 INFO:teuthology.orchestra.run.smithi037.stdout:717.out 2023-12-11T17:16:02.815 INFO:teuthology.orchestra.run.smithi037.stdout:718 2023-12-11T17:16:02.815 INFO:teuthology.orchestra.run.smithi037.stdout:718.out 2023-12-11T17:16:02.815 INFO:teuthology.orchestra.run.smithi037.stdout:719 2023-12-11T17:16:02.815 INFO:teuthology.orchestra.run.smithi037.stdout:719.out 2023-12-11T17:16:02.815 INFO:teuthology.orchestra.run.smithi037.stdout:720 2023-12-11T17:16:02.815 INFO:teuthology.orchestra.run.smithi037.stdout:720.out 2023-12-11T17:16:02.816 INFO:teuthology.orchestra.run.smithi037.stdout:721 2023-12-11T17:16:02.816 INFO:teuthology.orchestra.run.smithi037.stdout:721.out 2023-12-11T17:16:02.816 INFO:teuthology.orchestra.run.smithi037.stdout:722 2023-12-11T17:16:02.816 INFO:teuthology.orchestra.run.smithi037.stdout:722.out 2023-12-11T17:16:02.816 INFO:teuthology.orchestra.run.smithi037.stdout:723 2023-12-11T17:16:02.816 INFO:teuthology.orchestra.run.smithi037.stdout:723.out 2023-12-11T17:16:02.816 INFO:teuthology.orchestra.run.smithi037.stdout:724 2023-12-11T17:16:02.816 INFO:teuthology.orchestra.run.smithi037.stdout:724.out 2023-12-11T17:16:02.816 INFO:teuthology.orchestra.run.smithi037.stdout:725 2023-12-11T17:16:02.816 INFO:teuthology.orchestra.run.smithi037.stdout:725.out 2023-12-11T17:16:02.816 INFO:teuthology.orchestra.run.smithi037.stdout:726 2023-12-11T17:16:02.816 INFO:teuthology.orchestra.run.smithi037.stdout:726.out 2023-12-11T17:16:02.816 INFO:teuthology.orchestra.run.smithi037.stdout:727 2023-12-11T17:16:02.816 INFO:teuthology.orchestra.run.smithi037.stdout:727.out 2023-12-11T17:16:02.816 INFO:teuthology.orchestra.run.smithi037.stdout:728 2023-12-11T17:16:02.817 INFO:teuthology.orchestra.run.smithi037.stdout:728.out 2023-12-11T17:16:02.817 INFO:teuthology.orchestra.run.smithi037.stdout:729 2023-12-11T17:16:02.817 INFO:teuthology.orchestra.run.smithi037.stdout:729.out 2023-12-11T17:16:02.817 INFO:teuthology.orchestra.run.smithi037.stdout:730 2023-12-11T17:16:02.817 INFO:teuthology.orchestra.run.smithi037.stdout:730.out 2023-12-11T17:16:02.817 INFO:teuthology.orchestra.run.smithi037.stdout:731 2023-12-11T17:16:02.817 INFO:teuthology.orchestra.run.smithi037.stdout:731.out 2023-12-11T17:16:02.817 INFO:teuthology.orchestra.run.smithi037.stdout:732 2023-12-11T17:16:02.817 INFO:teuthology.orchestra.run.smithi037.stdout:732.out 2023-12-11T17:16:02.817 INFO:teuthology.orchestra.run.smithi037.stdout:733 2023-12-11T17:16:02.817 INFO:teuthology.orchestra.run.smithi037.stdout:733.out 2023-12-11T17:16:02.817 INFO:teuthology.orchestra.run.smithi037.stdout:group.list 2023-12-11T17:16:02.817 INFO:teuthology.orchestra.run.smithi037.stdout:Makefile 2023-12-11T17:16:02.819 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/001) 2023-12-11T17:16:03.481 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:16:03.495 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:16:03.497 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:16:03.500 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:16:03.500 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:16:11.746 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:16:11.760 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:16:14.036 INFO:teuthology.orchestra.run.smithi037.stdout:generic/001 11s 2023-12-11T17:16:14.054 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/001 2023-12-11T17:16:14.054 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:16:14.063 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:16:14.397 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:16:14.397 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/002) 2023-12-11T17:16:14.931 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:16:14.946 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:16:14.947 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:16:14.951 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:16:14.951 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:16:16.144 INFO:teuthology.orchestra.run.smithi037.stdout:generic/002 1s 2023-12-11T17:16:16.162 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/002 2023-12-11T17:16:16.162 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:16:16.169 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:16:16.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:16:16.233 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/003) 2023-12-11T17:16:16.795 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:16:16.810 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:16:16.812 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:16:16.816 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:16:16.816 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:16:17.469 INFO:teuthology.orchestra.run.smithi037.stdout:generic/003 [not run] atime not maintained by ceph 2023-12-11T17:16:17.480 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/003 2023-12-11T17:16:17.480 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/003 2023-12-11T17:16:17.480 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:16:17.488 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:16:17.521 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:16:17.521 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/004) 2023-12-11T17:16:18.109 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:16:18.124 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:16:18.125 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:16:18.128 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:16:18.128 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:16:18.817 INFO:teuthology.orchestra.run.smithi037.stdout:generic/004 [not run] O_TMPFILE is not supported 2023-12-11T17:16:18.835 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/004 2023-12-11T17:16:18.835 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/004 2023-12-11T17:16:18.835 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:16:18.847 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:16:18.890 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:16:18.891 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/005) 2023-12-11T17:16:19.498 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:16:19.512 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:16:19.514 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:16:19.518 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:16:19.518 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:16:20.651 INFO:teuthology.orchestra.run.smithi037.stdout:generic/005 1s 2023-12-11T17:16:20.668 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/005 2023-12-11T17:16:20.668 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:16:20.677 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:16:20.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:16:20.741 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/006) 2023-12-11T17:16:21.251 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:16:21.263 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:16:21.265 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:16:21.267 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:16:21.268 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:16:41.928 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:16:41.940 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:17:04.537 INFO:teuthology.orchestra.run.smithi037.stdout:generic/006 43s 2023-12-11T17:17:04.550 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/006 2023-12-11T17:17:04.550 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:17:04.557 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:17:04.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:17:04.794 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/007) 2023-12-11T17:17:05.388 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:17:05.401 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:17:05.402 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:17:05.405 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:17:05.405 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:17:12.085 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:17:12.093 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:17:42.230 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:17:42.238 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:18:12.538 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:18:12.549 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:18:32.539 INFO:teuthology.orchestra.run.smithi037.stdout:generic/007 87s 2023-12-11T17:18:32.564 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/007 2023-12-11T17:18:32.564 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:18:32.570 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:18:32.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:18:32.671 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/008) 2023-12-11T17:18:33.200 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:18:33.212 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:18:33.213 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:18:33.216 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:18:33.216 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:18:34.109 INFO:teuthology.orchestra.run.smithi037.stdout:generic/008 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-11T17:18:34.121 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/008 2023-12-11T17:18:34.121 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/008 2023-12-11T17:18:34.122 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:18:34.130 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:18:34.177 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:18:34.178 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/009) 2023-12-11T17:18:34.800 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:18:34.814 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:18:34.816 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:18:34.823 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:18:34.823 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:18:35.676 INFO:teuthology.orchestra.run.smithi037.stdout:generic/009 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-11T17:18:35.689 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/009 2023-12-11T17:18:35.689 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/009 2023-12-11T17:18:35.689 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:18:35.698 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:18:35.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:18:35.743 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/010) 2023-12-11T17:18:36.380 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:18:36.395 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:18:36.397 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:18:36.400 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:18:36.401 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:18:37.627 INFO:teuthology.orchestra.run.smithi037.stdout:generic/010 1s 2023-12-11T17:18:37.644 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/010 2023-12-11T17:18:37.644 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:18:37.652 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:18:37.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:18:37.741 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/011) 2023-12-11T17:18:38.277 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:18:38.292 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:18:38.294 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:18:38.298 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:18:38.298 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:18:43.462 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:18:43.469 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:19:13.607 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:19:13.617 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:19:27.596 INFO:teuthology.orchestra.run.smithi037.stdout:generic/011 49s 2023-12-11T17:19:27.618 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/011 2023-12-11T17:19:27.618 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:19:27.631 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:19:27.709 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:19:27.709 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/012) 2023-12-11T17:19:28.243 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:19:28.256 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:19:28.257 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:19:28.261 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:19:28.261 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:19:29.169 INFO:teuthology.orchestra.run.smithi037.stdout:generic/012 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T17:19:29.182 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/012 2023-12-11T17:19:29.182 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/012 2023-12-11T17:19:29.182 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:19:29.191 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:19:29.282 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:19:29.283 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/013) 2023-12-11T17:19:29.814 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:19:29.826 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:19:29.828 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:19:29.831 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:19:29.831 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:19:43.749 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:19:43.772 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:20:13.966 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:20:13.977 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:20:42.637 INFO:teuthology.orchestra.run.smithi037.stdout:generic/013 72s 2023-12-11T17:20:43.724 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/013 2023-12-11T17:20:43.725 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:20:43.734 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:20:43.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:20:43.800 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/014) 2023-12-11T17:20:44.468 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:20:44.483 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:20:44.486 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:20:44.489 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:20:44.489 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:20:44.618 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:20:44.626 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:21:15.400 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:21:15.409 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:21:47.721 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:21:47.731 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:22:18.675 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:22:18.683 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:22:50.255 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:22:50.262 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:23:20.411 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:23:20.417 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:23:50.578 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:23:50.590 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:24:20.957 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:24:20.962 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:24:51.115 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:24:51.122 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:25:21.277 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:25:21.288 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:25:27.342 INFO:teuthology.orchestra.run.smithi037.stdout:generic/014 283s 2023-12-11T17:25:27.365 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/014 2023-12-11T17:25:27.365 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:25:27.376 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:27.429 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:25:27.429 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/015) 2023-12-11T17:25:28.046 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:25:28.062 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:25:28.064 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:25:28.068 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:25:28.068 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:28.711 INFO:teuthology.orchestra.run.smithi037.stdout:generic/015 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-11T17:25:28.725 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/015 2023-12-11T17:25:28.725 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/015 2023-12-11T17:25:28.726 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:25:28.736 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:28.774 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:25:28.775 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/016) 2023-12-11T17:25:29.389 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:25:29.402 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:25:29.404 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:25:29.409 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:25:29.409 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:30.276 INFO:teuthology.orchestra.run.smithi037.stdout:generic/016 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T17:25:30.287 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/016 2023-12-11T17:25:30.288 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/016 2023-12-11T17:25:30.288 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:25:30.296 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:30.403 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:25:30.403 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/017) 2023-12-11T17:25:31.112 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:25:31.126 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:25:31.128 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:25:31.131 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:25:31.131 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:31.777 INFO:teuthology.orchestra.run.smithi037.stdout:generic/017 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-11T17:25:31.791 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/017 2023-12-11T17:25:31.791 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/017 2023-12-11T17:25:31.792 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:25:31.804 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:31.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:25:31.850 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/018) 2023-12-11T17:25:32.478 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:25:32.493 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:25:32.495 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:25:32.500 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:25:32.500 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:33.296 INFO:teuthology.orchestra.run.smithi037.stdout:generic/018 [not run] defragmentation not supported for fstype "ceph" 2023-12-11T17:25:33.321 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/018 2023-12-11T17:25:33.321 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/018 2023-12-11T17:25:33.321 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:25:33.331 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:33.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:25:33.368 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/019) 2023-12-11T17:25:33.986 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:25:33.999 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:25:34.000 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:25:34.004 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:25:34.004 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:34.624 INFO:teuthology.orchestra.run.smithi037.stdout:generic/019 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T17:25:34.637 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/019 2023-12-11T17:25:34.637 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/019 2023-12-11T17:25:34.638 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:25:34.647 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:34.685 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:25:34.685 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/020) 2023-12-11T17:25:35.306 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:25:35.320 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:25:35.321 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:25:35.324 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:25:35.324 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:47.030 INFO:teuthology.orchestra.run.smithi037.stdout:generic/020 12s 2023-12-11T17:25:47.049 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/020 2023-12-11T17:25:47.049 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:25:47.057 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:47.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:25:47.161 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/021) 2023-12-11T17:25:47.889 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:25:47.902 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:25:47.904 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:25:47.907 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:25:47.907 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:48.784 INFO:teuthology.orchestra.run.smithi037.stdout:generic/021 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T17:25:48.796 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/021 2023-12-11T17:25:48.796 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/021 2023-12-11T17:25:48.796 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:25:48.805 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:48.893 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:25:48.893 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/022) 2023-12-11T17:25:49.618 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:25:49.633 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:25:49.635 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:25:49.638 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:25:49.638 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:50.513 INFO:teuthology.orchestra.run.smithi037.stdout:generic/022 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T17:25:50.525 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/022 2023-12-11T17:25:50.525 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/022 2023-12-11T17:25:50.525 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:25:50.534 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:50.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:25:50.634 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/023) 2023-12-11T17:25:51.359 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:25:51.374 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:25:51.376 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:25:51.379 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:25:51.379 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:51.441 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:25:51.447 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:25:53.702 INFO:teuthology.orchestra.run.smithi037.stdout:generic/023 2s 2023-12-11T17:25:53.723 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/023 2023-12-11T17:25:53.723 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:25:53.734 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:53.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:25:53.866 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/024) 2023-12-11T17:25:54.607 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:25:54.621 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:25:54.622 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:25:54.625 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:25:54.625 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:55.319 INFO:teuthology.orchestra.run.smithi037.stdout:generic/024 [not run] kernel doesn't support renameat2 syscall 2023-12-11T17:25:55.333 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/024 2023-12-11T17:25:55.333 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/024 2023-12-11T17:25:55.333 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:25:55.343 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:55.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:25:55.432 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/025) 2023-12-11T17:25:56.149 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:25:56.164 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:25:56.165 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:25:56.170 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:25:56.170 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:56.844 INFO:teuthology.orchestra.run.smithi037.stdout:generic/025 [not run] kernel doesn't support renameat2 syscall 2023-12-11T17:25:56.856 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/025 2023-12-11T17:25:56.857 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/025 2023-12-11T17:25:56.857 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:25:56.865 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:56.970 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:25:56.971 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/026) 2023-12-11T17:25:57.672 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:25:57.687 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:25:57.688 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:25:57.691 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:25:57.691 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:58.431 INFO:teuthology.orchestra.run.smithi037.stdout:generic/026 [not run] ceph does not define maximum ACL count 2023-12-11T17:25:58.443 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/026 2023-12-11T17:25:58.443 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/026 2023-12-11T17:25:58.444 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:25:58.454 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:58.509 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:25:58.509 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/027) 2023-12-11T17:25:59.137 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:25:59.151 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:25:59.153 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:25:59.156 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:25:59.156 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:59.795 INFO:teuthology.orchestra.run.smithi037.stdout:generic/027 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-11T17:25:59.810 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/027 2023-12-11T17:25:59.810 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/027 2023-12-11T17:25:59.810 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:25:59.821 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:25:59.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:25:59.859 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/028) 2023-12-11T17:26:00.477 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:26:00.489 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:26:00.491 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:26:00.498 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:26:00.499 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:06.186 INFO:teuthology.orchestra.run.smithi037.stdout:generic/028 6s 2023-12-11T17:26:06.203 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/028 2023-12-11T17:26:06.203 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:26:06.210 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:06.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:26:06.256 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/029) 2023-12-11T17:26:06.924 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:26:06.935 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:26:06.937 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:26:06.940 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:26:06.940 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:12.343 INFO:teuthology.orchestra.run.smithi037.stdout:generic/029 5s 2023-12-11T17:26:12.362 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/029 2023-12-11T17:26:12.362 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:26:12.370 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:12.400 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:26:12.400 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/030) 2023-12-11T17:26:13.015 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:26:13.031 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:26:13.033 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:26:13.036 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:26:13.036 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:15.485 INFO:teuthology.orchestra.run.smithi037.stdout:generic/030 2s 2023-12-11T17:26:15.505 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/030 2023-12-11T17:26:15.506 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:26:15.515 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:15.541 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:26:15.541 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/031) 2023-12-11T17:26:16.152 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:26:16.168 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:26:16.169 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:26:16.173 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:26:16.173 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:16.983 INFO:teuthology.orchestra.run.smithi037.stdout:generic/031 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-12-11T17:26:16.998 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/031 2023-12-11T17:26:16.998 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/031 2023-12-11T17:26:16.998 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:26:17.005 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:17.056 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:26:17.056 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/032) 2023-12-11T17:26:17.676 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:26:17.692 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:26:17.694 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:26:17.697 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:26:17.697 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:18.377 INFO:teuthology.orchestra.run.smithi037.stdout:generic/032 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T17:26:18.391 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/032 2023-12-11T17:26:18.391 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/032 2023-12-11T17:26:18.391 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:26:18.399 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:18.444 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:26:18.444 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/033) 2023-12-11T17:26:19.070 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:26:19.087 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:26:19.088 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:26:19.091 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:26:19.091 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:19.907 INFO:teuthology.orchestra.run.smithi037.stdout:generic/033 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-11T17:26:19.927 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/033 2023-12-11T17:26:19.927 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/033 2023-12-11T17:26:19.927 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:26:19.937 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:20.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:26:20.000 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/034) 2023-12-11T17:26:20.625 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:26:20.644 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:26:20.646 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:26:20.650 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:26:20.650 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:21.344 INFO:teuthology.orchestra.run.smithi037.stdout:generic/034 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T17:26:21.357 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/034 2023-12-11T17:26:21.357 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/034 2023-12-11T17:26:21.357 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:26:21.364 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:21.408 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:26:21.409 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/035) 2023-12-11T17:26:21.578 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:26:21.585 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:26:22.050 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:26:22.066 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:26:22.068 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:26:22.072 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:26:22.072 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:22.875 INFO:teuthology.orchestra.run.smithi037.stdout:generic/035 0s 2023-12-11T17:26:22.897 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/035 2023-12-11T17:26:22.897 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:26:22.905 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:23.024 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:26:23.024 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/036) 2023-12-11T17:26:23.735 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:26:23.748 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:26:23.749 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:26:23.752 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:26:23.752 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:34.586 INFO:teuthology.orchestra.run.smithi037.stdout:generic/036 11s 2023-12-11T17:26:34.604 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/036 2023-12-11T17:26:34.604 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:26:34.613 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:34.716 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:26:34.717 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/037) 2023-12-11T17:26:35.465 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:26:35.483 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:26:35.485 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:26:35.488 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:26:35.488 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:48.645 INFO:teuthology.orchestra.run.smithi037.stdout:generic/037 13s 2023-12-11T17:26:48.665 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/037 2023-12-11T17:26:48.665 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:26:48.672 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:48.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:26:48.702 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/038) 2023-12-11T17:26:49.330 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:26:49.344 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:26:49.345 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:26:49.348 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:26:49.348 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:50.007 INFO:teuthology.orchestra.run.smithi037.stdout:generic/038 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T17:26:50.020 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/038 2023-12-11T17:26:50.020 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/038 2023-12-11T17:26:50.020 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:26:50.029 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:50.079 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:26:50.079 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/039) 2023-12-11T17:26:50.694 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:26:50.710 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:26:50.711 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:26:50.715 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:26:50.715 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:51.420 INFO:teuthology.orchestra.run.smithi037.stdout:generic/039 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T17:26:51.432 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/039 2023-12-11T17:26:51.432 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/039 2023-12-11T17:26:51.432 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:26:51.440 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:51.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:26:51.490 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/040) 2023-12-11T17:26:51.723 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:26:51.729 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:26:52.125 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:26:52.139 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:26:52.140 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:26:52.144 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:26:52.144 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:52.861 INFO:teuthology.orchestra.run.smithi037.stdout:generic/040 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T17:26:52.874 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/040 2023-12-11T17:26:52.874 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/040 2023-12-11T17:26:52.874 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:26:52.882 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:52.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:26:52.935 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/041) 2023-12-11T17:26:53.508 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:26:53.524 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:26:53.526 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:26:53.531 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:26:53.531 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:54.261 INFO:teuthology.orchestra.run.smithi037.stdout:generic/041 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T17:26:54.276 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/041 2023-12-11T17:26:54.276 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/041 2023-12-11T17:26:54.276 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:26:54.287 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:54.343 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:26:54.343 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/042) 2023-12-11T17:26:55.011 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:26:55.025 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:26:55.027 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:26:55.031 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:26:55.031 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:55.912 INFO:teuthology.orchestra.run.smithi037.stdout:generic/042 [not run] ceph does not support shutdown 2023-12-11T17:26:55.936 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/042 2023-12-11T17:26:55.936 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/042 2023-12-11T17:26:55.936 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:26:55.945 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:55.984 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:26:55.984 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/043) 2023-12-11T17:26:56.635 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:26:56.648 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:26:56.650 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:26:56.653 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:26:56.653 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:57.506 INFO:teuthology.orchestra.run.smithi037.stdout:generic/043 [not run] ceph does not support shutdown 2023-12-11T17:26:57.533 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/043 2023-12-11T17:26:57.533 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/043 2023-12-11T17:26:57.533 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:26:57.544 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:57.583 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:26:57.584 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/044) 2023-12-11T17:26:58.220 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:26:58.236 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:26:58.237 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:26:58.241 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:26:58.242 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:59.096 INFO:teuthology.orchestra.run.smithi037.stdout:generic/044 [not run] ceph does not support shutdown 2023-12-11T17:26:59.119 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/044 2023-12-11T17:26:59.119 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/044 2023-12-11T17:26:59.119 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:26:59.129 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:26:59.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:26:59.166 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/045) 2023-12-11T17:26:59.805 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:26:59.820 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:26:59.822 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:26:59.827 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:26:59.827 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:00.707 INFO:teuthology.orchestra.run.smithi037.stdout:generic/045 [not run] ceph does not support shutdown 2023-12-11T17:27:00.731 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/045 2023-12-11T17:27:00.731 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/045 2023-12-11T17:27:00.731 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:00.744 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:00.787 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:00.788 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/046) 2023-12-11T17:27:01.457 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:01.473 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:01.475 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:01.478 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:01.478 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:02.378 INFO:teuthology.orchestra.run.smithi037.stdout:generic/046 [not run] ceph does not support shutdown 2023-12-11T17:27:02.399 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/046 2023-12-11T17:27:02.399 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/046 2023-12-11T17:27:02.400 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:02.410 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:02.446 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:02.446 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/047) 2023-12-11T17:27:03.074 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:03.090 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:03.092 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:03.096 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:03.096 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:03.959 INFO:teuthology.orchestra.run.smithi037.stdout:generic/047 [not run] ceph does not support shutdown 2023-12-11T17:27:03.993 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/047 2023-12-11T17:27:03.994 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/047 2023-12-11T17:27:03.994 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:04.007 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:04.055 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:04.056 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/048) 2023-12-11T17:27:04.709 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:04.724 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:04.726 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:04.729 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:04.729 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:05.598 INFO:teuthology.orchestra.run.smithi037.stdout:generic/048 [not run] ceph does not support shutdown 2023-12-11T17:27:05.619 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/048 2023-12-11T17:27:05.619 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/048 2023-12-11T17:27:05.620 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:05.628 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:05.663 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:05.664 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/049) 2023-12-11T17:27:06.301 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:06.316 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:06.318 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:06.322 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:06.322 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:07.204 INFO:teuthology.orchestra.run.smithi037.stdout:generic/049 [not run] ceph does not support shutdown 2023-12-11T17:27:07.228 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/049 2023-12-11T17:27:07.228 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/049 2023-12-11T17:27:07.228 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:07.238 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:07.276 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:07.277 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/050) 2023-12-11T17:27:07.923 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:07.938 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:07.940 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:07.945 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:07.945 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:08.819 INFO:teuthology.orchestra.run.smithi037.stdout:generic/050 [not run] ceph does not support shutdown 2023-12-11T17:27:08.845 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/050 2023-12-11T17:27:08.845 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/050 2023-12-11T17:27:08.845 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:08.857 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:08.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:08.895 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/051) 2023-12-11T17:27:09.527 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:09.543 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:09.545 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:09.549 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:09.549 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:10.431 INFO:teuthology.orchestra.run.smithi037.stdout:generic/051 [not run] ceph does not support shutdown 2023-12-11T17:27:10.442 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/051 2023-12-11T17:27:10.442 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/051 2023-12-11T17:27:10.442 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:10.450 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:10.484 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:10.485 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/052) 2023-12-11T17:27:11.126 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:11.142 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:11.144 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:11.148 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:11.149 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:12.064 INFO:teuthology.orchestra.run.smithi037.stdout:generic/052 [not run] ceph does not support shutdown 2023-12-11T17:27:12.086 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/052 2023-12-11T17:27:12.086 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/052 2023-12-11T17:27:12.086 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:12.097 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:12.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:12.211 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/053) 2023-12-11T17:27:12.880 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:12.894 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:12.896 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:12.899 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:12.899 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:14.358 INFO:teuthology.orchestra.run.smithi037.stdout:generic/053 1s 2023-12-11T17:27:14.401 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/053 2023-12-11T17:27:14.402 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:14.420 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:14.472 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:14.472 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/054) 2023-12-11T17:27:15.023 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:15.040 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:15.042 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:15.045 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:15.045 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:15.972 INFO:teuthology.orchestra.run.smithi037.stdout:generic/054 [not run] ceph does not support shutdown 2023-12-11T17:27:15.997 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/054 2023-12-11T17:27:15.997 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/054 2023-12-11T17:27:15.997 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:16.009 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:16.053 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:16.053 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/055) 2023-12-11T17:27:16.708 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:16.724 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:16.725 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:16.729 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:16.729 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:17.595 INFO:teuthology.orchestra.run.smithi037.stdout:generic/055 [not run] ceph does not support shutdown 2023-12-11T17:27:17.633 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/055 2023-12-11T17:27:17.633 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/055 2023-12-11T17:27:17.633 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:17.646 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:17.686 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:17.686 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/056) 2023-12-11T17:27:18.353 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:18.369 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:18.370 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:18.374 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:18.374 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:19.110 INFO:teuthology.orchestra.run.smithi037.stdout:generic/056 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T17:27:19.123 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/056 2023-12-11T17:27:19.124 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/056 2023-12-11T17:27:19.124 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:19.136 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:19.190 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:19.190 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/057) 2023-12-11T17:27:19.843 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:19.856 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:19.857 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:19.861 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:19.861 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:20.584 INFO:teuthology.orchestra.run.smithi037.stdout:generic/057 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T17:27:20.597 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/057 2023-12-11T17:27:20.597 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/057 2023-12-11T17:27:20.597 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:20.607 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:20.657 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:20.658 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/058) 2023-12-11T17:27:21.311 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:21.328 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:21.330 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:21.334 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:21.334 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:21.864 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:27:21.873 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:27:22.245 INFO:teuthology.orchestra.run.smithi037.stdout:generic/058 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T17:27:22.261 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/058 2023-12-11T17:27:22.261 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/058 2023-12-11T17:27:22.261 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:22.274 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:22.386 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:22.386 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/059) 2023-12-11T17:27:23.021 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:23.035 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:23.036 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:23.040 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:23.040 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:23.817 INFO:teuthology.orchestra.run.smithi037.stdout:generic/059 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T17:27:23.832 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/059 2023-12-11T17:27:23.832 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/059 2023-12-11T17:27:23.832 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:23.845 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:23.889 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:23.889 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/060) 2023-12-11T17:27:24.523 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:24.537 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:24.539 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:24.543 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:24.543 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:25.521 INFO:teuthology.orchestra.run.smithi037.stdout:generic/060 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T17:27:25.533 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/060 2023-12-11T17:27:25.534 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/060 2023-12-11T17:27:25.534 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:25.544 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:25.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:25.645 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/061) 2023-12-11T17:27:26.359 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:26.374 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:26.376 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:26.379 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:26.379 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:27.305 INFO:teuthology.orchestra.run.smithi037.stdout:generic/061 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T17:27:27.317 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/061 2023-12-11T17:27:27.318 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/061 2023-12-11T17:27:27.318 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:27.327 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:27.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:27.410 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/062) 2023-12-11T17:27:28.083 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:28.097 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:28.099 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:28.102 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:28.102 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:31.074 INFO:teuthology.orchestra.run.smithi037.stdout:generic/062 3s 2023-12-11T17:27:31.117 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/062 2023-12-11T17:27:31.117 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:31.131 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:31.191 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:31.191 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/063) 2023-12-11T17:27:31.791 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:31.803 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:31.804 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:31.807 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:31.807 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:32.819 INFO:teuthology.orchestra.run.smithi037.stdout:generic/063 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T17:27:32.831 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/063 2023-12-11T17:27:32.831 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/063 2023-12-11T17:27:32.831 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:32.840 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:32.925 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:32.925 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/064) 2023-12-11T17:27:33.580 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:33.595 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:33.596 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:33.599 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:33.599 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:34.346 INFO:teuthology.orchestra.run.smithi037.stdout:generic/064 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-11T17:27:34.361 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/064 2023-12-11T17:27:34.361 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/064 2023-12-11T17:27:34.361 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:34.372 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:34.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:34.424 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/065) 2023-12-11T17:27:35.073 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:35.089 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:35.091 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:35.095 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:35.095 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:35.842 INFO:teuthology.orchestra.run.smithi037.stdout:generic/065 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T17:27:35.858 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/065 2023-12-11T17:27:35.858 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/065 2023-12-11T17:27:35.858 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:35.870 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:35.920 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:35.920 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/066) 2023-12-11T17:27:36.563 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:36.580 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:36.582 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:36.585 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:36.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:37.294 INFO:teuthology.orchestra.run.smithi037.stdout:generic/066 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T17:27:37.307 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/066 2023-12-11T17:27:37.307 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/066 2023-12-11T17:27:37.308 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:37.317 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:37.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:37.357 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/067) 2023-12-11T17:27:38.025 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:38.040 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:38.042 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:38.045 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:38.045 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:38.836 INFO:teuthology.orchestra.run.smithi037.stdout:generic/067 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T17:27:38.848 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/067 2023-12-11T17:27:38.849 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/067 2023-12-11T17:27:38.849 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:38.859 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:38.908 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:38.909 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/068) 2023-12-11T17:27:39.582 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:39.599 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:39.600 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:39.604 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:39.604 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:40.341 INFO:teuthology.orchestra.run.smithi037.stdout:generic/068 [not run] ceph does not support freezing 2023-12-11T17:27:40.357 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/068 2023-12-11T17:27:40.357 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/068 2023-12-11T17:27:40.357 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:27:40.370 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:40.417 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:27:40.417 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/069) 2023-12-11T17:27:41.089 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:27:41.105 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:27:41.107 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:27:41.110 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:27:41.111 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:27:52.006 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:27:52.015 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:28:01.663 INFO:teuthology.orchestra.run.smithi037.stdout:generic/069 20s 2023-12-11T17:28:01.706 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/069 2023-12-11T17:28:01.706 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:28:01.724 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:28:01.767 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:28:01.767 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/070) 2023-12-11T17:28:02.318 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:28:02.333 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:28:02.335 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:28:02.339 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:28:02.339 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:28:22.436 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:28:22.450 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:28:33.404 INFO:teuthology.orchestra.run.smithi037.stdout:generic/070 31s 2023-12-11T17:28:33.429 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/070 2023-12-11T17:28:33.430 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:28:33.437 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:28:33.610 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:28:33.610 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/071) 2023-12-11T17:28:34.432 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:28:34.448 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:28:34.449 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:28:34.452 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:28:34.452 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:28:35.138 INFO:teuthology.orchestra.run.smithi037.stdout:generic/071 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-11T17:28:35.150 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/071 2023-12-11T17:28:35.150 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/071 2023-12-11T17:28:35.150 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:28:35.161 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:28:35.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:28:35.200 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/072) 2023-12-11T17:28:35.800 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:28:35.813 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:28:35.815 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:28:35.818 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:28:35.818 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:28:36.647 INFO:teuthology.orchestra.run.smithi037.stdout:generic/072 [not run] xfs_io fcollapse failed (old kernel/wrong fs?) 2023-12-11T17:28:36.660 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/072 2023-12-11T17:28:36.660 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/072 2023-12-11T17:28:36.660 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:28:36.668 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:28:36.717 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:28:36.718 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/073) 2023-12-11T17:28:37.334 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:28:37.348 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:28:37.350 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:28:37.352 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:28:37.353 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:28:38.021 INFO:teuthology.orchestra.run.smithi037.stdout:generic/073 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T17:28:38.034 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/073 2023-12-11T17:28:38.034 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/073 2023-12-11T17:28:38.034 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:28:38.045 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:28:38.081 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:28:38.081 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/074) 2023-12-11T17:28:38.691 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:28:38.706 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:28:38.707 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:28:38.710 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:28:38.711 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:28:52.768 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:28:52.780 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:29:25.002 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:29:25.010 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:29:25.266 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-12-11T17:29:25.263+0000 7fcb1e884640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 209338) UID: 0 2023-12-11T17:29:25.267 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-12-11T17:29:25.264+0000 7f93f4e3d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 209338) UID: 0 2023-12-11T17:29:27.337 INFO:teuthology.orchestra.run.smithi037.stdout:generic/074 49s 2023-12-11T17:29:27.356 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/074 2023-12-11T17:29:27.356 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:29:27.366 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:29:27.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:29:27.862 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/075) 2023-12-11T17:29:28.858 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:29:28.874 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:29:28.876 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:29:28.879 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:29:28.879 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:02.633 INFO:teuthology.orchestra.run.smithi037.stdout:generic/075 33s 2023-12-11T17:30:02.656 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/075 2023-12-11T17:30:02.656 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:30:02.667 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:02.813 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:30:02.813 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/076) 2023-12-11T17:30:03.649 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:30:03.667 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:30:03.669 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:30:03.673 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:30:03.673 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:04.384 INFO:teuthology.orchestra.run.smithi037.stdout:generic/076 [not run] require 172.21.15.37:6789:/scratch to be local device 2023-12-11T17:30:04.399 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/076 2023-12-11T17:30:04.399 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/076 2023-12-11T17:30:04.399 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:30:04.409 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:04.456 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:30:04.456 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/077) 2023-12-11T17:30:05.698 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:30:05.715 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:30:05.717 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:30:05.721 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:30:05.721 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:10.704 INFO:teuthology.orchestra.run.smithi037.stdout:generic/077 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-11T17:30:10.716 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/077 2023-12-11T17:30:10.716 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/077 2023-12-11T17:30:10.717 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:30:10.727 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:10.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:30:10.885 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/078) 2023-12-11T17:30:12.040 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:30:12.059 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:30:12.060 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:30:12.063 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:30:12.064 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:12.825 INFO:teuthology.orchestra.run.smithi037.stdout:generic/078 [not run] kernel doesn't support renameat2 syscall 2023-12-11T17:30:12.838 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/078 2023-12-11T17:30:12.838 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/078 2023-12-11T17:30:12.838 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:30:12.847 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:12.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:30:12.935 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/079) 2023-12-11T17:30:13.829 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:30:13.843 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:30:13.844 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:30:13.848 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:30:13.849 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:14.589 INFO:teuthology.orchestra.run.smithi037.stdout:generic/079 [not run] file system doesn't support chattr +ia 2023-12-11T17:30:14.605 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/079 2023-12-11T17:30:14.605 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/079 2023-12-11T17:30:14.605 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:30:14.617 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:14.679 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:30:14.680 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/080) 2023-12-11T17:30:15.381 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:30:15.396 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:30:15.396 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:30:15.401 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:30:15.401 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:18.277 INFO:teuthology.orchestra.run.smithi037.stdout:generic/080 3s 2023-12-11T17:30:18.295 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/080 2023-12-11T17:30:18.295 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:30:18.308 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:18.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:30:18.374 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/081) 2023-12-11T17:30:19.397 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:30:19.416 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:30:19.418 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:30:19.422 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:30:19.422 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:20.268 INFO:teuthology.orchestra.run.smithi037.stdout:generic/081 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T17:30:20.277 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/081 2023-12-11T17:30:20.277 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/081 2023-12-11T17:30:20.278 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:30:20.285 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:20.488 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:30:20.488 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/082) 2023-12-11T17:30:21.150 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:30:21.166 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:30:21.168 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:30:21.171 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:30:21.171 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:21.870 INFO:teuthology.orchestra.run.smithi037.stdout:generic/082 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-11T17:30:21.884 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/082 2023-12-11T17:30:21.884 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/082 2023-12-11T17:30:21.884 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:30:21.892 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:21.934 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:30:21.934 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/083) 2023-12-11T17:30:22.633 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:30:22.650 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:30:22.652 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:30:22.656 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:30:22.657 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:23.468 INFO:teuthology.orchestra.run.smithi037.stdout:generic/083 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-11T17:30:23.481 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/083 2023-12-11T17:30:23.481 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/083 2023-12-11T17:30:23.482 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:30:23.491 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:23.626 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:30:23.626 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/084) 2023-12-11T17:30:24.323 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:30:24.340 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:30:24.341 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:30:24.344 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:30:24.345 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:30.809 INFO:teuthology.orchestra.run.smithi037.stdout:generic/084 6s 2023-12-11T17:30:30.865 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/084 2023-12-11T17:30:30.866 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:30:30.882 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:30.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:30:30.954 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/085) 2023-12-11T17:30:31.520 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:30:31.533 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:30:31.535 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:30:31.538 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:30:31.538 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:32.638 INFO:teuthology.orchestra.run.smithi037.stdout:generic/085 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T17:30:32.651 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/085 2023-12-11T17:30:32.652 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/085 2023-12-11T17:30:32.652 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:30:32.661 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:32.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:30:32.698 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/086) 2023-12-11T17:30:33.256 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:30:33.268 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:30:33.269 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:30:33.272 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:30:33.272 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:33.911 INFO:teuthology.orchestra.run.smithi037.stdout:generic/086 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T17:30:33.922 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/086 2023-12-11T17:30:33.922 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/086 2023-12-11T17:30:33.922 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:30:33.930 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:33.967 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:30:33.967 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/087) 2023-12-11T17:30:34.532 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:30:34.546 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:30:34.547 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:30:34.551 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:30:34.551 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:35.315 INFO:teuthology.orchestra.run.smithi037.stdout:generic/087 1s 2023-12-11T17:30:35.331 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/087 2023-12-11T17:30:35.331 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:30:35.338 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:35.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:30:35.465 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/088) 2023-12-11T17:30:36.144 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:30:36.156 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:30:36.157 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:30:36.160 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:30:36.160 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:36.820 INFO:teuthology.orchestra.run.smithi037.stdout:generic/088 0s 2023-12-11T17:30:36.834 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/088 2023-12-11T17:30:36.835 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:30:36.842 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:30:36.933 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:30:36.933 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/089) 2023-12-11T17:30:37.618 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:30:37.629 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:30:37.630 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:30:37.633 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:30:37.634 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:32:28.618 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:32:28.625 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:33:02.154 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:33:02.167 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:33:32.322 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:33:32.336 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:34:02.464 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:34:02.479 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:34:32.615 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:34:32.626 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:35:02.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:35:02.779 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:35:32.942 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:35:32.952 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:36:03.098 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:36:03.114 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:36:33.314 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:36:33.325 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:37:03.459 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:37:03.469 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:37:33.658 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:37:33.668 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:38:06.833 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:38:06.844 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:38:06.972 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-12-11T17:38:06.969+0000 7f93f4e3d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 220369) UID: 0 2023-12-11T17:38:06.972 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-12-11T17:38:06.969+0000 7fcb1e884640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 220369) UID: 0 2023-12-11T17:41:08.428 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:41:08.436 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:41:38.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:41:38.606 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:42:09.475 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:42:09.486 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:42:39.617 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:42:39.627 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:43:09.924 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:43:09.935 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:43:40.089 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:43:40.100 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:44:10.266 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:44:10.279 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:44:40.493 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:44:40.500 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:45:11.049 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:45:11.060 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:45:41.193 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:45:41.207 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:45:41.306 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-12-11T17:45:41.303+0000 7f93f4e3d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 222587) UID: 0 2023-12-11T17:45:41.306 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-12-11T17:45:41.303+0000 7fcb1e884640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 222587) UID: 0 2023-12-11T17:46:59.422 INFO:teuthology.orchestra.run.smithi037.stdout:generic/089 982s 2023-12-11T17:46:59.458 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/089 2023-12-11T17:46:59.458 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:46:59.469 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:46:59.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:46:59.599 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/090) 2023-12-11T17:47:00.294 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:47:00.304 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:47:00.305 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:47:00.307 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:47:00.307 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:47:01.026 INFO:teuthology.orchestra.run.smithi037.stdout:generic/090 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T17:47:01.040 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/090 2023-12-11T17:47:01.040 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/090 2023-12-11T17:47:01.040 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:47:01.051 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:47:01.103 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:47:01.127 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/091) 2023-12-11T17:47:01.674 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:47:01.689 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:47:01.691 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:47:01.694 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:47:01.694 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:48:31.969 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:48:31.979 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:49:02.112 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:49:02.122 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:49:32.401 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:49:32.411 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:50:02.665 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:50:02.676 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:50:32.804 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:50:32.814 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:51:02.992 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:51:03.004 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:51:04.636 INFO:teuthology.orchestra.run.smithi037.stdout:generic/091 243s 2023-12-11T17:51:04.656 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/091 2023-12-11T17:51:04.656 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:51:04.667 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:51:04.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:51:04.777 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/092) 2023-12-11T17:51:05.503 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:51:05.516 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:51:05.517 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:51:05.521 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:51:05.521 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:51:06.305 INFO:teuthology.orchestra.run.smithi037.stdout:generic/092 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T17:51:06.320 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/092 2023-12-11T17:51:06.321 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/092 2023-12-11T17:51:06.321 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:51:06.334 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:51:06.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:51:06.391 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/093) 2023-12-11T17:51:06.970 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:51:06.982 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:51:06.984 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:51:06.987 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:51:06.987 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:51:08.298 INFO:teuthology.orchestra.run.smithi037.stdout:generic/093 1s 2023-12-11T17:51:08.314 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/093 2023-12-11T17:51:08.314 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:51:08.323 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:51:08.453 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:51:08.453 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/094) 2023-12-11T17:51:09.103 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:51:09.118 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:51:09.119 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:51:09.123 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:51:09.123 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:51:09.946 INFO:teuthology.orchestra.run.smithi037.stdout:generic/094 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-11T17:51:09.958 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/094 2023-12-11T17:51:09.958 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/094 2023-12-11T17:51:09.958 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:51:09.969 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:51:10.069 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:51:10.069 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/095) 2023-12-11T17:51:10.759 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:51:10.773 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:51:10.775 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:51:10.778 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:51:10.778 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:51:26.182 INFO:teuthology.orchestra.run.smithi037.stdout:generic/095 15s 2023-12-11T17:51:26.201 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/095 2023-12-11T17:51:26.202 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:51:26.209 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:51:26.233 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:51:26.233 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/096) 2023-12-11T17:51:26.831 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:51:26.843 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:51:26.845 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:51:26.848 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:51:26.848 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:51:27.767 INFO:teuthology.orchestra.run.smithi037.stdout:generic/096 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-11T17:51:27.780 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/096 2023-12-11T17:51:27.780 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/096 2023-12-11T17:51:27.780 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:51:27.790 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:51:27.854 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:51:27.854 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/097) 2023-12-11T17:51:28.510 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:51:28.525 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:51:28.526 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:51:28.530 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:51:28.530 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:51:29.882 INFO:teuthology.orchestra.run.smithi037.stdout:generic/097 1s 2023-12-11T17:51:29.896 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/097 2023-12-11T17:51:29.896 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:51:29.902 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:51:29.938 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:51:29.938 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/098) 2023-12-11T17:51:30.555 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:51:30.570 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:51:30.571 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:51:30.575 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:51:30.575 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:51:32.435 INFO:teuthology.orchestra.run.smithi037.stdout:generic/098 2s 2023-12-11T17:51:32.453 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/098 2023-12-11T17:51:32.453 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:51:32.464 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:51:32.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:51:32.501 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/099) 2023-12-11T17:51:33.138 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:51:33.147 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:51:33.153 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:51:33.154 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:51:33.155 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:51:33.159 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:51:33.159 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:51:35.433 INFO:teuthology.orchestra.run.smithi037.stdout:generic/099 2s 2023-12-11T17:51:35.451 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/099 2023-12-11T17:51:35.451 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:51:35.462 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:51:35.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:51:35.595 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/100) 2023-12-11T17:51:36.249 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:51:36.264 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:51:36.266 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:51:36.270 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:51:36.270 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:52:03.663 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:52:03.677 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:52:12.840 INFO:teuthology.orchestra.run.smithi037.stdout:generic/100 36s 2023-12-11T17:52:12.858 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/100 2023-12-11T17:52:12.859 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:52:12.868 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:52:14.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:52:14.922 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/101) 2023-12-11T17:52:15.489 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:52:15.504 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:52:15.504 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:52:15.508 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:52:15.508 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:52:16.255 INFO:teuthology.orchestra.run.smithi037.stdout:generic/101 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T17:52:16.271 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/101 2023-12-11T17:52:16.271 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/101 2023-12-11T17:52:16.271 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:52:16.282 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:52:16.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:52:16.330 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/102) 2023-12-11T17:52:16.994 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:52:17.010 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:52:17.012 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:52:17.015 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:52:17.015 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:52:17.725 INFO:teuthology.orchestra.run.smithi037.stdout:generic/102 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-11T17:52:17.738 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/102 2023-12-11T17:52:17.738 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/102 2023-12-11T17:52:17.738 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:52:17.748 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:52:17.785 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:52:17.786 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/103) 2023-12-11T17:52:18.394 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:52:18.411 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:52:18.413 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:52:18.417 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:52:18.417 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:52:19.167 INFO:teuthology.orchestra.run.smithi037.stdout:generic/103 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T17:52:19.181 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/103 2023-12-11T17:52:19.181 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/103 2023-12-11T17:52:19.181 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:52:19.191 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:52:19.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:52:19.303 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/104) 2023-12-11T17:52:19.989 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:52:20.002 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:52:20.004 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:52:20.008 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:52:20.009 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:52:20.769 INFO:teuthology.orchestra.run.smithi037.stdout:generic/104 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T17:52:20.784 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/104 2023-12-11T17:52:20.785 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/104 2023-12-11T17:52:20.785 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:52:20.798 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:52:20.850 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:52:20.850 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/105) 2023-12-11T17:52:21.464 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:52:21.479 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:52:21.480 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:52:21.484 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:52:21.484 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:52:22.742 INFO:teuthology.orchestra.run.smithi037.stdout:generic/105 1s 2023-12-11T17:52:22.774 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/105 2023-12-11T17:52:22.774 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:52:22.795 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:52:22.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:52:22.855 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/106) 2023-12-11T17:52:23.471 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:52:23.484 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:52:23.486 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:52:23.490 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:52:23.490 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:52:24.256 INFO:teuthology.orchestra.run.smithi037.stdout:generic/106 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T17:52:24.274 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/106 2023-12-11T17:52:24.274 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/106 2023-12-11T17:52:24.274 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:52:24.286 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:52:24.336 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:52:24.336 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/107) 2023-12-11T17:52:24.973 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:52:24.987 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:52:24.989 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:52:24.993 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:52:24.993 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:52:25.732 INFO:teuthology.orchestra.run.smithi037.stdout:generic/107 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T17:52:25.743 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/107 2023-12-11T17:52:25.743 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/107 2023-12-11T17:52:25.744 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:52:25.754 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:52:25.802 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:52:25.802 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/108) 2023-12-11T17:52:26.465 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:52:26.479 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:52:26.482 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:52:26.486 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:52:26.486 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:52:27.526 INFO:teuthology.orchestra.run.smithi037.stdout:generic/108 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T17:52:27.539 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/108 2023-12-11T17:52:27.540 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/108 2023-12-11T17:52:27.540 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:52:27.549 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:52:27.592 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:52:27.592 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/109) 2023-12-11T17:52:28.214 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:52:28.228 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:52:28.229 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:52:28.232 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:52:28.232 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:52:33.875 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:52:33.885 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:52:40.763 INFO:teuthology.orchestra.run.smithi037.stdout:generic/109 12s 2023-12-11T17:52:40.776 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/109 2023-12-11T17:52:40.776 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:52:40.783 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:52:40.804 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:52:40.804 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/110) 2023-12-11T17:52:41.594 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:52:41.611 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:52:41.613 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:52:41.617 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:52:41.617 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:53:04.197 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:53:04.208 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:53:13.333 INFO:teuthology.orchestra.run.smithi037.stdout:generic/110 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T17:53:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/110 2023-12-11T17:53:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/110 2023-12-11T17:53:13.348 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:53:14.588 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:53:14.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:53:14.737 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/111) 2023-12-11T17:53:15.371 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:53:15.386 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:53:15.388 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:53:15.391 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:53:15.391 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:53:16.115 INFO:teuthology.orchestra.run.smithi037.stdout:generic/111 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T17:53:16.127 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/111 2023-12-11T17:53:16.127 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/111 2023-12-11T17:53:16.127 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:53:16.136 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:53:16.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:53:16.251 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/112) 2023-12-11T17:53:16.938 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:53:16.953 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:53:16.955 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:53:16.958 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:53:16.958 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:53:34.448 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:53:34.458 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:53:57.891 INFO:teuthology.orchestra.run.smithi037.stdout:generic/112 40s 2023-12-11T17:53:57.907 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/112 2023-12-11T17:53:57.907 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:53:57.915 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:53:58.009 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:53:58.009 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/113) 2023-12-11T17:53:58.730 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:53:58.747 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:53:58.748 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:53:58.752 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:53:58.753 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:54:04.591 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:54:04.599 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:54:16.931 INFO:teuthology.orchestra.run.smithi037.stdout:generic/113 18s 2023-12-11T17:54:16.946 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/113 2023-12-11T17:54:16.947 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:54:16.955 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:54:17.061 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:54:17.062 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/114) 2023-12-11T17:54:17.711 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:54:17.721 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:54:17.723 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:54:17.725 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:54:17.725 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:54:18.459 INFO:teuthology.orchestra.run.smithi037.stdout:generic/114 [not run] device block size: 4096 greater than 512 2023-12-11T17:54:18.475 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/114 2023-12-11T17:54:18.475 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/114 2023-12-11T17:54:18.475 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:54:18.487 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:54:18.537 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:54:18.537 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/115) 2023-12-11T17:54:19.198 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:54:19.213 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:54:19.215 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:54:19.219 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:54:19.219 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:54:19.984 INFO:teuthology.orchestra.run.smithi037.stdout:generic/115 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T17:54:19.997 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/115 2023-12-11T17:54:19.997 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/115 2023-12-11T17:54:19.998 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:54:20.007 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:54:20.114 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:54:20.114 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/116) 2023-12-11T17:54:20.818 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:54:20.830 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:54:20.832 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:54:20.834 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:54:20.834 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:54:21.564 INFO:teuthology.orchestra.run.smithi037.stdout:generic/116 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T17:54:21.577 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/116 2023-12-11T17:54:21.577 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/116 2023-12-11T17:54:21.577 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:54:21.587 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:54:21.704 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:54:21.704 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/117) 2023-12-11T17:54:22.406 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:54:22.423 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:54:22.424 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:54:22.428 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:54:22.428 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:54:34.790 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:54:34.800 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:54:50.966 INFO:teuthology.orchestra.run.smithi037.stdout:generic/117 28s 2023-12-11T17:54:50.979 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/117 2023-12-11T17:54:50.980 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:54:50.986 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:54:51.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:54:51.007 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/118) 2023-12-11T17:54:51.544 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:54:51.557 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:54:51.559 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:54:51.562 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:54:51.562 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:54:53.163 INFO:teuthology.orchestra.run.smithi037.stdout:generic/118 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T17:54:53.179 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/118 2023-12-11T17:54:53.180 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/118 2023-12-11T17:54:53.180 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:54:53.193 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:54:53.303 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:54:53.304 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/119) 2023-12-11T17:54:53.977 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:54:53.988 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:54:53.989 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:54:53.992 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:54:53.992 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:54:54.743 INFO:teuthology.orchestra.run.smithi037.stdout:generic/119 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T17:54:54.758 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/119 2023-12-11T17:54:54.758 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/119 2023-12-11T17:54:54.758 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:54:54.769 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:54:54.885 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:54:54.885 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/120) 2023-12-11T17:54:55.578 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:54:55.592 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:54:55.594 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:54:55.598 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:54:55.598 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:54:56.303 INFO:teuthology.orchestra.run.smithi037.stdout:generic/120 [not run] atime not maintained by ceph 2023-12-11T17:54:56.318 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/120 2023-12-11T17:54:56.318 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/120 2023-12-11T17:54:56.318 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:54:56.329 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:54:56.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:54:56.374 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/121) 2023-12-11T17:54:57.048 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:54:57.063 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:54:57.065 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:54:57.069 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:54:57.069 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:54:57.839 INFO:teuthology.orchestra.run.smithi037.stdout:generic/121 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-11T17:54:57.853 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/121 2023-12-11T17:54:57.853 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/121 2023-12-11T17:54:57.853 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:54:57.863 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:54:57.969 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:54:57.969 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/122) 2023-12-11T17:54:58.670 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:54:58.685 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:54:58.686 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:54:58.689 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:54:58.690 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:54:59.452 INFO:teuthology.orchestra.run.smithi037.stdout:generic/122 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-11T17:54:59.466 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/122 2023-12-11T17:54:59.466 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/122 2023-12-11T17:54:59.466 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:54:59.476 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:54:59.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:54:59.576 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/123) 2023-12-11T17:55:00.282 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:55:00.296 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:55:00.298 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:55:00.302 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:55:00.302 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:55:01.762 INFO:teuthology.orchestra.run.smithi037.stdout:generic/123 1s 2023-12-11T17:55:01.781 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/123 2023-12-11T17:55:01.781 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:55:01.791 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:55:01.917 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:55:01.918 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/124) 2023-12-11T17:55:02.595 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:55:02.609 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:55:02.611 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:55:02.614 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:55:02.614 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:55:04.944 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:55:04.951 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:55:07.929 INFO:teuthology.orchestra.run.smithi037.stdout:generic/124 5s 2023-12-11T17:55:07.964 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/124 2023-12-11T17:55:07.964 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:55:07.982 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:55:08.560 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:55:08.560 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/125) 2023-12-11T17:55:09.246 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:55:09.260 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:55:09.262 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:55:09.265 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:55:09.265 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:55:35.084 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:55:35.094 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:56:05.237 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:56:05.248 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:56:11.363 INFO:teuthology.orchestra.run.smithi037.stdout:generic/125 62s 2023-12-11T17:56:11.381 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/125 2023-12-11T17:56:11.381 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:56:11.390 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:56:11.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:56:11.479 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/126) 2023-12-11T17:56:12.156 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:56:12.170 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:56:12.171 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:56:12.175 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:56:12.175 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:56:13.307 INFO:teuthology.orchestra.run.smithi037.stdout:generic/126 1s 2023-12-11T17:56:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/126 2023-12-11T17:56:13.326 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T17:56:13.335 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:56:13.470 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T17:56:13.470 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/127) 2023-12-11T17:56:14.140 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T17:56:14.154 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T17:56:14.157 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T17:56:14.161 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T17:56:14.161 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T17:56:35.385 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:56:35.397 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:57:05.658 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:57:05.669 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:57:35.839 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:57:35.850 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:58:05.985 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:58:05.997 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:58:36.141 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:58:36.152 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:59:06.297 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:59:06.309 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:59:36.470 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T17:59:36.480 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:00:06.809 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:00:06.824 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:00:36.965 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:00:36.980 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:01:07.122 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:01:07.132 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:01:37.270 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:01:37.281 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:02:07.454 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:02:07.463 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:02:37.610 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:02:37.621 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:03:07.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:03:07.769 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:03:37.897 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:03:37.907 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:04:08.044 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:04:08.056 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:04:38.211 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:04:38.221 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:05:08.546 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:05:08.557 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:05:38.709 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:05:38.719 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:06:08.865 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:06:08.878 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:06:39.005 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:06:39.015 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:07:09.445 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:07:09.454 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:07:39.575 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:07:39.585 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:08:10.246 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:08:10.257 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:08:40.397 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:08:40.411 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:09:10.716 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:09:10.730 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:09:40.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:09:40.868 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:10:11.000 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:10:11.010 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:10:41.191 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:10:41.201 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:11:11.898 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:11:11.909 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:11:42.041 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:11:42.052 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:12:12.193 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:12:12.204 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:12:42.337 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:12:42.347 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:13:12.482 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:13:12.492 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:13:42.672 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:13:42.682 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:14:12.820 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:14:12.832 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:14:43.117 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:14:43.129 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:15:13.273 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:15:13.284 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:15:43.435 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:15:43.450 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:16:13.583 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:16:13.594 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:16:43.832 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:16:43.846 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:17:13.995 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:17:14.006 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:17:44.142 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:17:44.155 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:18:14.307 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:18:14.318 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:18:44.471 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:18:44.483 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:19:14.618 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:19:14.628 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:19:44.758 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:19:44.768 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:20:15.131 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:20:15.142 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:20:45.309 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:20:45.319 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:20:50.296 INFO:teuthology.orchestra.run.smithi037.stdout:generic/127 1476s 2023-12-11T18:20:50.317 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/127 2023-12-11T18:20:50.317 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:20:50.327 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:20:50.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:20:50.467 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/128) 2023-12-11T18:20:51.168 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:20:51.180 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:20:51.182 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:20:51.186 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:20:51.186 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:20:53.352 INFO:teuthology.orchestra.run.smithi037.stdout:generic/128 2s 2023-12-11T18:20:53.364 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/128 2023-12-11T18:20:53.364 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:20:53.371 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:20:53.392 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:20:53.392 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/129) 2023-12-11T18:20:53.924 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:20:53.940 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:20:53.942 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:20:53.946 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:20:53.946 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:21:15.573 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:21:15.586 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:21:45.806 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:21:45.821 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:22:16.040 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:22:16.051 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:22:46.206 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:22:46.212 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:23:16.386 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:23:16.395 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:23:16.508 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T18:23:16.506+0000 7f8de7bd6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258662) UID: 0 2023-12-11T18:23:16.508 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T18:23:16.506+0000 7f5aba636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258662) UID: 0 2023-12-11T18:23:16.509 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T18:23:16.506+0000 7f690ba68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258662) UID: 0 2023-12-11T18:23:16.509 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T18:23:16.506+0000 7fb782446640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 258662) UID: 0 2023-12-11T18:27:11.929 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:27:11.934 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:27:12.299 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T18:27:12.298+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99006) UID: 0 2023-12-11T18:27:12.301 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T18:27:12.299+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99006) UID: 0 2023-12-11T18:27:12.302 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T18:27:12.299+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99006) UID: 0 2023-12-11T18:27:12.309 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T18:27:12.307+0000 7efcd4284640 -1 Fail to open '/proc/99006/cmdline' error = (2) No such file or directory 2023-12-11T18:27:12.309 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T18:27:12.307+0000 7efcd4284640 -1 received signal: Hangup from (PID: 99006) UID: 0 2023-12-11T18:36:03.532 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:36:03.539 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:36:03.700 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T18:36:03.699+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99038) UID: 0 2023-12-11T18:36:03.701 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T18:36:03.699+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99038) UID: 0 2023-12-11T18:36:03.712 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T18:36:03.711+0000 7fe981309640 -1 Fail to open '/proc/99038/cmdline' error = (2) No such file or directory 2023-12-11T18:36:03.712 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T18:36:03.711+0000 7fe981309640 -1 received signal: Hangup from (PID: 99038) UID: 0 2023-12-11T18:36:03.713 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T18:36:03.699+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 99038) UID: 0 2023-12-11T18:41:24.571 INFO:teuthology.orchestra.run.smithi151.stderr:error: Compressing program wrote following message to stderr when compressing log /var/log/ceph/ceph-osd.4.log.1: 2023-12-11T18:41:24.571 INFO:teuthology.orchestra.run.smithi151.stderr:gzip: stdin: file size changed while zipping 2023-12-11T18:44:33.735 INFO:teuthology.orchestra.run.smithi037.stdout:generic/129 1417s 2023-12-11T18:44:34.988 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/129 2023-12-11T18:44:34.988 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:44:35.083 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:44:35.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:44:35.121 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/130) 2023-12-11T18:44:35.969 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:44:35.982 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:44:35.984 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:44:35.987 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:44:35.988 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:45:04.350 INFO:teuthology.orchestra.run.smithi037.stdout:generic/130 28s 2023-12-11T18:45:04.402 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/130 2023-12-11T18:45:04.402 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:45:04.415 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:45:04.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:45:04.463 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/131) 2023-12-11T18:45:05.078 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:45:05.094 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:45:05.095 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:45:05.099 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:45:05.100 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:45:08.100 INFO:teuthology.orchestra.run.smithi037.stdout:generic/131 3s 2023-12-11T18:45:08.116 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/131 2023-12-11T18:45:08.117 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:45:08.128 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:45:08.252 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:45:08.252 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/132) 2023-12-11T18:45:09.014 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:45:09.030 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:45:09.033 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:45:09.036 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:45:09.036 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:45:22.374 INFO:teuthology.orchestra.run.smithi037.stdout:generic/132 13s 2023-12-11T18:45:22.392 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/132 2023-12-11T18:45:22.392 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:45:22.401 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:45:22.428 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:45:22.428 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/133) 2023-12-11T18:45:23.065 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:45:23.082 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:45:23.083 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:45:23.087 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:45:23.087 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:45:45.206 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:45:45.217 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:45:45.354 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-12-11T18:45:45.353+0000 7fcb1e884640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 260943) UID: 0 2023-12-11T18:45:45.354 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-12-11T18:45:45.353+0000 7f93f4e3d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 260943) UID: 0 2023-12-11T18:48:30.409 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T18:48:30.410+0000 7f8de7bd6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 261287) UID: 0 2023-12-11T18:48:30.410 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T18:48:30.410+0000 7f5aba636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 261287) UID: 0 2023-12-11T18:48:30.410 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T18:48:30.410+0000 7f690ba68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 261287) UID: 0 2023-12-11T18:48:30.411 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T18:48:30.410+0000 7fb782446640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 261287) UID: 0 2023-12-11T18:55:26.097 INFO:teuthology.orchestra.run.smithi037.stdout:generic/133 603s 2023-12-11T18:55:26.112 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/133 2023-12-11T18:55:26.112 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:55:26.120 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:26.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:55:26.197 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/134) 2023-12-11T18:55:27.081 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:55:27.092 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:55:27.093 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:55:27.096 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:55:27.096 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:27.790 INFO:teuthology.orchestra.run.smithi037.stdout:generic/134 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:55:27.804 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/134 2023-12-11T18:55:27.804 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/134 2023-12-11T18:55:27.805 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:55:27.816 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:27.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:55:27.922 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/135) 2023-12-11T18:55:28.650 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:55:28.662 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:55:28.664 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:55:28.667 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:55:28.667 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:30.222 INFO:teuthology.orchestra.run.smithi037.stdout:generic/135 2s 2023-12-11T18:55:30.235 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/135 2023-12-11T18:55:30.235 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:55:30.242 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:30.265 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:55:30.265 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/136) 2023-12-11T18:55:30.808 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:55:30.822 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:55:30.824 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:55:30.827 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:55:30.827 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:31.537 INFO:teuthology.orchestra.run.smithi037.stdout:generic/136 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-11T18:55:31.547 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/136 2023-12-11T18:55:31.548 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/136 2023-12-11T18:55:31.548 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:55:31.555 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:31.696 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:55:31.696 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/137) 2023-12-11T18:55:32.383 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:55:32.397 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:55:32.398 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:55:32.402 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:55:32.402 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:33.104 INFO:teuthology.orchestra.run.smithi037.stdout:generic/137 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:55:33.116 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/137 2023-12-11T18:55:33.116 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/137 2023-12-11T18:55:33.116 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:55:33.125 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:33.250 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:55:33.250 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/138) 2023-12-11T18:55:33.954 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:55:33.967 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:55:33.969 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:55:33.973 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:55:33.973 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:34.666 INFO:teuthology.orchestra.run.smithi037.stdout:generic/138 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:55:34.681 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/138 2023-12-11T18:55:34.682 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/138 2023-12-11T18:55:34.682 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:55:34.694 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:34.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:55:34.807 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/139) 2023-12-11T18:55:35.516 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:55:35.529 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:55:35.530 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:55:35.534 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:55:35.534 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:36.156 INFO:teuthology.orchestra.run.smithi037.stdout:generic/139 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:55:36.170 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/139 2023-12-11T18:55:36.170 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/139 2023-12-11T18:55:36.171 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:55:36.179 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:36.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:55:36.302 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/140) 2023-12-11T18:55:37.001 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:55:37.011 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:55:37.012 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:55:37.015 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:55:37.015 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:37.703 INFO:teuthology.orchestra.run.smithi037.stdout:generic/140 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:55:37.716 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/140 2023-12-11T18:55:37.716 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/140 2023-12-11T18:55:37.716 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:55:37.725 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:37.827 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:55:37.828 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/141) 2023-12-11T18:55:38.523 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:55:38.535 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:55:38.536 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:55:38.539 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:55:38.539 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:39.403 INFO:teuthology.orchestra.run.smithi037.stdout:generic/141 1s 2023-12-11T18:55:39.420 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/141 2023-12-11T18:55:39.421 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:55:39.428 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:39.452 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:55:39.453 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/142) 2023-12-11T18:55:39.990 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:55:40.003 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:55:40.004 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:55:40.007 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:55:40.007 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:40.681 INFO:teuthology.orchestra.run.smithi037.stdout:generic/142 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:55:40.690 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/142 2023-12-11T18:55:40.691 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/142 2023-12-11T18:55:40.691 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:55:40.699 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:40.820 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:55:40.821 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/143) 2023-12-11T18:55:41.521 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:55:41.533 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:55:41.534 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:55:41.542 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:55:41.542 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:42.221 INFO:teuthology.orchestra.run.smithi037.stdout:generic/143 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:55:42.231 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/143 2023-12-11T18:55:42.232 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/143 2023-12-11T18:55:42.232 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:55:42.239 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:42.321 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:55:42.322 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/144) 2023-12-11T18:55:43.059 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:55:43.072 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:55:43.073 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:55:43.077 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:55:43.077 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:43.789 INFO:teuthology.orchestra.run.smithi037.stdout:generic/144 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:55:43.802 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/144 2023-12-11T18:55:43.803 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/144 2023-12-11T18:55:43.803 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:55:43.810 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:43.929 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:55:43.930 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/145) 2023-12-11T18:55:44.636 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:55:44.648 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:55:44.650 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:55:44.652 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:55:44.652 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:45.353 INFO:teuthology.orchestra.run.smithi037.stdout:generic/145 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:55:45.366 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/145 2023-12-11T18:55:45.366 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/145 2023-12-11T18:55:45.366 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:55:45.375 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:45.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:55:45.490 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/146) 2023-12-11T18:55:46.200 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:55:46.213 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:55:46.214 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:55:46.217 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:55:46.217 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:46.910 INFO:teuthology.orchestra.run.smithi037.stdout:generic/146 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:55:46.924 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/146 2023-12-11T18:55:46.925 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/146 2023-12-11T18:55:46.925 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:55:46.935 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:47.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:55:47.097 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/147) 2023-12-11T18:55:47.808 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:55:47.821 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:55:47.823 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:55:47.826 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:55:47.826 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:48.522 INFO:teuthology.orchestra.run.smithi037.stdout:generic/147 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:55:48.537 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/147 2023-12-11T18:55:48.537 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/147 2023-12-11T18:55:48.537 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:55:48.548 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:48.660 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:55:48.661 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/148) 2023-12-11T18:55:49.379 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:55:49.392 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:55:49.394 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:55:49.397 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:55:49.397 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:50.043 INFO:teuthology.orchestra.run.smithi037.stdout:generic/148 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:55:50.054 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/148 2023-12-11T18:55:50.054 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/148 2023-12-11T18:55:50.054 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:55:50.062 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:50.166 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:55:50.166 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/149) 2023-12-11T18:55:50.860 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:55:50.874 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:55:50.875 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:55:50.878 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:55:50.878 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:51.545 INFO:teuthology.orchestra.run.smithi037.stdout:generic/149 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:55:51.557 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/149 2023-12-11T18:55:51.557 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/149 2023-12-11T18:55:51.557 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:55:51.566 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:51.659 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:55:51.659 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/150) 2023-12-11T18:55:52.373 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:55:52.385 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:55:52.386 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:55:52.389 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:55:52.390 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:53.130 INFO:teuthology.orchestra.run.smithi037.stdout:generic/150 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:55:53.143 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/150 2023-12-11T18:55:53.143 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/150 2023-12-11T18:55:53.143 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:55:53.152 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:53.256 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:55:53.256 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/151) 2023-12-11T18:55:53.977 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:55:53.989 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:55:53.991 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:55:53.993 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:55:53.994 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:54.645 INFO:teuthology.orchestra.run.smithi037.stdout:generic/151 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:55:54.658 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/151 2023-12-11T18:55:54.658 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/151 2023-12-11T18:55:54.658 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:55:54.667 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:54.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:55:54.784 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/152) 2023-12-11T18:55:55.501 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:55:55.515 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:55:55.516 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:55:55.520 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:55:55.520 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:56.198 INFO:teuthology.orchestra.run.smithi037.stdout:generic/152 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:55:56.210 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/152 2023-12-11T18:55:56.211 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/152 2023-12-11T18:55:56.211 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:55:56.219 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:56.334 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:55:56.334 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/153) 2023-12-11T18:55:57.046 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:55:57.057 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:55:57.059 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:55:57.061 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:55:57.062 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:57.765 INFO:teuthology.orchestra.run.smithi037.stdout:generic/153 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:55:57.777 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/153 2023-12-11T18:55:57.777 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/153 2023-12-11T18:55:57.777 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:55:57.787 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:57.894 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:55:57.894 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/154) 2023-12-11T18:55:58.613 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:55:58.626 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:55:58.627 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:55:58.630 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:55:58.630 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:59.319 INFO:teuthology.orchestra.run.smithi037.stdout:generic/154 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:55:59.336 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/154 2023-12-11T18:55:59.336 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/154 2023-12-11T18:55:59.336 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:55:59.347 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:55:59.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:55:59.482 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/155) 2023-12-11T18:56:00.184 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:00.195 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:00.197 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:00.199 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:00.200 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:00.918 INFO:teuthology.orchestra.run.smithi037.stdout:generic/155 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:56:00.935 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/155 2023-12-11T18:56:00.935 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/155 2023-12-11T18:56:00.935 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:00.946 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:01.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:01.042 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/156) 2023-12-11T18:56:01.785 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:01.798 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:01.799 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:01.801 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:01.802 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:02.487 INFO:teuthology.orchestra.run.smithi037.stdout:generic/156 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:56:02.500 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/156 2023-12-11T18:56:02.500 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/156 2023-12-11T18:56:02.500 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:02.509 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:02.621 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:02.621 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/157) 2023-12-11T18:56:03.344 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:03.357 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:03.358 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:03.361 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:03.361 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:04.060 INFO:teuthology.orchestra.run.smithi037.stdout:generic/157 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:56:04.078 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/157 2023-12-11T18:56:04.079 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/157 2023-12-11T18:56:04.079 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:04.087 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:04.179 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:04.179 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/158) 2023-12-11T18:56:04.938 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:04.950 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:04.952 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:04.955 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:04.955 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:05.628 INFO:teuthology.orchestra.run.smithi037.stdout:generic/158 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-11T18:56:05.640 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/158 2023-12-11T18:56:05.640 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/158 2023-12-11T18:56:05.640 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:05.651 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:05.756 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:05.756 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/159) 2023-12-11T18:56:06.468 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:06.481 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:06.483 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:06.486 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:06.486 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:07.157 INFO:teuthology.orchestra.run.smithi037.stdout:generic/159 [not run] file system doesn't support chattr +i 2023-12-11T18:56:07.171 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/159 2023-12-11T18:56:07.171 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/159 2023-12-11T18:56:07.172 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:07.181 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:07.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:07.237 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/160) 2023-12-11T18:56:07.798 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:07.810 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:07.811 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:07.814 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:07.814 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:08.441 INFO:teuthology.orchestra.run.smithi037.stdout:generic/160 [not run] file system doesn't support chattr +i 2023-12-11T18:56:08.452 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/160 2023-12-11T18:56:08.453 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/160 2023-12-11T18:56:08.453 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:08.460 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:08.502 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:08.503 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/161) 2023-12-11T18:56:09.092 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:09.107 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:09.109 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:09.112 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:09.112 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:10.054 INFO:teuthology.orchestra.run.smithi037.stdout:generic/161 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:56:10.078 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/161 2023-12-11T18:56:10.078 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/161 2023-12-11T18:56:10.078 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:10.094 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:10.447 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:10.448 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/162) 2023-12-11T18:56:10.939 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:10.953 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:10.955 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:10.958 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:10.958 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:11.851 INFO:teuthology.orchestra.run.smithi037.stdout:generic/162 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-11T18:56:11.933 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/162 2023-12-11T18:56:11.937 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/162 2023-12-11T18:56:11.937 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:11.948 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:12.374 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:12.374 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/163) 2023-12-11T18:56:12.875 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:12.887 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:12.888 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:12.891 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:12.891 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:13.759 INFO:teuthology.orchestra.run.smithi037.stdout:generic/163 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-11T18:56:13.833 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/163 2023-12-11T18:56:13.833 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/163 2023-12-11T18:56:13.833 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:13.844 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:14.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:14.267 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/164) 2023-12-11T18:56:14.759 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:14.773 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:14.774 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:14.778 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:14.778 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:15.678 INFO:teuthology.orchestra.run.smithi037.stdout:generic/164 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:56:15.697 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/164 2023-12-11T18:56:15.697 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/164 2023-12-11T18:56:15.697 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:15.715 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:16.082 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:16.082 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/165) 2023-12-11T18:56:16.582 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:16.596 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:16.598 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:16.602 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:16.602 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:17.505 INFO:teuthology.orchestra.run.smithi037.stdout:generic/165 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:56:17.530 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/165 2023-12-11T18:56:17.531 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/165 2023-12-11T18:56:17.531 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:17.547 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:17.843 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:17.844 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/166) 2023-12-11T18:56:18.324 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:18.339 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:18.340 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:18.344 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:18.344 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:19.336 INFO:teuthology.orchestra.run.smithi037.stdout:generic/166 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:56:19.356 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/166 2023-12-11T18:56:19.356 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/166 2023-12-11T18:56:19.356 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:19.377 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:19.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:19.714 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/167) 2023-12-11T18:56:20.251 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:20.265 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:20.266 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:20.269 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:20.269 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:21.189 INFO:teuthology.orchestra.run.smithi037.stdout:generic/167 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:56:21.212 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/167 2023-12-11T18:56:21.213 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/167 2023-12-11T18:56:21.213 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:21.228 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:21.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:21.598 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/168) 2023-12-11T18:56:22.090 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:22.104 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:22.105 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:22.109 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:22.109 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:23.006 INFO:teuthology.orchestra.run.smithi037.stdout:generic/168 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:56:23.023 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/168 2023-12-11T18:56:23.023 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/168 2023-12-11T18:56:23.023 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:23.038 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:23.410 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:23.410 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/169) 2023-12-11T18:56:23.910 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:23.922 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:23.923 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:23.927 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:23.927 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:25.083 INFO:teuthology.orchestra.run.smithi037.stdout:generic/169 1s 2023-12-11T18:56:25.097 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/169 2023-12-11T18:56:25.097 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:25.103 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:25.125 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:25.126 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/170) 2023-12-11T18:56:25.732 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:25.746 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:25.747 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:25.751 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:25.751 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:26.747 INFO:teuthology.orchestra.run.smithi037.stdout:generic/170 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:56:26.770 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/170 2023-12-11T18:56:26.771 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/170 2023-12-11T18:56:26.771 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:26.792 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:27.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:27.136 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/171) 2023-12-11T18:56:27.627 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:27.641 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:27.642 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:27.645 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:27.646 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:28.548 INFO:teuthology.orchestra.run.smithi037.stdout:generic/171 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:56:28.564 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/171 2023-12-11T18:56:28.564 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/171 2023-12-11T18:56:28.565 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:28.577 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:28.961 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:28.961 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/172) 2023-12-11T18:56:29.438 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:29.451 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:29.453 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:29.457 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:29.457 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:30.384 INFO:teuthology.orchestra.run.smithi037.stdout:generic/172 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:56:30.405 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/172 2023-12-11T18:56:30.406 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/172 2023-12-11T18:56:30.406 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:30.425 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:30.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:30.771 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/173) 2023-12-11T18:56:31.275 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:31.289 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:31.290 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:31.294 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:31.294 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:32.219 INFO:teuthology.orchestra.run.smithi037.stdout:generic/173 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:56:32.243 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/173 2023-12-11T18:56:32.243 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/173 2023-12-11T18:56:32.243 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:32.263 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:32.591 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:32.591 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/174) 2023-12-11T18:56:33.074 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:33.088 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:33.089 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:33.093 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:33.093 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:33.993 INFO:teuthology.orchestra.run.smithi037.stdout:generic/174 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:56:34.016 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/174 2023-12-11T18:56:34.016 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/174 2023-12-11T18:56:34.016 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:34.037 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:34.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:34.385 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/175) 2023-12-11T18:56:34.905 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:34.917 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:34.919 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:34.922 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:34.922 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:35.846 INFO:teuthology.orchestra.run.smithi037.stdout:generic/175 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:56:35.865 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/175 2023-12-11T18:56:35.866 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/175 2023-12-11T18:56:35.866 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:35.877 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:36.209 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:36.210 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/176) 2023-12-11T18:56:36.764 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:36.777 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:36.778 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:36.782 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:36.782 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:37.687 INFO:teuthology.orchestra.run.smithi037.stdout:generic/176 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:56:37.704 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/176 2023-12-11T18:56:37.704 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/176 2023-12-11T18:56:37.704 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:37.719 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:37.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:37.980 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/177) 2023-12-11T18:56:38.518 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:38.534 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:38.534 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:38.536 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:38.536 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:39.576 INFO:teuthology.orchestra.run.smithi037.stdout:generic/177 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-11T18:56:39.590 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/177 2023-12-11T18:56:39.590 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/177 2023-12-11T18:56:39.590 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:39.600 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:39.743 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:39.743 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/178) 2023-12-11T18:56:40.427 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:40.438 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:40.440 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:40.444 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:40.444 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:41.128 INFO:teuthology.orchestra.run.smithi037.stdout:generic/178 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:56:41.141 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/178 2023-12-11T18:56:41.141 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/178 2023-12-11T18:56:41.141 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:41.149 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:41.230 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:41.230 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/179) 2023-12-11T18:56:41.979 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:41.992 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:41.993 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:41.997 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:41.997 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:42.676 INFO:teuthology.orchestra.run.smithi037.stdout:generic/179 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:56:42.687 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/179 2023-12-11T18:56:42.688 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/179 2023-12-11T18:56:42.688 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:42.696 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:42.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:42.792 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/180) 2023-12-11T18:56:43.544 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:43.558 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:43.560 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:43.563 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:43.563 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:44.228 INFO:teuthology.orchestra.run.smithi037.stdout:generic/180 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:56:44.242 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/180 2023-12-11T18:56:44.242 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/180 2023-12-11T18:56:44.242 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:44.251 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:44.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:44.379 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/181) 2023-12-11T18:56:45.091 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:45.105 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:45.106 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:45.109 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:45.109 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:45.774 INFO:teuthology.orchestra.run.smithi037.stdout:generic/181 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T18:56:45.786 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/181 2023-12-11T18:56:45.787 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/181 2023-12-11T18:56:45.787 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:45.795 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:45.879 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:45.880 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/182) 2023-12-11T18:56:46.598 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:46.612 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:46.614 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:46.617 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:46.617 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:47.305 INFO:teuthology.orchestra.run.smithi037.stdout:generic/182 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-11T18:56:47.318 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/182 2023-12-11T18:56:47.318 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/182 2023-12-11T18:56:47.318 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:47.329 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:47.465 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:47.465 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/183) 2023-12-11T18:56:48.142 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:48.152 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:48.153 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:48.156 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:48.156 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:49.011 INFO:teuthology.orchestra.run.smithi037.stdout:generic/183 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:56:49.039 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/183 2023-12-11T18:56:49.039 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/183 2023-12-11T18:56:49.039 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:49.057 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:49.421 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:49.421 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/184) 2023-12-11T18:56:49.887 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:49.897 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:49.898 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:49.901 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:49.901 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:50.568 INFO:teuthology.orchestra.run.smithi037.stdout:generic/184 0s 2023-12-11T18:56:50.584 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/184 2023-12-11T18:56:50.584 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:50.592 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:50.630 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:50.634 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/185) 2023-12-11T18:56:51.173 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:51.185 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:51.187 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:51.189 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:51.189 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:52.166 INFO:teuthology.orchestra.run.smithi037.stdout:generic/185 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:56:52.198 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/185 2023-12-11T18:56:52.201 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/185 2023-12-11T18:56:52.201 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:52.214 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:52.530 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:52.531 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/186) 2023-12-11T18:56:53.039 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:53.051 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:53.052 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:53.056 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:53.056 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:53.980 INFO:teuthology.orchestra.run.smithi037.stdout:generic/186 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:56:54.009 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/186 2023-12-11T18:56:54.009 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/186 2023-12-11T18:56:54.009 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:54.030 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:54.389 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:54.389 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/187) 2023-12-11T18:56:54.881 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:54.895 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:54.896 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:54.900 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:54.900 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:55.809 INFO:teuthology.orchestra.run.smithi037.stdout:generic/187 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:56:55.836 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/187 2023-12-11T18:56:55.836 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/187 2023-12-11T18:56:55.836 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:55.858 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:56.089 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:56.089 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/188) 2023-12-11T18:56:56.593 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:56.604 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:56.605 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:56.607 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:56.607 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:57.511 INFO:teuthology.orchestra.run.smithi037.stdout:generic/188 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:56:57.540 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/188 2023-12-11T18:56:57.540 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/188 2023-12-11T18:56:57.540 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:57.562 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:57.936 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:57.936 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/189) 2023-12-11T18:56:58.430 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:56:58.442 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:56:58.443 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:56:58.446 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:56:58.446 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:59.343 INFO:teuthology.orchestra.run.smithi037.stdout:generic/189 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:56:59.374 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/189 2023-12-11T18:56:59.375 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/189 2023-12-11T18:56:59.375 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:56:59.396 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:56:59.782 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:56:59.783 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/190) 2023-12-11T18:57:00.286 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:57:00.298 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:57:00.300 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:57:00.303 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:57:00.303 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:01.211 INFO:teuthology.orchestra.run.smithi037.stdout:generic/190 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:57:01.237 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/190 2023-12-11T18:57:01.238 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/190 2023-12-11T18:57:01.238 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:57:01.260 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:01.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:57:01.498 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/191) 2023-12-11T18:57:02.012 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:57:02.026 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:57:02.027 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:57:02.030 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:57:02.030 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:02.945 INFO:teuthology.orchestra.run.smithi037.stdout:generic/191 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:57:02.966 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/191 2023-12-11T18:57:02.966 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/191 2023-12-11T18:57:02.966 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:57:02.980 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:03.257 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:57:03.282 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/192) 2023-12-11T18:57:03.783 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:57:03.796 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:57:03.797 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:57:03.801 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:57:03.801 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:04.464 INFO:teuthology.orchestra.run.smithi037.stdout:generic/192 [not run] atime not maintained by ceph 2023-12-11T18:57:04.476 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/192 2023-12-11T18:57:04.476 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/192 2023-12-11T18:57:04.476 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:57:04.484 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:04.518 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:57:04.518 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/193) 2023-12-11T18:57:05.069 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:57:05.082 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:57:05.084 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:57:05.087 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:57:05.087 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:07.829 INFO:teuthology.orchestra.run.smithi037.stdout:generic/193 2s 2023-12-11T18:57:07.846 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/193 2023-12-11T18:57:07.846 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:57:07.853 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:08.004 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:57:08.004 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/194) 2023-12-11T18:57:08.693 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:57:08.705 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:57:08.706 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:57:08.709 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:57:08.709 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:09.622 INFO:teuthology.orchestra.run.smithi037.stdout:generic/194 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:57:09.646 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/194 2023-12-11T18:57:09.646 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/194 2023-12-11T18:57:09.646 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:57:09.656 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:09.992 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:57:09.992 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/195) 2023-12-11T18:57:10.501 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:57:10.515 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:57:10.516 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:57:10.520 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:57:10.520 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:11.381 INFO:teuthology.orchestra.run.smithi037.stdout:generic/195 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:57:11.397 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/195 2023-12-11T18:57:11.398 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/195 2023-12-11T18:57:11.398 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:57:11.409 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:11.801 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:57:11.801 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/196) 2023-12-11T18:57:12.312 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:57:12.326 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:57:12.328 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:57:12.331 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:57:12.331 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:13.284 INFO:teuthology.orchestra.run.smithi037.stdout:generic/196 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:57:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/196 2023-12-11T18:57:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/196 2023-12-11T18:57:13.300 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:57:13.313 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:13.620 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:57:13.621 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/197) 2023-12-11T18:57:14.108 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:57:14.121 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:57:14.122 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:57:14.125 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:57:14.125 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:15.003 INFO:teuthology.orchestra.run.smithi037.stdout:generic/197 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:57:15.019 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/197 2023-12-11T18:57:15.019 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/197 2023-12-11T18:57:15.019 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:57:15.031 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:15.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:57:15.369 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/198) 2023-12-11T18:57:15.843 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:57:15.855 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:57:15.856 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:57:15.859 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:57:15.859 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:17.749 INFO:teuthology.orchestra.run.smithi037.stdout:generic/198 1s 2023-12-11T18:57:17.767 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/198 2023-12-11T18:57:17.767 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:57:17.776 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:17.869 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:57:17.869 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/199) 2023-12-11T18:57:18.655 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:57:18.666 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:57:18.667 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:57:18.670 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:57:18.670 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:19.603 INFO:teuthology.orchestra.run.smithi037.stdout:generic/199 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:57:19.620 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/199 2023-12-11T18:57:19.620 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/199 2023-12-11T18:57:19.620 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:57:19.632 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:20.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:57:20.000 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/200) 2023-12-11T18:57:20.485 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:57:20.498 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:57:20.500 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:57:20.502 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:57:20.503 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:21.399 INFO:teuthology.orchestra.run.smithi037.stdout:generic/200 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:57:21.426 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/200 2023-12-11T18:57:21.426 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/200 2023-12-11T18:57:21.426 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:57:21.442 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:21.786 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:57:21.786 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/201) 2023-12-11T18:57:22.282 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:57:22.294 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:57:22.295 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:57:22.298 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:57:22.298 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:23.256 INFO:teuthology.orchestra.run.smithi037.stdout:generic/201 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:57:23.274 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/201 2023-12-11T18:57:23.275 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/201 2023-12-11T18:57:23.275 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:57:23.290 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:23.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:57:23.607 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/202) 2023-12-11T18:57:24.090 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:57:24.103 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:57:24.104 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:57:24.107 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:57:24.108 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:24.979 INFO:teuthology.orchestra.run.smithi037.stdout:generic/202 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:57:24.999 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/202 2023-12-11T18:57:24.999 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/202 2023-12-11T18:57:25.000 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:57:25.015 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:25.393 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:57:25.393 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/203) 2023-12-11T18:57:25.879 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:57:25.891 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:57:25.893 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:57:25.896 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:57:25.896 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:26.799 INFO:teuthology.orchestra.run.smithi037.stdout:generic/203 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:57:26.823 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/203 2023-12-11T18:57:26.823 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/203 2023-12-11T18:57:26.823 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:57:26.836 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:27.240 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:57:27.240 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/204) 2023-12-11T18:57:27.718 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:57:27.730 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:57:27.731 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:57:27.734 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:57:27.734 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:28.780 INFO:teuthology.orchestra.run.smithi037.stdout:generic/204 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-11T18:57:28.794 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/204 2023-12-11T18:57:28.794 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/204 2023-12-11T18:57:28.794 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:57:28.803 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:28.844 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:57:28.844 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/205) 2023-12-11T18:57:29.395 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:57:29.408 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:57:29.410 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:57:29.413 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:57:29.413 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:30.356 INFO:teuthology.orchestra.run.smithi037.stdout:generic/205 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:57:30.384 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/205 2023-12-11T18:57:30.384 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/205 2023-12-11T18:57:30.384 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:57:30.401 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:30.727 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:57:30.727 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/206) 2023-12-11T18:57:31.235 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:57:31.249 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:57:31.250 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:57:31.254 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:57:31.254 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:32.170 INFO:teuthology.orchestra.run.smithi037.stdout:generic/206 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T18:57:32.192 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/206 2023-12-11T18:57:32.192 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/206 2023-12-11T18:57:32.192 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:57:32.205 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:32.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:57:32.576 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/207) 2023-12-11T18:57:33.060 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:57:33.074 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:57:33.076 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:57:33.079 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:57:33.080 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:43.390 INFO:teuthology.orchestra.run.smithi037.stdout:generic/207 10s 2023-12-11T18:57:43.403 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/207 2023-12-11T18:57:43.403 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T18:57:43.410 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:57:43.471 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T18:57:43.471 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/208) 2023-12-11T18:57:44.216 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T18:57:44.229 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T18:57:44.231 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T18:57:44.234 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T18:57:44.234 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T18:58:27.988 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:58:27.996 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:58:59.355 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:58:59.362 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:59:29.495 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:59:29.501 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:59:59.669 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T18:59:59.680 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:00:29.822 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:00:29.835 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:01:00.791 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:01:00.802 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:01:00.908 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T19:01:00.909+0000 7f690ba68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 297144) UID: 0 2023-12-11T19:01:00.909 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T19:01:00.908+0000 7f8de7bd6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 297144) UID: 0 2023-12-11T19:01:00.909 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T19:01:00.908+0000 7f5aba636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 297144) UID: 0 2023-12-11T19:01:00.909 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T19:01:00.909+0000 7fb782446640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 297144) UID: 0 2023-12-11T19:01:05.090 INFO:teuthology.orchestra.run.smithi037.stdout:generic/208 201s 2023-12-11T19:01:05.106 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/208 2023-12-11T19:01:05.106 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:01:05.114 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:01:05.227 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:01:05.227 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/209) 2023-12-11T19:01:05.939 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:01:05.952 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:01:05.953 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:01:05.956 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:01:05.956 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:01:50.667 INFO:teuthology.orchestra.run.smithi037.stdout:generic/209 44s 2023-12-11T19:01:50.683 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/209 2023-12-11T19:01:50.683 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:01:50.692 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:01:50.771 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:01:50.771 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/210) 2023-12-11T19:01:51.509 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:01:51.522 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:01:51.523 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:01:51.527 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:01:51.527 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:01:52.349 INFO:teuthology.orchestra.run.smithi037.stdout:generic/210 1s 2023-12-11T19:01:52.365 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/210 2023-12-11T19:01:52.365 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:01:52.373 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:01:52.458 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:01:52.458 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/211) 2023-12-11T19:01:53.156 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:01:53.169 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:01:53.170 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:01:53.173 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:01:53.173 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:01:54.381 INFO:teuthology.orchestra.run.smithi037.stdout:generic/211 1s 2023-12-11T19:01:54.396 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/211 2023-12-11T19:01:54.397 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:01:54.404 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:01:54.438 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:01:54.439 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/212) 2023-12-11T19:01:55.012 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:01:55.026 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:01:55.028 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:01:55.032 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:01:55.032 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:01:55.814 INFO:teuthology.orchestra.run.smithi037.stdout:generic/212 0s 2023-12-11T19:01:55.831 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/212 2023-12-11T19:01:55.831 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:01:55.839 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:01:55.873 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:01:55.873 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/213) 2023-12-11T19:01:56.421 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:01:56.434 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:01:56.435 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:01:56.438 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:01:56.438 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:01:57.054 INFO:teuthology.orchestra.run.smithi037.stdout:generic/213 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T19:01:57.065 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/213 2023-12-11T19:01:57.065 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/213 2023-12-11T19:01:57.065 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:01:57.072 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:01:57.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:01:57.105 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/214) 2023-12-11T19:01:57.668 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:01:57.682 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:01:57.684 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:01:57.687 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:01:57.687 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:01:58.342 INFO:teuthology.orchestra.run.smithi037.stdout:generic/214 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T19:01:58.356 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/214 2023-12-11T19:01:58.356 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/214 2023-12-11T19:01:58.356 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:01:58.367 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:01:58.411 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:01:58.412 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/215) 2023-12-11T19:01:59.007 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:01:59.021 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:01:59.022 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:01:59.026 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:01:59.026 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:01.770 INFO:teuthology.orchestra.run.smithi037.stdout:generic/215 2s 2023-12-11T19:02:01.786 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/215 2023-12-11T19:02:01.786 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:01.795 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:01.871 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:01.871 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/216) 2023-12-11T19:02:02.423 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:02.435 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:02.437 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:02.440 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:02.440 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:03.334 INFO:teuthology.orchestra.run.smithi037.stdout:generic/216 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:02:03.355 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/216 2023-12-11T19:02:03.355 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/216 2023-12-11T19:02:03.355 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:03.368 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:03.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:03.741 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/217) 2023-12-11T19:02:04.278 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:04.294 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:04.295 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:04.299 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:04.299 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:05.245 INFO:teuthology.orchestra.run.smithi037.stdout:generic/217 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:02:05.261 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/217 2023-12-11T19:02:05.261 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/217 2023-12-11T19:02:05.261 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:05.273 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:05.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:05.626 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/218) 2023-12-11T19:02:06.173 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:06.185 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:06.187 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:06.189 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:06.190 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:07.078 INFO:teuthology.orchestra.run.smithi037.stdout:generic/218 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:02:07.104 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/218 2023-12-11T19:02:07.104 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/218 2023-12-11T19:02:07.105 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:07.118 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:07.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:07.491 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/219) 2023-12-11T19:02:07.988 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:08.001 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:08.002 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:08.006 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:08.006 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:08.626 INFO:teuthology.orchestra.run.smithi037.stdout:generic/219 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-11T19:02:08.641 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/219 2023-12-11T19:02:08.641 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/219 2023-12-11T19:02:08.642 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:08.653 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:08.698 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:08.698 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/220) 2023-12-11T19:02:09.278 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:09.291 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:09.293 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:09.296 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:09.297 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:10.209 INFO:teuthology.orchestra.run.smithi037.stdout:generic/220 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:02:10.227 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/220 2023-12-11T19:02:10.227 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/220 2023-12-11T19:02:10.227 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:10.243 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:10.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:10.607 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/221) 2023-12-11T19:02:11.089 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:11.101 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:11.102 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:11.105 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:11.105 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:12.783 INFO:teuthology.orchestra.run.smithi037.stdout:generic/221 1s 2023-12-11T19:02:12.802 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/221 2023-12-11T19:02:12.803 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:12.813 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:12.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:12.860 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/222) 2023-12-11T19:02:13.433 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:13.447 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:13.448 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:13.452 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:13.452 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:14.396 INFO:teuthology.orchestra.run.smithi037.stdout:generic/222 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:02:14.417 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/222 2023-12-11T19:02:14.417 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/222 2023-12-11T19:02:14.418 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:14.432 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:14.773 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:14.774 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/223) 2023-12-11T19:02:15.281 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:15.295 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:15.296 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:15.299 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:15.299 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:15.954 INFO:teuthology.orchestra.run.smithi037.stdout:generic/223 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T19:02:15.965 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/223 2023-12-11T19:02:15.966 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/223 2023-12-11T19:02:15.966 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:15.973 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:16.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:16.007 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/224) 2023-12-11T19:02:16.575 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:16.587 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:16.588 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:16.591 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:16.591 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:17.217 INFO:teuthology.orchestra.run.smithi037.stdout:generic/224 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-11T19:02:17.229 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/224 2023-12-11T19:02:17.229 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/224 2023-12-11T19:02:17.230 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:17.239 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:17.283 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:17.283 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/225) 2023-12-11T19:02:17.858 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:17.871 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:17.872 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:17.876 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:17.876 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:18.585 INFO:teuthology.orchestra.run.smithi037.stdout:generic/225 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-11T19:02:18.595 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/225 2023-12-11T19:02:18.596 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/225 2023-12-11T19:02:18.596 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:18.603 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:18.688 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:18.688 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/226) 2023-12-11T19:02:19.411 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:19.422 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:19.423 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:19.426 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:19.426 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:20.060 INFO:teuthology.orchestra.run.smithi037.stdout:generic/226 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-11T19:02:20.071 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/226 2023-12-11T19:02:20.071 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/226 2023-12-11T19:02:20.071 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:20.081 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:20.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:20.123 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/227) 2023-12-11T19:02:20.685 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:20.696 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:20.697 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:20.703 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:20.703 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:21.622 INFO:teuthology.orchestra.run.smithi037.stdout:generic/227 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:02:21.655 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/227 2023-12-11T19:02:21.655 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/227 2023-12-11T19:02:21.655 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:21.666 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:22.038 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:22.038 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/228) 2023-12-11T19:02:22.531 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:22.545 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:22.547 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:22.551 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:22.551 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:23.187 INFO:teuthology.orchestra.run.smithi037.stdout:generic/228 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T19:02:23.198 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/228 2023-12-11T19:02:23.199 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/228 2023-12-11T19:02:23.199 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:23.211 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:23.251 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:23.251 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/229) 2023-12-11T19:02:23.787 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:23.800 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:23.801 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:23.805 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:23.805 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:24.641 INFO:teuthology.orchestra.run.smithi037.stdout:generic/229 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:02:24.666 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/229 2023-12-11T19:02:24.666 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/229 2023-12-11T19:02:24.666 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:24.683 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:25.034 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:25.034 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/230) 2023-12-11T19:02:25.525 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:25.537 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:25.538 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:25.541 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:25.541 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:26.156 INFO:teuthology.orchestra.run.smithi037.stdout:generic/230 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-11T19:02:26.167 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/230 2023-12-11T19:02:26.167 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/230 2023-12-11T19:02:26.167 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:26.174 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:26.210 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:26.210 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/231) 2023-12-11T19:02:26.780 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:26.794 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:26.795 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:26.799 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:26.799 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:27.396 INFO:teuthology.orchestra.run.smithi037.stdout:generic/231 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-11T19:02:27.409 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/231 2023-12-11T19:02:27.409 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/231 2023-12-11T19:02:27.409 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:27.420 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:27.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:27.459 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/232) 2023-12-11T19:02:28.038 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:28.051 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:28.053 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:28.056 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:28.056 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:28.671 INFO:teuthology.orchestra.run.smithi037.stdout:generic/232 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-11T19:02:28.685 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/232 2023-12-11T19:02:28.685 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/232 2023-12-11T19:02:28.686 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:28.698 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:28.734 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:28.735 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/233) 2023-12-11T19:02:29.310 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:29.324 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:29.326 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:29.329 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:29.329 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:29.936 INFO:teuthology.orchestra.run.smithi037.stdout:generic/233 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-11T19:02:29.947 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/233 2023-12-11T19:02:29.947 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/233 2023-12-11T19:02:29.947 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:29.956 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:29.990 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:29.991 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/234) 2023-12-11T19:02:30.562 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:30.576 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:30.578 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:30.581 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:30.581 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:31.155 INFO:teuthology.orchestra.run.smithi037.stdout:generic/234 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-11T19:02:31.168 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/234 2023-12-11T19:02:31.169 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/234 2023-12-11T19:02:31.169 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:31.178 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:31.212 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:31.212 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/235) 2023-12-11T19:02:31.768 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:31.779 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:31.781 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:31.784 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:31.784 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:32.392 INFO:teuthology.orchestra.run.smithi037.stdout:generic/235 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-11T19:02:32.404 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/235 2023-12-11T19:02:32.405 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/235 2023-12-11T19:02:32.405 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:32.413 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:32.449 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:32.450 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/236) 2023-12-11T19:02:33.026 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:33.041 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:33.043 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:33.047 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:33.047 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:34.781 INFO:teuthology.orchestra.run.smithi037.stdout:generic/236 1s 2023-12-11T19:02:34.799 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/236 2023-12-11T19:02:34.799 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:34.808 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:34.910 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:34.910 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/237) 2023-12-11T19:02:35.625 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:35.639 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:35.640 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:35.644 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:35.644 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:36.433 INFO:teuthology.orchestra.run.smithi037.stdout:generic/237 1s 2023-12-11T19:02:36.447 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/237 2023-12-11T19:02:36.447 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:36.455 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:36.535 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:36.535 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/238) 2023-12-11T19:02:37.266 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:37.277 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:37.279 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:37.282 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:37.282 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:38.281 INFO:teuthology.orchestra.run.smithi037.stdout:generic/238 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:02:38.307 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/238 2023-12-11T19:02:38.307 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/238 2023-12-11T19:02:38.307 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:02:38.327 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:02:38.674 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:02:38.675 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/239) 2023-12-11T19:02:39.150 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:02:39.162 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:02:39.163 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:02:39.166 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:02:39.166 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:04:04.568 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:04:04.581 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:04:34.732 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:04:34.737 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:04:47.236 INFO:teuthology.orchestra.run.smithi037.stdout:generic/239 128s 2023-12-11T19:04:47.250 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/239 2023-12-11T19:04:47.251 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:04:47.258 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:04:47.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:04:47.346 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/240) 2023-12-11T19:04:48.027 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:04:48.042 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:04:48.045 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:04:48.050 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:04:48.050 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:04:49.685 INFO:teuthology.orchestra.run.smithi037.stdout:generic/240 1s 2023-12-11T19:04:49.701 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/240 2023-12-11T19:04:49.701 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:04:49.710 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:04:49.835 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:04:49.836 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/241) 2023-12-11T19:04:50.547 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:04:50.562 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:04:50.563 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:04:50.568 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:04:50.569 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:05:05.633 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:05:05.645 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:05:35.778 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:05:35.789 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:06:04.971 INFO:teuthology.orchestra.run.smithi037.stdout:generic/241 74s 2023-12-11T19:06:04.987 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/241 2023-12-11T19:06:04.987 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:06:04.996 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:05.849 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:06:05.849 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/242) 2023-12-11T19:06:05.950 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:06:05.963 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:06:06.803 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:06:06.817 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:06:06.822 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:06:06.822 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:06.822 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:07.753 INFO:teuthology.orchestra.run.smithi037.stdout:generic/242 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:06:07.779 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/242 2023-12-11T19:06:07.779 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/242 2023-12-11T19:06:07.779 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:06:07.794 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:08.042 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:06:08.042 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/243) 2023-12-11T19:06:08.598 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:06:08.614 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:06:08.615 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:06:08.619 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:08.620 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:09.661 INFO:teuthology.orchestra.run.smithi037.stdout:generic/243 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:06:09.678 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/243 2023-12-11T19:06:09.678 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/243 2023-12-11T19:06:09.679 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:06:09.691 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:09.974 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:06:09.974 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/244) 2023-12-11T19:06:10.549 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:06:10.567 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:06:10.567 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:06:10.570 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:10.570 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:11.256 INFO:teuthology.orchestra.run.smithi037.stdout:generic/244 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-11T19:06:11.272 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/244 2023-12-11T19:06:11.272 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/244 2023-12-11T19:06:11.272 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:06:11.285 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:11.332 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:06:11.332 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/245) 2023-12-11T19:06:12.012 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:06:12.028 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:06:12.030 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:06:12.034 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:12.034 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:12.871 INFO:teuthology.orchestra.run.smithi037.stdout:generic/245 0s 2023-12-11T19:06:12.890 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/245 2023-12-11T19:06:12.890 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:06:12.901 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:13.000 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:06:13.001 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/246) 2023-12-11T19:06:13.693 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:06:13.705 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:06:13.706 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:06:13.709 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:13.709 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:14.453 INFO:teuthology.orchestra.run.smithi037.stdout:generic/246 1s 2023-12-11T19:06:14.468 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/246 2023-12-11T19:06:14.468 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:06:14.476 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:14.588 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:06:14.588 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/247) 2023-12-11T19:06:15.274 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:06:15.285 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:06:15.286 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:06:15.289 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:15.289 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:30.158 INFO:teuthology.orchestra.run.smithi037.stdout:generic/247 15s 2023-12-11T19:06:30.173 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/247 2023-12-11T19:06:30.173 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:06:30.180 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:30.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:06:30.203 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/248) 2023-12-11T19:06:30.844 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:06:30.860 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:06:30.862 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:06:30.865 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:30.865 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:31.670 INFO:teuthology.orchestra.run.smithi037.stdout:generic/248 0s 2023-12-11T19:06:31.690 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/248 2023-12-11T19:06:31.690 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:06:31.699 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:31.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:06:31.750 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/249) 2023-12-11T19:06:32.399 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:06:32.412 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:06:32.413 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:06:32.417 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:32.417 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:33.618 INFO:teuthology.orchestra.run.smithi037.stdout:generic/249 1s 2023-12-11T19:06:33.638 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/249 2023-12-11T19:06:33.638 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:06:33.648 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:33.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:06:33.796 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/250) 2023-12-11T19:06:34.502 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:06:34.518 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:06:34.521 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:06:34.525 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:34.525 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:35.281 INFO:teuthology.orchestra.run.smithi037.stdout:generic/250 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:06:35.294 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/250 2023-12-11T19:06:35.295 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/250 2023-12-11T19:06:35.295 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:06:35.304 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:35.352 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:06:35.352 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/251) 2023-12-11T19:06:36.007 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:06:36.023 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:06:36.025 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:06:36.028 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:36.028 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:36.165 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:06:36.175 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:06:36.913 INFO:teuthology.orchestra.run.smithi037.stdout:generic/251 [not run] FITRIM not supported on /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:36.936 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/251 2023-12-11T19:06:36.936 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/251 2023-12-11T19:06:36.936 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:06:36.945 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:36.985 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:06:36.986 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/252) 2023-12-11T19:06:37.658 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:06:37.673 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:06:37.675 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:06:37.678 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:37.678 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:38.402 INFO:teuthology.orchestra.run.smithi037.stdout:generic/252 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:06:38.414 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/252 2023-12-11T19:06:38.415 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/252 2023-12-11T19:06:38.415 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:06:38.424 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:38.464 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:06:38.464 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/253) 2023-12-11T19:06:39.155 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:06:39.170 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:06:39.172 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:06:39.175 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:39.176 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:40.293 INFO:teuthology.orchestra.run.smithi037.stdout:generic/253 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:06:40.311 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/253 2023-12-11T19:06:40.312 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/253 2023-12-11T19:06:40.312 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:06:40.328 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:40.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:06:40.531 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/254) 2023-12-11T19:06:41.092 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:06:41.106 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:06:41.107 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:06:41.110 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:41.111 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:42.134 INFO:teuthology.orchestra.run.smithi037.stdout:generic/254 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:06:42.150 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/254 2023-12-11T19:06:42.151 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/254 2023-12-11T19:06:42.151 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:06:42.164 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:42.440 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:06:42.440 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/255) 2023-12-11T19:06:42.976 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:06:42.992 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:06:42.994 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:06:42.998 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:42.999 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:44.005 INFO:teuthology.orchestra.run.smithi037.stdout:generic/255 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T19:06:44.025 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/255 2023-12-11T19:06:44.025 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/255 2023-12-11T19:06:44.025 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:06:44.037 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:44.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:06:44.147 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/256) 2023-12-11T19:06:44.876 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:06:44.891 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:06:44.892 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:06:44.896 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:44.896 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:46.263 INFO:teuthology.orchestra.run.smithi037.stdout:generic/256 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-11T19:06:46.276 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/256 2023-12-11T19:06:46.277 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/256 2023-12-11T19:06:46.277 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:06:46.289 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:46.326 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:06:46.327 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/257) 2023-12-11T19:06:46.929 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:06:46.945 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:06:46.948 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:06:46.953 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:46.953 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:48.740 INFO:teuthology.orchestra.run.smithi037.stdout:generic/257 1s 2023-12-11T19:06:48.757 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/257 2023-12-11T19:06:48.757 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:06:48.766 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:48.865 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:06:48.865 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/258) 2023-12-11T19:06:49.572 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:06:49.583 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:06:49.584 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:06:49.586 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:49.586 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:50.204 INFO:teuthology.orchestra.run.smithi037.stdout:generic/258 [not run] ceph does not support negative timestamps 2023-12-11T19:06:50.217 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/258 2023-12-11T19:06:50.217 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/258 2023-12-11T19:06:50.217 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:06:50.227 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:50.266 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:06:50.266 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/259) 2023-12-11T19:06:50.916 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:06:50.933 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:06:50.935 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:06:50.938 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:50.938 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:51.989 INFO:teuthology.orchestra.run.smithi037.stdout:generic/259 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:06:52.024 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/259 2023-12-11T19:06:52.024 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/259 2023-12-11T19:06:52.027 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:06:52.049 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:52.264 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:06:52.265 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/260) 2023-12-11T19:06:52.855 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:06:52.871 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:06:52.872 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:06:52.876 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:52.876 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:53.755 INFO:teuthology.orchestra.run.smithi037.stdout:generic/260 [not run] FITRIM not supported on /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:53.776 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/260 2023-12-11T19:06:53.777 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/260 2023-12-11T19:06:53.777 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:06:53.789 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:53.830 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:06:53.832 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/261) 2023-12-11T19:06:54.521 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:06:54.537 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:06:54.540 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:06:54.544 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:54.544 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:55.572 INFO:teuthology.orchestra.run.smithi037.stdout:generic/261 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:06:55.589 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/261 2023-12-11T19:06:55.589 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/261 2023-12-11T19:06:55.589 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:06:55.602 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:55.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:06:55.837 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/262) 2023-12-11T19:06:56.399 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:06:56.414 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:06:56.415 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:06:56.419 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:56.419 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:57.475 INFO:teuthology.orchestra.run.smithi037.stdout:generic/262 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:06:57.497 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/262 2023-12-11T19:06:57.497 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/262 2023-12-11T19:06:57.497 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:06:57.512 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:06:57.703 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:06:57.703 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/263) 2023-12-11T19:06:58.262 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:06:58.276 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:06:58.278 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:06:58.281 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:06:58.282 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:07:06.323 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:07:06.334 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:07:36.486 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:07:36.496 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:08:06.634 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:08:06.646 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:08:36.780 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:08:36.792 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:08:40.026 INFO:teuthology.orchestra.run.smithi037.stdout:generic/263 102s 2023-12-11T19:08:40.044 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/263 2023-12-11T19:08:40.044 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:08:40.053 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:08:40.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:08:40.162 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/264) 2023-12-11T19:08:40.886 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:08:40.901 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:08:40.903 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:08:40.906 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:08:40.907 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:08:41.889 INFO:teuthology.orchestra.run.smithi037.stdout:generic/264 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:08:41.906 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/264 2023-12-11T19:08:41.906 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/264 2023-12-11T19:08:41.906 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:08:41.926 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:08:42.198 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:08:42.198 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/265) 2023-12-11T19:08:42.730 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:08:42.747 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:08:42.749 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:08:42.753 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:08:42.753 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:08:43.803 INFO:teuthology.orchestra.run.smithi037.stdout:generic/265 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:08:43.820 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/265 2023-12-11T19:08:43.820 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/265 2023-12-11T19:08:43.820 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:08:43.833 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:08:44.075 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:08:44.075 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/266) 2023-12-11T19:08:44.602 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:08:44.615 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:08:44.617 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:08:44.620 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:08:44.620 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:08:45.702 INFO:teuthology.orchestra.run.smithi037.stdout:generic/266 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:08:45.719 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/266 2023-12-11T19:08:45.720 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/266 2023-12-11T19:08:45.720 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:08:45.733 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:08:45.954 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:08:45.955 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/267) 2023-12-11T19:08:46.484 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:08:46.501 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:08:46.504 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:08:46.509 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:08:46.509 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:08:47.611 INFO:teuthology.orchestra.run.smithi037.stdout:generic/267 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:08:47.635 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/267 2023-12-11T19:08:47.635 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/267 2023-12-11T19:08:47.635 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:08:47.650 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:08:47.880 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:08:47.880 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/268) 2023-12-11T19:08:48.419 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:08:48.431 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:08:48.433 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:08:48.437 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:08:48.437 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:08:49.547 INFO:teuthology.orchestra.run.smithi037.stdout:generic/268 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:08:49.563 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/268 2023-12-11T19:08:49.564 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/268 2023-12-11T19:08:49.564 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:08:49.576 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:08:49.730 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:08:49.731 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/269) 2023-12-11T19:08:50.345 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:08:50.360 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:08:50.362 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:08:50.365 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:08:50.366 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:08:51.057 INFO:teuthology.orchestra.run.smithi037.stdout:generic/269 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-11T19:08:51.069 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/269 2023-12-11T19:08:51.069 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/269 2023-12-11T19:08:51.069 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:08:51.079 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:08:51.117 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:08:51.117 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/270) 2023-12-11T19:08:51.755 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:08:51.772 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:08:51.773 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:08:51.777 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:08:51.777 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:08:52.431 INFO:teuthology.orchestra.run.smithi037.stdout:generic/270 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-11T19:08:52.445 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/270 2023-12-11T19:08:52.445 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/270 2023-12-11T19:08:52.446 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:08:52.456 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:08:52.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:08:52.498 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/271) 2023-12-11T19:08:53.131 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:08:53.147 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:08:53.149 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:08:53.153 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:08:53.153 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:08:54.257 INFO:teuthology.orchestra.run.smithi037.stdout:generic/271 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:08:54.279 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/271 2023-12-11T19:08:54.280 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/271 2023-12-11T19:08:54.280 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:08:54.296 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:08:54.528 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:08:54.528 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/272) 2023-12-11T19:08:55.064 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:08:55.079 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:08:55.081 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:08:55.084 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:08:55.085 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:08:56.162 INFO:teuthology.orchestra.run.smithi037.stdout:generic/272 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:08:56.181 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/272 2023-12-11T19:08:56.182 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/272 2023-12-11T19:08:56.182 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:08:56.194 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:08:56.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:08:56.338 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/273) 2023-12-11T19:08:56.902 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:08:56.920 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:08:56.921 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:08:56.925 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:08:56.925 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:08:57.616 INFO:teuthology.orchestra.run.smithi037.stdout:generic/273 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-11T19:08:57.628 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/273 2023-12-11T19:08:57.629 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/273 2023-12-11T19:08:57.629 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:08:57.640 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:08:57.692 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:08:57.693 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/274) 2023-12-11T19:08:58.332 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:08:58.344 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:08:58.345 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:08:58.349 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:08:58.349 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:08:59.021 INFO:teuthology.orchestra.run.smithi037.stdout:generic/274 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-11T19:08:59.037 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/274 2023-12-11T19:08:59.037 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/274 2023-12-11T19:08:59.037 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:08:59.050 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:08:59.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:08:59.106 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/275) 2023-12-11T19:08:59.748 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:08:59.761 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:08:59.763 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:08:59.766 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:08:59.767 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:00.498 INFO:teuthology.orchestra.run.smithi037.stdout:generic/275 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-11T19:09:00.512 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/275 2023-12-11T19:09:00.513 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/275 2023-12-11T19:09:00.513 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:00.522 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:00.564 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:00.565 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/276) 2023-12-11T19:09:01.174 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:01.188 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:01.190 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:01.193 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:01.193 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:02.249 INFO:teuthology.orchestra.run.smithi037.stdout:generic/276 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:09:02.271 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/276 2023-12-11T19:09:02.271 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/276 2023-12-11T19:09:02.271 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:02.288 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:02.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:02.548 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/277) 2023-12-11T19:09:03.065 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:03.080 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:03.082 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:03.085 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:03.085 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:03.798 INFO:teuthology.orchestra.run.smithi037.stdout:generic/277 [not run] file system doesn't support chattr +A 2023-12-11T19:09:03.813 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/277 2023-12-11T19:09:03.814 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/277 2023-12-11T19:09:03.814 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:03.825 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:03.884 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:03.885 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/278) 2023-12-11T19:09:04.548 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:04.561 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:04.563 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:04.566 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:04.566 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:05.723 INFO:teuthology.orchestra.run.smithi037.stdout:generic/278 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:09:05.741 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/278 2023-12-11T19:09:05.741 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/278 2023-12-11T19:09:05.741 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:05.756 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:05.861 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:05.862 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/279) 2023-12-11T19:09:06.416 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:06.430 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:06.432 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:06.435 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:06.435 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:06.929 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:09:06.936 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:09:07.480 INFO:teuthology.orchestra.run.smithi037.stdout:generic/279 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:09:07.504 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/279 2023-12-11T19:09:07.505 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/279 2023-12-11T19:09:07.505 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:07.522 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:07.631 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:07.632 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/280) 2023-12-11T19:09:08.198 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:08.213 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:08.214 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:08.218 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:08.218 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:08.973 INFO:teuthology.orchestra.run.smithi037.stdout:generic/280 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-11T19:09:08.987 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/280 2023-12-11T19:09:08.988 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/280 2023-12-11T19:09:08.988 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:08.999 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:09.049 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:09.049 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/281) 2023-12-11T19:09:09.718 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:09.735 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:09.738 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:09.742 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:09.742 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:10.888 INFO:teuthology.orchestra.run.smithi037.stdout:generic/281 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:09:10.904 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/281 2023-12-11T19:09:10.904 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/281 2023-12-11T19:09:10.904 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:10.922 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:11.120 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:11.120 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/282) 2023-12-11T19:09:11.655 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:11.668 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:11.669 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:11.673 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:11.673 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:12.785 INFO:teuthology.orchestra.run.smithi037.stdout:generic/282 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:09:12.805 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/282 2023-12-11T19:09:12.806 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/282 2023-12-11T19:09:12.806 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:12.821 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:12.987 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:12.988 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/283) 2023-12-11T19:09:13.560 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:13.576 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:13.578 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:13.581 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:13.581 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:14.729 INFO:teuthology.orchestra.run.smithi037.stdout:generic/283 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:09:14.749 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/283 2023-12-11T19:09:14.750 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/283 2023-12-11T19:09:14.750 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:14.763 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:14.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:14.989 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/284) 2023-12-11T19:09:15.516 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:15.530 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:15.531 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:15.536 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:15.536 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:16.622 INFO:teuthology.orchestra.run.smithi037.stdout:generic/284 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:09:16.649 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/284 2023-12-11T19:09:16.649 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/284 2023-12-11T19:09:16.649 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:16.664 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:16.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:16.926 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/285) 2023-12-11T19:09:17.501 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:17.515 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:17.517 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:17.521 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:17.521 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:20.759 INFO:teuthology.orchestra.run.smithi037.stdout:generic/285 3s 2023-12-11T19:09:20.776 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/285 2023-12-11T19:09:20.776 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:20.784 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:21.293 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:21.293 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/286) 2023-12-11T19:09:22.080 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:22.093 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:22.095 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:22.097 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:22.098 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:22.790 INFO:teuthology.orchestra.run.smithi037.stdout:generic/286 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T19:09:22.805 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/286 2023-12-11T19:09:22.805 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/286 2023-12-11T19:09:22.805 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:22.813 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:22.856 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:22.856 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/287) 2023-12-11T19:09:23.475 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:23.491 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:23.492 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:23.495 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:23.495 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:24.454 INFO:teuthology.orchestra.run.smithi037.stdout:generic/287 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:09:24.470 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/287 2023-12-11T19:09:24.471 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/287 2023-12-11T19:09:24.471 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:24.483 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:24.728 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:24.728 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/288) 2023-12-11T19:09:25.368 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:25.383 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:25.386 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:25.390 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:25.390 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:26.218 INFO:teuthology.orchestra.run.smithi037.stdout:generic/288 [not run] FITRIM not supported on /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:26.253 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/288 2023-12-11T19:09:26.254 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/288 2023-12-11T19:09:26.254 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:26.265 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:26.294 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:26.294 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/289) 2023-12-11T19:09:26.836 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:26.851 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:26.852 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:26.855 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:26.856 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:27.922 INFO:teuthology.orchestra.run.smithi037.stdout:generic/289 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:09:27.941 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/289 2023-12-11T19:09:27.941 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/289 2023-12-11T19:09:27.941 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:27.954 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:28.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:28.172 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/290) 2023-12-11T19:09:28.714 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:28.730 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:28.732 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:28.736 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:28.736 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:29.787 INFO:teuthology.orchestra.run.smithi037.stdout:generic/290 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:09:29.806 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/290 2023-12-11T19:09:29.806 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/290 2023-12-11T19:09:29.807 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:29.821 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:30.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:30.081 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/291) 2023-12-11T19:09:30.608 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:30.619 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:30.621 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:30.625 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:30.625 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:31.651 INFO:teuthology.orchestra.run.smithi037.stdout:generic/291 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:09:31.668 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/291 2023-12-11T19:09:31.668 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/291 2023-12-11T19:09:31.668 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:31.681 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:31.949 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:31.949 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/292) 2023-12-11T19:09:32.481 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:32.496 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:32.498 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:32.502 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:32.502 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:33.553 INFO:teuthology.orchestra.run.smithi037.stdout:generic/292 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:09:33.573 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/292 2023-12-11T19:09:33.577 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/292 2023-12-11T19:09:33.577 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:33.593 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:33.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:33.838 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/293) 2023-12-11T19:09:34.388 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:34.405 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:34.406 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:34.410 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:34.410 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:35.459 INFO:teuthology.orchestra.run.smithi037.stdout:generic/293 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:09:35.480 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/293 2023-12-11T19:09:35.480 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/293 2023-12-11T19:09:35.480 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:35.493 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:35.793 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:35.793 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/294) 2023-12-11T19:09:36.340 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:36.355 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:36.357 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:36.361 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:36.361 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:37.057 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:09:37.063 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:09:37.561 INFO:teuthology.orchestra.run.smithi037.stdout:generic/294 1s 2023-12-11T19:09:37.603 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/294 2023-12-11T19:09:37.604 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:37.623 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:37.671 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:37.671 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/295) 2023-12-11T19:09:38.258 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:38.271 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:38.272 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:38.275 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:38.275 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:39.337 INFO:teuthology.orchestra.run.smithi037.stdout:generic/295 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:09:39.355 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/295 2023-12-11T19:09:39.357 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/295 2023-12-11T19:09:39.357 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:39.369 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:39.615 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:39.615 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/296) 2023-12-11T19:09:40.162 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:40.177 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:40.179 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:40.183 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:40.183 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:41.218 INFO:teuthology.orchestra.run.smithi037.stdout:generic/296 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:09:41.237 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/296 2023-12-11T19:09:41.238 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/296 2023-12-11T19:09:41.239 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:41.250 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:41.570 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:41.570 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/297) 2023-12-11T19:09:42.077 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:42.092 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:42.093 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:42.097 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:42.097 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:43.123 INFO:teuthology.orchestra.run.smithi037.stdout:generic/297 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:09:43.140 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/297 2023-12-11T19:09:43.140 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/297 2023-12-11T19:09:43.140 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:43.154 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:43.414 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:43.414 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/298) 2023-12-11T19:09:43.958 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:43.971 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:43.973 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:43.976 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:43.976 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:45.018 INFO:teuthology.orchestra.run.smithi037.stdout:generic/298 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:09:45.034 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/298 2023-12-11T19:09:45.035 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/298 2023-12-11T19:09:45.035 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:45.047 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:45.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:45.346 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/299) 2023-12-11T19:09:45.860 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:45.875 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:45.877 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:45.881 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:45.881 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:46.668 INFO:teuthology.orchestra.run.smithi037.stdout:generic/299 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:09:46.683 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/299 2023-12-11T19:09:46.684 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/299 2023-12-11T19:09:46.684 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:46.696 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:46.750 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:46.750 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/300) 2023-12-11T19:09:47.364 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:47.377 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:47.379 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:47.382 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:47.383 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:48.159 INFO:teuthology.orchestra.run.smithi037.stdout:generic/300 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:09:48.176 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/300 2023-12-11T19:09:48.176 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/300 2023-12-11T19:09:48.176 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:48.190 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:48.236 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:48.236 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/301) 2023-12-11T19:09:48.884 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:48.898 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:48.900 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:48.903 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:48.904 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:49.873 INFO:teuthology.orchestra.run.smithi037.stdout:generic/301 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:09:49.890 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/301 2023-12-11T19:09:49.890 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/301 2023-12-11T19:09:49.890 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:49.902 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:50.153 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:50.154 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/302) 2023-12-11T19:09:50.716 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:50.732 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:50.734 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:50.737 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:50.738 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:51.805 INFO:teuthology.orchestra.run.smithi037.stdout:generic/302 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:09:51.822 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/302 2023-12-11T19:09:51.822 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/302 2023-12-11T19:09:51.822 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:51.838 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:52.129 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:52.129 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/303) 2023-12-11T19:09:52.666 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:52.682 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:52.684 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:52.687 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:52.688 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:53.502 INFO:teuthology.orchestra.run.smithi037.stdout:generic/303 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T19:09:53.517 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/303 2023-12-11T19:09:53.517 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/303 2023-12-11T19:09:53.517 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:53.527 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:53.645 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:53.645 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/304) 2023-12-11T19:09:54.361 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:54.376 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:54.378 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:54.382 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:54.383 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:55.171 INFO:teuthology.orchestra.run.smithi037.stdout:generic/304 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-11T19:09:55.183 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/304 2023-12-11T19:09:55.183 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/304 2023-12-11T19:09:55.184 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:55.196 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:55.341 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:55.341 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/305) 2023-12-11T19:09:56.018 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:56.030 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:56.032 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:56.035 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:56.035 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:57.032 INFO:teuthology.orchestra.run.smithi037.stdout:generic/305 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:09:57.051 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/305 2023-12-11T19:09:57.051 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/305 2023-12-11T19:09:57.051 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:57.064 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:57.318 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:57.318 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/306) 2023-12-11T19:09:57.856 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:09:57.868 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:09:57.870 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:09:57.873 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:09:57.873 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:59.236 INFO:teuthology.orchestra.run.smithi037.stdout:generic/306 1s 2023-12-11T19:09:59.272 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/306 2023-12-11T19:09:59.272 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:09:59.286 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:09:59.499 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:09:59.500 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/307) 2023-12-11T19:10:00.215 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:10:00.228 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:10:00.230 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:10:00.234 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:10:00.234 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:10:02.561 INFO:teuthology.orchestra.run.smithi037.stdout:generic/307 2s 2023-12-11T19:10:02.687 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/307 2023-12-11T19:10:02.687 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:10:02.702 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:10:02.740 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:10:02.740 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/308) 2023-12-11T19:10:03.404 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:10:03.417 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:10:03.419 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:10:03.422 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:10:03.423 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:10:04.164 INFO:teuthology.orchestra.run.smithi037.stdout:generic/308 1s 2023-12-11T19:10:04.183 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/308 2023-12-11T19:10:04.183 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:10:04.192 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:10:04.237 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:10:04.238 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/309) 2023-12-11T19:10:04.875 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:10:04.891 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:10:04.893 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:10:04.896 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:10:04.896 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:10:06.721 INFO:teuthology.orchestra.run.smithi037.stdout:generic/309 1s 2023-12-11T19:10:06.740 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/309 2023-12-11T19:10:06.740 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:10:06.749 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:10:06.837 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:10:06.837 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/310) 2023-12-11T19:10:07.198 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:10:07.206 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:10:07.544 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:10:07.559 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:10:07.561 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:10:07.564 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:10:07.564 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:10:37.329 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:10:37.337 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:11:07.478 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:11:07.487 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:11:37.642 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:11:37.656 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:11:38.520 INFO:teuthology.orchestra.run.smithi037.stdout:generic/310 91s 2023-12-11T19:11:39.725 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/310 2023-12-11T19:11:39.725 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:11:39.738 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:11:39.924 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:11:39.924 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/311) 2023-12-11T19:11:40.546 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:11:40.557 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:11:40.559 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:11:40.562 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:11:40.562 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:11:41.372 INFO:teuthology.orchestra.run.smithi037.stdout:generic/311 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:11:41.388 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/311 2023-12-11T19:11:41.388 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/311 2023-12-11T19:11:41.388 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:11:41.401 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:11:41.450 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:11:41.451 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/312) 2023-12-11T19:11:42.094 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:11:42.110 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:11:42.113 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:11:42.117 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:11:42.117 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:11:42.803 INFO:teuthology.orchestra.run.smithi037.stdout:generic/312 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T19:11:42.817 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/312 2023-12-11T19:11:42.818 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/312 2023-12-11T19:11:42.818 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:11:42.831 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:11:42.888 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:11:42.889 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/313) 2023-12-11T19:11:43.565 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:11:43.578 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:11:43.580 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:11:43.584 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:11:43.584 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:11:48.400 INFO:teuthology.orchestra.run.smithi037.stdout:generic/313 5s 2023-12-11T19:11:48.421 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/313 2023-12-11T19:11:48.421 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:11:48.431 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:11:48.480 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:11:48.480 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/314) 2023-12-11T19:11:49.124 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:11:49.140 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:11:49.142 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:11:49.146 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:11:49.146 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:11:50.415 INFO:teuthology.orchestra.run.smithi037.stdout:generic/314 1s 2023-12-11T19:11:50.431 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/314 2023-12-11T19:11:50.431 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:11:50.441 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:11:50.498 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:11:50.499 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/315) 2023-12-11T19:11:51.170 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:11:51.188 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:11:51.190 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:11:51.194 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:11:51.194 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:11:51.938 INFO:teuthology.orchestra.run.smithi037.stdout:generic/315 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-11T19:11:51.951 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/315 2023-12-11T19:11:51.951 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/315 2023-12-11T19:11:51.951 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:11:51.961 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:11:52.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:11:52.012 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/316) 2023-12-11T19:11:52.682 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:11:52.698 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:11:52.700 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:11:52.704 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:11:52.704 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:11:53.747 INFO:teuthology.orchestra.run.smithi037.stdout:generic/316 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-11T19:11:53.762 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/316 2023-12-11T19:11:53.762 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/316 2023-12-11T19:11:53.762 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:11:53.775 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:11:53.887 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:11:53.887 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/317) 2023-12-11T19:11:54.605 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:11:54.618 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:11:54.620 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:11:54.623 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:11:54.623 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:11:56.421 INFO:teuthology.orchestra.run.smithi037.stdout:generic/317 2s 2023-12-11T19:11:56.439 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/317 2023-12-11T19:11:56.439 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:11:56.449 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:11:56.477 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:11:56.477 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/318) 2023-12-11T19:11:57.139 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:11:57.153 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:11:57.155 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:11:57.158 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:11:57.158 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:11:58.546 INFO:teuthology.orchestra.run.smithi037.stdout:generic/318 1s 2023-12-11T19:11:58.562 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/318 2023-12-11T19:11:58.562 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:11:58.570 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:11:58.597 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:11:58.597 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/319) 2023-12-11T19:11:59.253 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:11:59.266 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:11:59.268 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:11:59.271 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:11:59.271 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:12:00.323 INFO:teuthology.orchestra.run.smithi037.stdout:generic/319 1s 2023-12-11T19:12:00.344 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/319 2023-12-11T19:12:00.344 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:12:00.354 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:12:00.384 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:12:00.384 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/320) 2023-12-11T19:12:01.051 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:12:01.067 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:12:01.069 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:12:01.072 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:12:01.073 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:12:01.790 INFO:teuthology.orchestra.run.smithi037.stdout:generic/320 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-11T19:12:01.802 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/320 2023-12-11T19:12:01.802 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/320 2023-12-11T19:12:01.802 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:12:01.812 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:12:01.857 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:12:01.857 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/321) 2023-12-11T19:12:02.493 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:12:02.508 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:12:02.509 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:12:02.513 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:12:02.513 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:12:03.210 INFO:teuthology.orchestra.run.smithi037.stdout:generic/321 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:12:03.228 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/321 2023-12-11T19:12:03.228 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/321 2023-12-11T19:12:03.228 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:12:03.240 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:12:03.288 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:12:03.288 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/322) 2023-12-11T19:12:03.939 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:12:03.953 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:12:03.955 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:12:03.959 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:12:03.960 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:12:04.710 INFO:teuthology.orchestra.run.smithi037.stdout:generic/322 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:12:04.724 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/322 2023-12-11T19:12:04.724 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/322 2023-12-11T19:12:04.724 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:12:04.734 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:12:04.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:12:04.777 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/323) 2023-12-11T19:12:05.435 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:12:05.452 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:12:05.454 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:12:05.457 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:12:05.457 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:12:08.454 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:12:08.460 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:12:38.602 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:12:38.609 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:13:09.582 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:13:09.589 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:13:39.722 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:13:39.727 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:14:07.017 INFO:teuthology.orchestra.run.smithi037.stdout:generic/323 121s 2023-12-11T19:14:07.063 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/323 2023-12-11T19:14:07.063 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:14:07.076 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:07.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:14:07.173 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/324) 2023-12-11T19:14:08.053 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:14:08.067 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:14:08.068 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:14:08.071 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:14:08.072 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:08.703 INFO:teuthology.orchestra.run.smithi037.stdout:generic/324 [not run] defragmentation not supported for fstype "ceph" 2023-12-11T19:14:08.715 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/324 2023-12-11T19:14:08.715 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/324 2023-12-11T19:14:08.715 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:14:08.723 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:08.766 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:14:08.766 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/325) 2023-12-11T19:14:10.254 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:14:10.264 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:14:10.572 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:14:10.860 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:14:10.862 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:14:10.867 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:14:10.867 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:16.067 INFO:teuthology.orchestra.run.smithi037.stdout:generic/325 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:14:16.083 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/325 2023-12-11T19:14:16.083 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/325 2023-12-11T19:14:16.083 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:14:16.096 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:16.147 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:14:16.147 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/326) 2023-12-11T19:14:16.727 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:14:16.741 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:14:16.742 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:14:16.745 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:14:16.745 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:17.733 INFO:teuthology.orchestra.run.smithi037.stdout:generic/326 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:14:17.750 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/326 2023-12-11T19:14:17.750 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/326 2023-12-11T19:14:17.750 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:14:17.768 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:18.015 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:14:18.015 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/327) 2023-12-11T19:14:18.568 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:14:18.583 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:14:18.585 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:14:18.588 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:14:18.589 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:19.662 INFO:teuthology.orchestra.run.smithi037.stdout:generic/327 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:14:19.675 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/327 2023-12-11T19:14:19.675 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/327 2023-12-11T19:14:19.676 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:14:19.688 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:19.939 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:14:19.939 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/328) 2023-12-11T19:14:20.475 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:14:20.486 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:14:20.487 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:14:20.490 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:14:20.490 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:21.595 INFO:teuthology.orchestra.run.smithi037.stdout:generic/328 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:14:21.612 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/328 2023-12-11T19:14:21.612 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/328 2023-12-11T19:14:21.612 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:14:21.625 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:21.907 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:14:21.908 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/329) 2023-12-11T19:14:22.459 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:14:22.474 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:14:22.475 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:14:22.478 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:14:22.479 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:23.685 INFO:teuthology.orchestra.run.smithi037.stdout:generic/329 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:14:23.705 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/329 2023-12-11T19:14:23.705 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/329 2023-12-11T19:14:23.705 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:14:23.715 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:23.898 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:14:23.898 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/330) 2023-12-11T19:14:24.419 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:14:24.433 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:14:24.435 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:14:24.439 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:14:24.439 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:25.467 INFO:teuthology.orchestra.run.smithi037.stdout:generic/330 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:14:25.483 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/330 2023-12-11T19:14:25.483 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/330 2023-12-11T19:14:25.484 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:14:25.496 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:25.738 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:14:25.739 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/331) 2023-12-11T19:14:26.334 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:14:26.351 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:14:26.352 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:14:26.356 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:14:26.356 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:27.517 INFO:teuthology.orchestra.run.smithi037.stdout:generic/331 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:14:27.534 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/331 2023-12-11T19:14:27.535 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/331 2023-12-11T19:14:27.535 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:14:27.547 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:27.736 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:14:27.736 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/332) 2023-12-11T19:14:28.253 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:14:28.265 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:14:28.267 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:14:28.270 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:14:28.270 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:29.285 INFO:teuthology.orchestra.run.smithi037.stdout:generic/332 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:14:29.310 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/332 2023-12-11T19:14:29.310 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/332 2023-12-11T19:14:29.310 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:14:29.331 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:29.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:14:29.534 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/333) 2023-12-11T19:14:30.115 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:14:30.132 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:14:30.134 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:14:30.139 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:14:30.139 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:31.246 INFO:teuthology.orchestra.run.smithi037.stdout:generic/333 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:14:31.264 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/333 2023-12-11T19:14:31.264 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/333 2023-12-11T19:14:31.264 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:14:31.277 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:31.533 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:14:31.533 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/334) 2023-12-11T19:14:32.095 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:14:32.112 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:14:32.113 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:14:32.117 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:14:32.117 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:33.218 INFO:teuthology.orchestra.run.smithi037.stdout:generic/334 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:14:33.242 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/334 2023-12-11T19:14:33.242 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/334 2023-12-11T19:14:33.242 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:14:33.253 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:33.425 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:14:33.425 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/335) 2023-12-11T19:14:33.998 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:14:34.010 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:14:34.012 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:14:34.015 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:14:34.016 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:34.783 INFO:teuthology.orchestra.run.smithi037.stdout:generic/335 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:14:34.797 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/335 2023-12-11T19:14:34.797 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/335 2023-12-11T19:14:34.797 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:14:34.807 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:34.855 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:14:34.855 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/336) 2023-12-11T19:14:35.541 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:14:35.557 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:14:35.559 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:14:35.563 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:14:35.563 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:36.301 INFO:teuthology.orchestra.run.smithi037.stdout:generic/336 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:14:36.318 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/336 2023-12-11T19:14:36.318 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/336 2023-12-11T19:14:36.318 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:14:36.330 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:36.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:14:36.392 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/337) 2023-12-11T19:14:37.021 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:14:37.037 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:14:37.039 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:14:37.043 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:14:37.043 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:38.133 INFO:teuthology.orchestra.run.smithi037.stdout:generic/337 1s 2023-12-11T19:14:38.153 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/337 2023-12-11T19:14:38.153 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:14:38.164 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:38.200 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:14:38.200 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/338) 2023-12-11T19:14:38.850 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:14:38.866 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:14:38.868 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:14:38.872 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:14:38.872 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:39.632 INFO:teuthology.orchestra.run.smithi037.stdout:generic/338 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:14:39.648 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/338 2023-12-11T19:14:39.648 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/338 2023-12-11T19:14:39.648 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:14:39.661 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:39.714 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:14:39.714 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/339) 2023-12-11T19:14:40.381 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:14:40.397 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:14:40.399 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:14:40.402 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:14:40.403 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:14:41.037 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:14:41.043 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:15:11.216 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:15:11.225 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:15:41.353 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:15:41.363 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:16:11.509 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:16:11.520 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:16:18.976 INFO:teuthology.orchestra.run.smithi037.stdout:generic/339 98s 2023-12-11T19:16:18.990 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/339 2023-12-11T19:16:18.990 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:16:18.997 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:16:19.020 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:16:19.020 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/340) 2023-12-11T19:16:19.613 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:16:19.627 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:16:19.629 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:16:19.633 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:16:19.633 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:16:25.948 INFO:teuthology.orchestra.run.smithi037.stdout:generic/340 6s 2023-12-11T19:16:25.986 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/340 2023-12-11T19:16:25.986 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:16:26.003 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:16:26.041 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:16:26.042 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/341) 2023-12-11T19:16:26.645 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:16:26.659 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:16:26.660 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:16:26.663 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:16:26.664 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:16:27.410 INFO:teuthology.orchestra.run.smithi037.stdout:generic/341 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:16:27.420 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/341 2023-12-11T19:16:27.420 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/341 2023-12-11T19:16:27.420 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:16:27.427 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:16:27.457 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:16:27.458 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/342) 2023-12-11T19:16:28.057 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:16:28.073 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:16:28.075 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:16:28.079 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:16:28.079 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:16:28.821 INFO:teuthology.orchestra.run.smithi037.stdout:generic/342 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:16:28.837 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/342 2023-12-11T19:16:28.837 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/342 2023-12-11T19:16:28.837 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:16:28.849 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:16:28.896 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:16:28.896 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/343) 2023-12-11T19:16:29.530 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:16:29.546 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:16:29.548 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:16:29.552 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:16:29.552 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:16:30.415 INFO:teuthology.orchestra.run.smithi037.stdout:generic/343 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:16:30.428 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/343 2023-12-11T19:16:30.428 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/343 2023-12-11T19:16:30.429 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:16:30.439 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:16:30.501 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:16:30.501 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/344) 2023-12-11T19:16:31.164 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:16:31.180 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:16:31.182 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:16:31.187 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:16:31.187 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:16:41.672 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:16:41.689 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:16:41.958 INFO:teuthology.orchestra.run.smithi037.stdout:generic/344 10s 2023-12-11T19:16:41.991 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/344 2023-12-11T19:16:41.991 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:16:42.005 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:16:42.051 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:16:42.052 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/345) 2023-12-11T19:16:42.644 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:16:42.658 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:16:42.660 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:16:42.664 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:16:42.664 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:16:55.330 INFO:teuthology.orchestra.run.smithi037.stdout:generic/345 13s 2023-12-11T19:16:55.359 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/345 2023-12-11T19:16:55.361 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:16:55.375 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:16:55.418 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:16:55.418 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/346) 2023-12-11T19:16:56.030 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:16:56.048 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:16:56.050 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:16:56.053 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:16:56.053 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:01.762 INFO:teuthology.orchestra.run.smithi037.stdout:generic/346 5s 2023-12-11T19:17:01.796 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/346 2023-12-11T19:17:01.796 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:01.813 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:01.859 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:01.859 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/347) 2023-12-11T19:17:02.585 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:02.598 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:02.601 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:02.605 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:02.605 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:03.987 INFO:teuthology.orchestra.run.smithi037.stdout:generic/347 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:17:04.000 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/347 2023-12-11T19:17:04.000 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/347 2023-12-11T19:17:04.000 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:04.010 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:04.058 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:04.059 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/348) 2023-12-11T19:17:04.715 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:04.732 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:04.734 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:04.738 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:04.739 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:05.525 INFO:teuthology.orchestra.run.smithi037.stdout:generic/348 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:17:05.538 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/348 2023-12-11T19:17:05.538 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/348 2023-12-11T19:17:05.539 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:05.548 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:05.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:05.608 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/349) 2023-12-11T19:17:06.248 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:06.262 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:06.264 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:06.267 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:06.267 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:07.227 INFO:teuthology.orchestra.run.smithi037.stdout:generic/349 [not run] xfs_io fzero failed (old kernel/wrong fs?) 2023-12-11T19:17:07.238 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/349 2023-12-11T19:17:07.238 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/349 2023-12-11T19:17:07.238 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:07.246 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:07.302 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:07.302 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/350) 2023-12-11T19:17:07.921 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:07.932 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:07.933 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:07.936 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:07.936 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:09.647 INFO:teuthology.orchestra.run.smithi037.stdout:generic/350 1s 2023-12-11T19:17:09.666 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/350 2023-12-11T19:17:09.666 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:09.675 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:09.705 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:09.705 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/351) 2023-12-11T19:17:10.313 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:10.328 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:10.330 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:10.333 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:10.334 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:11.084 INFO:teuthology.orchestra.run.smithi037.stdout:generic/351 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T19:17:11.102 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/351 2023-12-11T19:17:11.102 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/351 2023-12-11T19:17:11.102 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:11.112 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:11.175 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:11.175 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/352) 2023-12-11T19:17:11.821 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:11.837 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:11.839 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:11.843 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:11.843 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:11.853 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:17:11.859 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:17:12.927 INFO:teuthology.orchestra.run.smithi037.stdout:generic/352 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:17:12.947 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/352 2023-12-11T19:17:12.947 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/352 2023-12-11T19:17:12.947 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:12.957 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:13.128 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:13.129 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/353) 2023-12-11T19:17:13.733 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:13.747 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:13.748 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:13.751 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:13.751 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:14.791 INFO:teuthology.orchestra.run.smithi037.stdout:generic/353 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:17:14.809 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/353 2023-12-11T19:17:14.809 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/353 2023-12-11T19:17:14.809 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:14.821 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:14.951 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:14.951 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/354) 2023-12-11T19:17:15.551 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:15.565 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:15.566 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:15.570 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:15.570 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:27.340 INFO:teuthology.orchestra.run.smithi037.stdout:generic/354 12s 2023-12-11T19:17:27.368 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/354 2023-12-11T19:17:27.368 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:27.380 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:27.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:27.423 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/355) 2023-12-11T19:17:28.053 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:28.066 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:28.067 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:28.070 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:28.070 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:29.784 INFO:teuthology.orchestra.run.smithi037.stdout:generic/355 1s 2023-12-11T19:17:29.803 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/355 2023-12-11T19:17:29.803 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:29.812 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:29.962 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:29.962 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/356) 2023-12-11T19:17:30.635 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:30.650 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:30.652 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:30.656 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:30.656 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:31.732 INFO:teuthology.orchestra.run.smithi037.stdout:generic/356 [not run] swapfiles are not supported 2023-12-11T19:17:31.745 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/356 2023-12-11T19:17:31.746 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/356 2023-12-11T19:17:31.746 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:31.755 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:31.812 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:31.812 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/357) 2023-12-11T19:17:32.466 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:32.481 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:32.482 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:32.486 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:32.486 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:33.535 INFO:teuthology.orchestra.run.smithi037.stdout:generic/357 [not run] swapfiles are not supported 2023-12-11T19:17:33.548 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/357 2023-12-11T19:17:33.549 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/357 2023-12-11T19:17:33.549 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:33.560 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:33.611 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:33.611 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/358) 2023-12-11T19:17:34.246 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:34.260 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:34.262 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:34.265 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:34.265 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:35.386 INFO:teuthology.orchestra.run.smithi037.stdout:generic/358 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:17:35.405 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/358 2023-12-11T19:17:35.405 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/358 2023-12-11T19:17:35.406 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:35.422 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:35.582 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:35.582 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/359) 2023-12-11T19:17:36.178 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:36.192 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:36.193 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:36.197 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:36.197 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:37.363 INFO:teuthology.orchestra.run.smithi037.stdout:generic/359 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:17:37.380 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/359 2023-12-11T19:17:37.380 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/359 2023-12-11T19:17:37.380 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:37.393 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:37.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:37.548 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/360) 2023-12-11T19:17:38.129 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:38.142 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:38.144 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:38.147 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:38.147 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:38.967 INFO:teuthology.orchestra.run.smithi037.stdout:generic/360 0s 2023-12-11T19:17:38.985 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/360 2023-12-11T19:17:38.985 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:38.994 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:39.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:39.049 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/361) 2023-12-11T19:17:39.735 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:39.751 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:39.753 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:39.758 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:39.758 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:40.561 INFO:teuthology.orchestra.run.smithi037.stdout:generic/361 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:17:40.578 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/361 2023-12-11T19:17:40.579 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/361 2023-12-11T19:17:40.579 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:40.591 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:40.646 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:40.646 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/362) 2023-12-11T19:17:41.292 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:41.308 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:41.309 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:41.313 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:41.313 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:42.000 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:17:42.007 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:17:42.028 INFO:teuthology.orchestra.run.smithi037.stdout:generic/362 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-11T19:17:42.040 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/362 2023-12-11T19:17:42.041 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/362 2023-12-11T19:17:42.041 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:42.050 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:42.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:42.091 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/363) 2023-12-11T19:17:42.815 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:42.828 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:42.829 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:42.832 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:42.833 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:43.526 INFO:teuthology.orchestra.run.smithi037.stdout:generic/363 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-11T19:17:43.539 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/363 2023-12-11T19:17:43.539 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/363 2023-12-11T19:17:43.539 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:43.549 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:43.594 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:43.594 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/364) 2023-12-11T19:17:44.248 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:44.263 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:44.264 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:44.267 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:44.268 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:45.006 INFO:teuthology.orchestra.run.smithi037.stdout:generic/364 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-11T19:17:45.022 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/364 2023-12-11T19:17:45.022 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/364 2023-12-11T19:17:45.023 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:45.036 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:45.086 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:45.087 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/365) 2023-12-11T19:17:45.757 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:45.772 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:45.773 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:45.777 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:45.777 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:46.454 INFO:teuthology.orchestra.run.smithi037.stdout:generic/365 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-11T19:17:46.470 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/365 2023-12-11T19:17:46.470 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/365 2023-12-11T19:17:46.470 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:46.482 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:46.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:46.531 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/366) 2023-12-11T19:17:47.183 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:47.197 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:47.199 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:47.202 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:47.203 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:47.911 INFO:teuthology.orchestra.run.smithi037.stdout:generic/366 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-11T19:17:47.925 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/366 2023-12-11T19:17:47.925 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/366 2023-12-11T19:17:47.925 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:47.935 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:47.980 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:47.980 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/367) 2023-12-11T19:17:48.633 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:48.650 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:48.652 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:48.655 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:48.656 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:49.355 INFO:teuthology.orchestra.run.smithi037.stdout:generic/367 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-11T19:17:49.369 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/367 2023-12-11T19:17:49.370 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/367 2023-12-11T19:17:49.370 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:49.382 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:49.432 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:49.433 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/368) 2023-12-11T19:17:50.094 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:50.110 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:50.112 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:50.116 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:50.116 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:50.864 INFO:teuthology.orchestra.run.smithi037.stdout:generic/368 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-11T19:17:50.879 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/368 2023-12-11T19:17:50.879 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/368 2023-12-11T19:17:50.879 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:50.889 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:50.935 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:50.936 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/369) 2023-12-11T19:17:51.550 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:51.563 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:51.564 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:51.567 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:51.567 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:52.289 INFO:teuthology.orchestra.run.smithi037.stdout:generic/369 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-11T19:17:52.305 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/369 2023-12-11T19:17:52.305 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/369 2023-12-11T19:17:52.305 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:52.317 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:52.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:52.367 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/370) 2023-12-11T19:17:53.067 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:53.083 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:53.084 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:53.088 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:53.088 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:53.794 INFO:teuthology.orchestra.run.smithi037.stdout:generic/370 [not run] this test requires richacl support on $SCRATCH_DEV 2023-12-11T19:17:53.807 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/370 2023-12-11T19:17:53.807 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/370 2023-12-11T19:17:53.807 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:53.816 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:53.860 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:53.861 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/371) 2023-12-11T19:17:54.525 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:54.538 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:54.541 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:54.544 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:54.544 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:55.287 INFO:teuthology.orchestra.run.smithi037.stdout:generic/371 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T19:17:55.303 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/371 2023-12-11T19:17:55.304 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/371 2023-12-11T19:17:55.304 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:55.316 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:55.380 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:55.381 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/372) 2023-12-11T19:17:56.063 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:56.078 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:56.080 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:56.083 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:56.084 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:57.234 INFO:teuthology.orchestra.run.smithi037.stdout:generic/372 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:17:57.251 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/372 2023-12-11T19:17:57.252 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/372 2023-12-11T19:17:57.252 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:57.270 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:57.379 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:57.379 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/373) 2023-12-11T19:17:57.975 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:57.990 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:57.992 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:57.996 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:57.996 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:59.131 INFO:teuthology.orchestra.run.smithi037.stdout:generic/373 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:17:59.150 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/373 2023-12-11T19:17:59.151 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/373 2023-12-11T19:17:59.151 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:17:59.163 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:17:59.357 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:17:59.357 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/374) 2023-12-11T19:17:59.925 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:17:59.941 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:17:59.943 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:17:59.947 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:17:59.947 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:01.001 INFO:teuthology.orchestra.run.smithi037.stdout:generic/374 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-11T19:18:01.119 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/374 2023-12-11T19:18:01.119 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/374 2023-12-11T19:18:01.119 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:01.132 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:01.312 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:01.312 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/375) 2023-12-11T19:18:01.906 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:01.919 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:01.921 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:01.924 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:01.924 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:02.887 INFO:teuthology.orchestra.run.smithi037.stdout:generic/375 0s 2023-12-11T19:18:02.905 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/375 2023-12-11T19:18:02.905 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:02.914 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:03.052 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:03.053 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/376) 2023-12-11T19:18:03.723 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:03.735 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:03.736 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:03.739 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:03.739 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:04.472 INFO:teuthology.orchestra.run.smithi037.stdout:generic/376 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:18:04.488 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/376 2023-12-11T19:18:04.488 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/376 2023-12-11T19:18:04.488 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:04.501 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:04.557 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:04.558 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/377) 2023-12-11T19:18:05.217 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:05.232 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:05.234 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:05.237 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:05.237 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:06.405 INFO:teuthology.orchestra.run.smithi037.stdout:generic/377 1s 2023-12-11T19:18:06.424 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/377 2023-12-11T19:18:06.424 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:06.434 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:06.463 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:06.463 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/378) 2023-12-11T19:18:07.124 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:07.142 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:07.143 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:07.147 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:07.147 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:08.483 INFO:teuthology.orchestra.run.smithi037.stdout:generic/378 1s 2023-12-11T19:18:08.499 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/378 2023-12-11T19:18:08.499 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:08.508 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:08.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:08.649 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/379) 2023-12-11T19:18:09.330 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:09.341 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:09.343 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:09.345 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:09.346 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:10.020 INFO:teuthology.orchestra.run.smithi037.stdout:generic/379 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-11T19:18:10.033 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/379 2023-12-11T19:18:10.033 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/379 2023-12-11T19:18:10.033 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:10.043 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:10.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:10.090 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/380) 2023-12-11T19:18:10.757 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:10.773 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:10.775 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:10.778 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:10.779 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:11.466 INFO:teuthology.orchestra.run.smithi037.stdout:generic/380 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-11T19:18:11.481 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/380 2023-12-11T19:18:11.481 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/380 2023-12-11T19:18:11.482 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:11.494 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:11.544 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:11.544 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/381) 2023-12-11T19:18:12.172 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:12.186 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:12.188 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:12.189 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:18:12.195 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:18:12.196 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:12.196 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:12.837 INFO:teuthology.orchestra.run.smithi037.stdout:generic/381 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-11T19:18:12.852 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/381 2023-12-11T19:18:12.852 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/381 2023-12-11T19:18:12.852 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:12.863 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:12.909 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:12.909 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/382) 2023-12-11T19:18:13.557 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:13.571 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:13.573 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:13.576 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:13.577 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:14.278 INFO:teuthology.orchestra.run.smithi037.stdout:generic/382 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-11T19:18:14.292 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/382 2023-12-11T19:18:14.292 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/382 2023-12-11T19:18:14.292 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:14.302 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:14.354 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:14.355 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/383) 2023-12-11T19:18:14.991 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:15.005 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:15.007 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:15.010 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:15.010 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:15.727 INFO:teuthology.orchestra.run.smithi037.stdout:generic/383 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-11T19:18:15.741 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/383 2023-12-11T19:18:15.741 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/383 2023-12-11T19:18:15.741 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:15.751 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:15.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:15.796 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/384) 2023-12-11T19:18:16.466 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:16.482 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:16.484 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:16.488 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:16.488 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:17.204 INFO:teuthology.orchestra.run.smithi037.stdout:generic/384 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-11T19:18:17.219 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/384 2023-12-11T19:18:17.219 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/384 2023-12-11T19:18:17.220 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:17.232 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:17.286 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:17.287 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/385) 2023-12-11T19:18:17.936 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:17.952 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:17.954 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:17.958 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:17.958 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:18.649 INFO:teuthology.orchestra.run.smithi037.stdout:generic/385 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-11T19:18:18.664 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/385 2023-12-11T19:18:18.664 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/385 2023-12-11T19:18:18.664 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:18.674 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:18.718 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:18.719 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/386) 2023-12-11T19:18:19.362 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:19.376 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:19.377 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:19.381 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:19.381 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:20.059 INFO:teuthology.orchestra.run.smithi037.stdout:generic/386 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-11T19:18:20.073 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/386 2023-12-11T19:18:20.074 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/386 2023-12-11T19:18:20.074 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:20.085 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:20.137 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:20.138 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/387) 2023-12-11T19:18:20.779 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:20.795 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:20.797 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:20.800 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:20.800 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:21.919 INFO:teuthology.orchestra.run.smithi037.stdout:generic/387 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:18:21.945 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/387 2023-12-11T19:18:21.946 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/387 2023-12-11T19:18:21.949 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:21.965 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:22.180 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:22.181 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/388) 2023-12-11T19:18:22.761 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:22.776 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:22.777 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:22.780 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:22.781 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:23.515 INFO:teuthology.orchestra.run.smithi037.stdout:generic/388 [not run] require 172.21.15.37:6789:/scratch to be local device 2023-12-11T19:18:23.532 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/388 2023-12-11T19:18:23.532 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/388 2023-12-11T19:18:23.532 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:23.545 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:23.596 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:23.596 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/389) 2023-12-11T19:18:24.259 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:24.275 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:24.277 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:24.282 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:24.282 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:25.011 INFO:teuthology.orchestra.run.smithi037.stdout:generic/389 [not run] O_TMPFILE is not supported 2023-12-11T19:18:25.023 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/389 2023-12-11T19:18:25.023 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/389 2023-12-11T19:18:25.024 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:25.034 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:25.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:25.080 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/390) 2023-12-11T19:18:25.745 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:25.758 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:25.760 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:25.763 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:25.763 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:26.576 INFO:teuthology.orchestra.run.smithi037.stdout:generic/390 [not run] ceph does not support freezing 2023-12-11T19:18:26.590 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/390 2023-12-11T19:18:26.590 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/390 2023-12-11T19:18:26.590 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:26.600 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:26.649 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:26.649 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/391) 2023-12-11T19:18:27.289 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:27.305 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:27.307 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:27.311 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:27.311 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:28.030 INFO:teuthology.orchestra.run.smithi037.stdout:generic/391 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T19:18:28.042 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/391 2023-12-11T19:18:28.042 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/391 2023-12-11T19:18:28.043 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:28.052 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:28.105 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:28.105 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/392) 2023-12-11T19:18:28.779 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:28.794 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:28.794 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:28.796 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:28.797 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:29.698 INFO:teuthology.orchestra.run.smithi037.stdout:generic/392 [not run] ceph does not support shutdown 2023-12-11T19:18:29.725 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/392 2023-12-11T19:18:29.725 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/392 2023-12-11T19:18:29.725 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:29.735 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:29.777 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:29.777 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/393) 2023-12-11T19:18:30.439 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:30.453 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:30.454 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:30.458 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:30.458 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:32.315 INFO:teuthology.orchestra.run.smithi037.stdout:generic/393 2s 2023-12-11T19:18:32.333 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/393 2023-12-11T19:18:32.333 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:32.342 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:32.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:32.373 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/394) 2023-12-11T19:18:33.018 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:33.032 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:33.034 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:33.037 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:33.037 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:33.849 INFO:teuthology.orchestra.run.smithi037.stdout:generic/394 0s 2023-12-11T19:18:33.867 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/394 2023-12-11T19:18:33.867 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:33.876 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:34.003 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:34.003 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/395) 2023-12-11T19:18:34.778 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:34.796 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:34.798 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:34.800 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:34.800 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:37.012 INFO:teuthology.orchestra.run.smithi037.stdout:generic/395 1s 2023-12-11T19:18:37.050 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/395 2023-12-11T19:18:37.050 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:37.065 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:37.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:37.112 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/396) 2023-12-11T19:18:37.727 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:37.743 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:37.744 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:37.747 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:37.747 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:39.338 INFO:teuthology.orchestra.run.smithi037.stdout:generic/396 1s 2023-12-11T19:18:39.354 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/396 2023-12-11T19:18:39.354 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:39.362 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:39.388 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:39.388 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/397) 2023-12-11T19:18:40.036 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:40.051 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:40.053 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:40.058 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:40.058 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:42.345 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:18:42.359 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:18:42.815 INFO:teuthology.orchestra.run.smithi037.stdout:generic/397 2s 2023-12-11T19:18:42.829 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/397 2023-12-11T19:18:42.829 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:42.836 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:42.858 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:42.858 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/398) 2023-12-11T19:18:43.350 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:43.362 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:43.364 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:43.367 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:43.367 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:44.435 INFO:teuthology.orchestra.run.smithi037.stdout:generic/398 [not run] kernel doesn't support renameat2 syscall 2023-12-11T19:18:44.446 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/398 2023-12-11T19:18:44.447 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/398 2023-12-11T19:18:44.447 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:44.455 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:44.566 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:44.567 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/399) 2023-12-11T19:18:45.258 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:45.273 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:45.275 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:45.279 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:45.279 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:46.533 INFO:teuthology.orchestra.run.smithi037.stdout:generic/399 [not run] Filesystem ceph not supported in _scratch_mkfs_sized_encrypted 2023-12-11T19:18:46.548 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/399 2023-12-11T19:18:46.549 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/399 2023-12-11T19:18:46.549 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:46.561 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:46.629 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:46.629 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/400) 2023-12-11T19:18:47.261 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:47.278 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:47.279 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:47.283 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:47.283 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:47.977 INFO:teuthology.orchestra.run.smithi037.stdout:generic/400 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-11T19:18:47.992 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/400 2023-12-11T19:18:47.992 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/400 2023-12-11T19:18:47.992 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:48.002 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:48.048 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:48.048 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/401) 2023-12-11T19:18:48.706 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:48.722 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:48.724 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:48.729 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:48.729 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:50.030 INFO:teuthology.orchestra.run.smithi037.stdout:generic/401 1s 2023-12-11T19:18:50.059 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/401 2023-12-11T19:18:50.059 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:50.075 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:50.123 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:50.124 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/402) 2023-12-11T19:18:50.734 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:50.749 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:50.750 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:50.755 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:50.755 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:51.836 INFO:teuthology.orchestra.run.smithi037.stdout:generic/402 [not run] filesystem ceph timestamp bounds are unknown 2023-12-11T19:18:51.863 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/402 2023-12-11T19:18:51.863 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/402 2023-12-11T19:18:51.863 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:51.876 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:51.922 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:51.923 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/403) 2023-12-11T19:18:52.558 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:52.574 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:52.575 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:52.582 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:52.582 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:54.106 INFO:teuthology.orchestra.run.smithi037.stdout:generic/403 2s 2023-12-11T19:18:54.124 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/403 2023-12-11T19:18:54.124 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:54.132 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:54.160 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:54.160 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/404) 2023-12-11T19:18:54.812 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:54.830 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:54.830 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:54.834 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:54.834 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:55.620 INFO:teuthology.orchestra.run.smithi037.stdout:generic/404 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T19:18:55.635 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/404 2023-12-11T19:18:55.635 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/404 2023-12-11T19:18:55.635 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:55.648 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:55.710 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:55.711 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/405) 2023-12-11T19:18:56.365 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:56.381 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:56.383 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:56.386 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:56.386 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:57.288 INFO:teuthology.orchestra.run.smithi037.stdout:generic/405 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:18:57.303 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/405 2023-12-11T19:18:57.303 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/405 2023-12-11T19:18:57.303 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:18:57.316 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:18:57.367 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:18:57.368 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/406) 2023-12-11T19:18:58.048 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:18:58.064 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:18:58.066 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:18:58.069 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:18:58.070 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:02.515 INFO:teuthology.orchestra.run.smithi037.stdout:generic/406 4s 2023-12-11T19:19:02.534 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/406 2023-12-11T19:19:02.534 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:19:02.543 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:02.575 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:19:02.575 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/407) 2023-12-11T19:19:03.234 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:19:03.250 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:19:03.252 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:19:03.255 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:19:03.256 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:04.146 INFO:teuthology.orchestra.run.smithi037.stdout:generic/407 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T19:19:04.156 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/407 2023-12-11T19:19:04.156 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/407 2023-12-11T19:19:04.156 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:19:04.163 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:04.291 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:19:04.291 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/408) 2023-12-11T19:19:04.964 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:19:04.979 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:19:04.981 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:19:04.985 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:19:04.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:05.852 INFO:teuthology.orchestra.run.smithi037.stdout:generic/408 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-11T19:19:05.864 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/408 2023-12-11T19:19:05.864 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/408 2023-12-11T19:19:05.865 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:19:05.875 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:06.017 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:19:06.018 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/409) 2023-12-11T19:19:06.706 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:19:06.718 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:19:06.720 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:19:06.723 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:19:06.723 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:07.426 INFO:teuthology.orchestra.run.smithi037.stdout:generic/409 [not run] require 172.21.15.37:6789:/scratch to be local device 2023-12-11T19:19:07.438 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/409 2023-12-11T19:19:07.438 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/409 2023-12-11T19:19:07.438 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:19:07.447 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:07.492 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:19:07.492 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/410) 2023-12-11T19:19:08.164 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:19:08.181 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:19:08.183 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:19:08.188 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:19:08.188 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:08.918 INFO:teuthology.orchestra.run.smithi037.stdout:generic/410 [not run] require 172.21.15.37:6789:/scratch to be local device 2023-12-11T19:19:08.960 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/410 2023-12-11T19:19:08.960 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/410 2023-12-11T19:19:08.960 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:19:08.960 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:08.988 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:19:08.988 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/411) 2023-12-11T19:19:09.651 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:19:09.667 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:19:09.669 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:19:09.672 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:19:09.672 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:10.447 INFO:teuthology.orchestra.run.smithi037.stdout:generic/411 [not run] require 172.21.15.37:6789:/scratch to be local device 2023-12-11T19:19:10.463 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/411 2023-12-11T19:19:10.463 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/411 2023-12-11T19:19:10.464 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:19:10.477 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:10.529 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:19:10.530 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/412) 2023-12-11T19:19:11.186 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:19:11.200 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:19:11.203 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:19:11.208 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:19:11.208 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:12.532 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:19:12.541 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:19:12.576 INFO:teuthology.orchestra.run.smithi037.stdout:generic/412 1s 2023-12-11T19:19:12.593 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/412 2023-12-11T19:19:12.594 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:19:12.601 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:12.625 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:19:12.626 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/413) 2023-12-11T19:19:13.325 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:19:13.338 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:19:13.339 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:19:13.342 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:19:13.342 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:14.272 INFO:teuthology.orchestra.run.smithi037.stdout:generic/413 [not run] mount 172.21.15.37:6789:/scratch with dax failed 2023-12-11T19:19:14.285 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/413 2023-12-11T19:19:14.285 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/413 2023-12-11T19:19:14.285 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:19:14.295 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:14.338 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:19:14.339 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/414) 2023-12-11T19:19:15.008 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:19:15.023 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:19:15.025 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:19:15.029 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:19:15.029 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:16.127 INFO:teuthology.orchestra.run.smithi037.stdout:generic/414 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:19:16.151 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/414 2023-12-11T19:19:16.152 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/414 2023-12-11T19:19:16.152 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:19:16.168 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:16.373 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:19:16.374 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/415) 2023-12-11T19:19:16.963 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:19:16.978 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:19:16.980 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:19:16.985 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:19:16.985 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:18.086 INFO:teuthology.orchestra.run.smithi037.stdout:generic/415 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:19:18.106 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/415 2023-12-11T19:19:18.106 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/415 2023-12-11T19:19:18.107 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:19:18.126 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:18.243 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:19:18.244 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/416) 2023-12-11T19:19:18.850 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:19:18.863 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:19:18.864 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:19:18.867 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:19:18.867 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:19.571 INFO:teuthology.orchestra.run.smithi037.stdout:generic/416 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-11T19:19:19.585 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/416 2023-12-11T19:19:19.586 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/416 2023-12-11T19:19:19.586 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:19:19.595 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:19.641 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:19:19.641 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/417) 2023-12-11T19:19:20.303 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:19:20.318 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:19:20.319 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:19:20.322 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:19:20.323 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:21.223 INFO:teuthology.orchestra.run.smithi037.stdout:generic/417 [not run] ceph does not support shutdown 2023-12-11T19:19:21.262 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/417 2023-12-11T19:19:21.262 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/417 2023-12-11T19:19:21.262 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:19:21.273 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:21.319 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:19:21.320 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/418) 2023-12-11T19:19:21.972 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:19:21.989 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:19:21.992 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:19:21.996 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:19:21.996 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:22.854 INFO:teuthology.orchestra.run.smithi037.stdout:generic/418 [not run] require 172.21.15.37:6789:/test to be valid block disk 2023-12-11T19:19:22.870 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/418 2023-12-11T19:19:22.871 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/418 2023-12-11T19:19:22.871 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:19:22.884 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:22.941 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:19:22.942 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/419) 2023-12-11T19:19:23.609 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:19:23.626 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:19:23.629 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:19:23.633 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:19:23.633 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:24.915 INFO:teuthology.orchestra.run.smithi037.stdout:generic/419 [not run] kernel doesn't support renameat2 syscall 2023-12-11T19:19:24.930 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/419 2023-12-11T19:19:24.931 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/419 2023-12-11T19:19:24.931 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:19:24.941 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:25.077 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:19:25.077 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/420) 2023-12-11T19:19:25.755 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:19:25.770 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:19:25.772 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:19:25.775 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:19:25.775 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:26.792 INFO:teuthology.orchestra.run.smithi037.stdout:generic/420 0s 2023-12-11T19:19:26.809 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/420 2023-12-11T19:19:26.809 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:19:26.818 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:26.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:19:26.981 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/421) 2023-12-11T19:19:27.675 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:19:27.688 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:19:27.690 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:19:27.694 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:19:27.694 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:35.664 INFO:teuthology.orchestra.run.smithi037.stdout:generic/421 8s 2023-12-11T19:19:35.696 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/421 2023-12-11T19:19:35.696 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:19:35.710 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:35.752 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:19:35.752 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/422) 2023-12-11T19:19:36.331 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:19:36.343 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:19:36.345 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:19:36.347 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:19:36.347 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:37.112 INFO:teuthology.orchestra.run.smithi037.stdout:generic/422 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-11T19:19:37.124 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/422 2023-12-11T19:19:37.124 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/422 2023-12-11T19:19:37.125 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:19:37.134 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:37.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:19:37.196 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/423) 2023-12-11T19:19:37.856 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:19:37.873 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:19:37.875 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:19:37.879 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:19:37.879 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:38.928 INFO:teuthology.orchestra.run.smithi037.stdout:generic/423 0s 2023-12-11T19:19:38.948 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/423 2023-12-11T19:19:38.948 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:19:38.958 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:39.091 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:19:39.092 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/424) 2023-12-11T19:19:39.790 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:19:39.804 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:19:39.806 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:19:39.809 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:19:39.809 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:40.536 INFO:teuthology.orchestra.run.smithi037.stdout:generic/424 [not run] file system doesn't support any of /bin/chattr +a/+c/+d/+i 2023-12-11T19:19:40.549 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/424 2023-12-11T19:19:40.549 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/424 2023-12-11T19:19:40.549 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:19:40.558 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:40.602 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:19:40.602 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/425) 2023-12-11T19:19:41.237 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:19:41.251 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:19:41.253 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:19:41.256 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:19:41.256 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:42.067 INFO:teuthology.orchestra.run.smithi037.stdout:generic/425 [not run] xfs_io fiemap -a failed (old kernel/wrong fs?) 2023-12-11T19:19:42.081 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/425 2023-12-11T19:19:42.081 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/425 2023-12-11T19:19:42.081 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:19:42.091 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:19:42.203 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:19:42.204 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/426) 2023-12-11T19:19:42.740 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:19:42.748 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:19:42.836 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T19:19:42.835+0000 7f8de7bd6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 406876) UID: 0 2023-12-11T19:19:42.836 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T19:19:42.835+0000 7f5aba636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 406876) UID: 0 2023-12-11T19:19:42.837 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T19:19:42.835+0000 7fb782446640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 406876) UID: 0 2023-12-11T19:19:42.837 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T19:19:42.835+0000 7f690ba68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 406876) UID: 0 2023-12-11T19:19:42.884 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:19:42.895 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:19:42.896 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:19:42.898 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:19:42.899 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:20:38.012 INFO:teuthology.orchestra.run.smithi037.stdout:generic/426 54s 2023-12-11T19:20:38.217 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/426 2023-12-11T19:20:38.217 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:20:38.231 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:20:38.553 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:20:38.553 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/427) 2023-12-11T19:20:41.892 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:20:41.906 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:20:41.908 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:20:41.911 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:20:41.911 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:20:42.969 INFO:teuthology.orchestra.run.smithi037.stdout:generic/427 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-11T19:20:42.982 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/427 2023-12-11T19:20:42.982 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/427 2023-12-11T19:20:42.982 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:20:42.993 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:20:43.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:20:43.032 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/428) 2023-12-11T19:20:43.625 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:20:43.638 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:20:43.639 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:20:43.642 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:20:43.642 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:20:44.334 INFO:teuthology.orchestra.run.smithi037.stdout:generic/428 1s 2023-12-11T19:20:44.349 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/428 2023-12-11T19:20:44.349 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:20:44.355 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:20:44.402 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:20:44.402 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/429) 2023-12-11T19:20:44.982 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:20:44.994 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:20:44.995 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:20:44.998 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:20:44.999 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:20:57.262 INFO:teuthology.orchestra.run.smithi037.stdout:generic/429 12s 2023-12-11T19:20:57.279 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/429 2023-12-11T19:20:57.279 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:20:57.287 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:20:57.313 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:20:57.313 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/430) 2023-12-11T19:20:58.205 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:20:58.215 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:20:58.217 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:20:58.219 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:20:58.219 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:20:59.055 INFO:teuthology.orchestra.run.smithi037.stdout:generic/430 1s 2023-12-11T19:20:59.071 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/430 2023-12-11T19:20:59.071 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:20:59.080 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:20:59.196 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:20:59.197 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/431) 2023-12-11T19:20:59.878 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:20:59.889 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:20:59.891 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:20:59.894 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:20:59.894 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:21:00.702 INFO:teuthology.orchestra.run.smithi037.stdout:generic/431 0s 2023-12-11T19:21:00.718 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/431 2023-12-11T19:21:00.719 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:21:00.726 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:21:00.863 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:21:00.863 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/432) 2023-12-11T19:21:01.560 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:21:01.572 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:21:01.573 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:21:01.576 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:21:01.576 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:21:02.420 INFO:teuthology.orchestra.run.smithi037.stdout:generic/432 1s 2023-12-11T19:21:02.435 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/432 2023-12-11T19:21:02.435 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:21:02.442 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:21:02.573 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:21:02.574 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/433) 2023-12-11T19:21:03.266 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:21:03.279 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:21:03.280 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:21:03.284 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:21:03.284 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:21:04.088 INFO:teuthology.orchestra.run.smithi037.stdout:generic/433 1s 2023-12-11T19:21:04.104 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/433 2023-12-11T19:21:04.104 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:21:04.112 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:21:04.247 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:21:04.247 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/434) 2023-12-11T19:21:04.955 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:21:04.968 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:21:04.969 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:21:04.972 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:21:04.972 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:21:08.524 INFO:teuthology.orchestra.run.smithi037.stdout:generic/434 3s 2023-12-11T19:21:08.545 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/434 2023-12-11T19:21:08.545 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:21:08.555 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:21:08.702 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:21:08.702 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/435) 2023-12-11T19:21:09.414 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:21:09.426 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:21:09.427 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:21:09.430 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:21:09.430 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:22:31.445 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:22:31.455 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:22:31.651 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-12-11T19:22:31.649+0000 7f93f4e3d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 412091) UID: 0 2023-12-11T19:22:31.652 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-12-11T19:22:31.649+0000 7fcb1e884640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 412091) UID: 0 2023-12-11T19:22:31.685 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T19:22:31.684+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101178) UID: 0 2023-12-11T19:22:31.685 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T19:22:31.684+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101178) UID: 0 2023-12-11T19:22:31.686 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T19:22:31.684+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101178) UID: 0 2023-12-11T19:22:31.686 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T19:22:31.684+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101178) UID: 0 2023-12-11T19:25:57.249 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:25:57.263 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:26:27.479 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:26:27.486 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:26:57.626 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:26:57.636 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:27:27.839 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:27:27.852 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:27:58.901 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:27:58.911 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:28:29.050 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:28:29.059 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:28:59.223 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:28:59.229 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:29:29.377 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:29:29.387 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:29:29.493 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-12-11T19:29:29.492+0000 7fcb1e884640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 412455) UID: 0 2023-12-11T19:29:29.493 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-12-11T19:29:29.492+0000 7f93f4e3d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 412455) UID: 0 2023-12-11T19:32:39.692 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:32:39.699 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:32:39.834 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T19:32:39.834+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101357) UID: 0 2023-12-11T19:32:39.835 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T19:32:39.834+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101357) UID: 0 2023-12-11T19:32:39.835 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T19:32:39.834+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101357) UID: 0 2023-12-11T19:32:39.835 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T19:32:39.834+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 101357) UID: 0 2023-12-11T19:35:32.597 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:35:32.608 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:35:32.727 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-12-11T19:35:32.727+0000 7fcb1e884640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 412500) UID: 0 2023-12-11T19:35:32.728 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-12-11T19:35:32.727+0000 7f93f4e3d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 412500) UID: 0 2023-12-11T19:36:15.546 INFO:teuthology.orchestra.run.smithi037.stdout:generic/435 905s 2023-12-11T19:36:15.572 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/435 2023-12-11T19:36:15.572 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:36:15.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:36:15.619 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:36:15.620 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/436) 2023-12-11T19:36:16.253 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:36:16.266 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:36:16.267 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:36:16.270 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:36:16.271 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:36:17.789 INFO:teuthology.orchestra.run.smithi037.stdout:generic/436 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T19:36:17.800 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/436 2023-12-11T19:36:17.801 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/436 2023-12-11T19:36:17.801 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:36:17.810 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:36:17.895 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:36:17.895 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/437) 2023-12-11T19:36:18.662 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:36:18.675 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:36:18.676 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:36:18.679 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:36:18.680 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:36:20.157 INFO:teuthology.orchestra.run.smithi037.stdout:generic/437 2s 2023-12-11T19:36:20.175 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/437 2023-12-11T19:36:20.176 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:36:20.186 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:36:20.244 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:36:20.245 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/438) 2023-12-11T19:36:20.804 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:36:20.814 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:36:20.816 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:36:20.818 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:36:20.818 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:38:56.432 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:38:56.438 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:39:25.090 INFO:teuthology.orchestra.run.smithi037.stdout:generic/438 184s 2023-12-11T19:39:25.104 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/438 2023-12-11T19:39:25.105 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:39:25.112 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:39:25.156 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:39:25.157 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/439) 2023-12-11T19:39:25.762 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:39:25.778 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:39:25.780 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:39:25.784 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:39:25.784 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:39:26.619 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:39:26.629 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:39:27.669 INFO:teuthology.orchestra.run.smithi037.stdout:generic/439 1s 2023-12-11T19:39:27.684 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/439 2023-12-11T19:39:27.684 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:39:27.691 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:39:27.721 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:39:27.721 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/440) 2023-12-11T19:39:28.308 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:39:28.321 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:39:28.322 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:39:28.325 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:39:28.325 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:39:30.620 INFO:teuthology.orchestra.run.smithi037.stdout:generic/440 2s 2023-12-11T19:39:30.638 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/440 2023-12-11T19:39:30.638 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:39:30.647 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:39:30.676 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:39:30.676 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/441) 2023-12-11T19:39:31.317 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:39:31.333 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:39:31.335 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:39:31.339 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:39:31.340 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:39:32.189 INFO:teuthology.orchestra.run.smithi037.stdout:generic/441 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:39:32.204 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/441 2023-12-11T19:39:32.205 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/441 2023-12-11T19:39:32.205 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:39:32.215 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:39:32.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:39:32.274 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/442) 2023-12-11T19:39:32.942 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:39:32.962 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:39:32.963 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:39:32.964 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:39:32.964 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:39:33.715 INFO:teuthology.orchestra.run.smithi037.stdout:generic/442 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:39:33.730 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/442 2023-12-11T19:39:33.730 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/442 2023-12-11T19:39:33.730 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:39:33.742 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:39:33.792 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:39:33.792 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/443) 2023-12-11T19:39:34.441 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:39:34.456 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:39:34.457 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:39:34.461 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:39:34.461 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:39:35.282 INFO:teuthology.orchestra.run.smithi037.stdout:generic/443 1s 2023-12-11T19:39:35.302 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/443 2023-12-11T19:39:35.302 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:39:35.311 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:39:35.365 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:39:35.365 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/444) 2023-12-11T19:39:35.996 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:39:36.009 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:39:36.011 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:39:36.014 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:39:36.014 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:39:37.288 INFO:teuthology.orchestra.run.smithi037.stdout:generic/444 1s 2023-12-11T19:39:37.314 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/444 2023-12-11T19:39:37.314 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:39:37.326 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:39:37.390 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:39:37.391 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/445) 2023-12-11T19:39:38.043 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:39:38.058 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:39:38.059 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:39:38.063 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:39:38.063 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:39:39.601 INFO:teuthology.orchestra.run.smithi037.stdout:generic/445 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T19:39:39.614 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/445 2023-12-11T19:39:39.614 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/445 2023-12-11T19:39:39.614 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:39:39.623 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:39:39.746 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:39:39.747 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/446) 2023-12-11T19:39:40.468 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:39:40.483 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:39:40.485 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:39:40.490 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:39:40.490 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:39:56.774 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:39:56.781 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:40:26.938 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:40:26.946 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:40:54.400 INFO:teuthology.orchestra.run.smithi037.stdout:generic/446 74s 2023-12-11T19:40:54.430 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/446 2023-12-11T19:40:54.430 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:40:54.444 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:40:54.490 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:40:54.491 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/447) 2023-12-11T19:40:55.141 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:40:55.156 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:40:55.157 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:40:55.160 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:40:55.160 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:40:56.243 INFO:teuthology.orchestra.run.smithi037.stdout:generic/447 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:40:56.259 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/447 2023-12-11T19:40:56.260 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/447 2023-12-11T19:40:56.260 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:40:56.274 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:40:56.513 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:40:56.514 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/448) 2023-12-11T19:40:57.088 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:40:57.089 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:40:57.095 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:40:57.104 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:40:57.105 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:40:57.109 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:40:57.109 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:40:59.616 INFO:teuthology.orchestra.run.smithi037.stdout:generic/448 2s 2023-12-11T19:40:59.634 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/448 2023-12-11T19:40:59.634 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:40:59.642 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:40:59.735 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:40:59.736 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/449) 2023-12-11T19:41:00.457 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:41:00.469 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:41:00.470 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:41:00.473 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:41:00.473 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:01.256 INFO:teuthology.orchestra.run.smithi037.stdout:generic/449 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-11T19:41:01.273 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/449 2023-12-11T19:41:01.273 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/449 2023-12-11T19:41:01.274 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:41:01.286 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:01.409 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:41:01.410 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/450) 2023-12-11T19:41:02.094 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:41:02.106 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:41:02.107 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:41:02.110 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:41:02.111 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:04.198 INFO:teuthology.orchestra.run.smithi037.stdout:generic/450 2s 2023-12-11T19:41:04.219 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/450 2023-12-11T19:41:04.219 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:41:04.229 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:04.351 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:41:04.352 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/451) 2023-12-11T19:41:05.060 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:41:05.071 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:41:05.072 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:41:05.075 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:41:05.075 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:27.437 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:41:27.442 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:41:35.934 INFO:teuthology.orchestra.run.smithi037.stdout:generic/451 30s 2023-12-11T19:41:35.953 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/451 2023-12-11T19:41:35.954 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:41:35.963 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:36.084 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:41:36.085 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/452) 2023-12-11T19:41:36.820 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:41:36.834 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:41:36.836 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:41:36.840 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:41:36.840 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:37.958 INFO:teuthology.orchestra.run.smithi037.stdout:generic/452 0s 2023-12-11T19:41:37.975 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/452 2023-12-11T19:41:37.976 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:41:37.984 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:38.012 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:41:38.012 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/453) 2023-12-11T19:41:38.701 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:41:38.717 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:41:38.719 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:41:38.722 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:41:38.723 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:39.434 INFO:teuthology.orchestra.run.smithi037.stdout:generic/453 [not run] ceph does not allow unrestricted byte streams for names 2023-12-11T19:41:39.451 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/453 2023-12-11T19:41:39.451 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/453 2023-12-11T19:41:39.451 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:41:39.464 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:39.517 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:41:39.518 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/454) 2023-12-11T19:41:40.145 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:41:40.161 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:41:40.163 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:41:40.166 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:41:40.166 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:40.906 INFO:teuthology.orchestra.run.smithi037.stdout:generic/454 [not run] ceph does not allow unrestricted byte streams for names 2023-12-11T19:41:40.923 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/454 2023-12-11T19:41:40.923 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/454 2023-12-11T19:41:40.923 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:41:40.937 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:41.010 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:41:41.010 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/455) 2023-12-11T19:41:41.639 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:41:41.655 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:41:41.658 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:41:41.662 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:41:41.662 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:42.557 INFO:teuthology.orchestra.run.smithi037.stdout:generic/455 [not run] This test requires a valid $LOGWRITES_DEV 2023-12-11T19:41:42.574 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/455 2023-12-11T19:41:42.574 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/455 2023-12-11T19:41:42.574 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:41:42.587 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:42.634 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:41:42.635 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/456) 2023-12-11T19:41:43.261 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:41:43.276 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:41:43.278 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:41:43.281 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:41:43.281 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:44.083 INFO:teuthology.orchestra.run.smithi037.stdout:generic/456 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T19:41:44.097 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/456 2023-12-11T19:41:44.097 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/456 2023-12-11T19:41:44.097 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:41:44.108 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:44.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:41:44.164 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/457) 2023-12-11T19:41:44.838 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:41:44.853 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:41:44.855 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:41:44.859 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:41:44.860 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:46.244 INFO:teuthology.orchestra.run.smithi037.stdout:generic/457 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:41:46.261 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/457 2023-12-11T19:41:46.262 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/457 2023-12-11T19:41:46.262 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:41:46.274 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:46.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:41:46.422 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/458) 2023-12-11T19:41:46.951 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:41:46.968 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:41:46.970 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:41:46.975 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:41:46.975 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:48.093 INFO:teuthology.orchestra.run.smithi037.stdout:generic/458 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T19:41:48.110 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/458 2023-12-11T19:41:48.110 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/458 2023-12-11T19:41:48.110 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:41:48.123 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:48.482 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:41:48.482 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/459) 2023-12-11T19:41:48.998 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:41:49.013 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:41:49.015 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:41:49.018 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:41:49.018 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:50.006 INFO:teuthology.orchestra.run.smithi037.stdout:generic/459 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:41:50.022 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/459 2023-12-11T19:41:50.023 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/459 2023-12-11T19:41:50.023 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:41:50.034 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:50.088 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:41:50.088 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/460) 2023-12-11T19:41:50.722 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:41:50.736 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:41:50.738 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:41:50.742 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:41:50.742 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:54.350 INFO:teuthology.orchestra.run.smithi037.stdout:generic/460 4s 2023-12-11T19:41:54.370 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/460 2023-12-11T19:41:54.370 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:41:54.380 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:54.415 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:41:54.415 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/461) 2023-12-11T19:41:55.061 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:41:55.077 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:41:55.078 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:41:55.083 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:41:55.083 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:56.021 INFO:teuthology.orchestra.run.smithi037.stdout:generic/461 [not run] ceph does not support shutdown 2023-12-11T19:41:56.036 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/461 2023-12-11T19:41:56.036 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/461 2023-12-11T19:41:56.036 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:41:56.045 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:56.090 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:41:56.090 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/462) 2023-12-11T19:41:56.728 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:41:56.742 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:41:56.744 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:41:56.748 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:41:56.748 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:57.643 INFO:teuthology.orchestra.run.smithi037.stdout:generic/462 [not run] mount 172.21.15.37:6789:/scratch with dax failed 2023-12-11T19:41:57.658 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/462 2023-12-11T19:41:57.658 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/462 2023-12-11T19:41:57.658 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:41:57.668 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:57.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:41:57.713 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/463) 2023-12-11T19:41:57.743 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:41:57.767 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:41:58.327 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:41:58.342 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:41:58.344 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:41:58.348 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:41:58.349 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:59.186 INFO:teuthology.orchestra.run.smithi037.stdout:generic/463 [not run] Reflink not supported by test filesystem type: ceph 2023-12-11T19:41:59.199 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/463 2023-12-11T19:41:59.199 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/463 2023-12-11T19:41:59.199 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:41:59.209 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:41:59.346 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:41:59.346 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/464) 2023-12-11T19:42:00.085 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:42:00.099 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:42:00.101 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:42:00.103 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:42:00.103 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:42:27.904 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:42:27.916 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:42:58.927 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:42:58.941 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:43:00.471 INFO:teuthology.orchestra.run.smithi037.stdout:generic/464 60s 2023-12-11T19:43:00.490 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/464 2023-12-11T19:43:00.490 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:43:00.498 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:43:00.526 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:43:00.527 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/465) 2023-12-11T19:43:01.164 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:43:01.180 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:43:01.182 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:43:01.185 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:43:01.185 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:43:11.265 INFO:teuthology.orchestra.run.smithi037.stdout:generic/465 9s 2023-12-11T19:43:11.300 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/465 2023-12-11T19:43:11.303 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:43:11.315 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:43:11.368 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:43:11.368 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/466) 2023-12-11T19:43:12.047 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:43:12.059 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:43:12.060 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:43:12.063 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:43:12.063 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:43:12.722 INFO:teuthology.orchestra.run.smithi037.stdout:generic/466 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:43:12.737 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/466 2023-12-11T19:43:12.737 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/466 2023-12-11T19:43:12.737 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:43:12.749 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:43:12.797 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:43:12.797 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/467) 2023-12-11T19:43:13.494 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:43:13.506 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:43:13.508 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:43:13.512 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:43:13.512 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:43:27.682 INFO:teuthology.orchestra.run.smithi037.stdout:generic/467 14s 2023-12-11T19:43:27.745 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/467 2023-12-11T19:43:27.746 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:43:27.760 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:43:27.981 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:43:27.982 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/468) 2023-12-11T19:43:29.137 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:43:29.152 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:43:30.014 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:43:30.031 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:43:30.033 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:43:30.037 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:43:30.037 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:43:31.023 INFO:teuthology.orchestra.run.smithi037.stdout:generic/468 [not run] ceph does not support shutdown 2023-12-11T19:43:31.047 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/468 2023-12-11T19:43:31.047 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/468 2023-12-11T19:43:31.047 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:43:31.056 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:43:31.096 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:43:31.096 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/469) 2023-12-11T19:43:31.766 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:43:31.781 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:43:31.783 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:43:31.787 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:43:31.787 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:43:32.536 INFO:teuthology.orchestra.run.smithi037.stdout:generic/469 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-11T19:43:32.549 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/469 2023-12-11T19:43:32.549 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/469 2023-12-11T19:43:32.549 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:43:32.558 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:43:32.607 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:43:32.607 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/470) 2023-12-11T19:43:33.238 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:43:33.251 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:43:33.252 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:43:33.256 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:43:33.256 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:43:34.078 INFO:teuthology.orchestra.run.smithi037.stdout:generic/470 [not run] This test requires a valid $LOGWRITES_DEV 2023-12-11T19:43:34.094 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/470 2023-12-11T19:43:34.094 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/470 2023-12-11T19:43:34.095 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:43:34.107 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:43:34.157 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:43:34.157 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/471) 2023-12-11T19:43:34.809 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:43:34.825 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:43:34.826 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:43:34.829 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:43:34.830 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:43:59.394 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:43:59.406 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:44:30.029 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:44:30.040 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:44:39.459 INFO:teuthology.orchestra.run.smithi037.stdout:generic/471 64s 2023-12-11T19:44:39.475 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/471 2023-12-11T19:44:39.475 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:44:39.483 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:44:39.558 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:44:39.558 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/472) 2023-12-11T19:44:40.544 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:44:40.569 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:44:40.571 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:44:40.577 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:44:40.577 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:44:45.386 INFO:teuthology.orchestra.run.smithi037.stdout:generic/472 [not run] swapfiles are not supported 2023-12-11T19:44:45.400 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/472 2023-12-11T19:44:45.400 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/472 2023-12-11T19:44:45.400 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:44:45.411 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:44:45.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:44:45.459 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/473) 2023-12-11T19:44:46.130 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:44:46.149 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:44:46.150 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:44:46.154 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:44:46.155 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:44:46.951 INFO:teuthology.orchestra.run.smithi037.stdout:generic/473 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-11T19:44:46.969 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/473 2023-12-11T19:44:46.969 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/473 2023-12-11T19:44:46.969 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:44:46.981 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:44:47.032 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:44:47.033 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/474) 2023-12-11T19:44:47.645 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:44:47.661 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:44:47.663 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:44:47.667 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:44:47.667 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:44:48.527 INFO:teuthology.orchestra.run.smithi037.stdout:generic/474 [not run] ceph does not support shutdown 2023-12-11T19:44:48.549 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/474 2023-12-11T19:44:48.549 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/474 2023-12-11T19:44:48.549 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:44:48.559 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:44:48.595 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:44:48.595 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/475) 2023-12-11T19:44:49.255 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:44:49.270 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:44:49.272 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:44:49.277 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:44:49.277 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:44:50.038 INFO:teuthology.orchestra.run.smithi037.stdout:generic/475 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T19:44:50.055 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/475 2023-12-11T19:44:50.055 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/475 2023-12-11T19:44:50.055 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T19:44:50.067 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:44:50.110 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T19:44:50.110 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/476) 2023-12-11T19:44:50.790 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T19:44:50.804 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T19:44:50.806 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T19:44:50.810 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T19:44:50.810 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T19:45:00.182 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:45:00.197 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:45:30.395 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:45:30.404 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:46:00.953 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:46:00.963 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:46:31.161 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:46:31.175 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:47:01.440 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:47:01.453 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:47:31.667 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:47:31.675 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:48:01.861 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:48:01.870 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:48:32.091 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:48:32.097 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:49:02.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:49:02.755 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:49:35.504 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:49:35.514 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:50:06.643 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:50:06.649 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:50:06.780 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T19:50:06.780+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102220) UID: 0 2023-12-11T19:50:06.780 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T19:50:06.780+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102220) UID: 0 2023-12-11T19:50:06.783 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T19:50:06.780+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102220) UID: 0 2023-12-11T19:50:06.784 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T19:50:06.781+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102220) UID: 0 2023-12-11T19:54:09.350 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:54:09.356 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:54:40.470 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:54:40.585 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:55:10.995 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:55:11.009 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T19:55:11.206 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-12-11T19:55:11.204+0000 7f93f4e3d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 542695) UID: 0 2023-12-11T19:55:11.206 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-12-11T19:55:11.203+0000 7fcb1e884640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 542695) UID: 0 2023-12-11T20:00:39.146 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T20:00:39.147+0000 7f5aba636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542796) UID: 0 2023-12-11T20:00:39.149 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T20:00:39.143+0000 7f8de7bd6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542796) UID: 0 2023-12-11T20:00:39.151 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T20:00:39.151+0000 7f690ba68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542796) UID: 0 2023-12-11T20:00:39.161 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T20:00:39.162+0000 7fb782446640 -1 Fail to open '/proc/542796/cmdline' error = (2) No such file or directory 2023-12-11T20:00:39.180 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T20:00:39.162+0000 7fb782446640 -1 received signal: Hangup from (PID: 542796) UID: 0 2023-12-11T20:06:56.293 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T20:06:56.306 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T20:06:56.500 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T20:06:56.502+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102461) UID: 0 2023-12-11T20:06:56.501 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T20:06:56.502+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102461) UID: 0 2023-12-11T20:06:56.501 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T20:06:56.502+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102461) UID: 0 2023-12-11T20:06:56.501 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T20:06:56.502+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102461) UID: 0 2023-12-11T20:06:57.250 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T20:06:57.250+0000 7f8de7bd6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542880) UID: 0 2023-12-11T20:06:57.251 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T20:06:57.250+0000 7f5aba636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542880) UID: 0 2023-12-11T20:06:57.259 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T20:06:57.260+0000 7f690ba68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542880) UID: 0 2023-12-11T20:06:57.262 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T20:06:57.263+0000 7fb782446640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 542880) UID: 0 2023-12-11T20:19:27.969 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T20:19:27.981 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T20:19:28.254 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T20:19:28.256+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102591) UID: 0 2023-12-11T20:19:28.255 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T20:19:28.256+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102591) UID: 0 2023-12-11T20:19:28.255 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T20:19:28.256+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102591) UID: 0 2023-12-11T20:19:28.257 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T20:19:28.259+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102591) UID: 0 2023-12-11T20:19:28.379 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-12-11T20:19:28.380+0000 7f93f4e3d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 543058) UID: 0 2023-12-11T20:19:28.380 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-12-11T20:19:28.380+0000 7fcb1e884640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 543058) UID: 0 2023-12-11T20:28:10.804 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T20:28:10.804+0000 7f5aba636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 543131) UID: 0 2023-12-11T20:28:10.805 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T20:28:10.804+0000 7f690ba68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 543131) UID: 0 2023-12-11T20:28:10.805 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T20:28:10.805+0000 7fb782446640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 543131) UID: 0 2023-12-11T20:28:10.806 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T20:28:10.805+0000 7f8de7bd6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 543131) UID: 0 2023-12-11T20:37:05.460 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T20:37:05.499 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T20:37:05.813 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T20:37:05.815+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102728) UID: 0 2023-12-11T20:37:05.813 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T20:37:05.815+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102728) UID: 0 2023-12-11T20:37:05.814 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T20:37:05.815+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102728) UID: 0 2023-12-11T20:37:05.814 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T20:37:05.815+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102728) UID: 0 2023-12-11T20:37:05.948 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-12-11T20:37:05.949+0000 7f93f4e3d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 543195) UID: 0 2023-12-11T20:37:05.948 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-12-11T20:37:05.949+0000 7fcb1e884640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 543195) UID: 0 2023-12-11T20:44:13.059 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T20:44:13.057+0000 7f8de7bd6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 543296) UID: 0 2023-12-11T20:44:13.061 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T20:44:13.062+0000 7fb782446640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 543296) UID: 0 2023-12-11T20:44:13.062 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T20:44:13.059+0000 7f690ba68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 543296) UID: 0 2023-12-11T20:44:13.066 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T20:44:13.056+0000 7f5aba636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 543296) UID: 0 2023-12-11T20:51:13.144 INFO:teuthology.orchestra.run.smithi037.stdout:generic/476 3979s 2023-12-11T20:51:14.767 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/476 2023-12-11T20:51:14.767 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T20:51:14.785 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T20:51:14.838 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T20:51:14.839 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/477) 2023-12-11T20:51:24.645 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T20:51:24.660 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T20:51:24.696 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T20:51:24.696 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T20:51:24.696 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T20:59:29.087 INFO:teuthology.orchestra.run.smithi037.stdout:generic/477 54s 2023-12-11T20:59:29.389 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/477 2023-12-11T20:59:29.389 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T20:59:29.397 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T20:59:29.590 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T20:59:29.591 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/478) 2023-12-11T20:59:33.347 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T20:59:33.362 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T20:59:33.363 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T20:59:33.368 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T20:59:33.368 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T20:59:46.231 INFO:teuthology.orchestra.run.smithi037.stdout:generic/478 13s 2023-12-11T20:59:46.251 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/478 2023-12-11T20:59:46.251 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T20:59:46.259 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T20:59:46.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T20:59:46.318 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/479) 2023-12-11T20:59:47.015 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T20:59:47.031 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T20:59:47.033 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T20:59:47.037 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T20:59:47.037 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T20:59:48.328 INFO:teuthology.orchestra.run.smithi037.stdout:generic/479 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T20:59:48.342 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/479 2023-12-11T20:59:48.343 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/479 2023-12-11T20:59:48.343 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T20:59:48.353 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T20:59:48.422 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T20:59:48.422 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/480) 2023-12-11T20:59:49.120 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T20:59:49.138 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T20:59:49.139 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T20:59:49.143 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T20:59:49.143 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T20:59:49.978 INFO:teuthology.orchestra.run.smithi037.stdout:generic/480 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T20:59:49.995 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/480 2023-12-11T20:59:49.995 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/480 2023-12-11T20:59:49.995 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T20:59:50.002 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T20:59:50.062 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T20:59:50.062 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/481) 2023-12-11T20:59:50.751 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T20:59:50.770 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T20:59:50.771 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T20:59:50.774 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T20:59:50.774 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T20:59:51.497 INFO:teuthology.orchestra.run.smithi037.stdout:generic/481 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T20:59:51.511 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/481 2023-12-11T20:59:51.511 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/481 2023-12-11T20:59:51.511 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T20:59:51.523 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T20:59:51.569 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T20:59:51.569 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/482) 2023-12-11T20:59:52.257 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T20:59:52.276 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T20:59:52.278 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T20:59:52.283 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T20:59:52.283 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T20:59:54.344 INFO:teuthology.orchestra.run.smithi037.stdout:generic/482 [not run] This test requires a valid $LOGWRITES_DEV 2023-12-11T20:59:54.360 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/482 2023-12-11T20:59:54.360 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/482 2023-12-11T20:59:54.360 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T20:59:54.370 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T20:59:54.419 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T20:59:54.420 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/483) 2023-12-11T20:59:55.207 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T20:59:55.219 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T20:59:55.221 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T20:59:55.224 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T20:59:55.224 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T20:59:56.597 INFO:teuthology.orchestra.run.smithi037.stdout:generic/483 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T20:59:56.611 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/483 2023-12-11T20:59:56.611 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/483 2023-12-11T20:59:56.611 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T20:59:56.619 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T20:59:56.665 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T20:59:56.665 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/484) 2023-12-11T20:59:57.372 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T20:59:57.387 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T20:59:57.389 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T20:59:57.393 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T20:59:57.393 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T20:59:58.238 INFO:teuthology.orchestra.run.smithi037.stdout:generic/484 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T20:59:58.254 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/484 2023-12-11T20:59:58.258 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/484 2023-12-11T20:59:58.258 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T20:59:58.270 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T20:59:58.311 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T20:59:58.311 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/485) 2023-12-11T20:59:58.992 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T20:59:59.009 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T20:59:59.010 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T20:59:59.014 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T20:59:59.014 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T20:59:59.763 INFO:teuthology.orchestra.run.smithi037.stdout:generic/485 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-11T20:59:59.778 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/485 2023-12-11T20:59:59.778 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/485 2023-12-11T20:59:59.778 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T20:59:59.792 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T20:59:59.845 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T20:59:59.845 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/486) 2023-12-11T21:00:00.525 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:00.543 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:00.545 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:00.549 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:00.550 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:01.938 INFO:teuthology.orchestra.run.smithi037.stdout:generic/486 1s 2023-12-11T21:00:01.956 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/486 2023-12-11T21:00:01.956 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:01.966 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:02.008 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:02.008 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/487) 2023-12-11T21:00:02.692 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:02.705 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:02.706 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:02.709 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:02.709 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:03.511 INFO:teuthology.orchestra.run.smithi037.stdout:generic/487 [not run] This test requires a valid $SCRATCH_LOGDEV 2023-12-11T21:00:03.526 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/487 2023-12-11T21:00:03.526 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/487 2023-12-11T21:00:03.526 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:03.535 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:03.574 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:03.575 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/488) 2023-12-11T21:00:04.290 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:04.310 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:04.311 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:04.315 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:04.315 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:05.057 INFO:teuthology.orchestra.run.smithi037.stdout:generic/488 [not run] Filesystem ceph not supported in _scratch_mkfs_sized 2023-12-11T21:00:05.071 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/488 2023-12-11T21:00:05.071 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/488 2023-12-11T21:00:05.071 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:05.084 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:05.135 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:05.136 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/489) 2023-12-11T21:00:05.829 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:05.849 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:05.850 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:05.856 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:05.856 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:06.609 INFO:teuthology.orchestra.run.smithi037.stdout:generic/489 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T21:00:06.628 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/489 2023-12-11T21:00:06.628 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/489 2023-12-11T21:00:06.629 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:06.638 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:06.682 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:06.683 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/490) 2023-12-11T21:00:07.349 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:07.367 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:07.370 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:07.373 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:07.374 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:09.948 INFO:teuthology.orchestra.run.smithi037.stdout:generic/490 2s 2023-12-11T21:00:09.972 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/490 2023-12-11T21:00:09.972 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:09.984 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:10.158 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:10.158 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/491) 2023-12-11T21:00:11.050 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:11.067 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:11.074 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:11.075 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:11.075 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:11.921 INFO:teuthology.orchestra.run.smithi037.stdout:generic/491 [not run] ceph does not support freezing 2023-12-11T21:00:11.936 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/491 2023-12-11T21:00:11.937 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/491 2023-12-11T21:00:11.937 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:11.947 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:11.995 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:11.995 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/492) 2023-12-11T21:00:12.667 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:12.685 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:12.686 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:12.690 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:12.690 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:13.434 INFO:teuthology.orchestra.run.smithi037.stdout:generic/492 [not run] xfs_io label failed (old kernel/wrong fs?) 2023-12-11T21:00:13.447 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/492 2023-12-11T21:00:13.447 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/492 2023-12-11T21:00:13.447 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:13.455 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:13.497 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:13.497 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/493) 2023-12-11T21:00:14.163 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:14.177 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:14.178 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:14.181 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:14.182 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:15.381 INFO:teuthology.orchestra.run.smithi037.stdout:generic/493 [not run] swapfiles are not supported 2023-12-11T21:00:15.395 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/493 2023-12-11T21:00:15.397 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/493 2023-12-11T21:00:15.397 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:15.407 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:15.459 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:15.459 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/494) 2023-12-11T21:00:16.145 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:16.162 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:16.163 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:16.167 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:16.167 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:17.260 INFO:teuthology.orchestra.run.smithi037.stdout:generic/494 [not run] swapfiles are not supported 2023-12-11T21:00:17.275 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/494 2023-12-11T21:00:17.275 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/494 2023-12-11T21:00:17.275 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:17.289 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:17.339 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:17.339 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/495) 2023-12-11T21:00:18.023 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:18.041 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:18.042 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:18.046 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:18.046 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:19.113 INFO:teuthology.orchestra.run.smithi037.stdout:generic/495 [not run] swapfiles are not supported 2023-12-11T21:00:19.130 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/495 2023-12-11T21:00:19.130 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/495 2023-12-11T21:00:19.130 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:19.145 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:19.206 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:19.207 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/496) 2023-12-11T21:00:19.866 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:19.879 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:19.882 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:19.886 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:19.887 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:21.007 INFO:teuthology.orchestra.run.smithi037.stdout:generic/496 [not run] swapfiles are not supported 2023-12-11T21:00:21.028 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/496 2023-12-11T21:00:21.028 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/496 2023-12-11T21:00:21.028 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:21.039 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:21.095 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:21.095 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/497) 2023-12-11T21:00:21.770 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:21.797 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:21.798 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:21.804 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:21.804 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:22.924 INFO:teuthology.orchestra.run.smithi037.stdout:generic/497 [not run] swapfiles are not supported 2023-12-11T21:00:22.938 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/497 2023-12-11T21:00:22.938 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/497 2023-12-11T21:00:22.938 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:22.949 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:23.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:23.007 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/498) 2023-12-11T21:00:23.705 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:23.720 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:23.721 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:23.726 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:23.726 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:24.547 INFO:teuthology.orchestra.run.smithi037.stdout:generic/498 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T21:00:24.563 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/498 2023-12-11T21:00:24.563 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/498 2023-12-11T21:00:24.563 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:24.572 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:24.628 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:24.628 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/499) 2023-12-11T21:00:25.316 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:25.337 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:25.339 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:25.342 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:25.342 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:26.081 INFO:teuthology.orchestra.run.smithi037.stdout:generic/499 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-11T21:00:26.093 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/499 2023-12-11T21:00:26.093 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/499 2023-12-11T21:00:26.093 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:26.103 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:26.162 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:26.162 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/500) 2023-12-11T21:00:26.852 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:26.870 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:26.872 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:26.877 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:26.877 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:27.709 INFO:teuthology.orchestra.run.smithi037.stdout:generic/500 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T21:00:27.728 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/500 2023-12-11T21:00:27.728 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/500 2023-12-11T21:00:27.729 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:27.738 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:27.784 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:27.785 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/501) 2023-12-11T21:00:28.414 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:28.431 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:28.433 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:28.437 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:28.437 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:30.150 INFO:teuthology.orchestra.run.smithi037.stdout:generic/501 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T21:00:30.167 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/501 2023-12-11T21:00:30.167 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/501 2023-12-11T21:00:30.168 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:30.180 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:30.479 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:30.479 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/502) 2023-12-11T21:00:31.084 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:31.101 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:31.103 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:31.106 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:31.106 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:32.197 INFO:teuthology.orchestra.run.smithi037.stdout:generic/502 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T21:00:32.214 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/502 2023-12-11T21:00:32.214 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/502 2023-12-11T21:00:32.214 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:32.223 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:32.285 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:32.286 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/503) 2023-12-11T21:00:32.964 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:32.977 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:32.978 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:32.982 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:32.982 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:33.762 INFO:teuthology.orchestra.run.smithi037.stdout:generic/503 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T21:00:33.775 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/503 2023-12-11T21:00:33.775 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/503 2023-12-11T21:00:33.775 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:33.784 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:33.851 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:33.851 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/504) 2023-12-11T21:00:34.521 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:34.538 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:34.539 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:34.543 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:34.543 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:35.382 INFO:teuthology.orchestra.run.smithi037.stdout:generic/504 1s 2023-12-11T21:00:35.401 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/504 2023-12-11T21:00:35.401 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:35.411 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:35.467 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:35.467 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/505) 2023-12-11T21:00:36.147 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:36.161 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:36.162 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:36.168 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:36.168 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:37.086 INFO:teuthology.orchestra.run.smithi037.stdout:generic/505 [not run] ceph does not support shutdown 2023-12-11T21:00:37.114 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/505 2023-12-11T21:00:37.114 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/505 2023-12-11T21:00:37.114 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:37.124 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:37.164 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:37.164 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/506) 2023-12-11T21:00:37.849 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:37.865 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:37.866 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:37.874 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:37.874 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:38.576 INFO:teuthology.orchestra.run.smithi037.stdout:generic/506 [not run] disk quotas not supported by this filesystem type: ceph 2023-12-11T21:00:38.592 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/506 2023-12-11T21:00:38.592 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/506 2023-12-11T21:00:38.592 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:38.603 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:38.654 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:38.654 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/507) 2023-12-11T21:00:39.316 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:39.330 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:39.331 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:39.336 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:39.336 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:40.141 INFO:teuthology.orchestra.run.smithi037.stdout:generic/507 [not run] file system doesn't support chattr +ASai 2023-12-11T21:00:40.156 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/507 2023-12-11T21:00:40.156 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/507 2023-12-11T21:00:40.156 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:40.167 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:40.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:40.219 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/508) 2023-12-11T21:00:40.917 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:40.928 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:40.930 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:40.933 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:40.933 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:41.661 INFO:teuthology.orchestra.run.smithi037.stdout:generic/508 [not run] lsattr not supported by test filesystem type: ceph 2023-12-11T21:00:41.673 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/508 2023-12-11T21:00:41.673 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/508 2023-12-11T21:00:41.673 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:41.685 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:41.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:41.741 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/509) 2023-12-11T21:00:42.422 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:42.437 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:42.439 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:42.442 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:42.442 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:43.194 INFO:teuthology.orchestra.run.smithi037.stdout:generic/509 [not run] O_TMPFILE is not supported 2023-12-11T21:00:43.207 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/509 2023-12-11T21:00:43.207 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/509 2023-12-11T21:00:43.207 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:43.221 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:43.267 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:43.268 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/510) 2023-12-11T21:00:43.951 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:43.970 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:43.972 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:43.975 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:43.975 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:44.673 INFO:teuthology.orchestra.run.smithi037.stdout:generic/510 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T21:00:44.685 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/510 2023-12-11T21:00:44.685 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/510 2023-12-11T21:00:44.685 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:44.695 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:44.741 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:44.741 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/511) 2023-12-11T21:00:45.420 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:45.438 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:45.440 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:45.443 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:45.443 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:46.170 INFO:teuthology.orchestra.run.smithi037.stdout:generic/511 [not run] xfs_io falloc -k failed (old kernel/wrong fs?) 2023-12-11T21:00:46.185 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/511 2023-12-11T21:00:46.185 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/511 2023-12-11T21:00:46.185 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:46.194 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:46.246 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:46.246 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/512) 2023-12-11T21:00:46.918 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:46.932 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:46.934 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:46.939 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:46.939 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:47.725 INFO:teuthology.orchestra.run.smithi037.stdout:generic/512 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T21:00:47.741 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/512 2023-12-11T21:00:47.741 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/512 2023-12-11T21:00:47.742 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:47.750 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:47.806 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:47.806 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/513) 2023-12-11T21:00:48.471 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:48.489 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:48.492 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:48.494 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:48.494 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:49.637 INFO:teuthology.orchestra.run.smithi037.stdout:generic/513 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T21:00:49.658 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/513 2023-12-11T21:00:49.659 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/513 2023-12-11T21:00:49.659 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:49.679 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:50.018 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:50.018 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/514) 2023-12-11T21:00:50.722 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:50.737 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:50.740 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:50.745 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:50.745 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:51.911 INFO:teuthology.orchestra.run.smithi037.stdout:generic/514 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T21:00:51.929 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/514 2023-12-11T21:00:51.930 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/514 2023-12-11T21:00:51.930 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:51.947 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:52.274 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:52.274 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/515) 2023-12-11T21:00:53.006 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:53.023 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:53.024 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:53.029 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:53.029 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:54.143 INFO:teuthology.orchestra.run.smithi037.stdout:generic/515 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T21:00:54.166 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/515 2023-12-11T21:00:54.166 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/515 2023-12-11T21:00:54.166 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:54.179 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:54.436 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:54.436 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/516) 2023-12-11T21:00:55.187 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:55.203 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:55.205 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:55.209 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:55.209 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:56.057 INFO:teuthology.orchestra.run.smithi037.stdout:generic/516 [not run] Dedupe not supported by test filesystem type: ceph 2023-12-11T21:00:56.072 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/516 2023-12-11T21:00:56.072 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/516 2023-12-11T21:00:56.072 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:56.083 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:56.219 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:56.219 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/517) 2023-12-11T21:00:57.074 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:57.090 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:57.091 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:57.096 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:57.096 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:58.119 INFO:teuthology.orchestra.run.smithi037.stdout:generic/517 [not run] Dedupe not supported by scratch filesystem type: ceph 2023-12-11T21:00:58.247 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/517 2023-12-11T21:00:58.247 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/517 2023-12-11T21:00:58.247 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:00:58.262 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:00:58.598 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:00:58.598 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/518) 2023-12-11T21:00:59.314 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:00:59.332 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:00:59.334 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:00:59.339 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:00:59.339 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:01:00.514 INFO:teuthology.orchestra.run.smithi037.stdout:generic/518 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T21:01:00.536 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/518 2023-12-11T21:01:00.536 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/518 2023-12-11T21:01:00.536 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:01:00.547 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:01:00.799 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:01:00.799 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/519) 2023-12-11T21:01:01.511 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:01:01.524 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:01:01.526 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:01:01.534 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:01:01.534 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:01:02.340 INFO:teuthology.orchestra.run.smithi037.stdout:generic/519 [not run] FIBMAP not supported by this filesystem 2023-12-11T21:01:02.356 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/519 2023-12-11T21:01:02.356 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/519 2023-12-11T21:01:02.356 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:01:02.368 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:01:02.505 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:01:02.505 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/520) 2023-12-11T21:01:03.421 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:01:03.434 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:01:03.436 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:01:03.439 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:01:03.439 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:01:04.210 INFO:teuthology.orchestra.run.smithi037.stdout:generic/520 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T21:01:04.222 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/520 2023-12-11T21:01:04.222 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/520 2023-12-11T21:01:04.222 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T21:01:04.229 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:01:04.278 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T21:01:04.278 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/521) 2023-12-11T21:01:04.935 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T21:01:04.949 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T21:01:04.950 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T21:01:04.954 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T21:01:04.955 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T21:02:58.317 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:02:58.326 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:02:58.517 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-12-11T21:02:58.517+0000 7f93f4e3d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 564944) UID: 0 2023-12-11T21:02:58.517 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-12-11T21:02:58.517+0000 7fcb1e884640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 564944) UID: 0 2023-12-11T21:02:58.589 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T21:02:58.589+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102860) UID: 0 2023-12-11T21:02:58.590 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T21:02:58.589+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102860) UID: 0 2023-12-11T21:02:58.590 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T21:02:58.589+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102860) UID: 0 2023-12-11T21:02:58.591 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T21:02:58.589+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102860) UID: 0 2023-12-11T21:12:04.680 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T21:12:04.679+0000 7f5aba636640 -1 Fail to read '/proc/564957/cmdline' error = (3) No such process 2023-12-11T21:12:04.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T21:12:04.679+0000 7fb782446640 -1 Fail to open '/proc/564957/cmdline' error = (2) No such file or directory 2023-12-11T21:12:04.681 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T21:12:04.679+0000 7fb782446640 -1 received signal: Hangup from (PID: 564957) UID: 0 2023-12-11T21:12:04.681 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T21:12:04.679+0000 7f690ba68640 -1 Fail to open '/proc/564957/cmdline' error = (2) No such file or directory 2023-12-11T21:12:04.681 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T21:12:04.679+0000 7f690ba68640 -1 received signal: Hangup from (PID: 564957) UID: 0 2023-12-11T21:12:04.681 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T21:12:04.679+0000 7f8de7bd6640 -1 Fail to open '/proc/564957/cmdline' error = (2) No such file or directory 2023-12-11T21:12:04.682 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T21:12:04.679+0000 7f8de7bd6640 -1 received signal: Hangup from (PID: 564957) UID: 0 2023-12-11T21:12:04.682 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T21:12:04.679+0000 7f5aba636640 -1 received signal: Hangup from (PID: 564957) UID: 0 2023-12-11T21:16:12.479 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:16:12.486 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:16:12.750 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T21:16:12.750+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102896) UID: 0 2023-12-11T21:16:12.750 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T21:16:12.750+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102896) UID: 0 2023-12-11T21:16:12.750 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T21:16:12.751+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102896) UID: 0 2023-12-11T21:16:12.752 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T21:16:12.752+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102896) UID: 0 2023-12-11T21:21:35.612 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:21:35.620 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:21:35.741 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T21:21:35.742+0000 7f8de7bd6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565005) UID: 0 2023-12-11T21:21:35.742 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T21:21:35.742+0000 7f5aba636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565005) UID: 0 2023-12-11T21:21:35.742 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T21:21:35.742+0000 7f690ba68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565005) UID: 0 2023-12-11T21:21:35.742 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T21:21:35.743+0000 7fb782446640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565005) UID: 0 2023-12-11T21:21:35.753 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T21:21:35.753+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102928) UID: 0 2023-12-11T21:21:35.754 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T21:21:35.753+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102928) UID: 0 2023-12-11T21:21:35.755 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T21:21:35.755+0000 7f0077a7d640 -1 Fail to open '/proc/102928/cmdline' error = (2) No such file or directory 2023-12-11T21:21:35.755 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T21:21:35.755+0000 7f0077a7d640 -1 received signal: Hangup from (PID: 102928) UID: 0 2023-12-11T21:21:35.756 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T21:21:35.755+0000 7fdadfa99640 -1 Fail to open '/proc/102928/cmdline' error = (2) No such file or directory 2023-12-11T21:21:35.756 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T21:21:35.755+0000 7fdadfa99640 -1 received signal: Hangup from (PID: 102928) UID: 0 2023-12-11T21:25:52.814 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:25:52.822 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:25:52.943 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T21:25:52.943+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102954) UID: 0 2023-12-11T21:25:52.943 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T21:25:52.943+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102954) UID: 0 2023-12-11T21:25:52.944 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T21:25:52.943+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102954) UID: 0 2023-12-11T21:25:52.944 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T21:25:52.943+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 102954) UID: 0 2023-12-11T21:25:53.013 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T21:25:53.013+0000 7f8de7bd6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565030) UID: 0 2023-12-11T21:25:53.014 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T21:25:53.013+0000 7f5aba636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565030) UID: 0 2023-12-11T21:25:53.014 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T21:25:53.014+0000 7f690ba68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565030) UID: 0 2023-12-11T21:25:53.014 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T21:25:53.014+0000 7fb782446640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565030) UID: 0 2023-12-11T21:33:29.380 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:33:29.388 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:34:02.703 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:34:02.709 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:34:32.857 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:34:32.863 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:35:03.013 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:35:03.020 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:35:33.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:35:33.184 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:36:03.348 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:36:03.354 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:36:33.499 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:36:33.506 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:37:03.645 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:37:03.652 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:37:03.773 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T21:37:03.773+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103114) UID: 0 2023-12-11T21:37:03.774 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T21:37:03.773+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103114) UID: 0 2023-12-11T21:37:03.774 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T21:37:03.773+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103114) UID: 0 2023-12-11T21:37:03.775 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T21:37:03.773+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103114) UID: 0 2023-12-11T21:41:12.495 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:41:12.501 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:41:44.524 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:41:44.536 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:42:14.683 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:42:14.689 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:42:44.832 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:42:44.839 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:43:15.776 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:43:15.782 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:43:45.923 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:43:45.931 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:44:16.069 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:44:16.076 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:44:46.210 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:44:46.219 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:45:16.367 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:45:16.374 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:45:46.545 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:45:46.551 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:46:16.768 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:46:16.775 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:46:46.916 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:46:46.924 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:46:47.036 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T21:46:47.035+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103353) UID: 0 2023-12-11T21:46:47.036 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T21:46:47.035+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103353) UID: 0 2023-12-11T21:46:47.037 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T21:46:47.036+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103353) UID: 0 2023-12-11T21:46:47.037 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T21:46:47.036+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103353) UID: 0 2023-12-11T21:50:43.407 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:50:43.415 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:50:43.601 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T21:50:43.601+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103377) UID: 0 2023-12-11T21:50:43.601 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T21:50:43.601+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103377) UID: 0 2023-12-11T21:50:43.601 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T21:50:43.601+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103377) UID: 0 2023-12-11T21:50:43.602 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T21:50:43.601+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103377) UID: 0 2023-12-11T21:55:03.189 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:55:03.196 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:55:33.365 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:55:33.370 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:56:03.845 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:56:03.851 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:56:33.982 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:56:33.989 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:57:04.123 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:57:04.130 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T21:57:04.241 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T21:57:04.240+0000 7f5aba636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565529) UID: 0 2023-12-11T21:57:04.241 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T21:57:04.240+0000 7f8de7bd6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565529) UID: 0 2023-12-11T21:57:04.242 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T21:57:04.241+0000 7fb782446640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565529) UID: 0 2023-12-11T21:57:04.242 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T21:57:04.241+0000 7f690ba68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565529) UID: 0 2023-12-11T22:00:52.112 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:00:52.118 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:00:52.235 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T22:00:52.235+0000 7f8de7bd6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565555) UID: 0 2023-12-11T22:00:52.235 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T22:00:52.235+0000 7f5aba636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565555) UID: 0 2023-12-11T22:00:52.236 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T22:00:52.235+0000 7fb782446640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565555) UID: 0 2023-12-11T22:00:52.236 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T22:00:52.235+0000 7f690ba68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565555) UID: 0 2023-12-11T22:04:47.169 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:04:47.176 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:05:17.372 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:05:17.379 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:05:47.512 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:05:47.518 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:06:17.669 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:06:17.679 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:06:17.795 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T22:06:17.794+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103590) UID: 0 2023-12-11T22:06:17.795 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T22:06:17.794+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103590) UID: 0 2023-12-11T22:06:17.796 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T22:06:17.794+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103590) UID: 0 2023-12-11T22:06:17.796 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T22:06:17.794+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103590) UID: 0 2023-12-11T22:10:23.586 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:10:23.594 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:10:23.709 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T22:10:23.708+0000 7f5aba636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565681) UID: 0 2023-12-11T22:10:23.710 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T22:10:23.708+0000 7f8de7bd6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565681) UID: 0 2023-12-11T22:10:23.710 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T22:10:23.708+0000 7fb782446640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565681) UID: 0 2023-12-11T22:10:23.710 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T22:10:23.709+0000 7f690ba68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 565681) UID: 0 2023-12-11T22:10:23.861 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T22:10:23.859+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103620) UID: 0 2023-12-11T22:10:23.861 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T22:10:23.859+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103620) UID: 0 2023-12-11T22:10:23.861 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T22:10:23.860+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103620) UID: 0 2023-12-11T22:10:23.863 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T22:10:23.862+0000 7fe981309640 -1 Fail to open '/proc/103620/cmdline' error = (2) No such file or directory 2023-12-11T22:10:23.863 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T22:10:23.862+0000 7fe981309640 -1 received signal: Hangup from (PID: 103620) UID: 0 2023-12-11T22:19:00.153 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:19:00.159 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:19:30.573 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:19:30.581 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:20:00.714 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:20:00.723 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:20:30.904 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:20:30.911 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:21:01.062 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:21:01.067 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:21:31.686 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:21:31.693 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:22:01.850 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:22:01.855 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:22:31.991 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:22:31.997 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:22:32.112 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T22:22:32.112+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103785) UID: 0 2023-12-11T22:22:32.113 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T22:22:32.112+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103785) UID: 0 2023-12-11T22:22:32.113 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T22:22:32.112+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103785) UID: 0 2023-12-11T22:22:32.113 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T22:22:32.113+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103785) UID: 0 2023-12-11T22:26:30.723 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:26:30.729 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:27:01.044 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:27:01.052 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:27:31.201 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:27:31.207 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:28:01.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:28:01.377 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:28:31.527 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:28:31.534 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:29:01.663 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:29:01.670 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:29:31.794 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:29:31.800 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:29:31.944 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-12-11T22:29:31.943+0000 7f93f4e3d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 565973) UID: 0 2023-12-11T22:29:31.944 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-12-11T22:29:31.943+0000 7fcb1e884640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 565973) UID: 0 2023-12-11T22:32:50.953 INFO:teuthology.orchestra.run.smithi037.stdout:generic/521 5505s 2023-12-11T22:32:51.006 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/521 2023-12-11T22:32:51.006 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T22:32:51.021 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T22:32:51.151 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T22:32:51.151 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/522) 2023-12-11T22:32:52.437 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T22:32:52.457 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T22:32:52.460 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T22:32:52.465 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T22:32:52.466 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T22:32:53.213 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T22:32:53.213+0000 7f8de7bd6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 566432) UID: 0 2023-12-11T22:32:53.213 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T22:32:53.213+0000 7f5aba636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 566432) UID: 0 2023-12-11T22:32:53.214 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T22:32:53.213+0000 7fb782446640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 566432) UID: 0 2023-12-11T22:32:53.214 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T22:32:53.213+0000 7f690ba68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 566432) UID: 0 2023-12-11T22:37:05.061 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:37:05.068 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:37:05.289 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T22:37:05.288+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103945) UID: 0 2023-12-11T22:37:05.289 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T22:37:05.288+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103945) UID: 0 2023-12-11T22:37:05.289 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T22:37:05.288+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103945) UID: 0 2023-12-11T22:37:05.290 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T22:37:05.288+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 103945) UID: 0 2023-12-11T22:41:34.568 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:41:34.579 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:42:04.865 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:42:04.875 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:42:35.583 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:42:35.591 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:43:05.760 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:43:05.767 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:43:35.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:43:35.961 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:44:06.081 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:44:06.088 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:44:36.220 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:44:36.227 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:45:06.892 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:45:06.900 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:45:38.298 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:45:38.305 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:46:08.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:46:08.464 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:46:38.600 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:46:38.608 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:47:08.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:47:08.751 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:47:08.860 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T22:47:08.860+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104175) UID: 0 2023-12-11T22:47:08.861 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T22:47:08.860+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104175) UID: 0 2023-12-11T22:47:08.861 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T22:47:08.860+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104175) UID: 0 2023-12-11T22:47:08.861 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T22:47:08.861+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104175) UID: 0 2023-12-11T22:51:07.198 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:51:07.205 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:51:07.335 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T22:51:07.334+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104198) UID: 0 2023-12-11T22:51:07.335 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T22:51:07.334+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104198) UID: 0 2023-12-11T22:51:07.336 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T22:51:07.335+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104198) UID: 0 2023-12-11T22:51:07.336 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T22:51:07.334+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104198) UID: 0 2023-12-11T22:51:07.580 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T22:51:07.580+0000 7f5aba636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 566720) UID: 0 2023-12-11T22:51:07.581 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T22:51:07.580+0000 7fb782446640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 566720) UID: 0 2023-12-11T22:51:07.581 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T22:51:07.581+0000 7f690ba68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 566720) UID: 0 2023-12-11T22:51:07.581 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T22:51:07.581+0000 7f8de7bd6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 566720) UID: 0 2023-12-11T22:59:55.643 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:59:55.651 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T22:59:55.829 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T22:59:55.829+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104250) UID: 0 2023-12-11T22:59:55.829 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T22:59:55.829+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104250) UID: 0 2023-12-11T22:59:55.829 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T22:59:55.829+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104250) UID: 0 2023-12-11T22:59:55.830 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T22:59:55.830+0000 7fdadfa99640 -1 received signal: Hangup from (PID: 104250) UID: 0 2023-12-11T22:59:56.047 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T22:59:56.047+0000 7f8de7bd6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 566758) UID: 0 2023-12-11T22:59:56.048 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T22:59:56.048+0000 7f5aba636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 566758) UID: 0 2023-12-11T22:59:56.048 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T22:59:56.048+0000 7f690ba68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 566758) UID: 0 2023-12-11T22:59:56.048 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T22:59:56.048+0000 7fb782446640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 566758) UID: 0 2023-12-11T23:09:41.664 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:09:41.674 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:10:13.749 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:10:13.756 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:10:45.292 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:10:45.299 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:11:17.529 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:11:17.536 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:11:47.690 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:11:47.696 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:12:17.832 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:12:17.839 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:12:47.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:12:47.978 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:13:18.121 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:13:18.128 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:13:18.253 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T23:13:18.253+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104419) UID: 0 2023-12-11T23:13:18.253 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T23:13:18.253+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104419) UID: 0 2023-12-11T23:13:18.254 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T23:13:18.254+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104419) UID: 0 2023-12-11T23:13:18.254 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T23:13:18.255+0000 7fe981309640 -1 Fail to open '/proc/104419/cmdline' error = (2) No such file or directory 2023-12-11T23:13:18.254 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T23:13:18.255+0000 7fe981309640 -1 received signal: Hangup from (PID: 104419) UID: 0 2023-12-11T23:17:03.250 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:17:03.258 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:17:34.330 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:17:34.338 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:18:06.029 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:18:06.036 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:18:38.168 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:18:38.175 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:19:08.323 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:19:08.333 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:19:38.505 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:19:38.511 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:20:08.646 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:20:08.654 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:20:38.812 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:20:38.817 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:21:08.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:21:08.962 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:21:39.110 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:21:39.115 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:22:09.334 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:22:09.346 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:22:39.490 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:22:39.502 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:22:39.631 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T23:22:39.632+0000 7f5aba636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 567156) UID: 0 2023-12-11T23:22:39.632 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T23:22:39.632+0000 7fb782446640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 567156) UID: 0 2023-12-11T23:22:39.633 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T23:22:39.633+0000 7f8de7bd6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 567156) UID: 0 2023-12-11T23:22:39.634 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T23:22:39.633+0000 7f690ba68640 -1 received signal: Hangup from (PID: 567156) UID: 0 2023-12-11T23:26:46.566 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:26:46.577 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:26:46.968 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T23:26:46.967+0000 7f8de7bd6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 567181) UID: 0 2023-12-11T23:26:46.969 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T23:26:46.968+0000 7f5aba636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 567181) UID: 0 2023-12-11T23:26:46.969 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T23:26:46.968+0000 7fb782446640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 567181) UID: 0 2023-12-11T23:26:46.969 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T23:26:46.968+0000 7f690ba68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 567181) UID: 0 2023-12-11T23:30:48.775 INFO:teuthology.orchestra.run.smithi037.stdout:generic/522 3476s 2023-12-11T23:30:48.920 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/522 2023-12-11T23:30:48.921 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:30:48.930 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:30:49.007 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:30:49.007 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/523) 2023-12-11T23:30:50.491 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:30:50.509 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:30:50.511 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:30:50.516 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:30:50.516 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:30:52.285 INFO:teuthology.orchestra.run.smithi037.stdout:generic/523 2s 2023-12-11T23:30:52.312 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/523 2023-12-11T23:30:52.312 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:30:52.322 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:30:52.362 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:30:52.362 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/524) 2023-12-11T23:30:53.100 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:30:53.115 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:30:53.116 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:30:53.120 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:30:53.120 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:00.994 INFO:teuthology.orchestra.run.smithi037.stdout:generic/524 7s 2023-12-11T23:31:01.021 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/524 2023-12-11T23:31:01.021 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:31:01.029 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:01.074 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:31:01.074 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/525) 2023-12-11T23:31:01.832 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:31:01.846 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:31:01.847 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:31:01.851 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:31:01.851 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:03.020 INFO:teuthology.orchestra.run.smithi037.stdout:generic/525 [not run] filesystem does not support huge file size 2023-12-11T23:31:03.044 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/525 2023-12-11T23:31:03.044 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/525 2023-12-11T23:31:03.044 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:31:03.054 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:03.112 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:31:03.112 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/526) 2023-12-11T23:31:03.800 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:31:03.815 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:31:03.817 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:31:03.819 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:31:03.820 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:04.839 INFO:teuthology.orchestra.run.smithi037.stdout:generic/526 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T23:31:04.852 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/526 2023-12-11T23:31:04.852 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/526 2023-12-11T23:31:04.852 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:31:04.863 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:04.926 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:31:04.926 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/527) 2023-12-11T23:31:05.618 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:31:05.633 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:31:05.635 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:31:05.640 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:31:05.640 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:06.434 INFO:teuthology.orchestra.run.smithi037.stdout:generic/527 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T23:31:06.448 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/527 2023-12-11T23:31:06.449 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/527 2023-12-11T23:31:06.449 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:31:06.459 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:06.531 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:31:06.531 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/528) 2023-12-11T23:31:07.230 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:31:07.248 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:31:07.250 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:31:07.253 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:31:07.254 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:09.622 INFO:teuthology.orchestra.run.smithi037.stdout:generic/528 1s 2023-12-11T23:31:09.691 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/528 2023-12-11T23:31:09.691 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:31:09.702 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:09.803 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:31:09.803 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/529) 2023-12-11T23:31:10.700 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:31:10.716 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:31:10.718 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:31:10.723 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:31:10.724 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:12.267 INFO:teuthology.orchestra.run.smithi037.stdout:generic/529 1s 2023-12-11T23:31:12.287 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/529 2023-12-11T23:31:12.287 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:31:12.297 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:12.330 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:31:12.330 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/530) 2023-12-11T23:31:13.019 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:31:13.041 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:31:13.043 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:31:13.047 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:31:13.047 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:14.017 INFO:teuthology.orchestra.run.smithi037.stdout:generic/530 [not run] ceph does not support shutdown 2023-12-11T23:31:14.045 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/530 2023-12-11T23:31:14.045 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/530 2023-12-11T23:31:14.045 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:31:14.056 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:14.106 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:31:14.106 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/531) 2023-12-11T23:31:14.769 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:31:14.785 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:31:14.789 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:31:14.791 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:31:14.791 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:15.467 INFO:teuthology.orchestra.run.smithi037.stdout:generic/531 [not run] O_TMPFILE is not supported 2023-12-11T23:31:15.480 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/531 2023-12-11T23:31:15.481 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/531 2023-12-11T23:31:15.481 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:31:15.489 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:15.539 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:31:15.539 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/532) 2023-12-11T23:31:16.218 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:31:16.230 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:31:16.232 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:31:16.235 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:31:16.236 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:17.087 INFO:teuthology.orchestra.run.smithi037.stdout:generic/532 1s 2023-12-11T23:31:17.108 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/532 2023-12-11T23:31:17.108 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:31:17.120 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:17.172 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:31:17.173 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/533) 2023-12-11T23:31:17.972 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:31:17.984 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:31:17.985 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:31:17.989 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:31:17.989 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:19.722 INFO:teuthology.orchestra.run.smithi037.stdout:generic/533 1s 2023-12-11T23:31:19.742 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/533 2023-12-11T23:31:19.742 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:31:19.753 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:19.796 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:31:19.797 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/534) 2023-12-11T23:31:20.425 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:31:20.442 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:31:20.444 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:31:20.446 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:31:20.446 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:21.137 INFO:teuthology.orchestra.run.smithi037.stdout:generic/534 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T23:31:21.149 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/534 2023-12-11T23:31:21.149 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/534 2023-12-11T23:31:21.149 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:31:21.158 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:21.201 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:31:21.201 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/535) 2023-12-11T23:31:21.882 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:31:21.901 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:31:21.901 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:31:21.904 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:31:21.904 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:22.643 INFO:teuthology.orchestra.run.smithi037.stdout:generic/535 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T23:31:22.656 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/535 2023-12-11T23:31:22.656 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/535 2023-12-11T23:31:22.656 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:31:22.666 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:22.713 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:31:22.713 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/536) 2023-12-11T23:31:23.412 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:31:23.430 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:31:23.432 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:31:23.437 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:31:23.437 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:24.316 INFO:teuthology.orchestra.run.smithi037.stdout:generic/536 [not run] ceph does not support shutdown 2023-12-11T23:31:24.342 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/536 2023-12-11T23:31:24.342 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/536 2023-12-11T23:31:24.343 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:31:24.352 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:24.391 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:31:24.391 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/537) 2023-12-11T23:31:25.037 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:31:25.052 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:31:25.054 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:31:25.058 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:31:25.058 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:25.953 INFO:teuthology.orchestra.run.smithi037.stdout:generic/537 [not run] FSTRIM not supported 2023-12-11T23:31:25.978 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/537 2023-12-11T23:31:25.979 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/537 2023-12-11T23:31:25.979 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:31:25.987 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:26.027 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:31:26.028 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/538) 2023-12-11T23:31:26.665 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:31:26.680 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:31:26.681 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:31:26.684 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:31:26.684 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:31:49.140 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:31:49.145 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:31:49.288 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-12-11T23:31:49.287+0000 7fcb1e884640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 575457) UID: 0 2023-12-11T23:31:49.288 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-12-11T23:31:49.287+0000 7f93f4e3d640 -1 received signal: Hangup from killall ceph-mds -1 (PID: 575457) UID: 0 2023-12-11T23:31:49.462 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T23:31:49.462+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104920) UID: 0 2023-12-11T23:31:49.463 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T23:31:49.462+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104920) UID: 0 2023-12-11T23:31:49.463 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T23:31:49.463+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104920) UID: 0 2023-12-11T23:31:49.463 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T23:31:49.463+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 104920) UID: 0 2023-12-11T23:39:37.840 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:39:37.847 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:39:37.958 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T23:39:37.957+0000 7f8de7bd6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579384) UID: 0 2023-12-11T23:39:37.958 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T23:39:37.957+0000 7f5aba636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579384) UID: 0 2023-12-11T23:39:37.959 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T23:39:37.958+0000 7f690ba68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579384) UID: 0 2023-12-11T23:39:37.959 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T23:39:37.958+0000 7fb782446640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 579384) UID: 0 2023-12-11T23:39:38.003 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T23:39:38.003+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105194) UID: 0 2023-12-11T23:39:38.004 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T23:39:38.004+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105194) UID: 0 2023-12-11T23:39:38.004 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T23:39:38.004+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105194) UID: 0 2023-12-11T23:39:38.004 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T23:39:38.004+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 105194) UID: 0 2023-12-11T23:44:21.419 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:44:21.425 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:44:23.457 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T23:44:23.456+0000 7f8de7bd6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581678) UID: 0 2023-12-11T23:44:23.457 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T23:44:23.456+0000 7f5aba636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581678) UID: 0 2023-12-11T23:44:23.457 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T23:44:23.456+0000 7fb782446640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581678) UID: 0 2023-12-11T23:44:23.458 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T23:44:23.456+0000 7f690ba68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 581678) UID: 0 2023-12-11T23:44:26.196 INFO:teuthology.orchestra.run.smithi037.stdout:generic/538 780s 2023-12-11T23:44:26.300 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/538 2023-12-11T23:44:26.301 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:44:26.310 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:26.424 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:44:26.424 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/539) 2023-12-11T23:44:27.945 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:44:27.961 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:44:27.962 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:44:27.965 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:44:27.966 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:30.821 INFO:teuthology.orchestra.run.smithi037.stdout:generic/539 2s 2023-12-11T23:44:30.840 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/539 2023-12-11T23:44:30.840 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:44:30.849 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:30.953 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:44:30.953 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/540) 2023-12-11T23:44:31.832 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:44:31.851 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:44:31.852 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:44:31.856 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:44:31.856 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:33.011 INFO:teuthology.orchestra.run.smithi037.stdout:generic/540 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T23:44:33.031 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/540 2023-12-11T23:44:33.032 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/540 2023-12-11T23:44:33.032 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:44:33.053 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:33.317 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:44:33.317 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/541) 2023-12-11T23:44:34.023 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:44:34.039 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:44:34.040 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:44:34.044 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:44:34.044 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:35.176 INFO:teuthology.orchestra.run.smithi037.stdout:generic/541 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T23:44:35.200 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/541 2023-12-11T23:44:35.200 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/541 2023-12-11T23:44:35.200 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:44:35.212 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:35.548 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:44:35.548 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/542) 2023-12-11T23:44:36.279 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:44:36.297 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:44:36.297 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:44:36.301 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:44:36.301 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:37.384 INFO:teuthology.orchestra.run.smithi037.stdout:generic/542 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T23:44:37.406 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/542 2023-12-11T23:44:37.406 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/542 2023-12-11T23:44:37.406 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:44:37.418 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:37.776 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:44:37.777 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/543) 2023-12-11T23:44:38.478 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:44:38.491 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:44:38.492 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:44:38.495 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:44:38.495 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:39.551 INFO:teuthology.orchestra.run.smithi037.stdout:generic/543 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T23:44:39.585 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/543 2023-12-11T23:44:39.585 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/543 2023-12-11T23:44:39.591 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:44:39.604 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:39.914 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:44:39.915 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/544) 2023-12-11T23:44:40.655 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:44:40.669 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:44:40.671 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:44:40.675 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:44:40.675 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:41.787 INFO:teuthology.orchestra.run.smithi037.stdout:generic/544 [not run] Reflink not supported by scratch filesystem type: ceph 2023-12-11T23:44:41.804 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/544 2023-12-11T23:44:41.805 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/544 2023-12-11T23:44:41.805 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:44:41.821 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:42.149 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:44:42.150 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/545) 2023-12-11T23:44:42.835 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:44:42.850 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:44:42.851 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:44:42.854 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:44:42.854 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:43.823 INFO:teuthology.orchestra.run.smithi037.stdout:generic/545 [not run] file system doesn't support chattr +i 2023-12-11T23:44:43.841 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/545 2023-12-11T23:44:43.841 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/545 2023-12-11T23:44:43.841 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:44:43.852 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:43.905 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:44:43.905 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/546) 2023-12-11T23:44:44.599 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:44:44.615 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:44:44.617 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:44:44.621 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:44:44.621 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:45.708 INFO:teuthology.orchestra.run.smithi037.stdout:generic/546 [not run] xfs_io falloc failed (old kernel/wrong fs?) 2023-12-11T23:44:45.722 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/546 2023-12-11T23:44:45.722 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/546 2023-12-11T23:44:45.722 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:44:45.733 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:45.800 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:44:45.800 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/547) 2023-12-11T23:44:46.488 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:44:46.504 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:44:46.506 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:44:46.510 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:44:46.510 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:47.342 INFO:teuthology.orchestra.run.smithi037.stdout:generic/547 [not run] require 172.21.15.37:6789:/scratch to be valid block disk 2023-12-11T23:44:47.357 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/547 2023-12-11T23:44:47.357 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/547 2023-12-11T23:44:47.357 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:44:47.365 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:47.413 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:44:47.413 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/548) 2023-12-11T23:44:48.100 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:44:48.117 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:44:48.118 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:44:48.120 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:44:48.120 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:50.989 INFO:teuthology.orchestra.run.smithi037.stdout:generic/548 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-11T23:44:51.005 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/548 2023-12-11T23:44:51.005 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/548 2023-12-11T23:44:51.005 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:44:51.017 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:51.080 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:44:51.080 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/549) 2023-12-11T23:44:51.740 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:44:51.757 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:44:51.759 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:44:51.763 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:44:51.763 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:53.928 INFO:teuthology.orchestra.run.smithi037.stdout:generic/549 [not run] xfs_io fiemap failed (old kernel/wrong fs?) 2023-12-11T23:44:53.944 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/549 2023-12-11T23:44:53.945 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/549 2023-12-11T23:44:53.945 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:44:53.959 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:54.021 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:44:54.022 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/550) 2023-12-11T23:44:54.717 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:44:54.734 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:44:54.736 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:44:54.740 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:44:54.740 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:56.070 INFO:teuthology.orchestra.run.smithi037.stdout:generic/550 [not run] encryption policy '-c 9 -n 9 -f 0' is unusable; probably missing kernel crypto API support 2023-12-11T23:44:56.118 INFO:teuthology.orchestra.run.smithi037.stdout:Ran: generic/550 2023-12-11T23:44:56.118 INFO:teuthology.orchestra.run.smithi037.stdout:Not run: generic/550 2023-12-11T23:44:56.118 INFO:teuthology.orchestra.run.smithi037.stdout:Passed all 1 tests 2023-12-11T23:44:56.129 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:44:56.173 INFO:tasks.cephfs.xfstests_dev:Command return value: 0 2023-12-11T23:44:56.173 DEBUG:teuthology.orchestra.run.smithi037:> (cd /tmp/tmp.gLzcJVJdzjxfstests-dev && exec sudo env DIFF_LENGTH=0 ./check generic/551) 2023-12-11T23:44:56.779 INFO:teuthology.orchestra.run.smithi037.stdout:FSTYP -- ceph 2023-12-11T23:44:56.797 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM -- Linux/x86_64 smithi037 6.6.0-gcd68252d7b4d #1 SMP PREEMPT_DYNAMIC Fri Dec 8 17:14:54 UTC 2023 2023-12-11T23:44:56.800 INFO:teuthology.orchestra.run.smithi037.stdout:MKFS_OPTIONS -- 172.21.15.37:6789:/scratch 2023-12-11T23:44:56.804 INFO:teuthology.orchestra.run.smithi037.stdout:MOUNT_OPTIONS -- -o name=admin,secret=AQAaQndlMDCHCBAAc3pQKg2xDZsyDtiRo4gOlw== -o context=system_u:object_r:root_t:s0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch 2023-12-11T23:44:56.804 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-11T23:48:58.524 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:48:58.537 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:48:58.749 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T23:48:58.748+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 106255) UID: 0 2023-12-11T23:48:58.751 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T23:48:58.751+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 106255) UID: 0 2023-12-11T23:48:58.753 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T23:48:58.751+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 106255) UID: 0 2023-12-11T23:48:58.754 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T23:48:58.753+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 106255) UID: 0 2023-12-11T23:53:19.123 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:53:19.134 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:53:19.255 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-11T23:53:19.254+0000 7f8de7bd6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 589197) UID: 0 2023-12-11T23:53:19.256 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-11T23:53:19.254+0000 7f5aba636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 589197) UID: 0 2023-12-11T23:53:19.256 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-11T23:53:19.254+0000 7fb782446640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 589197) UID: 0 2023-12-11T23:53:19.256 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-11T23:53:19.255+0000 7f690ba68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 589197) UID: 0 2023-12-11T23:58:00.507 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:58:00.513 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-11T23:58:00.612 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-11T23:58:00.612+0000 7f0077a7d640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107166) UID: 0 2023-12-11T23:58:00.612 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-11T23:58:00.612+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107166) UID: 0 2023-12-11T23:58:00.612 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-11T23:58:00.612+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107166) UID: 0 2023-12-11T23:58:00.613 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-11T23:58:00.612+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107166) UID: 0 2023-12-12T00:02:23.395 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:02:23.403 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:02:53.649 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:02:53.655 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:03:23.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:03:23.828 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:03:55.136 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:03:55.142 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:04:25.285 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:04:25.297 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:04:25.449 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-12T00:04:25.448+0000 7f5aba636640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 589966) UID: 0 2023-12-12T00:04:25.450 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-12T00:04:25.448+0000 7f690ba68640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 589966) UID: 0 2023-12-12T00:04:25.450 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-12T00:04:25.448+0000 7fb782446640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 589966) UID: 0 2023-12-12T00:04:25.450 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-12T00:04:25.448+0000 7f8de7bd6640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 589966) UID: 0 2023-12-12T00:05:14.174 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-12T00:05:14.173+0000 7f006e08e640 -1 bdev(0x55d56b916e00 /var/lib/ceph/osd/ceph-5/block) _aio_thread got r=-28 ((28) No space left on device) 2023-12-12T00:05:14.255 INFO:tasks.ceph.osd.5.smithi151.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-119-ga62fda73/rpm/el9/BUILD/ceph-19.0.0-119-ga62fda73/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f006e08e640 time 2023-12-12T00:05:14.191817+0000 2023-12-12T00:05:14.255 INFO:tasks.ceph.osd.5.smithi151.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-119-ga62fda73/rpm/el9/BUILD/ceph-19.0.0-119-ga62fda73/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-12T00:05:14.255 INFO:tasks.ceph.osd.5.smithi151.stderr: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev) 2023-12-12T00:05:14.255 INFO:tasks.ceph.osd.5.smithi151.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x55d56904dee9] 2023-12-12T00:05:14.255 INFO:tasks.ceph.osd.5.smithi151.stderr: 2: (KernelDevice::_aio_thread()+0x10f6) [0x55d56999e5b6] 2023-12-12T00:05:14.255 INFO:tasks.ceph.osd.5.smithi151.stderr: 3: ceph-osd(+0xda2811) [0x55d56997f811] 2023-12-12T00:05:14.256 INFO:tasks.ceph.osd.5.smithi151.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f007ae9f802] 2023-12-12T00:05:14.256 INFO:tasks.ceph.osd.5.smithi151.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f007ae3f450] 2023-12-12T00:05:14.256 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-12T00:05:14.254+0000 7f006e08e640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-119-ga62fda73/rpm/el9/BUILD/ceph-19.0.0-119-ga62fda73/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f006e08e640 time 2023-12-12T00:05:14.191817+0000 2023-12-12T00:05:14.256 INFO:tasks.ceph.osd.5.smithi151.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-119-ga62fda73/rpm/el9/BUILD/ceph-19.0.0-119-ga62fda73/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-12T00:05:14.256 INFO:tasks.ceph.osd.5.smithi151.stderr: 2023-12-12T00:05:14.256 INFO:tasks.ceph.osd.5.smithi151.stderr: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev) 2023-12-12T00:05:14.256 INFO:tasks.ceph.osd.5.smithi151.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x55d56904dee9] 2023-12-12T00:05:14.256 INFO:tasks.ceph.osd.5.smithi151.stderr: 2: (KernelDevice::_aio_thread()+0x10f6) [0x55d56999e5b6] 2023-12-12T00:05:14.256 INFO:tasks.ceph.osd.5.smithi151.stderr: 3: ceph-osd(+0xda2811) [0x55d56997f811] 2023-12-12T00:05:14.256 INFO:tasks.ceph.osd.5.smithi151.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f007ae9f802] 2023-12-12T00:05:14.256 INFO:tasks.ceph.osd.5.smithi151.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f007ae3f450] 2023-12-12T00:05:14.256 INFO:tasks.ceph.osd.5.smithi151.stderr: 2023-12-12T00:05:14.257 INFO:tasks.ceph.osd.5.smithi151.stderr:*** Caught signal (Aborted) ** 2023-12-12T00:05:14.257 INFO:tasks.ceph.osd.5.smithi151.stderr: in thread 7f006e08e640 thread_name:bstore_aio 2023-12-12T00:05:14.258 INFO:tasks.ceph.osd.5.smithi151.stderr: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev) 2023-12-12T00:05:14.258 INFO:tasks.ceph.osd.5.smithi151.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f007ae54db0] 2023-12-12T00:05:14.258 INFO:tasks.ceph.osd.5.smithi151.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f007aea154c] 2023-12-12T00:05:14.258 INFO:tasks.ceph.osd.5.smithi151.stderr: 3: raise() 2023-12-12T00:05:14.258 INFO:tasks.ceph.osd.5.smithi151.stderr: 4: abort() 2023-12-12T00:05:14.258 INFO:tasks.ceph.osd.5.smithi151.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x55d56904dfaa] 2023-12-12T00:05:14.259 INFO:tasks.ceph.osd.5.smithi151.stderr: 6: (KernelDevice::_aio_thread()+0x10f6) [0x55d56999e5b6] 2023-12-12T00:05:14.259 INFO:tasks.ceph.osd.5.smithi151.stderr: 7: ceph-osd(+0xda2811) [0x55d56997f811] 2023-12-12T00:05:14.259 INFO:tasks.ceph.osd.5.smithi151.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f007ae9f802] 2023-12-12T00:05:14.259 INFO:tasks.ceph.osd.5.smithi151.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f007ae3f450] 2023-12-12T00:05:14.259 INFO:tasks.ceph.osd.5.smithi151.stderr:2023-12-12T00:05:14.258+0000 7f006e08e640 -1 *** Caught signal (Aborted) ** 2023-12-12T00:05:14.259 INFO:tasks.ceph.osd.5.smithi151.stderr: in thread 7f006e08e640 thread_name:bstore_aio 2023-12-12T00:05:14.259 INFO:tasks.ceph.osd.5.smithi151.stderr: 2023-12-12T00:05:14.259 INFO:tasks.ceph.osd.5.smithi151.stderr: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev) 2023-12-12T00:05:14.260 INFO:tasks.ceph.osd.5.smithi151.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f007ae54db0] 2023-12-12T00:05:14.260 INFO:tasks.ceph.osd.5.smithi151.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f007aea154c] 2023-12-12T00:05:14.260 INFO:tasks.ceph.osd.5.smithi151.stderr: 3: raise() 2023-12-12T00:05:14.260 INFO:tasks.ceph.osd.5.smithi151.stderr: 4: abort() 2023-12-12T00:05:14.260 INFO:tasks.ceph.osd.5.smithi151.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x55d56904dfaa] 2023-12-12T00:05:14.260 INFO:tasks.ceph.osd.5.smithi151.stderr: 6: (KernelDevice::_aio_thread()+0x10f6) [0x55d56999e5b6] 2023-12-12T00:05:14.260 INFO:tasks.ceph.osd.5.smithi151.stderr: 7: ceph-osd(+0xda2811) [0x55d56997f811] 2023-12-12T00:05:14.260 INFO:tasks.ceph.osd.5.smithi151.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f007ae9f802] 2023-12-12T00:05:14.260 INFO:tasks.ceph.osd.5.smithi151.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f007ae3f450] 2023-12-12T00:05:14.260 INFO:tasks.ceph.osd.5.smithi151.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-12T00:05:14.260 INFO:tasks.ceph.osd.5.smithi151.stderr: 2023-12-12T00:05:14.282 INFO:tasks.ceph.osd.5.smithi151.stderr: -7> 2023-12-12T00:05:14.254+0000 7f006e08e640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-119-ga62fda73/rpm/el9/BUILD/ceph-19.0.0-119-ga62fda73/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f006e08e640 time 2023-12-12T00:05:14.191817+0000 2023-12-12T00:05:14.282 INFO:tasks.ceph.osd.5.smithi151.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-119-ga62fda73/rpm/el9/BUILD/ceph-19.0.0-119-ga62fda73/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-12T00:05:14.282 INFO:tasks.ceph.osd.5.smithi151.stderr: 2023-12-12T00:05:14.282 INFO:tasks.ceph.osd.5.smithi151.stderr: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev) 2023-12-12T00:05:14.282 INFO:tasks.ceph.osd.5.smithi151.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x55d56904dee9] 2023-12-12T00:05:14.282 INFO:tasks.ceph.osd.5.smithi151.stderr: 2: (KernelDevice::_aio_thread()+0x10f6) [0x55d56999e5b6] 2023-12-12T00:05:14.282 INFO:tasks.ceph.osd.5.smithi151.stderr: 3: ceph-osd(+0xda2811) [0x55d56997f811] 2023-12-12T00:05:14.282 INFO:tasks.ceph.osd.5.smithi151.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f007ae9f802] 2023-12-12T00:05:14.282 INFO:tasks.ceph.osd.5.smithi151.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f007ae3f450] 2023-12-12T00:05:14.282 INFO:tasks.ceph.osd.5.smithi151.stderr: 2023-12-12T00:05:14.283 INFO:tasks.ceph.osd.5.smithi151.stderr: 0> 2023-12-12T00:05:14.258+0000 7f006e08e640 -1 *** Caught signal (Aborted) ** 2023-12-12T00:05:14.283 INFO:tasks.ceph.osd.5.smithi151.stderr: in thread 7f006e08e640 thread_name:bstore_aio 2023-12-12T00:05:14.283 INFO:tasks.ceph.osd.5.smithi151.stderr: 2023-12-12T00:05:14.283 INFO:tasks.ceph.osd.5.smithi151.stderr: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev) 2023-12-12T00:05:14.283 INFO:tasks.ceph.osd.5.smithi151.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f007ae54db0] 2023-12-12T00:05:14.283 INFO:tasks.ceph.osd.5.smithi151.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f007aea154c] 2023-12-12T00:05:14.283 INFO:tasks.ceph.osd.5.smithi151.stderr: 3: raise() 2023-12-12T00:05:14.283 INFO:tasks.ceph.osd.5.smithi151.stderr: 4: abort() 2023-12-12T00:05:14.283 INFO:tasks.ceph.osd.5.smithi151.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x55d56904dfaa] 2023-12-12T00:05:14.283 INFO:tasks.ceph.osd.5.smithi151.stderr: 6: (KernelDevice::_aio_thread()+0x10f6) [0x55d56999e5b6] 2023-12-12T00:05:14.283 INFO:tasks.ceph.osd.5.smithi151.stderr: 7: ceph-osd(+0xda2811) [0x55d56997f811] 2023-12-12T00:05:14.283 INFO:tasks.ceph.osd.5.smithi151.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f007ae9f802] 2023-12-12T00:05:14.283 INFO:tasks.ceph.osd.5.smithi151.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f007ae3f450] 2023-12-12T00:05:14.283 INFO:tasks.ceph.osd.5.smithi151.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-12T00:05:14.283 INFO:tasks.ceph.osd.5.smithi151.stderr: 2023-12-12T00:05:14.302 INFO:tasks.ceph.osd.5.smithi151.stderr: -103> 2023-12-12T00:05:14.254+0000 7f006e08e640 -1 /home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-119-ga62fda73/rpm/el9/BUILD/ceph-19.0.0-119-ga62fda73/src/blk/kernel/KernelDevice.cc: In function 'void KernelDevice::_aio_thread()' thread 7f006e08e640 time 2023-12-12T00:05:14.191817+0000 2023-12-12T00:05:14.303 INFO:tasks.ceph.osd.5.smithi151.stderr:/home/jenkins-build/build/workspace/ceph-dev-new-build/ARCH/x86_64/AVAILABLE_ARCH/x86_64/AVAILABLE_DIST/centos9/DIST/centos9/MACHINE_SIZE/gigantic/release/19.0.0-119-ga62fda73/rpm/el9/BUILD/ceph-19.0.0-119-ga62fda73/src/blk/kernel/KernelDevice.cc: 633: ceph_abort_msg("Unexpected IO error. This may suggest a hardware issue. Please check your kernel log!") 2023-12-12T00:05:14.303 INFO:tasks.ceph.osd.5.smithi151.stderr: 2023-12-12T00:05:14.303 INFO:tasks.ceph.osd.5.smithi151.stderr: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev) 2023-12-12T00:05:14.303 INFO:tasks.ceph.osd.5.smithi151.stderr: 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xc6) [0x55d56904dee9] 2023-12-12T00:05:14.303 INFO:tasks.ceph.osd.5.smithi151.stderr: 2: (KernelDevice::_aio_thread()+0x10f6) [0x55d56999e5b6] 2023-12-12T00:05:14.303 INFO:tasks.ceph.osd.5.smithi151.stderr: 3: ceph-osd(+0xda2811) [0x55d56997f811] 2023-12-12T00:05:14.303 INFO:tasks.ceph.osd.5.smithi151.stderr: 4: /lib64/libc.so.6(+0x9f802) [0x7f007ae9f802] 2023-12-12T00:05:14.303 INFO:tasks.ceph.osd.5.smithi151.stderr: 5: /lib64/libc.so.6(+0x3f450) [0x7f007ae3f450] 2023-12-12T00:05:14.303 INFO:tasks.ceph.osd.5.smithi151.stderr: 2023-12-12T00:05:14.303 INFO:tasks.ceph.osd.5.smithi151.stderr: -96> 2023-12-12T00:05:14.258+0000 7f006e08e640 -1 *** Caught signal (Aborted) ** 2023-12-12T00:05:14.303 INFO:tasks.ceph.osd.5.smithi151.stderr: in thread 7f006e08e640 thread_name:bstore_aio 2023-12-12T00:05:14.303 INFO:tasks.ceph.osd.5.smithi151.stderr: 2023-12-12T00:05:14.303 INFO:tasks.ceph.osd.5.smithi151.stderr: ceph version 19.0.0-119-ga62fda73 (a62fda73efba5520d409bb5a21bd8373289dda5d) reef (dev) 2023-12-12T00:05:14.303 INFO:tasks.ceph.osd.5.smithi151.stderr: 1: /lib64/libc.so.6(+0x54db0) [0x7f007ae54db0] 2023-12-12T00:05:14.304 INFO:tasks.ceph.osd.5.smithi151.stderr: 2: /lib64/libc.so.6(+0xa154c) [0x7f007aea154c] 2023-12-12T00:05:14.304 INFO:tasks.ceph.osd.5.smithi151.stderr: 3: raise() 2023-12-12T00:05:14.304 INFO:tasks.ceph.osd.5.smithi151.stderr: 4: abort() 2023-12-12T00:05:14.304 INFO:tasks.ceph.osd.5.smithi151.stderr: 5: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0x187) [0x55d56904dfaa] 2023-12-12T00:05:14.304 INFO:tasks.ceph.osd.5.smithi151.stderr: 6: (KernelDevice::_aio_thread()+0x10f6) [0x55d56999e5b6] 2023-12-12T00:05:14.304 INFO:tasks.ceph.osd.5.smithi151.stderr: 7: ceph-osd(+0xda2811) [0x55d56997f811] 2023-12-12T00:05:14.304 INFO:tasks.ceph.osd.5.smithi151.stderr: 8: /lib64/libc.so.6(+0x9f802) [0x7f007ae9f802] 2023-12-12T00:05:14.304 INFO:tasks.ceph.osd.5.smithi151.stderr: 9: /lib64/libc.so.6(+0x3f450) [0x7f007ae3f450] 2023-12-12T00:05:14.304 INFO:tasks.ceph.osd.5.smithi151.stderr: NOTE: a copy of the executable, or `objdump -rdS ` is needed to interpret this. 2023-12-12T00:05:14.304 INFO:tasks.ceph.osd.5.smithi151.stderr: 2023-12-12T00:05:14.660 INFO:tasks.ceph.osd.5.smithi151.stderr:daemon-helper: command failed with exit status 5 2023-12-12T00:05:21.098 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-12-12T00:05:27.713 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~7s 2023-12-12T00:05:34.326 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~13s 2023-12-12T00:05:40.938 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~20s 2023-12-12T00:05:47.553 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~26s 2023-12-12T00:05:54.166 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~33s 2023-12-12T00:06:00.779 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~40s 2023-12-12T00:06:07.391 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~46s 2023-12-12T00:06:14.004 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~53s 2023-12-12T00:06:20.618 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~60s 2023-12-12T00:06:27.230 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~66s 2023-12-12T00:06:33.845 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~73s 2023-12-12T00:06:40.458 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~79s 2023-12-12T00:06:47.071 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~86s 2023-12-12T00:06:53.684 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~93s 2023-12-12T00:07:00.297 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~99s 2023-12-12T00:07:06.911 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~106s 2023-12-12T00:07:13.525 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~112s 2023-12-12T00:07:20.138 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~119s 2023-12-12T00:07:26.752 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~126s 2023-12-12T00:07:33.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~132s 2023-12-12T00:07:39.979 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~139s 2023-12-12T00:07:46.592 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~145s 2023-12-12T00:07:53.205 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~152s 2023-12-12T00:07:59.817 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~159s 2023-12-12T00:08:06.428 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~165s 2023-12-12T00:08:13.042 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~172s 2023-12-12T00:08:19.654 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~179s 2023-12-12T00:08:26.266 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~185s 2023-12-12T00:08:32.878 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~192s 2023-12-12T00:08:39.493 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~198s 2023-12-12T00:08:46.106 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~205s 2023-12-12T00:08:47.502 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:08:47.507 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:08:52.719 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~212s 2023-12-12T00:08:59.332 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~218s 2023-12-12T00:09:05.946 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~225s 2023-12-12T00:09:12.559 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~231s 2023-12-12T00:09:19.171 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~238s 2023-12-12T00:09:23.504 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:09:23.511 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:09:23.624 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-12T00:09:23.623+0000 7fe981309640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107641) UID: 0 2023-12-12T00:09:23.625 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-12T00:09:23.623+0000 7fdadfa99640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107641) UID: 0 2023-12-12T00:09:23.625 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-12T00:09:23.623+0000 7efcd4284640 -1 received signal: Hangup from killall ceph-osd -1 (PID: 107641) UID: 0 2023-12-12T00:09:25.785 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~245s 2023-12-12T00:09:32.398 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~251s 2023-12-12T00:09:39.012 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~258s 2023-12-12T00:09:45.626 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~265s 2023-12-12T00:09:52.238 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~271s 2023-12-12T00:09:58.850 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~278s 2023-12-12T00:10:05.463 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~284s 2023-12-12T00:10:12.075 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~291s 2023-12-12T00:10:18.688 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~298s 2023-12-12T00:10:25.302 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~304s 2023-12-12T00:10:25.302 INFO:tasks.daemonwatchdog.daemon_watchdog:BARK! unmounting mounts and killing all daemons 2023-12-12T00:10:25.303 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-12T00:10:25.303 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T00:10:25.384 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-12T00:10:25.384 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T00:10:25.447 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-12T00:10:26.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.320+0000 7f1d56b6c640 1 Processor -- start 2023-12-12T00:10:26.323 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.320+0000 7f1d56b6c640 1 -- start start 2023-12-12T00:10:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.322+0000 7f1d56b6c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d5006c410 0x7f1d50166020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.322+0000 7f1d56b6c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d500b3bb0 con 0x7f1d50143e00 2023-12-12T00:10:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.323+0000 7f1d56b6c640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d500b4e60 con 0x7f1d50072180 2023-12-12T00:10:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.323+0000 7f1d56b6c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d501441e0 con 0x7f1d5006c410 2023-12-12T00:10:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.323+0000 7f1d54908640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1d50143e00 0x7f1d500b4040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34900/0 (socket says 172.21.15.37:34900) 2023-12-12T00:10:26.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.323+0000 7f1d54908640 1 -- 172.21.15.37:0/2435482806 learned_addr learned my addr 172.21.15.37:0/2435482806 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-12T00:10:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.323+0000 7f1d55109640 1 --2- 172.21.15.37:0/2435482806 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d5006c410 0x7f1d50166020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.324+0000 7f1d4f7fe640 1 -- 172.21.15.37:0/2435482806 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3013786859 0 0) 0x7f1d500b3bb0 con 0x7f1d50143e00 2023-12-12T00:10:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.324+0000 7f1d4f7fe640 1 -- 172.21.15.37:0/2435482806 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d40003520 con 0x7f1d50143e00 2023-12-12T00:10:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.324+0000 7f1d4f7fe640 1 -- 172.21.15.37:0/2435482806 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2027057579 0 0) 0x7f1d40003520 con 0x7f1d50143e00 2023-12-12T00:10:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.324+0000 7f1d4f7fe640 1 -- 172.21.15.37:0/2435482806 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d5006c410 msgr2=0x7f1d50166020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T00:10:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.324+0000 7f1d4f7fe640 1 --2- 172.21.15.37:0/2435482806 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d5006c410 0x7f1d50166020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.324+0000 7f1d4f7fe640 1 -- 172.21.15.37:0/2435482806 >> v1:172.21.15.151:6789/0 conn(0x7f1d50072180 legacy=0x7f1d500b4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.324+0000 7f1d4f7fe640 1 -- 172.21.15.37:0/2435482806 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d50072680 con 0x7f1d50143e00 2023-12-12T00:10:26.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.324+0000 7f1d4f7fe640 1 -- 172.21.15.37:0/2435482806 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f1d44001670 con 0x7f1d50143e00 2023-12-12T00:10:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.324+0000 7f1d4f7fe640 1 -- 172.21.15.37:0/2435482806 >> v1:172.21.15.37:6789/0 conn(0x7f1d50143e00 legacy=0x7f1d500b4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.325+0000 7f1d4f7fe640 1 --2- 172.21.15.37:0/2435482806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d400039a0 0x7f1d40003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.325+0000 7f1d4f7fe640 1 --2- 172.21.15.37:0/2435482806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d400047c0 0x7f1d40004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.325+0000 7f1d4f7fe640 1 --2- 172.21.15.37:0/2435482806 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d5006c410 0x7f1d40005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.325+0000 7f1d4f7fe640 1 -- 172.21.15.37:0/2435482806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d501441e0 con 0x7f1d400047c0 2023-12-12T00:10:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.325+0000 7f1d4f7fe640 1 -- 172.21.15.37:0/2435482806 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4000ba30 con 0x7f1d400039a0 2023-12-12T00:10:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.325+0000 7f1d4f7fe640 1 -- 172.21.15.37:0/2435482806 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d4000bba0 con 0x7f1d5006c410 2023-12-12T00:10:26.328 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.325+0000 7f1d4ffff640 1 --2- 172.21.15.37:0/2435482806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d400047c0 0x7f1d40004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.325+0000 7f1d54908640 1 --2- 172.21.15.37:0/2435482806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d400039a0 0x7f1d40003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:26.329 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.325+0000 7f1d55109640 1 --2- 172.21.15.37:0/2435482806 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d5006c410 0x7f1d40005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.326+0000 7f1d4ffff640 1 -- 172.21.15.37:0/2435482806 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d5006c410 msgr2=0x7f1d40005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T00:10:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.326+0000 7f1d4ffff640 1 --2- 172.21.15.37:0/2435482806 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d5006c410 0x7f1d40005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.326+0000 7f1d4ffff640 1 -- 172.21.15.37:0/2435482806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d400039a0 msgr2=0x7f1d40003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T00:10:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.326+0000 7f1d4ffff640 1 --2- 172.21.15.37:0/2435482806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d400039a0 0x7f1d40003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.326+0000 7f1d4ffff640 1 -- 172.21.15.37:0/2435482806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d40003520 con 0x7f1d400047c0 2023-12-12T00:10:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.326+0000 7f1d54908640 1 --2- 172.21.15.37:0/2435482806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d400039a0 0x7f1d40003d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T00:10:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.327+0000 7f1d4ffff640 1 --2- 172.21.15.37:0/2435482806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d400047c0 0x7f1d40004c40 secure :-1 s=READY pgs=2639 cs=0 l=1 rev1=1 crypto rx=0x7f1d500725b0 tx=0x7f1d400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=632bd62319417d16 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T00:10:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.327+0000 7f1d4f7fe640 1 -- 172.21.15.37:0/2435482806 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c032600 con 0x7f1d400047c0 2023-12-12T00:10:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.327+0000 7f1d4f7fe640 1 -- 172.21.15.37:0/2435482806 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3c02e050 con 0x7f1d400047c0 2023-12-12T00:10:26.330 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.327+0000 7f1d4f7fe640 1 -- 172.21.15.37:0/2435482806 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c0329c0 con 0x7f1d400047c0 2023-12-12T00:10:26.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.328+0000 7f1d56b6c640 1 -- 172.21.15.37:0/2435482806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d400047c0 msgr2=0x7f1d40004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:26.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.328+0000 7f1d56b6c640 1 --2- 172.21.15.37:0/2435482806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d400047c0 0x7f1d40004c40 secure :-1 s=READY pgs=2639 cs=0 l=1 rev1=1 crypto rx=0x7f1d500725b0 tx=0x7f1d400057f0 comp rx=0 tx=0).stop 2023-12-12T00:10:26.331 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.328+0000 7f1d55109640 1 -- 172.21.15.37:0/2435482806 reap_dead start 2023-12-12T00:10:26.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.328+0000 7f1d56b6c640 1 -- 172.21.15.37:0/2435482806 shutdown_connections 2023-12-12T00:10:26.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.328+0000 7f1d56b6c640 1 -- 172.21.15.37:0/2435482806 >> 172.21.15.37:0/2435482806 conn(0x7f1d500b0a90 msgr2=0x7f1d500b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T00:10:26.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.328+0000 7f1d56b6c640 1 -- 172.21.15.37:0/2435482806 shutdown_connections 2023-12-12T00:10:26.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.328+0000 7f1d56b6c640 1 -- 172.21.15.37:0/2435482806 wait complete. 2023-12-12T00:10:26.332 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.331+0000 7f1d56b6c640 1 Processor -- start 2023-12-12T00:10:26.333 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.331+0000 7f1d56b6c640 1 -- start start 2023-12-12T00:10:26.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.332+0000 7f1d56b6c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d400047c0 0x7f1d5013e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:26.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.332+0000 7f1d56b6c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d500c4880 0x7f1d5015deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:26.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.332+0000 7f1d56b6c640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d5015e3f0 0x7f1d500c6cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:26.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.332+0000 7f1d56b6c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d5015e870 con 0x7f1d500c4880 2023-12-12T00:10:26.334 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.332+0000 7f1d56b6c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d500c43f0 con 0x7f1d400047c0 2023-12-12T00:10:26.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.332+0000 7f1d56b6c640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d500c79d0 con 0x7f1d5015e3f0 2023-12-12T00:10:26.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.332+0000 7f1d4ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d500c4880 0x7f1d5015deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:26.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.332+0000 7f1d4ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d500c4880 0x7f1d5015deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42842/0 (socket says 172.21.15.37:42842) 2023-12-12T00:10:26.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.332+0000 7f1d4ffff640 1 -- 172.21.15.37:0/1609794749 learned_addr learned my addr 172.21.15.37:0/1609794749 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-12T00:10:26.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.333+0000 7f1d55109640 1 --2- 172.21.15.37:0/1609794749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d5015e3f0 0x7f1d500c6cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:26.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.333+0000 7f1d54908640 1 --2- 172.21.15.37:0/1609794749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d400047c0 0x7f1d5013e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:26.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.333+0000 7f1d4ffff640 1 -- 172.21.15.37:0/1609794749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d5015e3f0 msgr2=0x7f1d500c6cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:26.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.333+0000 7f1d4ffff640 1 --2- 172.21.15.37:0/1609794749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d5015e3f0 0x7f1d500c6cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:26.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.333+0000 7f1d4ffff640 1 -- 172.21.15.37:0/1609794749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d400047c0 msgr2=0x7f1d5013e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:26.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.333+0000 7f1d4ffff640 1 --2- 172.21.15.37:0/1609794749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d400047c0 0x7f1d5013e9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:26.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.333+0000 7f1d4ffff640 1 -- 172.21.15.37:0/1609794749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d500c3da0 con 0x7f1d500c4880 2023-12-12T00:10:26.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.333+0000 7f1d4ffff640 1 --2- 172.21.15.37:0/1609794749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d500c4880 0x7f1d5015deb0 secure :-1 s=READY pgs=2640 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c001920 tx=0x7f1d3c001230 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T00:10:26.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.334+0000 7f1d4d7fa640 1 -- 172.21.15.37:0/1609794749 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c0054e0 con 0x7f1d500c4880 2023-12-12T00:10:26.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.334+0000 7f1d4d7fa640 1 -- 172.21.15.37:0/1609794749 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d3c007050 con 0x7f1d500c4880 2023-12-12T00:10:26.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.334+0000 7f1d56b6c640 1 -- 172.21.15.37:0/1609794749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d500c4080 con 0x7f1d500c4880 2023-12-12T00:10:26.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.334+0000 7f1d4d7fa640 1 -- 172.21.15.37:0/1609794749 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d3c0073e0 con 0x7f1d500c4880 2023-12-12T00:10:26.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.334+0000 7f1d56b6c640 1 -- 172.21.15.37:0/1609794749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d500c4d00 con 0x7f1d500c4880 2023-12-12T00:10:26.338 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.336+0000 7f1d56b6c640 1 -- 172.21.15.37:0/1609794749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d5015e7d0 con 0x7f1d500c4880 2023-12-12T00:10:26.339 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.337+0000 7f1d4d7fa640 1 -- 172.21.15.37:0/1609794749 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f1d3c007540 con 0x7f1d500c4880 2023-12-12T00:10:26.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.338+0000 7f1d4d7fa640 1 --2- 172.21.15.37:0/1609794749 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1d3406ae70 0x7f1d3406d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:26.340 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.338+0000 7f1d4d7fa640 1 -- 172.21.15.37:0/1609794749 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f1d3c0ab640 con 0x7f1d500c4880 2023-12-12T00:10:26.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.339+0000 7f1d54908640 1 --2- 172.21.15.37:0/1609794749 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1d3406ae70 0x7f1d3406d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:26.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.341+0000 7f1d54908640 1 --2- 172.21.15.37:0/1609794749 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1d3406ae70 0x7f1d3406d330 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f1d44000fd0 tx=0x7f1d44001a90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T00:10:26.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.354+0000 7f1d4d7fa640 1 -- 172.21.15.37:0/1609794749 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1d3c0764f0 con 0x7f1d500c4880 2023-12-12T00:10:26.563 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.561+0000 7f1d56b6c640 1 -- 172.21.15.37:0/1609794749 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d500745d0 con 0x7f1d500c4880 2023-12-12T00:10:26.580 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.578+0000 7f1d4d7fa640 1 -- 172.21.15.37:0/1609794749 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+16909 (secure 0 0 0) 0x7f1d3c079b10 con 0x7f1d500c4880 2023-12-12T00:10:26.581 INFO:teuthology.orchestra.run.smithi037.stdout: 2023-12-12T00:10:26.581 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":43,"fsid":"349792a4-57b1-4c92-9cc0-0c9ba4325d41","created":"2023-12-11T17:09:25.300722+0000","modified":"2023-12-12T00:05:15.721402+0000","last_up_change":"2023-12-12T00:05:14.693297+0000","last_in_change":"2023-12-11T17:09:28.767296+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":6,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-11T17:09:38.415636+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_metadata","create_time":"2023-12-11T17:11:24.128757+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.4900000095367432,"score_stable":1.4900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.309999942779541,"raw_score_stable":1.309999942779541,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_data","create_time":"2023-12-11T17:11:25.159839+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6100000143051147,"score_stable":1.6100000143051147,"optimal_score":0.87999999523162842,"raw_score_acting":1.4199999570846558,"raw_score_stable":1.4199999570846558,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"b4bafba7-b7d5-488d-be85-93d79e39f8df","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6801","nonce":3177893057}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6803","nonce":3177893057}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6807","nonce":3177893057}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":3177893057},{"type":"v1","addr":"172.21.15.37:6805","nonce":3177893057}]},"public_addr":"172.21.15.37:6801/3177893057","cluster_addr":"172.21.15.37:6803/3177893057","heartbeat_back_addr":"172.21.15.37:6807/3177893057","heartbeat_front_addr":"172.21.15.37:6805/3177893057","state":["exists","up"]},{"osd":1,"uuid":"fd1160c5-2118-4d05-806f-a69d666cb362","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6813","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6815","nonce":1457860485}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6818","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6819","nonce":1457860485}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6824","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6826","nonce":1457860485}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6820","nonce":1457860485},{"type":"v1","addr":"172.21.15.37:6822","nonce":1457860485}]},"public_addr":"172.21.15.37:6815/1457860485","cluster_addr":"172.21.15.37:6819/1457860485","heartbeat_back_addr":"172.21.15.37:6826/1457860485","heartbeat_front_addr":"172.21.15.37:6822/1457860485","state":["exists","up"]},{"osd":2,"uuid":"1a2c713e-b1c9-4828-8e2e-c7dfd1280f37","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6808","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6809","nonce":2707368582}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6810","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6811","nonce":2707368582}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6816","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6817","nonce":2707368582}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6812","nonce":2707368582},{"type":"v1","addr":"172.21.15.37:6814","nonce":2707368582}]},"public_addr":"172.21.15.37:6809/2707368582","cluster_addr":"172.21.15.37:6811/2707368582","heartbeat_back_addr":"172.21.15.37:6817/2707368582","heartbeat_front_addr":"172.21.15.37:6814/2707368582","state":["exists","up"]},{"osd":3,"uuid":"d4cfe2e1-3157-484b-a50b-12b6bcd7ae05","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6821","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6823","nonce":2938574997}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6825","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6827","nonce":2938574997}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6830","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6831","nonce":2938574997}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6828","nonce":2938574997},{"type":"v1","addr":"172.21.15.37:6829","nonce":2938574997}]},"public_addr":"172.21.15.37:6823/2938574997","cluster_addr":"172.21.15.37:6827/2938574997","heartbeat_back_addr":"172.21.15.37:6831/2938574997","heartbeat_front_addr":"172.21.15.37:6829/2938574997","state":["exists","up"]},{"osd":4,"uuid":"9f129950-acee-449b-849a-5a39a8f06e02","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6817","nonce":1944498382}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6819","nonce":1944498382}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6824","nonce":1944498382}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":1944498382},{"type":"v1","addr":"172.21.15.151:6821","nonce":1944498382}]},"public_addr":"172.21.15.151:6817/1944498382","cluster_addr":"172.21.15.151:6819/1944498382","heartbeat_back_addr":"172.21.15.151:6824/1944498382","heartbeat_front_addr":"172.21.15.151:6821/1944498382","state":["exists","up"]},{"osd":5,"uuid":"ada36ce6-7b6d-4147-8467-b10da804ef27","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":37,"down_at":42,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6801","nonce":491338889}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6803","nonce":491338889}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6810","nonce":491338889}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":491338889},{"type":"v1","addr":"172.21.15.151:6806","nonce":491338889}]},"public_addr":"172.21.15.151:6801/491338889","cluster_addr":"172.21.15.151:6803/491338889","heartbeat_back_addr":"172.21.15.151:6810/491338889","heartbeat_front_addr":"172.21.15.151:6806/491338889","state":["exists"]},{"osd":6,"uuid":"9b1caf4e-dc67-480d-86b6-a9d5e75c85b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6823","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6825","nonce":2023784978}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6827","nonce":2023784978}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6831","nonce":2023784978}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":2023784978},{"type":"v1","addr":"172.21.15.151:6829","nonce":2023784978}]},"public_addr":"172.21.15.151:6825/2023784978","cluster_addr":"172.21.15.151:6827/2023784978","heartbeat_back_addr":"172.21.15.151:6831/2023784978","heartbeat_front_addr":"172.21.15.151:6829/2023784978","state":["exists","up"]},{"osd":7,"uuid":"b709866c-d3eb-4847-b700-c67ed124103c","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6805","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6807","nonce":1859505134}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6809","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6811","nonce":1859505134}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6815","nonce":1859505134}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":1859505134},{"type":"v1","addr":"172.21.15.151:6813","nonce":1859505134}]},"public_addr":"172.21.15.151:6807/1859505134","cluster_addr":"172.21.15.151:6811/1859505134","heartbeat_back_addr":"172.21.15.151:6815/1859505134","heartbeat_front_addr":"172.21.15.151:6813/1859505134","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.355140+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.195342+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.335391+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.097661+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.129944+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.306988+0000","dead_epoch":42},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.189156+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-11T17:09:34.362917+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"6.d","mappings":[{"from":5,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-12T00:10:26.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.581+0000 7f1d56b6c640 1 -- 172.21.15.37:0/1609794749 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1d3406ae70 msgr2=0x7f1d3406d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:26.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.581+0000 7f1d56b6c640 1 --2- 172.21.15.37:0/1609794749 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1d3406ae70 0x7f1d3406d330 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f1d44000fd0 tx=0x7f1d44001a90 comp rx=0 tx=0).stop 2023-12-12T00:10:26.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.581+0000 7f1d56b6c640 1 -- 172.21.15.37:0/1609794749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d500c4880 msgr2=0x7f1d5015deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:26.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.581+0000 7f1d56b6c640 1 --2- 172.21.15.37:0/1609794749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d500c4880 0x7f1d5015deb0 secure :-1 s=READY pgs=2640 cs=0 l=1 rev1=1 crypto rx=0x7f1d3c001920 tx=0x7f1d3c001230 comp rx=0 tx=0).stop 2023-12-12T00:10:26.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.581+0000 7f1d56b6c640 1 -- 172.21.15.37:0/1609794749 shutdown_connections 2023-12-12T00:10:26.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.581+0000 7f1d56b6c640 1 --2- 172.21.15.37:0/1609794749 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f1d3406ae70 0x7f1d3406d330 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:26.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.581+0000 7f1d56b6c640 1 --2- 172.21.15.37:0/1609794749 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f1d5015e3f0 0x7f1d500c6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:26.583 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.581+0000 7f1d56b6c640 1 --2- 172.21.15.37:0/1609794749 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1d500c4880 0x7f1d5015deb0 unknown :-1 s=CLOSED pgs=2640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.581+0000 7f1d56b6c640 1 --2- 172.21.15.37:0/1609794749 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1d400047c0 0x7f1d5013e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.581+0000 7f1d56b6c640 1 -- 172.21.15.37:0/1609794749 >> 172.21.15.37:0/1609794749 conn(0x7f1d500b0a90 msgr2=0x7f1d500708a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T00:10:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.581+0000 7f1d56b6c640 1 -- 172.21.15.37:0/1609794749 shutdown_connections 2023-12-12T00:10:26.584 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.581+0000 7f1d56b6c640 1 -- 172.21.15.37:0/1609794749 wait complete. 2023-12-12T00:10:26.608 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-11T17:09:38.415636+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-11T17:11:24.128757+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.4900000095367432, 'score_stable': 1.4900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_data', 'create_time': '2023-12-11T17:11:25.159839+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6100000143051147, 'score_stable': 1.6100000143051147, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.4199999570846558, 'raw_score_stable': 1.4199999570846558, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-12T00:10:26.609 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-12T00:10:26.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.829+0000 7f585ccd5640 1 Processor -- start 2023-12-12T00:10:26.831 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.829+0000 7f585ccd5640 1 -- start start 2023-12-12T00:10:26.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.831+0000 7f585ccd5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58580c9a50 0x7f58580c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:26.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.831+0000 7f585ccd5640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58580ca3e0 con 0x7f5858070450 2023-12-12T00:10:26.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.831+0000 7f585ccd5640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58580cca70 con 0x7f5858070830 2023-12-12T00:10:26.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.831+0000 7f585ccd5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58580cc860 con 0x7f58580c9a50 2023-12-12T00:10:26.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.831+0000 7f585659c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5858070450 0x7f58580ae070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34912/0 (socket says 172.21.15.37:34912) 2023-12-12T00:10:26.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.831+0000 7f585659c640 1 -- 172.21.15.37:0/1118385584 learned_addr learned my addr 172.21.15.37:0/1118385584 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-12T00:10:26.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.832+0000 7f5856d9d640 1 --2- 172.21.15.37:0/1118385584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58580c9a50 0x7f58580c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.832+0000 7f5855d9b640 1 -- 172.21.15.37:0/1118385584 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1346899638 0 0) 0x7f58580ca3e0 con 0x7f5858070450 2023-12-12T00:10:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.832+0000 7f5855d9b640 1 -- 172.21.15.37:0/1118385584 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5844003520 con 0x7f5858070450 2023-12-12T00:10:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.832+0000 7f5855d9b640 1 -- 172.21.15.37:0/1118385584 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3412231682 0 0) 0x7f5844003520 con 0x7f5858070450 2023-12-12T00:10:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.832+0000 7f5855d9b640 1 -- 172.21.15.37:0/1118385584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58580c9a50 msgr2=0x7f58580c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T00:10:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.832+0000 7f5855d9b640 1 --2- 172.21.15.37:0/1118385584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58580c9a50 0x7f58580c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.832+0000 7f5855d9b640 1 -- 172.21.15.37:0/1118385584 >> v1:172.21.15.151:6789/0 conn(0x7f5858070830 legacy=0x7f58580cdaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.832+0000 7f5855d9b640 1 -- 172.21.15.37:0/1118385584 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58580ccd50 con 0x7f5858070450 2023-12-12T00:10:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.832+0000 7f5855d9b640 1 -- 172.21.15.37:0/1118385584 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 2049408256 0 0) 0x7f5848001670 con 0x7f5858070450 2023-12-12T00:10:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.832+0000 7f5855d9b640 1 -- 172.21.15.37:0/1118385584 >> v1:172.21.15.37:6789/0 conn(0x7f5858070450 legacy=0x7f58580ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.832+0000 7f5855d9b640 1 --2- 172.21.15.37:0/1118385584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58440039a0 0x7f5844003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.832+0000 7f5855d9b640 1 --2- 172.21.15.37:0/1118385584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58440047c0 0x7f5844004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.832+0000 7f5855d9b640 1 --2- 172.21.15.37:0/1118385584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5844005180 0x7f584400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.832+0000 7f5855d9b640 1 -- 172.21.15.37:0/1118385584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58580cc860 con 0x7f5844005180 2023-12-12T00:10:26.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.832+0000 7f5855d9b640 1 -- 172.21.15.37:0/1118385584 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f584400bec0 con 0x7f58440047c0 2023-12-12T00:10:26.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.832+0000 7f5855d9b640 1 -- 172.21.15.37:0/1118385584 --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f584400c080 con 0x7f58440039a0 2023-12-12T00:10:26.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.832+0000 7f5856d9d640 1 --2- 172.21.15.37:0/1118385584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58580c9a50 0x7f58580c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T00:10:26.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.833+0000 7f5856d9d640 1 --2- 172.21.15.37:0/1118385584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5844005180 0x7f584400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:26.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.833+0000 7f584dd9b640 1 --2- 172.21.15.37:0/1118385584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58440047c0 0x7f5844004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.833+0000 7f585659c640 1 --2- 172.21.15.37:0/1118385584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58440039a0 0x7f5844003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.833+0000 7f5856d9d640 1 -- 172.21.15.37:0/1118385584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58440039a0 msgr2=0x7f5844003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T00:10:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.833+0000 7f5856d9d640 1 --2- 172.21.15.37:0/1118385584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58440039a0 0x7f5844003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.833+0000 7f5856d9d640 1 -- 172.21.15.37:0/1118385584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58440047c0 msgr2=0x7f5844004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T00:10:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.833+0000 7f5856d9d640 1 --2- 172.21.15.37:0/1118385584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f58440047c0 0x7f5844004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.833+0000 7f5856d9d640 1 -- 172.21.15.37:0/1118385584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5844003520 con 0x7f5844005180 2023-12-12T00:10:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.833+0000 7f585659c640 1 --2- 172.21.15.37:0/1118385584 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f58440039a0 0x7f5844003dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T00:10:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.834+0000 7f5856d9d640 1 --2- 172.21.15.37:0/1118385584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5844005180 0x7f584400b980 secure :-1 s=READY pgs=2642 cs=0 l=1 rev1=1 crypto rx=0x7f58580c9e30 tx=0x7f58440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53fd93b109e1a0ea server_cookie=0 in_seq=0 out_seq=0 2023-12-12T00:10:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.835+0000 7f5855d9b640 1 -- 172.21.15.37:0/1118385584 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585000a310 con 0x7f5844005180 2023-12-12T00:10:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.835+0000 7f5855d9b640 1 -- 172.21.15.37:0/1118385584 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5850003990 con 0x7f5844005180 2023-12-12T00:10:26.837 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.835+0000 7f5855d9b640 1 -- 172.21.15.37:0/1118385584 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5850003da0 con 0x7f5844005180 2023-12-12T00:10:26.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.835+0000 7f585ccd5640 1 -- 172.21.15.37:0/1118385584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5844005180 msgr2=0x7f584400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:26.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.835+0000 7f585ccd5640 1 --2- 172.21.15.37:0/1118385584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5844005180 0x7f584400b980 secure :-1 s=READY pgs=2642 cs=0 l=1 rev1=1 crypto rx=0x7f58580c9e30 tx=0x7f58440057f0 comp rx=0 tx=0).stop 2023-12-12T00:10:26.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.835+0000 7f5856d9d640 1 -- 172.21.15.37:0/1118385584 reap_dead start 2023-12-12T00:10:26.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.836+0000 7f585ccd5640 1 -- 172.21.15.37:0/1118385584 shutdown_connections 2023-12-12T00:10:26.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.836+0000 7f585ccd5640 1 -- 172.21.15.37:0/1118385584 >> 172.21.15.37:0/1118385584 conn(0x7f58580cee70 msgr2=0x7f58580cf280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T00:10:26.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.836+0000 7f585ccd5640 1 -- 172.21.15.37:0/1118385584 shutdown_connections 2023-12-12T00:10:26.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.836+0000 7f585ccd5640 1 -- 172.21.15.37:0/1118385584 wait complete. 2023-12-12T00:10:26.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.838+0000 7f585ccd5640 1 Processor -- start 2023-12-12T00:10:26.839 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.838+0000 7f585ccd5640 1 -- start start 2023-12-12T00:10:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.839+0000 7f585ccd5640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5844005180 0x7f5858156bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.839+0000 7f585ccd5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5858157100 0x7f58580c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.839+0000 7f585ccd5640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f585809b080 0x7f58580c83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.839+0000 7f585ccd5640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585809cc30 con 0x7f585809b080 2023-12-12T00:10:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.839+0000 7f585ccd5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585815cc10 con 0x7f5858157100 2023-12-12T00:10:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.839+0000 7f585ccd5640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585809c950 con 0x7f5844005180 2023-12-12T00:10:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.839+0000 7f5856d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f585809b080 0x7f58580c83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.839+0000 7f5856d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f585809b080 0x7f58580c83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42872/0 (socket says 172.21.15.37:42872) 2023-12-12T00:10:26.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.839+0000 7f5856d9d640 1 -- 172.21.15.37:0/2202007730 learned_addr learned my addr 172.21.15.37:0/2202007730 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-12T00:10:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.839+0000 7f584dd9b640 1 --2- 172.21.15.37:0/2202007730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5858157100 0x7f58580c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.839+0000 7f585659c640 1 --2- 172.21.15.37:0/2202007730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5844005180 0x7f5858156bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.839+0000 7f5856d9d640 1 -- 172.21.15.37:0/2202007730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5844005180 msgr2=0x7f5858156bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.839+0000 7f5856d9d640 1 --2- 172.21.15.37:0/2202007730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5844005180 0x7f5858156bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.840+0000 7f5856d9d640 1 -- 172.21.15.37:0/2202007730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5858157100 msgr2=0x7f58580c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.840+0000 7f5856d9d640 1 --2- 172.21.15.37:0/2202007730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5858157100 0x7f58580c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.840+0000 7f5856d9d640 1 -- 172.21.15.37:0/2202007730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585809a5a0 con 0x7f585809b080 2023-12-12T00:10:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.840+0000 7f585659c640 1 --2- 172.21.15.37:0/2202007730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5844005180 0x7f5858156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T00:10:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.840+0000 7f5856d9d640 1 --2- 172.21.15.37:0/2202007730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f585809b080 0x7f58580c83c0 secure :-1 s=READY pgs=2643 cs=0 l=1 rev1=1 crypto rx=0x7f585002c520 tx=0x7f5850004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T00:10:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.840+0000 7f584f7fe640 1 -- 172.21.15.37:0/2202007730 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585003b070 con 0x7f585809b080 2023-12-12T00:10:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.840+0000 7f584f7fe640 1 -- 172.21.15.37:0/2202007730 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585002cc50 con 0x7f585809b080 2023-12-12T00:10:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.840+0000 7f585ccd5640 1 -- 172.21.15.37:0/2202007730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585809a880 con 0x7f585809b080 2023-12-12T00:10:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.840+0000 7f584f7fe640 1 -- 172.21.15.37:0/2202007730 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5850004030 con 0x7f585809b080 2023-12-12T00:10:26.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.841+0000 7f585ccd5640 1 -- 172.21.15.37:0/2202007730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5858156880 con 0x7f585809b080 2023-12-12T00:10:26.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.842+0000 7f585ccd5640 1 -- 172.21.15.37:0/2202007730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585809a400 con 0x7f585809b080 2023-12-12T00:10:26.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.843+0000 7f584f7fe640 1 -- 172.21.15.37:0/2202007730 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f5850004190 con 0x7f585809b080 2023-12-12T00:10:26.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.844+0000 7f584f7fe640 1 --2- 172.21.15.37:0/2202007730 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f583806ae70 0x7f583806d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:26.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.844+0000 7f584f7fe640 1 -- 172.21.15.37:0/2202007730 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f58500aae70 con 0x7f585809b080 2023-12-12T00:10:26.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.845+0000 7f585659c640 1 --2- 172.21.15.37:0/2202007730 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f583806ae70 0x7f583806d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:26.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.846+0000 7f585659c640 1 --2- 172.21.15.37:0/2202007730 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f583806ae70 0x7f583806d330 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f58480017a0 tx=0x7f5848009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T00:10:26.850 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:26.848+0000 7f584f7fe640 1 -- 172.21.15.37:0/2202007730 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f5850075f30 con 0x7f585809b080 2023-12-12T00:10:27.084 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.082+0000 7f585ccd5640 1 -- 172.21.15.37:0/2202007730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f585809ada0 con 0x7f585809b080 2023-12-12T00:10:27.085 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.083+0000 7f584f7fe640 1 -- 172.21.15.37:0/2202007730 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f585809ada0 con 0x7f585809b080 2023-12-12T00:10:27.085 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 1 2023-12-12T00:10:27.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.086+0000 7f585ccd5640 1 -- 172.21.15.37:0/2202007730 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f583806ae70 msgr2=0x7f583806d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:27.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.086+0000 7f585ccd5640 1 --2- 172.21.15.37:0/2202007730 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f583806ae70 0x7f583806d330 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f58480017a0 tx=0x7f5848009040 comp rx=0 tx=0).stop 2023-12-12T00:10:27.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.086+0000 7f585ccd5640 1 -- 172.21.15.37:0/2202007730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f585809b080 msgr2=0x7f58580c83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:27.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.086+0000 7f585ccd5640 1 --2- 172.21.15.37:0/2202007730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f585809b080 0x7f58580c83c0 secure :-1 s=READY pgs=2643 cs=0 l=1 rev1=1 crypto rx=0x7f585002c520 tx=0x7f5850004ab0 comp rx=0 tx=0).stop 2023-12-12T00:10:27.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.086+0000 7f585ccd5640 1 -- 172.21.15.37:0/2202007730 shutdown_connections 2023-12-12T00:10:27.088 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.086+0000 7f585ccd5640 1 --2- 172.21.15.37:0/2202007730 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f583806ae70 0x7f583806d330 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:27.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.086+0000 7f585ccd5640 1 --2- 172.21.15.37:0/2202007730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5858157100 0x7f58580c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:27.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.086+0000 7f585ccd5640 1 --2- 172.21.15.37:0/2202007730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f585809b080 0x7f58580c83c0 unknown :-1 s=CLOSED pgs=2643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:27.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.086+0000 7f585ccd5640 1 --2- 172.21.15.37:0/2202007730 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f5844005180 0x7f5858156bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:27.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.086+0000 7f585ccd5640 1 -- 172.21.15.37:0/2202007730 >> 172.21.15.37:0/2202007730 conn(0x7f58580cee70 msgr2=0x7f5858072fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T00:10:27.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.086+0000 7f585ccd5640 1 -- 172.21.15.37:0/2202007730 shutdown_connections 2023-12-12T00:10:27.089 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.086+0000 7f585ccd5640 1 -- 172.21.15.37:0/2202007730 wait complete. 2023-12-12T00:10:27.110 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-12T00:10:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.339+0000 7f2270448640 1 Processor -- start 2023-12-12T00:10:27.341 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.339+0000 7f2270448640 1 -- start start 2023-12-12T00:10:27.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.341+0000 7f2270448640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f22680cff60 0x7f226815d470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:27.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.341+0000 7f2270448640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f226815dd60 con 0x7f22681609b0 2023-12-12T00:10:27.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.341+0000 7f2270448640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f226815e040 con 0x7f22680cfb20 2023-12-12T00:10:27.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.341+0000 7f2270448640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2268160d90 con 0x7f22680cff60 2023-12-12T00:10:27.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.341+0000 7f226e9e5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f22680cff60 0x7f226815d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:27.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.341+0000 7f226e1e4640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f22681609b0 0x7f22680d0ce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:34914/0 (socket says 172.21.15.37:34914) 2023-12-12T00:10:27.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.341+0000 7f226e1e4640 1 -- 172.21.15.37:0/2060635204 learned_addr learned my addr 172.21.15.37:0/2060635204 (peer_addr_for_me v1:172.21.15.37:0/0) 2023-12-12T00:10:27.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.342+0000 7f226e9e5640 1 -- 172.21.15.37:0/2060635204 >> v1:172.21.15.151:6789/0 conn(0x7f22680cfb20 legacy=0x7f226815cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:27.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.342+0000 7f226e9e5640 1 -- 172.21.15.37:0/2060635204 >> v1:172.21.15.37:6789/0 conn(0x7f22681609b0 legacy=0x7f22680d0ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:27.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.342+0000 7f226e9e5640 1 -- 172.21.15.37:0/2060635204 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f226815e320 con 0x7f22680cff60 2023-12-12T00:10:27.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.342+0000 7f226d1e2640 1 -- 172.21.15.37:0/2060635204 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 638940257 0 0) 0x7f226815dd60 con 0x7f22681609b0 2023-12-12T00:10:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.343+0000 7f226e9e5640 1 --2- 172.21.15.37:0/2060635204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22680cff60 0x7f226815d470 secure :-1 s=READY pgs=2645 cs=0 l=1 rev1=1 crypto rx=0x7f2260009d90 tx=0x7f226002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4357d7ca6ad20a10 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T00:10:27.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.344+0000 7f226d1e2640 1 -- 172.21.15.37:0/2060635204 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f226002cd00 con 0x7f22680cff60 2023-12-12T00:10:27.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.344+0000 7f226d1e2640 1 -- 172.21.15.37:0/2060635204 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f226002ce60 con 0x7f22680cff60 2023-12-12T00:10:27.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.344+0000 7f226d1e2640 1 -- 172.21.15.37:0/2060635204 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2260034660 con 0x7f22680cff60 2023-12-12T00:10:27.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.344+0000 7f2270448640 1 -- 172.21.15.37:0/2060635204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22680cff60 msgr2=0x7f226815d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:27.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.344+0000 7f2270448640 1 --2- 172.21.15.37:0/2060635204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22680cff60 0x7f226815d470 secure :-1 s=READY pgs=2645 cs=0 l=1 rev1=1 crypto rx=0x7f2260009d90 tx=0x7f226002bf50 comp rx=0 tx=0).stop 2023-12-12T00:10:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.345+0000 7f2270448640 1 -- 172.21.15.37:0/2060635204 shutdown_connections 2023-12-12T00:10:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.345+0000 7f2270448640 1 --2- 172.21.15.37:0/2060635204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22680cff60 0x7f226815d470 unknown :-1 s=CLOSED pgs=2645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.345+0000 7f2270448640 1 -- 172.21.15.37:0/2060635204 >> 172.21.15.37:0/2060635204 conn(0x7f226809c450 msgr2=0x7f22680d3110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T00:10:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.345+0000 7f2270448640 1 -- 172.21.15.37:0/2060635204 shutdown_connections 2023-12-12T00:10:27.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.345+0000 7f2270448640 1 -- 172.21.15.37:0/2060635204 wait complete. 2023-12-12T00:10:27.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.347+0000 7f2270448640 1 Processor -- start 2023-12-12T00:10:27.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.347+0000 7f2270448640 1 -- start start 2023-12-12T00:10:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.348+0000 7f2270448640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22680cfb20 0x7f22681582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.348+0000 7f2270448640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22680cff60 0x7f2268147fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.348+0000 7f2270448640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22681609b0 0x7f2268148510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.348+0000 7f2270448640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22680b8fe0 con 0x7f22680cfb20 2023-12-12T00:10:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.348+0000 7f2270448640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2268158d40 con 0x7f22681609b0 2023-12-12T00:10:27.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.348+0000 7f2270448640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2268159020 con 0x7f22680cff60 2023-12-12T00:10:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.349+0000 7f226e1e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22680cfb20 0x7f22681582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.349+0000 7f226e1e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22680cfb20 0x7f22681582e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42886/0 (socket says 172.21.15.37:42886) 2023-12-12T00:10:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.349+0000 7f226e1e4640 1 -- 172.21.15.37:0/3578509872 learned_addr learned my addr 172.21.15.37:0/3578509872 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-12T00:10:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.349+0000 7f226d9e3640 1 --2- 172.21.15.37:0/3578509872 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22680cff60 0x7f2268147fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.349+0000 7f226e9e5640 1 --2- 172.21.15.37:0/3578509872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22681609b0 0x7f2268148510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.349+0000 7f226e1e4640 1 -- 172.21.15.37:0/3578509872 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22680cff60 msgr2=0x7f2268147fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.349+0000 7f226e1e4640 1 --2- 172.21.15.37:0/3578509872 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22680cff60 0x7f2268147fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.349+0000 7f226e1e4640 1 -- 172.21.15.37:0/3578509872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22681609b0 msgr2=0x7f2268148510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.349+0000 7f226e1e4640 1 --2- 172.21.15.37:0/3578509872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22681609b0 0x7f2268148510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.349+0000 7f226e1e4640 1 -- 172.21.15.37:0/3578509872 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2260009a70 con 0x7f22680cfb20 2023-12-12T00:10:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.349+0000 7f226d9e3640 1 --2- 172.21.15.37:0/3578509872 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22680cff60 0x7f2268147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T00:10:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.349+0000 7f226e9e5640 1 --2- 172.21.15.37:0/3578509872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22681609b0 0x7f2268148510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-12T00:10:27.352 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.350+0000 7f226e1e4640 1 --2- 172.21.15.37:0/3578509872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22680cfb20 0x7f22681582e0 secure :-1 s=READY pgs=2646 cs=0 l=1 rev1=1 crypto rx=0x7f226400c4d0 tx=0x7f226400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T00:10:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.350+0000 7f225effd640 1 -- 172.21.15.37:0/3578509872 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22640074e0 con 0x7f22680cfb20 2023-12-12T00:10:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.350+0000 7f225effd640 1 -- 172.21.15.37:0/3578509872 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2264007660 con 0x7f22680cfb20 2023-12-12T00:10:27.353 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.350+0000 7f2270448640 1 -- 172.21.15.37:0/3578509872 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2268159300 con 0x7f22680cfb20 2023-12-12T00:10:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.350+0000 7f225effd640 1 -- 172.21.15.37:0/3578509872 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2264004a20 con 0x7f22680cfb20 2023-12-12T00:10:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.350+0000 7f2270448640 1 -- 172.21.15.37:0/3578509872 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2268158820 con 0x7f22680cfb20 2023-12-12T00:10:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.351+0000 7f2270448640 1 -- 172.21.15.37:0/3578509872 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22680745d0 con 0x7f22680cfb20 2023-12-12T00:10:27.354 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.352+0000 7f225effd640 1 -- 172.21.15.37:0/3578509872 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f2264004b80 con 0x7f22680cfb20 2023-12-12T00:10:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.353+0000 7f225effd640 1 --2- 172.21.15.37:0/3578509872 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f224c06ae70 0x7f224c06d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:27.355 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.353+0000 7f225effd640 1 -- 172.21.15.37:0/3578509872 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f2264088cf0 con 0x7f22680cfb20 2023-12-12T00:10:27.356 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.354+0000 7f226d9e3640 1 --2- 172.21.15.37:0/3578509872 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f224c06ae70 0x7f224c06d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:27.358 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.356+0000 7f226d9e3640 1 --2- 172.21.15.37:0/3578509872 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f224c06ae70 0x7f224c06d330 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f22680b4580 tx=0x7f2258009040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T00:10:27.360 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.358+0000 7f225effd640 1 -- 172.21.15.37:0/3578509872 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f2264053ba0 con 0x7f22680cfb20 2023-12-12T00:10:27.564 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.562+0000 7f2270448640 1 -- 172.21.15.37:0/3578509872 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f22680b6050 con 0x7f22680cfb20 2023-12-12T00:10:27.565 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.563+0000 7f225effd640 1 -- 172.21.15.37:0/3578509872 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f22680b6050 con 0x7f22680cfb20 2023-12-12T00:10:27.565 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 32 2023-12-12T00:10:27.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.565+0000 7f2270448640 1 -- 172.21.15.37:0/3578509872 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f224c06ae70 msgr2=0x7f224c06d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:27.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.565+0000 7f2270448640 1 --2- 172.21.15.37:0/3578509872 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f224c06ae70 0x7f224c06d330 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f22680b4580 tx=0x7f2258009040 comp rx=0 tx=0).stop 2023-12-12T00:10:27.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.565+0000 7f2270448640 1 -- 172.21.15.37:0/3578509872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22680cfb20 msgr2=0x7f22681582e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:27.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.565+0000 7f2270448640 1 --2- 172.21.15.37:0/3578509872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22680cfb20 0x7f22681582e0 secure :-1 s=READY pgs=2646 cs=0 l=1 rev1=1 crypto rx=0x7f226400c4d0 tx=0x7f226400c990 comp rx=0 tx=0).stop 2023-12-12T00:10:27.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.566+0000 7f2270448640 1 -- 172.21.15.37:0/3578509872 shutdown_connections 2023-12-12T00:10:27.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.566+0000 7f2270448640 1 --2- 172.21.15.37:0/3578509872 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f224c06ae70 0x7f224c06d330 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:27.568 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.566+0000 7f2270448640 1 --2- 172.21.15.37:0/3578509872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22681609b0 0x7f2268148510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:27.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.566+0000 7f2270448640 1 --2- 172.21.15.37:0/3578509872 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f22680cff60 0x7f2268147fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:27.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.566+0000 7f2270448640 1 --2- 172.21.15.37:0/3578509872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f22680cfb20 0x7f22681582e0 unknown :-1 s=CLOSED pgs=2646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:27.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.566+0000 7f2270448640 1 -- 172.21.15.37:0/3578509872 >> 172.21.15.37:0/3578509872 conn(0x7f226809c450 msgr2=0x7f22680d1380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T00:10:27.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.566+0000 7f2270448640 1 -- 172.21.15.37:0/3578509872 shutdown_connections 2023-12-12T00:10:27.569 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.566+0000 7f2270448640 1 -- 172.21.15.37:0/3578509872 wait complete. 2023-12-12T00:10:27.591 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-12T00:10:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.827+0000 7fafeccce640 1 Processor -- start 2023-12-12T00:10:27.829 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.827+0000 7fafeccce640 1 -- start start 2023-12-12T00:10:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.830+0000 7fafeccce640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafe815d250 0x7fafe80b0f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.830+0000 7fafeccce640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fafe806c590 0x7fafe80adb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.830+0000 7fafeccce640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafe80b1780 con 0x7fafe815d630 2023-12-12T00:10:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.830+0000 7fafeccce640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafe80b1a60 con 0x7fafe806c590 2023-12-12T00:10:27.832 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.830+0000 7fafeccce640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80b1d40 con 0x7fafe815d250 2023-12-12T00:10:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.830+0000 7fafe6d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fafe806c590 0x7fafe80adb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.830+0000 7fafe6d9d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fafe806c590 0x7fafe80adb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42888/0 (socket says 172.21.15.37:42888) 2023-12-12T00:10:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.830+0000 7fafe6d9d640 1 -- 172.21.15.37:0/1825017759 learned_addr learned my addr 172.21.15.37:0/1825017759 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-12T00:10:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.831+0000 7fafe6d9d640 1 -- 172.21.15.37:0/1825017759 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafe815d250 msgr2=0x7fafe80b0f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T00:10:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.831+0000 7fafe6d9d640 1 --2- 172.21.15.37:0/1825017759 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafe815d250 0x7fafe80b0f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.831+0000 7fafe6d9d640 1 -- 172.21.15.37:0/1825017759 >> v1:172.21.15.151:6789/0 conn(0x7fafe815d630 legacy=0x7fafe806be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T00:10:27.833 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.831+0000 7fafe6d9d640 1 -- 172.21.15.37:0/1825017759 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe80b2020 con 0x7fafe806c590 2023-12-12T00:10:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.832+0000 7fafe6d9d640 1 --2- 172.21.15.37:0/1825017759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe806c590 0x7fafe80adb60 secure :-1 s=READY pgs=2647 cs=0 l=1 rev1=1 crypto rx=0x7fafe0009e50 tx=0x7fafe002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0913120161ef9ad server_cookie=0 in_seq=0 out_seq=0 2023-12-12T00:10:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.832+0000 7fafe559a640 1 -- 172.21.15.37:0/1825017759 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe002ca80 con 0x7fafe806c590 2023-12-12T00:10:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.832+0000 7fafe559a640 1 -- 172.21.15.37:0/1825017759 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe002cbe0 con 0x7fafe806c590 2023-12-12T00:10:27.834 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.832+0000 7fafe559a640 1 -- 172.21.15.37:0/1825017759 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe00343f0 con 0x7fafe806c590 2023-12-12T00:10:27.835 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.833+0000 7fafeccce640 1 -- 172.21.15.37:0/1825017759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe806c590 msgr2=0x7fafe80adb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.833+0000 7fafeccce640 1 --2- 172.21.15.37:0/1825017759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe806c590 0x7fafe80adb60 secure :-1 s=READY pgs=2647 cs=0 l=1 rev1=1 crypto rx=0x7fafe0009e50 tx=0x7fafe002bee0 comp rx=0 tx=0).stop 2023-12-12T00:10:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.833+0000 7fafeccce640 1 -- 172.21.15.37:0/1825017759 shutdown_connections 2023-12-12T00:10:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.833+0000 7fafeccce640 1 --2- 172.21.15.37:0/1825017759 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe806c590 0x7fafe80adb60 unknown :-1 s=CLOSED pgs=2647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.833+0000 7fafeccce640 1 --2- 172.21.15.37:0/1825017759 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafe815d250 0x7fafe80b0f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.833+0000 7fafeccce640 1 -- 172.21.15.37:0/1825017759 >> 172.21.15.37:0/1825017759 conn(0x7fafe80d0e90 msgr2=0x7fafe80d12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T00:10:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.834+0000 7fafeccce640 1 -- 172.21.15.37:0/1825017759 shutdown_connections 2023-12-12T00:10:27.836 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.834+0000 7fafeccce640 1 -- 172.21.15.37:0/1825017759 wait complete. 2023-12-12T00:10:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.836+0000 7fafeccce640 1 Processor -- start 2023-12-12T00:10:27.838 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.836+0000 7fafeccce640 1 -- start start 2023-12-12T00:10:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.838+0000 7fafeccce640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafe806c590 0x7fafe80b67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.838+0000 7fafeccce640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafe815d250 0x7fafe80c5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.838+0000 7fafeccce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe815d630 0x7fafe815b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.838+0000 7fafeccce640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe80c6c00 con 0x7fafe815d630 2023-12-12T00:10:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.838+0000 7fafeccce640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafe8151c70 con 0x7fafe806c590 2023-12-12T00:10:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.838+0000 7fafeccce640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafe815f2c0 con 0x7fafe815d250 2023-12-12T00:10:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.838+0000 7fafe6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe815d630 0x7fafe815b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:27.840 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.838+0000 7fafe6d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe815d630 0x7fafe815b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42890/0 (socket says 172.21.15.37:42890) 2023-12-12T00:10:27.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.838+0000 7fafe6d9d640 1 -- 172.21.15.37:0/2625036756 learned_addr learned my addr 172.21.15.37:0/2625036756 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-12T00:10:27.841 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.839+0000 7fafe6d9d640 1 -- 172.21.15.37:0/2625036756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafe815d250 msgr2=0x7fafe80c5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.839+0000 7fafe6d9d640 1 --2- 172.21.15.37:0/2625036756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafe815d250 0x7fafe80c5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.839+0000 7fafe6d9d640 1 -- 172.21.15.37:0/2625036756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafe806c590 msgr2=0x7fafe80b67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.839+0000 7fafe6d9d640 1 --2- 172.21.15.37:0/2625036756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafe806c590 0x7fafe80b67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.839+0000 7fafe6d9d640 1 -- 172.21.15.37:0/2625036756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafe0009b30 con 0x7fafe815d630 2023-12-12T00:10:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.839+0000 7fafe6d9d640 1 --2- 172.21.15.37:0/2625036756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe815d630 0x7fafe815b030 secure :-1 s=READY pgs=2648 cs=0 l=1 rev1=1 crypto rx=0x7fafe0009e50 tx=0x7fafe0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T00:10:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.839+0000 7fafd6ffd640 1 -- 172.21.15.37:0/2625036756 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe003e450 con 0x7fafe815d630 2023-12-12T00:10:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.839+0000 7fafd6ffd640 1 -- 172.21.15.37:0/2625036756 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafe003e5d0 con 0x7fafe815d630 2023-12-12T00:10:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.839+0000 7fafeccce640 1 -- 172.21.15.37:0/2625036756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafe815f5a0 con 0x7fafe815d630 2023-12-12T00:10:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.839+0000 7fafd6ffd640 1 -- 172.21.15.37:0/2625036756 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafe003e980 con 0x7fafe815d630 2023-12-12T00:10:27.842 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.840+0000 7fafeccce640 1 -- 172.21.15.37:0/2625036756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafe815fb60 con 0x7fafe815d630 2023-12-12T00:10:27.843 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.841+0000 7fafeccce640 1 -- 172.21.15.37:0/2625036756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafe80673f0 con 0x7fafe815d630 2023-12-12T00:10:27.844 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.842+0000 7fafd6ffd640 1 -- 172.21.15.37:0/2625036756 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7fafe002cd50 con 0x7fafe815d630 2023-12-12T00:10:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.843+0000 7fafd6ffd640 1 --2- 172.21.15.37:0/2625036756 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fafc806ae40 0x7fafc806d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:27.845 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.843+0000 7fafd6ffd640 1 -- 172.21.15.37:0/2625036756 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7fafe00ac710 con 0x7fafe815d630 2023-12-12T00:10:27.846 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.844+0000 7fafe659c640 1 --2- 172.21.15.37:0/2625036756 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fafc806ae40 0x7fafc806d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:27.848 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.845+0000 7fafe659c640 1 --2- 172.21.15.37:0/2625036756 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fafc806ae40 0x7fafc806d300 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fafd8009710 tx=0x7fafd8006c90 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T00:10:27.853 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:27.851+0000 7fafd6ffd640 1 -- 172.21.15.37:0/2625036756 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7fafe00776e0 con 0x7fafe815d630 2023-12-12T00:10:28.061 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.059+0000 7fafeccce640 1 -- 172.21.15.37:0/2625036756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fafe80d00b0 con 0x7fafe815d630 2023-12-12T00:10:28.062 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.060+0000 7fafd6ffd640 1 -- 172.21.15.37:0/2625036756 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7fafe00aae60 con 0x7fafe815d630 2023-12-12T00:10:28.062 INFO:teuthology.orchestra.run.smithi037.stdout:pg_num: 64 2023-12-12T00:10:28.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.062+0000 7fafeccce640 1 -- 172.21.15.37:0/2625036756 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fafc806ae40 msgr2=0x7fafc806d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:28.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.062+0000 7fafeccce640 1 --2- 172.21.15.37:0/2625036756 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fafc806ae40 0x7fafc806d300 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7fafd8009710 tx=0x7fafd8006c90 comp rx=0 tx=0).stop 2023-12-12T00:10:28.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.062+0000 7fafeccce640 1 -- 172.21.15.37:0/2625036756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe815d630 msgr2=0x7fafe815b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:28.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.062+0000 7fafeccce640 1 --2- 172.21.15.37:0/2625036756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe815d630 0x7fafe815b030 secure :-1 s=READY pgs=2648 cs=0 l=1 rev1=1 crypto rx=0x7fafe0009e50 tx=0x7fafe0004a40 comp rx=0 tx=0).stop 2023-12-12T00:10:28.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.063+0000 7fafeccce640 1 -- 172.21.15.37:0/2625036756 shutdown_connections 2023-12-12T00:10:28.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.063+0000 7fafeccce640 1 --2- 172.21.15.37:0/2625036756 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7fafc806ae40 0x7fafc806d300 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:28.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.063+0000 7fafeccce640 1 --2- 172.21.15.37:0/2625036756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fafe815d630 0x7fafe815b030 unknown :-1 s=CLOSED pgs=2648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:28.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.063+0000 7fafeccce640 1 --2- 172.21.15.37:0/2625036756 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7fafe815d250 0x7fafe80c5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:28.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.063+0000 7fafeccce640 1 --2- 172.21.15.37:0/2625036756 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fafe806c590 0x7fafe80b67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:28.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.063+0000 7fafeccce640 1 -- 172.21.15.37:0/2625036756 >> 172.21.15.37:0/2625036756 conn(0x7fafe80d0e90 msgr2=0x7fafe80afa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T00:10:28.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.063+0000 7fafeccce640 1 -- 172.21.15.37:0/2625036756 shutdown_connections 2023-12-12T00:10:28.065 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.063+0000 7fafeccce640 1 -- 172.21.15.37:0/2625036756 wait complete. 2023-12-12T00:10:28.088 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-12T00:10:28.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.320+0000 7f165f5e3640 1 Processor -- start 2023-12-12T00:10:28.322 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.320+0000 7f165f5e3640 1 -- start start 2023-12-12T00:10:28.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.322+0000 7f165f5e3640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1658143e00 0x7f16580b4040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:28.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.322+0000 7f165f5e3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f165806c410 0x7f165815ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:28.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.322+0000 7f165f5e3640 1 -- --> v1:172.21.15.151:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16580b3bb0 con 0x7f1658072180 2023-12-12T00:10:28.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.322+0000 7f165f5e3640 1 -- --> v2:172.21.15.151:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16581441e0 con 0x7f1658143e00 2023-12-12T00:10:28.324 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.322+0000 7f165f5e3640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1658072680 con 0x7f165806c410 2023-12-12T00:10:28.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.323+0000 7f165d37f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1658143e00 0x7f16580b4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:28.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.323+0000 7f165db80640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f165806c410 0x7f165815ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:28.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.323+0000 7f165d37f640 1 --2- >> v2:172.21.15.151:3300/0 conn(0x7f1658143e00 0x7f16580b4040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.37:38512/0 (socket says 172.21.15.37:38512) 2023-12-12T00:10:28.325 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.323+0000 7f165d37f640 1 -- 172.21.15.37:0/1398615333 learned_addr learned my addr 172.21.15.37:0/1398615333 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-12T00:10:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.324+0000 7f165d37f640 1 -- 172.21.15.37:0/1398615333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f165806c410 msgr2=0x7f165815ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-12T00:10:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.324+0000 7f165d37f640 1 --2- 172.21.15.37:0/1398615333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f165806c410 0x7f165815ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.324+0000 7f165d37f640 1 -- 172.21.15.37:0/1398615333 >> v1:172.21.15.151:6789/0 conn(0x7f1658072180 legacy=0x7f16580b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.324+0000 7f165d37f640 1 -- 172.21.15.37:0/1398615333 --> v2:172.21.15.151:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16580b1e30 con 0x7f1658143e00 2023-12-12T00:10:28.326 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.324+0000 7f165db80640 1 --2- 172.21.15.37:0/1398615333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f165806c410 0x7f165815ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-12T00:10:28.327 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.325+0000 7f165d37f640 1 --2- 172.21.15.37:0/1398615333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1658143e00 0x7f16580b4040 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1654009870 tx=0x7f165402b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c16dcd9119f1f5d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T00:10:28.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.333+0000 7f164ffff640 1 -- 172.21.15.37:0/1398615333 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1654030840 con 0x7f1658143e00 2023-12-12T00:10:28.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.333+0000 7f164ffff640 1 -- 172.21.15.37:0/1398615333 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16540309a0 con 0x7f1658143e00 2023-12-12T00:10:28.335 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.333+0000 7f164ffff640 1 -- 172.21.15.37:0/1398615333 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1654030d30 con 0x7f1658143e00 2023-12-12T00:10:28.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.334+0000 7f165f5e3640 1 -- 172.21.15.37:0/1398615333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1658143e00 msgr2=0x7f16580b4040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:28.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.334+0000 7f165f5e3640 1 --2- 172.21.15.37:0/1398615333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1658143e00 0x7f16580b4040 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f1654009870 tx=0x7f165402b980 comp rx=0 tx=0).stop 2023-12-12T00:10:28.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.334+0000 7f165f5e3640 1 -- 172.21.15.37:0/1398615333 shutdown_connections 2023-12-12T00:10:28.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.334+0000 7f165f5e3640 1 --2- 172.21.15.37:0/1398615333 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f165806c410 0x7f165815ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:28.336 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.334+0000 7f165f5e3640 1 --2- 172.21.15.37:0/1398615333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1658143e00 0x7f16580b4040 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:28.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.334+0000 7f165f5e3640 1 -- 172.21.15.37:0/1398615333 >> 172.21.15.37:0/1398615333 conn(0x7f16580b0a90 msgr2=0x7f16580b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T00:10:28.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.334+0000 7f165f5e3640 1 -- 172.21.15.37:0/1398615333 shutdown_connections 2023-12-12T00:10:28.337 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.334+0000 7f165f5e3640 1 -- 172.21.15.37:0/1398615333 wait complete. 2023-12-12T00:10:28.342 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.337+0000 7f165f5e3640 1 Processor -- start 2023-12-12T00:10:28.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.337+0000 7f165f5e3640 1 -- start start 2023-12-12T00:10:28.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.339+0000 7f165f5e3640 1 --2- >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f165806c410 0x7f165812f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:28.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.339+0000 7f165f5e3640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1658072180 0x7f165812fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:28.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.339+0000 7f165f5e3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1658143e00 0x7f1658141df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:28.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.339+0000 7f165f5e3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16581f37d0 con 0x7f1658143e00 2023-12-12T00:10:28.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.339+0000 7f165f5e3640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1658130d50 con 0x7f1658072180 2023-12-12T00:10:28.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.339+0000 7f165f5e3640 1 -- --> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16581304f0 con 0x7f165806c410 2023-12-12T00:10:28.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.340+0000 7f165db80640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1658143e00 0x7f1658141df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:28.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.340+0000 7f165db80640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1658143e00 0x7f1658141df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42894/0 (socket says 172.21.15.37:42894) 2023-12-12T00:10:28.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.340+0000 7f165db80640 1 -- 172.21.15.37:0/4226479087 learned_addr learned my addr 172.21.15.37:0/4226479087 (peer_addr_for_me v2:172.21.15.37:0/0) 2023-12-12T00:10:28.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.340+0000 7f165cb7e640 1 --2- 172.21.15.37:0/4226479087 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1658072180 0x7f165812fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:28.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.340+0000 7f165d37f640 1 --2- 172.21.15.37:0/4226479087 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f165806c410 0x7f165812f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:28.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.340+0000 7f165db80640 1 -- 172.21.15.37:0/4226479087 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f165806c410 msgr2=0x7f165812f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:28.343 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.340+0000 7f165db80640 1 --2- 172.21.15.37:0/4226479087 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f165806c410 0x7f165812f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:28.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.340+0000 7f165db80640 1 -- 172.21.15.37:0/4226479087 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1658072180 msgr2=0x7f165812fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:28.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.340+0000 7f165db80640 1 --2- 172.21.15.37:0/4226479087 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1658072180 0x7f165812fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:28.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.340+0000 7f165db80640 1 -- 172.21.15.37:0/4226479087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1650009a70 con 0x7f1658143e00 2023-12-12T00:10:28.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.340+0000 7f165cb7e640 1 --2- 172.21.15.37:0/4226479087 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1658072180 0x7f165812fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-12T00:10:28.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.341+0000 7f165db80640 1 --2- 172.21.15.37:0/4226479087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1658143e00 0x7f1658141df0 secure :-1 s=READY pgs=2649 cs=0 l=1 rev1=1 crypto rx=0x7f165000efc0 tx=0x7f1650009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T00:10:28.344 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.341+0000 7f164dffb640 1 -- 172.21.15.37:0/4226479087 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1650009d70 con 0x7f1658143e00 2023-12-12T00:10:28.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.341+0000 7f164dffb640 1 -- 172.21.15.37:0/4226479087 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f165000f040 con 0x7f1658143e00 2023-12-12T00:10:28.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.341+0000 7f164dffb640 1 -- 172.21.15.37:0/4226479087 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1650003990 con 0x7f1658143e00 2023-12-12T00:10:28.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.341+0000 7f165f5e3640 1 -- 172.21.15.37:0/4226479087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16540094d0 con 0x7f1658143e00 2023-12-12T00:10:28.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.341+0000 7f165f5e3640 1 -- 172.21.15.37:0/4226479087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16581f3d20 con 0x7f1658143e00 2023-12-12T00:10:28.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.343+0000 7f165f5e3640 1 -- 172.21.15.37:0/4226479087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16580745d0 con 0x7f1658143e00 2023-12-12T00:10:28.345 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.344+0000 7f164dffb640 1 -- 172.21.15.37:0/4226479087 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) v1 ==== 89231+0+0 (secure 0 0 0) 0x7f16500144a0 con 0x7f1658143e00 2023-12-12T00:10:28.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.344+0000 7f164dffb640 1 --2- 172.21.15.37:0/4226479087 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f163c06ae40 0x7f163c06d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-12T00:10:28.346 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.345+0000 7f164dffb640 1 -- 172.21.15.37:0/4226479087 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 6058+0+0 (secure 0 0 0) 0x7f165008a3e0 con 0x7f1658143e00 2023-12-12T00:10:28.347 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.345+0000 7f165d37f640 1 --2- 172.21.15.37:0/4226479087 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f163c06ae40 0x7f163c06d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-12T00:10:28.349 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.347+0000 7f165d37f640 1 --2- 172.21.15.37:0/4226479087 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f163c06ae40 0x7f163c06d300 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1654036000 tx=0x7f165403b040 comp rx=0 tx=0).ready entity=mgr.4111 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-12T00:10:28.351 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.350+0000 7f164dffb640 1 -- 172.21.15.37:0/4226479087 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179825 (secure 0 0 0) 0x7f1650055330 con 0x7f1658143e00 2023-12-12T00:10:28.587 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.585+0000 7f165f5e3640 1 -- 172.21.15.37:0/4226479087 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f165806ddc0 con 0x7f1658143e00 2023-12-12T00:10:28.588 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.586+0000 7f164dffb640 1 -- 172.21.15.37:0/4226479087 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v43) v1 ==== 80+0+0 (secure 0 0 0) 0x7f1650058950 con 0x7f1658143e00 2023-12-12T00:10:28.588 INFO:teuthology.orchestra.run.smithi037.stderr:listed 0 entries 2023-12-12T00:10:28.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.589+0000 7f165f5e3640 1 -- 172.21.15.37:0/4226479087 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f163c06ae40 msgr2=0x7f163c06d300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:28.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.589+0000 7f165f5e3640 1 --2- 172.21.15.37:0/4226479087 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f163c06ae40 0x7f163c06d300 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1654036000 tx=0x7f165403b040 comp rx=0 tx=0).stop 2023-12-12T00:10:28.591 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.589+0000 7f165f5e3640 1 -- 172.21.15.37:0/4226479087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1658143e00 msgr2=0x7f1658141df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-12T00:10:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.589+0000 7f165f5e3640 1 --2- 172.21.15.37:0/4226479087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1658143e00 0x7f1658141df0 secure :-1 s=READY pgs=2649 cs=0 l=1 rev1=1 crypto rx=0x7f165000efc0 tx=0x7f1650009f90 comp rx=0 tx=0).stop 2023-12-12T00:10:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.589+0000 7f165f5e3640 1 -- 172.21.15.37:0/4226479087 shutdown_connections 2023-12-12T00:10:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.589+0000 7f165f5e3640 1 --2- 172.21.15.37:0/4226479087 >> [v2:172.21.15.151:6832/3081040918,v1:172.21.15.151:6833/3081040918] conn(0x7f163c06ae40 0x7f163c06d300 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.589+0000 7f165f5e3640 1 --2- 172.21.15.37:0/4226479087 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1658072180 0x7f165812fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.589+0000 7f165f5e3640 1 --2- 172.21.15.37:0/4226479087 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1658143e00 0x7f1658141df0 unknown :-1 s=CLOSED pgs=2649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.589+0000 7f165f5e3640 1 --2- 172.21.15.37:0/4226479087 >> [v2:172.21.15.151:3301/0,v1:172.21.15.151:6790/0] conn(0x7f165806c410 0x7f165812f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-12T00:10:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.589+0000 7f165f5e3640 1 -- 172.21.15.37:0/4226479087 >> 172.21.15.37:0/4226479087 conn(0x7f16580b0a90 msgr2=0x7f1658144320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-12T00:10:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.590+0000 7f165f5e3640 1 -- 172.21.15.37:0/4226479087 shutdown_connections 2023-12-12T00:10:28.592 INFO:teuthology.orchestra.run.smithi037.stderr:2023-12-12T00:10:28.590+0000 7f165f5e3640 1 -- 172.21.15.37:0/4226479087 wait complete. 2023-12-12T00:10:28.617 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-12-12T00:10:28.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T00:10:28.617 DEBUG:teuthology.orchestra.run.smithi037:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-12-12T00:10:28.749 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-12-12T00:10:28.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T00:10:28.750 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-12T00:10:28.831 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2023-12-12T00:10:28.831 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T00:10:28.881 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4055074,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3250028k,nr_inodes=812507,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6500064k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 172.21.15.37:6789:/test /tmp/tmp.IOXZHTg9krtest ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=349792a4-57b1-4c92-9cc0-0c9ba4325d41,acl 0 0 172.21.15.37:6789:/scratch /tmp/tmp.4GCEnGEZ83scratch ceph rw,context=system_u:object_r:root_t:s0,relatime,name=admin,secret=,fsid=349792a4-57b1-4c92-9cc0-0c9ba4325d41,acl 0 0 2023-12-12T00:10:28.881 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi037.front.sepia.ceph.com 2023-12-12T00:10:28.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T00:10:28.881 DEBUG:teuthology.orchestra.run.smithi037:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-12T00:10:28.929 INFO:teuthology.orchestra.run.smithi037.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-12T00:10:28.930 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T00:10:28.931 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-12T00:10:28.931 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T00:10:29.916 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-12T00:10:29.916 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-12-12T00:10:29.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T00:10:29.917 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-12T00:10:29.987 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.1': No such file or directory 2023-12-12T00:10:29.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T00:10:29.988 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2023-12-12T00:10:29.988 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-12T00:10:30.038 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4054301,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=27,pgrp=1,timeout=0,minproto=5,maxproto=5,direct 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 ramfs /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 ramfs /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3249412k,nr_inodes=812353,mode=700,uid=1000,gid=1301 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6498828k,nr_inodes=819200,mode=755 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-12T00:10:30.039 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi151.front.sepia.ceph.com 2023-12-12T00:10:30.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-12T00:10:30.039 DEBUG:teuthology.orchestra.run.smithi151:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-12T00:10:30.085 INFO:teuthology.orchestra.run.smithi151.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-12T00:10:30.086 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-12T00:10:31.698 INFO:tasks.ceph.osd.0:Sent signal 15 2023-12-12T00:10:31.698 INFO:tasks.ceph.osd.1:Sent signal 15 2023-12-12T00:10:31.699 INFO:tasks.ceph.osd.2:Sent signal 15 2023-12-12T00:10:31.699 INFO:tasks.ceph.osd.3:Sent signal 15 2023-12-12T00:10:31.699 INFO:tasks.ceph.osd.4:Sent signal 15 2023-12-12T00:10:31.699 INFO:tasks.ceph.osd.6:Sent signal 15 2023-12-12T00:10:31.700 INFO:tasks.ceph.osd.7:Sent signal 15 2023-12-12T00:10:31.700 INFO:tasks.ceph.mds.a:Sent signal 15 2023-12-12T00:10:31.700 INFO:tasks.ceph.mds.c:Sent signal 15 2023-12-12T00:10:31.700 INFO:tasks.ceph.mds.b:Sent signal 15 2023-12-12T00:10:31.700 INFO:tasks.ceph.mds.d:Sent signal 15 2023-12-12T00:10:31.700 INFO:tasks.ceph.mon.a:Sent signal 15 2023-12-12T00:10:31.701 INFO:tasks.ceph.mon.b:Sent signal 15 2023-12-12T00:10:31.701 INFO:tasks.ceph.mon.c:Sent signal 15 2023-12-12T00:10:31.701 INFO:tasks.ceph.mgr.y:Sent signal 15 2023-12-12T00:10:31.701 INFO:tasks.ceph.mgr.x:Sent signal 15 2023-12-12T00:10:31.702 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-12T00:10:31.699+0000 7efcd4284640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 88576) UID: 0 2023-12-12T00:10:31.702 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-12T00:10:31.699+0000 7efcd4284640 -1 osd.6 43 *** Got signal Terminated *** 2023-12-12T00:10:31.702 INFO:tasks.ceph.osd.6.smithi151.stderr:2023-12-12T00:10:31.699+0000 7efcd4284640 -1 osd.6 43 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-12T00:10:31.702 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-12T00:10:31.699+0000 7fe981309640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 88569) UID: 0 2023-12-12T00:10:31.703 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-12T00:10:31.699+0000 7fe981309640 -1 osd.4 43 *** Got signal Terminated *** 2023-12-12T00:10:31.703 INFO:tasks.ceph.osd.4.smithi151.stderr:2023-12-12T00:10:31.699+0000 7fe981309640 -1 osd.4 43 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-12T00:10:31.703 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-12T00:10:31.699+0000 7fdadfa99640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 88574) UID: 0 2023-12-12T00:10:31.703 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-12T00:10:31.699+0000 7fdadfa99640 -1 osd.7 43 *** Got signal Terminated *** 2023-12-12T00:10:31.703 INFO:tasks.ceph.osd.7.smithi151.stderr:2023-12-12T00:10:31.699+0000 7fdadfa99640 -1 osd.7 43 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-12T00:10:31.703 INFO:tasks.ceph.mds.b.smithi151.stderr:2023-12-12T00:10:31.700+0000 7f9c7c1be640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i b (PID: 95070) UID: 0 2023-12-12T00:10:31.704 INFO:tasks.ceph.mds.b.smithi151.stderr:2023-12-12T00:10:31.700+0000 7f9c7c1be640 -1 mds.b *** got signal Terminated *** 2023-12-12T00:10:31.704 INFO:tasks.ceph.mds.d.smithi151.stderr:2023-12-12T00:10:31.700+0000 7fb6435be640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i d (PID: 95072) UID: 0 2023-12-12T00:10:31.704 INFO:tasks.ceph.mds.d.smithi151.stderr:2023-12-12T00:10:31.700+0000 7fb6435be640 -1 mds.d *** got signal Terminated *** 2023-12-12T00:10:31.704 INFO:tasks.ceph.mon.b.smithi151.stderr:2023-12-12T00:10:31.700+0000 7f6cc1023640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i b (PID: 88001) UID: 0 2023-12-12T00:10:31.704 INFO:tasks.ceph.mon.b.smithi151.stderr:2023-12-12T00:10:31.700+0000 7f6cc1023640 -1 mon.b@1(peon) e1 *** Got Signal Terminated *** 2023-12-12T00:10:31.705 INFO:tasks.ceph.mon.c.smithi151.stderr:2023-12-12T00:10:31.700+0000 7fc137b9f640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i c (PID: 88003) UID: 0 2023-12-12T00:10:31.705 INFO:tasks.ceph.mon.c.smithi151.stderr:2023-12-12T00:10:31.701+0000 7fc137b9f640 -1 mon.c@2(peon) e1 *** Got Signal Terminated *** 2023-12-12T00:10:31.705 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-12T00:10:31.701+0000 7f50a4e82640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mgr -f --cluster ceph -i x (PID: 88005) UID: 0 2023-12-12T00:10:31.705 INFO:tasks.ceph.mgr.x.smithi151.stderr:2023-12-12T00:10:31.701+0000 7f50a4e82640 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2023-12-12T00:10:31.706 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-12T00:10:31.697+0000 7f8de7bd6640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 88534) UID: 0 2023-12-12T00:10:31.706 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-12T00:10:31.697+0000 7f8de7bd6640 -1 osd.0 43 *** Got signal Terminated *** 2023-12-12T00:10:31.706 INFO:tasks.ceph.osd.0.smithi037.stderr:2023-12-12T00:10:31.697+0000 7f8de7bd6640 -1 osd.0 43 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-12T00:10:31.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-12T00:10:31.698+0000 7f5aba636640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 88541) UID: 0 2023-12-12T00:10:31.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-12T00:10:31.698+0000 7f5aba636640 -1 osd.1 43 *** Got signal Terminated *** 2023-12-12T00:10:31.706 INFO:tasks.ceph.osd.1.smithi037.stderr:2023-12-12T00:10:31.698+0000 7f5aba636640 -1 osd.1 43 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-12T00:10:31.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-12T00:10:31.698+0000 7fb782446640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 88549) UID: 0 2023-12-12T00:10:31.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-12T00:10:31.698+0000 7fb782446640 -1 osd.2 43 *** Got signal Terminated *** 2023-12-12T00:10:31.707 INFO:tasks.ceph.osd.2.smithi037.stderr:2023-12-12T00:10:31.698+0000 7fb782446640 -1 osd.2 43 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-12T00:10:31.707 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-12T00:10:31.699+0000 7f690ba68640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 88554) UID: 0 2023-12-12T00:10:31.708 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-12T00:10:31.699+0000 7f690ba68640 -1 osd.3 43 *** Got signal Terminated *** 2023-12-12T00:10:31.708 INFO:tasks.ceph.osd.3.smithi037.stderr:2023-12-12T00:10:31.699+0000 7f690ba68640 -1 osd.3 43 *** Immediate shutdown (osd_fast_shutdown=true) *** 2023-12-12T00:10:31.708 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-12-12T00:10:31.699+0000 7f93f4e3d640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i a (PID: 101651) UID: 0 2023-12-12T00:10:31.708 INFO:tasks.ceph.mds.a.smithi037.stderr:2023-12-12T00:10:31.699+0000 7f93f4e3d640 -1 mds.a *** got signal Terminated *** 2023-12-12T00:10:31.708 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-12-12T00:10:31.700+0000 7fcb1e884640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mds -f --cluster ceph -i c (PID: 101653) UID: 0 2023-12-12T00:10:31.708 INFO:tasks.ceph.mds.c.smithi037.stderr:2023-12-12T00:10:31.700+0000 7fcb1e884640 -1 mds.c *** got signal Terminated *** 2023-12-12T00:10:31.709 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-12-12T00:10:31.700+0000 7f32207e4640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper kill ceph-mon -f --cluster ceph -i a (PID: 88300) UID: 0 2023-12-12T00:10:31.709 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-12-12T00:10:31.700+0000 7f32207e4640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2023-12-12T00:10:31.738 INFO:tasks.ceph.mon.a.smithi037.stderr:2023-12-12T00:10:31.736+0000 7f321afd9640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-12T00:10:31.904 INFO:tasks.ceph.mgr.y.smithi037.stderr:daemon-helper: command crashed with signal 15 2023-12-12T00:12:28.923 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:12:28.935 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:12:59.193 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:12:59.204 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:13:29.398 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:13:29.408 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:13:59.624 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:13:59.634 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:14:29.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:14:29.842 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:15:00.041 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:15:00.051 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:15:30.214 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:15:30.225 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:16:00.436 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:16:00.447 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:16:30.665 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:16:30.675 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:17:00.877 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:17:00.887 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:17:31.082 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:17:31.092 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:18:01.320 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:18:01.330 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:18:31.533 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:18:31.544 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:19:01.728 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:19:01.738 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:19:31.958 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:19:31.968 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:20:02.153 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:20:02.164 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:20:32.409 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:20:32.421 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:21:02.646 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:21:02.656 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:21:32.868 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:21:32.878 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:22:03.088 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:22:03.098 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:22:33.309 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:22:33.319 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:23:03.547 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:23:03.557 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:23:33.767 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:23:33.778 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:24:03.921 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:24:03.932 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:24:34.135 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:24:34.145 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:25:04.451 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:25:04.462 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:25:34.693 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:25:34.703 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:26:04.914 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:26:04.924 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:26:35.160 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:26:35.171 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:27:05.390 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:27:05.400 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:27:35.610 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:27:35.622 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:28:05.823 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:28:05.833 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:28:36.053 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:28:36.062 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:29:06.206 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:29:06.217 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:29:36.420 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:29:36.430 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:30:06.640 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:30:06.651 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:30:36.845 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:30:36.856 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:31:07.074 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:31:07.084 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:31:37.294 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:31:37.305 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:32:07.499 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:32:07.509 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:32:37.738 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:32:37.749 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:33:07.883 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:33:07.893 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:33:38.128 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:33:38.139 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:34:08.358 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:34:08.368 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:34:38.579 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:34:38.590 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:35:08.800 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:35:08.810 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:35:38.962 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:35:38.973 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:36:09.184 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:36:09.194 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:36:39.404 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:36:39.414 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:37:09.634 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:37:09.645 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:37:39.855 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:37:39.865 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:38:10.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:38:10.019 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:38:40.229 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:38:40.239 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:39:10.386 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:39:10.396 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:39:40.620 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:39:40.630 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:40:10.842 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:40:10.852 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:40:40.996 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:40:41.006 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:41:11.225 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:41:11.235 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:41:41.437 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:41:41.447 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:42:11.659 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:42:11.669 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:42:41.872 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:42:41.882 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:43:12.074 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:43:12.084 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:43:42.279 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:43:42.290 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:44:12.492 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:44:12.503 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:44:42.712 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:44:42.722 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:45:12.941 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:45:12.951 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:45:43.145 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:45:43.156 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:46:13.358 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:46:13.368 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:46:43.570 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:46:43.581 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:47:13.783 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:47:13.794 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:47:43.996 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:47:44.006 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:48:14.200 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:48:14.214 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:48:44.404 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:48:44.414 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:49:14.642 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:49:14.652 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:49:44.837 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:49:44.848 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:50:14.992 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:50:15.002 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:50:45.213 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:50:45.223 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:51:15.442 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:51:15.452 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:51:45.663 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:51:45.673 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:52:15.876 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:52:15.886 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:52:46.080 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:52:46.090 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:53:16.300 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:53:16.310 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:53:46.530 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:53:46.540 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:54:16.735 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:54:16.746 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:54:46.971 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:54:46.982 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:55:17.196 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:55:17.207 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:55:47.346 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:55:47.356 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:56:17.567 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:56:17.577 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:56:47.788 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:56:47.798 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:57:18.001 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:57:18.011 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:57:48.230 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:57:48.240 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:58:18.493 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:58:18.503 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:58:48.697 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:58:48.707 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:59:18.917 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:59:18.928 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:59:49.138 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T00:59:49.148 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:00:19.343 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:00:19.353 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:00:49.547 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:00:49.558 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:01:19.751 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:01:19.761 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:01:49.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:01:49.982 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:02:20.201 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:02:20.211 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:02:50.430 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:02:50.440 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:03:20.649 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:03:20.659 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:03:50.872 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:03:50.883 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:04:21.076 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:04:21.087 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:04:51.305 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:04:51.316 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:05:21.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:05:21.579 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:05:51.806 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:05:51.816 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:06:22.009 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:06:22.020 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:06:52.248 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:06:52.258 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:07:22.476 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:07:22.487 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:07:52.698 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:07:52.708 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:08:22.910 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:08:22.920 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:08:53.131 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:08:53.141 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:09:23.352 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:09:23.363 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:09:53.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:09:53.600 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:10:23.821 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:10:23.831 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:10:54.040 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:10:54.050 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:11:24.261 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:11:24.271 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:11:54.473 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:11:54.483 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:12:24.686 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:12:24.696 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:12:54.908 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:12:54.918 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:13:25.129 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:13:25.139 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:13:55.348 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:13:55.358 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:14:25.570 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:14:25.580 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:14:55.791 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:14:55.801 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:15:26.031 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:15:26.041 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:15:56.241 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:15:56.251 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:16:26.470 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:16:26.480 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:16:56.682 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:16:56.693 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:17:26.842 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:17:26.852 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:17:57.074 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:17:57.085 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:18:27.295 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:18:27.305 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:18:57.533 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:18:57.544 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:19:27.737 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:19:27.747 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:19:57.950 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:19:57.960 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:20:28.171 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:20:28.183 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:20:58.410 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:20:58.420 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:21:28.621 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:21:28.631 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:21:58.835 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:21:58.846 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:22:29.048 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:22:29.062 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:22:59.202 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:22:59.213 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:23:29.421 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:23:29.431 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:23:59.618 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:23:59.628 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:24:29.813 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:24:29.824 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:25:00.051 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:25:00.061 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:25:30.197 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:25:30.208 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:26:00.351 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:26:00.361 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:26:30.573 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:26:30.586 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:27:00.785 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:27:00.795 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:27:31.006 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:27:31.017 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:28:01.158 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:28:01.167 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:28:31.364 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:28:31.374 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:29:01.577 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:29:01.587 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:29:31.806 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:29:31.816 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:30:02.010 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:30:02.020 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:30:32.159 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:30:32.168 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:31:02.319 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:31:02.330 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:31:32.556 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:31:32.566 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:32:02.778 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:32:02.787 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:32:32.991 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:32:33.001 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:33:03.202 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:33:03.212 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:33:33.424 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:33:33.434 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:34:03.653 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:34:03.663 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:34:33.874 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:34:33.885 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:35:04.086 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:35:04.097 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:35:34.283 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:35:34.293 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:36:04.487 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:36:04.498 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:36:34.700 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:36:34.710 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:37:04.937 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:37:04.947 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:37:35.140 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:37:35.151 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:38:05.371 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:38:05.381 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:38:35.592 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:38:35.602 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:39:05.796 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:39:05.806 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:39:36.000 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:39:36.010 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:40:06.232 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:40:06.242 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:40:36.458 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:40:36.468 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:41:06.680 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:41:06.690 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:41:36.900 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:41:36.911 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:42:07.113 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:42:07.123 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:42:37.342 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:42:37.354 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:43:07.547 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:43:07.557 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:43:37.760 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:43:37.770 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:44:07.964 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:44:07.974 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:44:38.159 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:44:38.170 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:45:08.381 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:45:08.392 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:45:38.593 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:45:38.603 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:46:08.799 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:46:08.810 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:46:38.957 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:46:38.968 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:47:09.113 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:47:09.123 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:47:39.344 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:47:39.354 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:48:09.556 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:48:09.566 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:48:39.704 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:48:39.714 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:49:09.940 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:49:09.950 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:49:40.161 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:49:40.171 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:50:10.383 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:50:10.393 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:50:40.611 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:50:40.621 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:51:10.832 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:51:10.842 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:51:41.062 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:51:41.072 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:52:11.290 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:52:11.301 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:52:41.530 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:52:41.540 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:53:11.742 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:53:11.752 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:53:41.979 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:53:41.989 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:54:12.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:54:12.202 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:54:42.429 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:54:42.439 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:55:12.684 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:55:12.694 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:55:42.896 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:55:42.906 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:56:13.101 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:56:13.111 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:56:43.338 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:56:43.348 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:57:13.558 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:57:13.573 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:57:43.805 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:57:43.817 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:58:14.025 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:58:14.035 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:58:44.222 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:58:44.232 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:59:14.380 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:59:14.390 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:59:44.536 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T01:59:44.546 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:00:14.793 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:00:14.804 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:00:45.006 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:00:45.017 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:01:15.203 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:01:15.213 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:01:45.415 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:01:45.425 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:02:15.627 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:02:15.637 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:02:45.831 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:02:45.841 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:03:16.044 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:03:16.054 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:03:46.272 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:03:46.283 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:04:16.485 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:04:16.495 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:04:46.698 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:04:46.708 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:05:16.919 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:05:16.929 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:05:47.140 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:05:47.150 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:06:17.361 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:06:17.371 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:06:47.565 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:06:47.575 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:07:17.803 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:07:17.813 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:07:48.016 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:07:48.026 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:08:18.220 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:08:18.230 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:08:48.432 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:08:48.442 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:09:18.669 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:09:18.680 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:09:48.866 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:09:48.877 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:10:19.088 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:10:19.098 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:10:49.316 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:10:49.326 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:11:19.529 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:11:19.539 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:11:49.733 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:11:49.743 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:12:19.945 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:12:19.955 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:12:50.091 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:12:50.101 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:13:20.295 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:13:20.305 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:13:50.492 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:13:50.502 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:14:20.713 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:14:20.722 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:14:50.924 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:14:50.934 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:15:21.082 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:15:21.092 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:15:51.283 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:15:51.293 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:16:21.504 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:16:21.515 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:16:51.709 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:16:51.719 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:17:21.929 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:17:21.939 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:17:52.085 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:17:52.095 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:18:22.288 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:18:22.298 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:18:52.518 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:18:52.527 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:19:22.730 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:19:22.740 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:19:52.960 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:19:52.970 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:20:23.113 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:20:23.123 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:20:53.335 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:20:53.345 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:21:23.531 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:21:23.541 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:21:53.752 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:21:53.762 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:22:23.973 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:22:23.983 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:22:54.177 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:22:54.186 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:23:24.398 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:23:24.408 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:23:54.611 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:23:54.621 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:24:24.831 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:24:24.841 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:24:55.061 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:24:55.071 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:25:25.283 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:25:25.293 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:25:55.436 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:25:55.446 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:26:25.658 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:26:25.669 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:26:55.877 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:26:55.886 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:27:26.090 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:27:26.100 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:27:56.313 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:27:56.323 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:28:26.550 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:28:26.560 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:28:56.761 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:28:56.771 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:29:26.966 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:29:26.976 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:29:57.112 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:29:57.122 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:30:27.351 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:30:27.361 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:30:57.572 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:30:57.582 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:31:27.776 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:31:27.786 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:31:57.989 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:31:57.999 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:32:28.192 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:32:28.202 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:32:58.414 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:32:58.424 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:33:28.634 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:33:28.645 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:33:58.822 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:33:58.832 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:34:29.051 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:34:29.062 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:34:59.281 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:34:59.291 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:35:29.485 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:35:29.495 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:35:59.723 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:35:59.733 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:36:29.927 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:36:29.938 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:37:00.148 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:37:00.158 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:37:30.360 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:37:30.370 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:38:00.573 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:38:00.583 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:38:30.777 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:38:30.787 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:39:00.999 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:39:01.008 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:39:31.220 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:39:31.230 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:40:01.448 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:40:01.458 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:40:31.605 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:40:32.152 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:41:02.311 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:41:02.321 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:41:32.520 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:41:32.530 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:42:02.749 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:42:02.759 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:42:32.988 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:42:32.998 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:43:03.217 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:43:03.226 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:43:33.437 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:43:33.448 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:44:03.650 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:44:03.659 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:44:33.863 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:44:33.872 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:45:04.100 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:45:04.110 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:45:34.312 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:45:34.322 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:46:04.542 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:46:04.552 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:46:34.747 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:46:34.757 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:47:04.967 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:47:04.977 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:47:35.213 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:47:35.223 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:48:05.409 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:48:05.419 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:48:35.647 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:48:35.656 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:49:05.868 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:49:05.878 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:49:36.089 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:49:36.099 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:50:06.310 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:50:06.323 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:50:36.531 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:50:36.541 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:51:06.752 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:51:06.762 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:51:36.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:51:36.982 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:52:07.194 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:52:07.204 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:52:37.432 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:52:37.442 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:53:07.635 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:53:07.645 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:53:37.865 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:53:37.875 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:54:08.069 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:54:08.079 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:54:38.290 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:54:38.301 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:55:08.545 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:55:08.555 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:55:38.749 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:55:38.760 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:56:08.978 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:56:08.989 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:56:39.182 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:56:39.192 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:57:09.404 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:57:09.414 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:57:39.625 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:57:39.638 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:58:09.820 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:58:09.830 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:58:39.967 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:58:39.977 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:59:10.188 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:59:10.198 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:59:40.401 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T02:59:40.410 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:00:10.647 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:00:10.657 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:00:40.851 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:00:40.861 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:01:11.089 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:01:11.099 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:01:41.366 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:01:41.376 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:02:11.581 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:02:11.591 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:02:41.752 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:02:41.762 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:03:11.956 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:03:11.966 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:03:42.169 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:03:42.179 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:04:12.407 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:04:12.417 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:04:42.636 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:04:42.646 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:05:12.782 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:05:12.792 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:05:42.994 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:05:43.004 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:06:13.224 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:06:13.233 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:06:43.419 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:06:43.429 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:07:13.641 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:07:13.652 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:07:43.795 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:07:43.806 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:08:14.025 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:08:14.036 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:08:44.237 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:08:44.247 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:09:14.516 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:09:14.526 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:09:44.720 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:09:44.731 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:10:14.869 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:10:14.880 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:10:45.080 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:10:45.092 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:11:15.300 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:11:15.355 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:11:45.563 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:11:45.573 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:12:15.793 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:12:15.804 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:12:46.005 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:12:46.014 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:13:16.227 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:13:16.239 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:13:46.456 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:13:46.467 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:14:16.667 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:14:16.678 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:14:46.906 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:14:46.916 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:15:17.101 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:15:17.111 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:15:47.315 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:15:47.325 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:16:17.536 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:16:17.549 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:16:47.739 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:16:47.750 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:17:17.961 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:17:17.971 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:17:48.190 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:17:48.200 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:18:18.385 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:18:18.395 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:18:48.590 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:18:48.601 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:19:18.820 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:19:18.830 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:19:49.041 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:19:49.053 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:20:19.254 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:20:19.264 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:20:49.483 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:20:49.494 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:21:19.713 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:21:19.723 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:21:49.926 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:21:49.936 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:22:20.121 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:22:20.131 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:22:50.359 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:22:50.369 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:23:20.564 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:23:20.574 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:23:50.770 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:23:50.780 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:24:21.013 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:24:21.023 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:24:51.226 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:24:51.236 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:25:21.491 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:25:21.501 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:25:51.646 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:25:51.656 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:26:21.877 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:26:21.887 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:26:52.085 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:26:52.095 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:27:22.289 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:27:22.299 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:27:52.510 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:27:52.520 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:28:22.739 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:28:22.749 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:28:52.951 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:28:52.961 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:29:23.155 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:29:23.165 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:29:53.385 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:29:53.396 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:30:23.613 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:30:23.624 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:30:53.835 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:30:53.845 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:31:24.047 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:31:24.057 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:31:54.276 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:31:54.286 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:32:24.513 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:32:24.524 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:32:54.734 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:32:54.744 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:33:24.954 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:33:24.963 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:33:55.158 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:33:55.168 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:34:25.387 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:34:25.397 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:34:55.608 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:34:55.622 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:35:25.829 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:35:25.847 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:35:56.065 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:35:56.075 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:36:26.304 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:36:26.314 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:36:56.516 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:36:56.526 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:37:26.770 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:37:26.780 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:37:56.991 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:37:57.001 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:38:27.220 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:38:27.230 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:38:57.433 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:38:57.443 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:39:27.654 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:39:27.663 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:39:57.883 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:39:57.894 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:40:28.111 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:40:28.121 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:40:58.316 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:40:58.326 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:41:28.512 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:41:28.522 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:41:58.733 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:41:58.743 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:42:28.963 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:42:28.973 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:42:59.182 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:42:59.192 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:43:29.396 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:43:29.406 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:43:59.616 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:43:59.626 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:44:29.845 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:44:29.855 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:45:00.075 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:45:00.085 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:45:30.297 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:45:30.307 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:46:00.509 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:46:00.519 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:46:30.737 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:46:30.747 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:47:00.941 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:47:00.951 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:47:31.162 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:47:31.172 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:48:01.394 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:48:01.404 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:48:31.620 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:48:31.630 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:49:01.849 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:49:01.859 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:49:32.070 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:49:32.080 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:50:02.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:50:02.301 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:50:32.519 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:50:32.529 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:51:02.749 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:51:02.759 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:51:32.979 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:51:32.988 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:52:03.199 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:52:03.209 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:52:33.357 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:52:33.367 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:53:03.574 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:53:03.584 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:53:33.812 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:53:33.822 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:54:03.999 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:54:04.010 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:54:34.203 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:54:34.213 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:55:04.392 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:55:04.403 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:55:34.588 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:55:34.598 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:56:04.816 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:56:04.826 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:56:35.029 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:56:35.039 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:57:05.266 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:57:05.276 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:57:35.420 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:57:35.430 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:58:05.642 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:58:05.652 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:58:35.846 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:58:35.856 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:59:06.058 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:59:06.067 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:59:36.263 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T03:59:36.272 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:00:06.421 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:00:06.431 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:00:36.622 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:00:36.631 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:01:06.840 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:01:06.850 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:01:36.996 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:01:37.006 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:02:07.151 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:02:07.160 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:02:37.374 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:02:37.385 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:03:07.594 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:03:07.604 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:03:37.859 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:03:37.869 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:04:08.077 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:04:08.087 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:04:38.291 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:04:38.301 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:05:08.496 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:05:08.507 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:05:38.757 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:05:38.767 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:06:08.963 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:06:08.973 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:06:39.185 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:06:39.194 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:07:09.405 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:07:09.414 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:07:39.635 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:07:39.645 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:08:09.840 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:08:09.850 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:08:39.986 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:08:39.996 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:09:10.207 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:09:10.216 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:09:40.420 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:09:40.430 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:10:10.658 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:10:10.667 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:10:40.877 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:10:40.887 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:11:11.099 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:11:11.109 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:11:41.322 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:11:41.335 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:12:11.534 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:12:11.543 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:12:41.763 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:12:41.773 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:13:11.992 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:13:12.002 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:13:42.197 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:13:42.207 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:14:12.410 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:14:12.420 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:14:42.624 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:14:42.634 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:15:12.819 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:15:12.829 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:15:43.024 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:15:43.035 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:16:13.252 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:16:13.262 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:16:43.483 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:16:43.493 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:17:13.695 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:17:13.705 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:17:43.916 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:17:43.926 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:18:14.137 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:18:14.148 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:18:44.350 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:18:44.360 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:19:14.545 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:19:14.555 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:19:44.750 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:19:44.760 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:20:14.979 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:20:14.989 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:20:45.193 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:20:45.204 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:21:15.431 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:21:15.440 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:21:45.642 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:21:45.652 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:22:15.889 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:22:15.901 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:22:46.118 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:22:46.129 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:23:16.347 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:23:16.358 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:23:46.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:23:46.580 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:24:16.781 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:24:16.791 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:24:47.010 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:24:47.020 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:25:17.206 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:25:17.217 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:25:47.353 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:25:47.363 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:26:17.557 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:26:17.568 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:26:47.777 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:26:47.787 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:27:18.033 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:27:18.043 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:27:48.254 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:27:48.264 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:28:18.474 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:28:18.485 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:28:48.695 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:28:48.705 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:29:18.908 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:29:18.918 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:29:49.163 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:29:49.173 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:30:19.383 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:30:19.393 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:30:49.605 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:30:49.615 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:31:19.808 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:31:19.818 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:31:50.029 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:31:50.039 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:32:20.243 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:32:20.255 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:32:50.480 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:32:50.490 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:33:20.709 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:33:20.718 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:33:50.921 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:33:50.931 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:34:21.126 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:34:21.136 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:34:51.380 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:34:51.390 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:35:21.600 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:35:21.610 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:35:51.826 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:35:51.836 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:36:22.051 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:36:22.060 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:36:52.197 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:36:52.206 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:37:22.419 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:37:22.428 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:37:52.638 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:37:52.649 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:38:22.868 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:38:22.878 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:38:53.072 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:38:53.082 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:39:23.294 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:39:23.304 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:39:53.523 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:39:53.533 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:40:23.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:40:23.754 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:40:53.948 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:40:53.958 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:41:24.162 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:41:24.172 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:41:54.389 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:41:54.399 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:42:24.546 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:42:24.556 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:42:54.766 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:42:54.778 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:43:24.995 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:43:25.004 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:43:55.207 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:43:55.217 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:44:25.430 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:44:25.444 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:44:55.573 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:44:55.583 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:45:25.779 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:45:25.789 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:45:55.992 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:45:56.001 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:46:26.196 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:46:26.206 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:46:56.409 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:46:56.419 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:47:26.571 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:47:26.581 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:47:56.784 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:47:56.794 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:48:27.022 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:48:27.032 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:48:57.250 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:48:57.260 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:49:27.480 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:49:27.490 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:49:57.630 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:49:57.640 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:50:27.863 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:50:27.873 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:50:58.085 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:50:58.095 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:51:28.290 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:51:28.300 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:51:58.493 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:51:58.503 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:52:28.697 DEBUG:teuthology.orchestra.run.smithi037:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:52:28.707 DEBUG:teuthology.orchestra.run.smithi151:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-12T04:52:40.446 DEBUG:teuthology.exit:Got signal 15; running 1 handler... 2023-12-12T04:52:40.446 DEBUG:teuthology.task.console_log:Killing console logger for smithi037 2023-12-12T04:52:40.447 DEBUG:teuthology.task.console_log:Killing console logger for smithi151 2023-12-12T04:52:40.447 DEBUG:teuthology.exit:Finished running handlers